2025-12-04T08:52:49.4943331Z Current runner version: '2.329.0' 2025-12-04T08:52:49.4946279Z Runner name: 'linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z' 2025-12-04T08:52:49.4946679Z Runner group name: 'default' 2025-12-04T08:52:49.4947119Z Machine name: 'linux' 2025-12-04T08:52:49.4948237Z ##[group]GITHUB_TOKEN Permissions 2025-12-04T08:52:49.4949312Z Contents: read 2025-12-04T08:52:49.4949580Z Metadata: read 2025-12-04T08:52:49.4949812Z ##[endgroup] 2025-12-04T08:52:49.4950833Z Secret source: Actions 2025-12-04T08:52:49.4951113Z Prepare workflow directory 2025-12-04T08:52:49.5188501Z Prepare all required actions 2025-12-04T08:52:49.5208290Z Getting action download info 2025-12-04T08:52:49.9565489Z Download action repository 'pytorch/pytorch@main' (SHA:ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32) 2025-12-04T08:52:54.0640074Z Download action repository 'pytorch/test-infra@main' (SHA:39aa74d619174326f4e2fb0e216151c2f29d9ffd) 2025-12-04T08:52:55.3490132Z Download action repository 'actions/upload-artifact@ea165f8d65b6e75b540449e92b4886f43607fa02' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02) 2025-12-04T08:52:56.4824550Z Download action repository 'aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722' (SHA:ececac1a45f3b08a01d2dd070d28d111c5fe6722) 2025-12-04T08:52:57.5243340Z Getting action download info 2025-12-04T08:52:57.7340611Z Download action repository 'actions/checkout@v4' (SHA:34e114876b0b11c390a56381ad16ebd13914f8d5) 2025-12-04T08:52:58.6877787Z Getting action download info 2025-12-04T08:52:58.9016847Z Download action repository 'nick-fields/retry@v3.0.0' (SHA:7152eba30c6575329ac0576536151aca5a72780e) 2025-12-04T08:52:59.7830358Z Getting action download info 2025-12-04T08:53:00.0138002Z Uses: pytorch/pytorch/.github/workflows/_rocm-test.yml@refs/heads/main (ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32) 2025-12-04T08:53:00.0140051Z ##[group] Inputs 2025-12-04T08:53:00.0140199Z build-environment: linux-noble-rocm-py3.12-mi300 2025-12-04T08:53:00.0141940Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}]} 2025-12-04T08:53:00.0143954Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:00.0144235Z sync-tag: 2025-12-04T08:53:00.0144752Z timeout-minutes: 300 2025-12-04T08:53:00.0144874Z tests-to-include: 2025-12-04T08:53:00.0144989Z dashboard-tag: 2025-12-04T08:53:00.0145216Z disable-monitor: true 2025-12-04T08:53:00.0145568Z monitor-log-interval: 5 2025-12-04T08:53:00.0145785Z monitor-data-collect-interval: 1 2025-12-04T08:53:00.0145914Z ##[endgroup] 2025-12-04T08:53:00.0146121Z Complete job name: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T08:53:00.0389883Z ##[group]Run pytorch/pytorch/.github/actions/checkout-pytorch@main 2025-12-04T08:53:00.0390152Z with: 2025-12-04T08:53:00.0390243Z no-sudo: true 2025-12-04T08:53:00.0390344Z submodules: recursive 2025-12-04T08:53:00.0390442Z fetch-depth: 0 2025-12-04T08:53:00.0390588Z env: 2025-12-04T08:53:00.0390681Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:00.0390795Z ##[endgroup] 2025-12-04T08:53:00.0448982Z ##[group]Run echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-12-04T08:53:00.0449360Z echo "IN_CONTAINER_RUNNER=$(if [ -f /.inarc ] || [ -f /.incontainer ]; then echo true ; else echo false; fi)" >> "$GITHUB_OUTPUT" 2025-12-04T08:53:00.0456020Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:00.0456178Z env: 2025-12-04T08:53:00.0456270Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:00.0456378Z ##[endgroup] 2025-12-04T08:53:00.0606330Z ##[group]Run actions/checkout@v4 2025-12-04T08:53:00.0606494Z with: 2025-12-04T08:53:00.0606607Z ref: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:00.0606740Z fetch-depth: 0 2025-12-04T08:53:00.0606838Z submodules: recursive 2025-12-04T08:53:00.0606940Z show-progress: false 2025-12-04T08:53:00.0607041Z repository: pytorch/pytorch 2025-12-04T08:53:00.0607257Z token: *** 2025-12-04T08:53:00.0607356Z ssh-strict: true 2025-12-04T08:53:00.0607450Z ssh-user: git 2025-12-04T08:53:00.0607554Z persist-credentials: true 2025-12-04T08:53:00.0607665Z clean: true 2025-12-04T08:53:00.0607765Z sparse-checkout-cone-mode: true 2025-12-04T08:53:00.0607886Z fetch-tags: false 2025-12-04T08:53:00.0607983Z lfs: false 2025-12-04T08:53:00.0608074Z set-safe-directory: true 2025-12-04T08:53:00.0608194Z env: 2025-12-04T08:53:00.0608284Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:00.0608391Z ##[endgroup] 2025-12-04T08:53:00.1176278Z Syncing repository: pytorch/pytorch 2025-12-04T08:53:00.1176921Z ##[group]Getting Git version info 2025-12-04T08:53:00.1177092Z Working directory is '/home/runner/_work/pytorch/pytorch' 2025-12-04T08:53:00.1177347Z [command]/usr/bin/git version 2025-12-04T08:53:00.1177467Z git version 2.52.0 2025-12-04T08:53:00.1200023Z ##[endgroup] 2025-12-04T08:53:00.1206536Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/62ac933b-b44c-4f01-ba5c-04ac2df268ef/.gitconfig' 2025-12-04T08:53:00.1212160Z Temporarily overriding HOME='/home/runner/_work/_temp/62ac933b-b44c-4f01-ba5c-04ac2df268ef' before making global git config changes 2025-12-04T08:53:00.1212634Z Adding repository directory to the temporary git global config as a safe directory 2025-12-04T08:53:00.1215511Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-12-04T08:53:00.1243706Z [command]/usr/bin/git config --local --get remote.origin.url 2025-12-04T08:53:00.1259480Z https://github.com/pytorch/pytorch 2025-12-04T08:53:00.1274136Z ##[group]Removing previously created refs, to avoid conflicts 2025-12-04T08:53:00.1277857Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-12-04T08:53:00.1303321Z refs/heads/main 2025-12-04T08:53:00.1316596Z [command]/usr/bin/git checkout --detach 2025-12-04T08:53:01.5843220Z HEAD is now at 76aeb8c7e0f7 [DebugMode] default values for outputs, stack trace (#169499) 2025-12-04T08:53:01.5932204Z [command]/usr/bin/git branch --delete --force main 2025-12-04T08:53:01.6036642Z Deleted branch main (was 76aeb8c7e0f7). 2025-12-04T08:53:01.6043728Z ##[endgroup] 2025-12-04T08:53:01.6048197Z [command]/usr/bin/git submodule status 2025-12-04T08:53:01.6291061Z 7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe) 2025-12-04T08:53:01.6341897Z 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081) 2025-12-04T08:53:01.6396427Z b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327) 2025-12-04T08:53:01.6461512Z c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0) 2025-12-04T08:53:01.6491319Z 3ebbc93ded7285963bff932c678fa367eb393ba6 third_party/NVTX (v3.1.0-313-g3ebbc93) 2025-12-04T08:53:01.6544497Z 1d8f600fd424278486eade7ed3e877c99f0846b1 third_party/VulkanMemoryAllocator (v2.1.0-982-g1d8f600) 2025-12-04T08:53:01.6838231Z 51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a0103656) 2025-12-04T08:53:01.6866496Z 01aae101b9e5e94d6c16a9514c9fb8df99c93150 third_party/aiter (v0.1.1-92-g01aae101) 2025-12-04T08:53:01.6881580Z 299e5928955cc62af9968370293b916f5130916f third_party/benchmark (v1.9.3) 2025-12-04T08:53:01.6942318Z 7fe50dc3da2069d6645d9deb8c017a876472a977 third_party/composable_kernel (rocm-6.4.3-459-g7fe50dc3d) 2025-12-04T08:53:01.7039625Z 89c932f313c6437c38f2982869beacc89c2f2246 third_party/cpp-httplib (v0.26.0) 2025-12-04T08:53:01.7115651Z f858c30bcb16f8effd5ff46996f0514539e17abc third_party/cpuinfo (f858c30) 2025-12-04T08:53:01.7153064Z 0b1577c8c83401237d601d0d0db5210506705396 third_party/cudnn_frontend (v0.5-61-g0b1577c) 2025-12-04T08:53:01.7211960Z f88806b1e31dfa579842638740216dd41fc6c588 third_party/cutlass (v4.3.1) 2025-12-04T08:53:01.7244159Z c0b988d39a9e47c794d699f29930ed4d7c7e13a4 third_party/fbgemm (v1.4.0-rc1-2-gc0b988d39) 2025-12-04T08:53:01.7301235Z 979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4) 2025-12-04T08:53:01.7319122Z a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757 third_party/flatbuffers (v24.12.23) 2025-12-04T08:53:01.7559829Z 407c905e45ad75fc29bf0f9bb7c5c2fd3475976f third_party/fmt (12.1.0) 2025-12-04T08:53:01.7631498Z 3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17) 2025-12-04T08:53:01.7717812Z 54cbae0d3a67fa890b4c3d9ee162b7860315e341 third_party/gloo (remotes/origin/gh/c-p-i-o/1/base-37-g54cbae0) 2025-12-04T08:53:01.7851004Z 52eb8108c5bdec04579160ae17225d66034bd723 third_party/googletest (release-1.8.0-3544-g52eb8108) 2025-12-04T08:53:01.7901027Z 719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1) 2025-12-04T08:53:01.7943013Z dec1d23ca65ab069d225dfe40dea14f455170959 third_party/ittapi (v3.25.5) 2025-12-04T08:53:01.8087913Z 31f85df8fbd89c188f14ef10f1ec65379786b943 third_party/kineto (heads/main) 2025-12-04T08:53:01.8121371Z d7770c89632329a9914ef1a90289917597639cbe third_party/kleidiai (v1.15.0) 2025-12-04T08:53:01.8137032Z fbd8b99c2b828428947d70fdc046bb55609be93e third_party/mimalloc (v2.2.4) 2025-12-04T08:53:01.8155860Z 55f93686c01528224f448c19128836e7df245f72 third_party/nlohmann (v3.12.0) 2025-12-04T08:53:01.8373371Z e709452ef2bbc1d113faf678c24e6d3467696e83 third_party/onnx (v1.18.0) 2025-12-04T08:53:01.8390114Z a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2) 2025-12-04T08:53:01.8407712Z 0fa0ef591e38c2758e3184c6c23e497b9f732ffa third_party/pocketfft (release_for_eigen-40-g0fa0ef5) 2025-12-04T08:53:01.8613319Z d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b) 2025-12-04T08:53:01.8671615Z 072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master) 2025-12-04T08:53:01.8712083Z 4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e) 2025-12-04T08:53:01.8728970Z f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8 third_party/pybind11 (v3.0.1) 2025-12-04T08:53:01.8783807Z f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated) 2025-12-04T08:53:01.8830645Z 5a1d179df9cf652951b59010a2d2075372d67f68 third_party/sleef (3.8) 2025-12-04T08:53:01.8877346Z 2b4cd91092d335a697416b2a3cb398283246849d third_party/tensorpipe (heads/main) 2025-12-04T08:53:01.8889969Z ##[group]Cleaning the repository 2025-12-04T08:53:01.8896603Z [command]/usr/bin/git clean -ffdx 2025-12-04T08:53:01.9009679Z [command]/usr/bin/git reset --hard HEAD 2025-12-04T08:53:03.5855314Z HEAD is now at 76aeb8c7e0f7 [DebugMode] default values for outputs, stack trace (#169499) 2025-12-04T08:53:03.6544362Z ##[endgroup] 2025-12-04T08:53:03.6545710Z ##[group]Disabling automatic garbage collection 2025-12-04T08:53:03.6549143Z [command]/usr/bin/git config --local gc.auto 0 2025-12-04T08:53:03.6578805Z ##[endgroup] 2025-12-04T08:53:03.6579010Z ##[group]Setting up auth 2025-12-04T08:53:03.6583313Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-12-04T08:53:03.6600956Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-12-04T08:53:03.6811019Z Entering 'android/libs/fbjni' 2025-12-04T08:53:03.6837782Z Entering 'third_party/FP16' 2025-12-04T08:53:03.6861849Z Entering 'third_party/FXdiv' 2025-12-04T08:53:03.6892475Z Entering 'third_party/NNPACK' 2025-12-04T08:53:03.6919264Z Entering 'third_party/NVTX' 2025-12-04T08:53:03.6941064Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:03.6961319Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:03.6986391Z Entering 'third_party/aiter' 2025-12-04T08:53:03.7012999Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:03.7043495Z Entering 'third_party/benchmark' 2025-12-04T08:53:03.7070556Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:03.7099200Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:03.7122883Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:03.7153285Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:03.7179780Z Entering 'third_party/cutlass' 2025-12-04T08:53:03.7209604Z Entering 'third_party/fbgemm' 2025-12-04T08:53:03.7242093Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:03.7263624Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:03.7287834Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:03.7315620Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:03.7340662Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:03.7372440Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:03.7393664Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:03.7418713Z Entering 'third_party/flash-attention' 2025-12-04T08:53:03.7443194Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:03.7470225Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:03.7502005Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:03.7527609Z Entering 'third_party/fmt' 2025-12-04T08:53:03.7550552Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:03.7573839Z Entering 'third_party/gloo' 2025-12-04T08:53:03.7600118Z Entering 'third_party/googletest' 2025-12-04T08:53:03.7620621Z Entering 'third_party/ideep' 2025-12-04T08:53:03.7647713Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:03.7671164Z Entering 'third_party/ittapi' 2025-12-04T08:53:03.7696567Z Entering 'third_party/kineto' 2025-12-04T08:53:03.7723252Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:03.7749471Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:03.7775047Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:03.7796760Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:03.7817366Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:03.7836137Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:03.7859219Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:03.7880117Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:03.7906285Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:03.7930241Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:03.7954660Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:03.7983667Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:03.8010225Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:03.8038344Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:03.8068103Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:03.8096791Z Entering 'third_party/kleidiai' 2025-12-04T08:53:03.8119174Z Entering 'third_party/mimalloc' 2025-12-04T08:53:03.8144677Z Entering 'third_party/nlohmann' 2025-12-04T08:53:03.8169238Z Entering 'third_party/onnx' 2025-12-04T08:53:03.8197849Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:03.8221058Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:03.8245411Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:03.8265611Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:03.8286926Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:03.8309038Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:03.8331396Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:03.8359622Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:03.8413626Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:03.8463040Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:03.8511825Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:03.8543107Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:03.8584515Z Entering 'third_party/pocketfft' 2025-12-04T08:53:03.8613250Z Entering 'third_party/protobuf' 2025-12-04T08:53:03.8651501Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:03.8675965Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:03.8706901Z Entering 'third_party/psimd' 2025-12-04T08:53:03.8736856Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:03.8760180Z Entering 'third_party/pybind11' 2025-12-04T08:53:03.8790184Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:03.8816432Z Entering 'third_party/sleef' 2025-12-04T08:53:03.8837832Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:03.8863174Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:03.8883972Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:03.8905912Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:03.8929722Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:03.8952248Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:03.8999013Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-12-04T08:53:03.9021345Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-12-04T08:53:03.9205953Z Entering 'android/libs/fbjni' 2025-12-04T08:53:03.9229047Z Entering 'third_party/FP16' 2025-12-04T08:53:03.9251988Z Entering 'third_party/FXdiv' 2025-12-04T08:53:03.9274369Z Entering 'third_party/NNPACK' 2025-12-04T08:53:03.9296895Z Entering 'third_party/NVTX' 2025-12-04T08:53:03.9322600Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:03.9345615Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:03.9373505Z Entering 'third_party/aiter' 2025-12-04T08:53:03.9405156Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:03.9431037Z Entering 'third_party/benchmark' 2025-12-04T08:53:03.9455218Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:03.9482711Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:03.9504585Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:03.9532034Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:03.9554845Z Entering 'third_party/cutlass' 2025-12-04T08:53:03.9582606Z Entering 'third_party/fbgemm' 2025-12-04T08:53:03.9605327Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:03.9627415Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:03.9652582Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:03.9671849Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:03.9714050Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:03.9736755Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:03.9757258Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:03.9796308Z Entering 'third_party/flash-attention' 2025-12-04T08:53:03.9835172Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:03.9879913Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:03.9921332Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:03.9954719Z Entering 'third_party/fmt' 2025-12-04T08:53:03.9988833Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:04.0012769Z Entering 'third_party/gloo' 2025-12-04T08:53:04.0033877Z Entering 'third_party/googletest' 2025-12-04T08:53:04.0057048Z Entering 'third_party/ideep' 2025-12-04T08:53:04.0090560Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:04.0126644Z Entering 'third_party/ittapi' 2025-12-04T08:53:04.0150389Z Entering 'third_party/kineto' 2025-12-04T08:53:04.0178171Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:04.0203610Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:04.0229992Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:04.0251994Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:04.0278129Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:04.0302978Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:04.0340873Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:04.0362147Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:04.0390869Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:04.0412350Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:04.0435657Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:04.0464517Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:04.0490240Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:04.0529761Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:04.0549384Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:04.0570353Z Entering 'third_party/kleidiai' 2025-12-04T08:53:04.0593606Z Entering 'third_party/mimalloc' 2025-12-04T08:53:04.0617798Z Entering 'third_party/nlohmann' 2025-12-04T08:53:04.0642403Z Entering 'third_party/onnx' 2025-12-04T08:53:04.0675188Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:04.0700572Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:04.0724545Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:04.0753542Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:04.0784027Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:04.0805981Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:04.0827457Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:04.0846246Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:04.0875871Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:04.0896449Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:04.0927252Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:04.0958444Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:04.0994756Z Entering 'third_party/pocketfft' 2025-12-04T08:53:04.1022727Z Entering 'third_party/protobuf' 2025-12-04T08:53:04.1044861Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:04.1067702Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:04.1096336Z Entering 'third_party/psimd' 2025-12-04T08:53:04.1118367Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:04.1143275Z Entering 'third_party/pybind11' 2025-12-04T08:53:04.1168939Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:04.1209497Z Entering 'third_party/sleef' 2025-12-04T08:53:04.1249652Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:04.1286031Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:04.1312974Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:04.1339760Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:04.1362077Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:04.1386345Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:04.1436485Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.1460775Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url 2025-12-04T08:53:04.1624813Z Entering 'android/libs/fbjni' 2025-12-04T08:53:04.1637235Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T08:53:04.1645817Z Entering 'third_party/FP16' 2025-12-04T08:53:04.1655863Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T08:53:04.1663922Z Entering 'third_party/FXdiv' 2025-12-04T08:53:04.1673594Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T08:53:04.1683815Z Entering 'third_party/NNPACK' 2025-12-04T08:53:04.1694635Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T08:53:04.1703880Z Entering 'third_party/NVTX' 2025-12-04T08:53:04.1718172Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T08:53:04.1727314Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:04.1737867Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T08:53:04.1747943Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:04.1757864Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T08:53:04.1772643Z Entering 'third_party/aiter' 2025-12-04T08:53:04.1786618Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T08:53:04.1797480Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:04.1810121Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T08:53:04.1823519Z Entering 'third_party/benchmark' 2025-12-04T08:53:04.1835343Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:04.1843696Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:04.1857265Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T08:53:04.1869781Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:04.1880068Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T08:53:04.1888671Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:04.1901739Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T08:53:04.1911886Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:04.1923771Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T08:53:04.1934373Z Entering 'third_party/cutlass' 2025-12-04T08:53:04.1945505Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T08:53:04.1957361Z Entering 'third_party/fbgemm' 2025-12-04T08:53:04.1967145Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T08:53:04.1975959Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:04.1991484Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T08:53:04.2001686Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:04.2030390Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T08:53:04.2043323Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:04.2052608Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T08:53:04.2064398Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:04.2076788Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T08:53:04.2091840Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:04.2105587Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T08:53:04.2114847Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:04.2130465Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T08:53:04.2140180Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:04.2151158Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T08:53:04.2162668Z Entering 'third_party/flash-attention' 2025-12-04T08:53:04.2172803Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T08:53:04.2189361Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:04.2203729Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T08:53:04.2221697Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:04.2235872Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T08:53:04.2255447Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:04.2272141Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T08:53:04.2284360Z Entering 'third_party/fmt' 2025-12-04T08:53:04.2295944Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:04.2305928Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:04.2320442Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T08:53:04.2332515Z Entering 'third_party/gloo' 2025-12-04T08:53:04.2342769Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T08:53:04.2356178Z Entering 'third_party/googletest' 2025-12-04T08:53:04.2371358Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.2381073Z Entering 'third_party/ideep' 2025-12-04T08:53:04.2390918Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T08:53:04.2398328Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:04.2408142Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T08:53:04.2422468Z Entering 'third_party/ittapi' 2025-12-04T08:53:04.2432158Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T08:53:04.2441798Z Entering 'third_party/kineto' 2025-12-04T08:53:04.2451738Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T08:53:04.2460237Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:04.2474819Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T08:53:04.2485757Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:04.2496968Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T08:53:04.2507056Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:04.2517097Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T08:53:04.2528114Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:04.2539149Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:04.2547925Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:04.2560272Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T08:53:04.2568019Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:04.2581686Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T08:53:04.2596369Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:04.2607765Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T08:53:04.2616269Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:04.2626345Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.2638198Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:04.2652088Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T08:53:04.2664428Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:04.2675226Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T08:53:04.2685391Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:04.2696425Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:04.2705797Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:04.2716743Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:04.2726683Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:04.2736304Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:04.2754401Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:04.2763933Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T08:53:04.2772165Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:04.2785248Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.2799595Z Entering 'third_party/kleidiai' 2025-12-04T08:53:04.2812477Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T08:53:04.2822764Z Entering 'third_party/mimalloc' 2025-12-04T08:53:04.2832763Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T08:53:04.2845906Z Entering 'third_party/nlohmann' 2025-12-04T08:53:04.2860627Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T08:53:04.2871217Z Entering 'third_party/onnx' 2025-12-04T08:53:04.2883770Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T08:53:04.2901578Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:04.2921672Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:04.2936992Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:04.2957730Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T08:53:04.2974347Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:04.2995240Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:04.3007891Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:04.3023096Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.3032911Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:04.3047882Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T08:53:04.3058477Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:04.3074113Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T08:53:04.3084667Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:04.3103188Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T08:53:04.3113229Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:04.3133901Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T08:53:04.3147099Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:04.3160901Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:04.3175371Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:04.3185289Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:04.3195101Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:04.3207003Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:04.3219139Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:04.3230855Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T08:53:04.3253828Z Entering 'third_party/pocketfft' 2025-12-04T08:53:04.3265880Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T08:53:04.3275502Z Entering 'third_party/protobuf' 2025-12-04T08:53:04.3287260Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T08:53:04.3298650Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:04.3308793Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:04.3316689Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:04.3334161Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.3347103Z Entering 'third_party/psimd' 2025-12-04T08:53:04.3361367Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T08:53:04.3372347Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:04.3382729Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T08:53:04.3391768Z Entering 'third_party/pybind11' 2025-12-04T08:53:04.3401818Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:04.3411021Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:04.3432047Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T08:53:04.3445471Z Entering 'third_party/sleef' 2025-12-04T08:53:04.3455448Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T08:53:04.3463478Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:04.3477087Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T08:53:04.3486598Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:04.3498263Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:04.3507325Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:04.3519204Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T08:53:04.3530450Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:04.3542380Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T08:53:04.3557072Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:04.3567343Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:04.3575917Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:04.3588490Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T08:53:04.3617006Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3638826Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3656242Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3670607Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3687554Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3703831Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3718345Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3733254Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3746956Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3766403Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3780862Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3799493Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3820024Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3836957Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3867715Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3870888Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3886451Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3905128Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3923509Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3943867Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3960275Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3977343Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.3991697Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4006593Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4027147Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4043830Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4058631Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4075622Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4093266Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4108443Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4123538Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4138357Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4155402Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4171759Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4188388Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4213638Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4241468Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4268697Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4285722Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4301806Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4316485Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4336295Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4359834Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4378139Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4392550Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4413511Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4428270Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4444203Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4459397Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4473768Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4494726Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4510349Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4526124Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4548405Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4573171Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4591984Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4615018Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4638868Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4659218Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4677090Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4694569Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4710667Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4727178Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4742327Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4759097Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4775226Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4793982Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4810363Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4827566Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4846427Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4862754Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4878412Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4895186Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4916056Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4933621Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4950214Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4966057Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.4984088Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.5000074Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.5016553Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.5032028Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:04.5050869Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-12-04T08:53:04.5076051Z ##[endgroup] 2025-12-04T08:53:04.5076256Z ##[group]Fetching the repository 2025-12-04T08:53:04.5079650Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-12-04T08:53:05.1412909Z From https://github.com/pytorch/pytorch 2025-12-04T08:53:05.1413594Z - [deleted] (none) -> ciflow/inductor/168919 2025-12-04T08:53:05.1414091Z - [deleted] (none) -> ciflow/linux-aarch64/168919 2025-12-04T08:53:05.1414580Z - [deleted] (none) -> ciflow/mps/168919 2025-12-04T08:53:05.1415021Z - [deleted] (none) -> ciflow/rocm/168919 2025-12-04T08:53:05.1415461Z - [deleted] (none) -> ciflow/trunk/167958 2025-12-04T08:53:05.1415907Z - [deleted] (none) -> ciflow/trunk/168919 2025-12-04T08:53:05.1416382Z - [deleted] (none) -> ciflow/trunk/169431 2025-12-04T08:53:05.1416828Z - [deleted] (none) -> ciflow/win-arm64/168919 2025-12-04T08:53:09.1475109Z * [new branch] 2.6.0.dev20241004+ -> origin/2.6.0.dev20241004+ 2025-12-04T08:53:09.1475709Z * [new branch] 2.9.1 -> origin/2.9.1 2025-12-04T08:53:09.1476333Z * [new branch] AaronWang04_addmmfusion_perftest -> origin/AaronWang04_addmmfusion_perftest 2025-12-04T08:53:09.1476988Z * [new branch] Flamefire-patch-1 -> origin/Flamefire-patch-1 2025-12-04T08:53:09.1477591Z * [new branch] HDCharles-2.6.0-release-notes -> origin/HDCharles-2.6.0-release-notes 2025-12-04T08:53:09.1478167Z * [new branch] HOPrintFunc -> origin/HOPrintFunc 2025-12-04T08:53:09.1478811Z * [new branch] IvanKobzarev/stack/1 -> origin/IvanKobzarev/stack/1 2025-12-04T08:53:09.1479335Z * [new branch] NicoshevSVE128 -> origin/NicoshevSVE128 2025-12-04T08:53:09.1479883Z * [new branch] PR-AOTInductorNoneBug -> origin/PR-AOTInductorNoneBug 2025-12-04T08:53:09.1480480Z * [new branch] PR-AOTInductorNoneBugFix -> origin/PR-AOTInductorNoneBugFix 2025-12-04T08:53:09.1481061Z * [new branch] PR-FixConfigsIssue -> origin/PR-FixConfigsIssue 2025-12-04T08:53:09.1481589Z * [new branch] PR-NoneBugFix-viable -> origin/PR-NoneBugFix-viable 2025-12-04T08:53:09.1482018Z * [new branch] PR-ResetToZero -> origin/PR-ResetToZero 2025-12-04T08:53:09.1482344Z * [new branch] Update-Flash-Packaging -> origin/Update-Flash-Packaging 2025-12-04T08:53:09.1482646Z * [new branch] VLA_exp -> origin/VLA_exp 2025-12-04T08:53:09.1483042Z * [new branch] activation_bench -> origin/activation_bench 2025-12-04T08:53:09.1484183Z * [new branch] addmm-heuristic -> origin/addmm-heuristic 2025-12-04T08:53:09.1484480Z * [new branch] adi/onednn_aarch64 -> origin/adi/onednn_aarch64 2025-12-04T08:53:09.1484897Z * [new branch] adi/test -> origin/adi/test 2025-12-04T08:53:09.1485178Z * [new branch] adi/test_bgemm -> origin/adi/test_bgemm 2025-12-04T08:53:09.1485464Z * [new branch] adi/test_m8g -> origin/adi/test_m8g 2025-12-04T08:53:09.1485742Z * [new branch] adi/test_onednn -> origin/adi/test_onednn 2025-12-04T08:53:09.1486036Z * [new branch] adi/test_onednn_v3.9 -> origin/adi/test_onednn_v3.9 2025-12-04T08:53:09.1486362Z * [new branch] adi/test_presve_change -> origin/adi/test_presve_change 2025-12-04T08:53:09.1486668Z * [new branch] adi/test_timm -> origin/adi/test_timm 2025-12-04T08:53:09.1486970Z * [new branch] adi/testpresve_change -> origin/adi/testpresve_change 2025-12-04T08:53:09.1487297Z * [new branch] aditew01/test/vec_bf16 -> origin/aditew01/test/vec_bf16 2025-12-04T08:53:09.1487627Z * [new branch] ah-globalfeedback-hook -> origin/ah-globalfeedback-hook 2025-12-04T08:53:09.1487988Z * [new branch] albanD-patch-1 -> origin/albanD-patch-1 2025-12-04T08:53:09.1488308Z * [new branch] also-surround-shimh -> origin/also-surround-shimh 2025-12-04T08:53:09.1488621Z * [new branch] angelayi/aot_compile -> origin/angelayi/aot_compile 2025-12-04T08:53:09.1488980Z * [new branch] angelayi/aoti_additional_files -> origin/angelayi/aoti_additional_files 2025-12-04T08:53:09.1489330Z * [new branch] angelayi/benchmark -> origin/angelayi/benchmark 2025-12-04T08:53:09.1489704Z * [new branch] angelayi/change_pytree_serialization -> origin/angelayi/change_pytree_serialization 2025-12-04T08:53:09.1490089Z * [new branch] angelayi/cpp_loader -> origin/angelayi/cpp_loader 2025-12-04T08:53:09.1490413Z * [new branch] angelayi/inductor_const -> origin/angelayi/inductor_const 2025-12-04T08:53:09.1490716Z * [new branch] angelayi/lstm -> origin/angelayi/lstm 2025-12-04T08:53:09.1491015Z * [new branch] angelayi/no_so_weight -> origin/angelayi/no_so_weight 2025-12-04T08:53:09.1491327Z * [new branch] angelayi/scan_layers -> origin/angelayi/scan_layers 2025-12-04T08:53:09.1491613Z * [new branch] angelayi/side_eff -> origin/angelayi/side_eff 2025-12-04T08:53:09.1491841Z * [new branch] angelayi/state_dict -> origin/angelayi/state_dict 2025-12-04T08:53:09.1492085Z * [new branch] angelayi/symint_input -> origin/angelayi/symint_input 2025-12-04T08:53:09.1492317Z * [new branch] angelayi/symm_mem -> origin/angelayi/symm_mem 2025-12-04T08:53:09.1492543Z * [new branch] angelayi/test_cpp -> origin/angelayi/test_cpp 2025-12-04T08:53:09.1492779Z * [new branch] angelayi/torch_size -> origin/angelayi/torch_size 2025-12-04T08:53:09.1493064Z * [new branch] annotate_assert -> origin/annotate_assert 2025-12-04T08:53:09.1493306Z * [new branch] annotate_fallback_kernel -> origin/annotate_fallback_kernel 2025-12-04T08:53:09.1493551Z * [new branch] annotation_deepcopy -> origin/annotation_deepcopy 2025-12-04T08:53:09.1493779Z * [new branch] annotation_dynamo -> origin/annotation_dynamo 2025-12-04T08:53:09.1494009Z * [new branch] aot_eager_stack_trace -> origin/aot_eager_stack_trace 2025-12-04T08:53:09.1494234Z * [new branch] aoti-cuda-alloc -> origin/aoti-cuda-alloc 2025-12-04T08:53:09.1494464Z * [new branch] aoti_const_device -> origin/aoti_const_device 2025-12-04T08:53:09.1494868Z * [new branch] aoti_fqn_name_interface -> origin/aoti_fqn_name_interface 2025-12-04T08:53:09.1495174Z * [new branch] aoti_package_weights_binary -> origin/aoti_package_weights_binary 2025-12-04T08:53:09.1495433Z * [new branch] aoti_target_windows -> origin/aoti_target_windows 2025-12-04T08:53:09.1495711Z * [new branch] arsh/feat/inductor_check_profiling -> origin/arsh/feat/inductor_check_profiling 2025-12-04T08:53:09.1495973Z * [new branch] async_tp -> origin/async_tp 2025-12-04T08:53:09.1496234Z * [new branch] atalman-inductor-perf-cu124 -> origin/atalman-inductor-perf-cu124 2025-12-04T08:53:09.1496539Z * [new branch] atalman-inductor-perf-cu124.1 -> origin/atalman-inductor-perf-cu124.1 2025-12-04T08:53:09.1496805Z * [new branch] atalman-patch-2 -> origin/atalman-patch-2 2025-12-04T08:53:09.1497039Z * [new branch] atalman-patch-3 -> origin/atalman-patch-3 2025-12-04T08:53:09.1497261Z * [new branch] atalman-patch-4 -> origin/atalman-patch-4 2025-12-04T08:53:09.1497483Z * [new branch] atalman-patch-5 -> origin/atalman-patch-5 2025-12-04T08:53:09.1497705Z * [new branch] atalman-patch-6 -> origin/atalman-patch-6 2025-12-04T08:53:09.1497927Z * [new branch] atalman-patch-7 -> origin/atalman-patch-7 2025-12-04T08:53:09.1498145Z * [new branch] atalman-patch-8 -> origin/atalman-patch-8 2025-12-04T08:53:09.1498375Z * [new branch] atalman_inductor_2.3.1 -> origin/atalman_inductor_2.3.1 2025-12-04T08:53:09.1498618Z * [new branch] atalman_inductor_2.4.0 -> origin/atalman_inductor_2.4.0 2025-12-04T08:53:09.1498856Z * [new branch] atalman_inductor_2.4.x -> origin/atalman_inductor_2.4.x 2025-12-04T08:53:09.1499125Z * [new branch] attention_benchmarking_clean -> origin/attention_benchmarking_clean 2025-12-04T08:53:09.1499399Z * [new branch] bahuang/dt_fix_scalar_add -> origin/bahuang/dt_fix_scalar_add 2025-12-04T08:53:09.1499649Z * [new branch] bahuang/fix_debug_mode -> origin/bahuang/fix_debug_mode 2025-12-04T08:53:09.1499884Z * [new branch] bahuang/fix_expand -> origin/bahuang/fix_expand 2025-12-04T08:53:09.1500111Z * [new branch] bahuang/test -> origin/bahuang/test 2025-12-04T08:53:09.1500315Z * [new branch] base/1.5 -> origin/base/1.5 2025-12-04T08:53:09.1500572Z * [new branch] batching_sdpa_efficient_attention -> origin/batching_sdpa_efficient_attention 2025-12-04T08:53:09.1500840Z * [new branch] bench_scaled_mm_ops -> origin/bench_scaled_mm_ops 2025-12-04T08:53:09.1501080Z * [new branch] benchmark-updates -> origin/benchmark-updates 2025-12-04T08:53:09.1501329Z * [new branch] benchmarking-script -> origin/benchmarking-script 2025-12-04T08:53:09.1501568Z * [new branch] bertmaher/pinbump26 -> origin/bertmaher/pinbump26 2025-12-04T08:53:09.1501799Z * [new branch] bertrand/cutlass -> origin/bertrand/cutlass 2025-12-04T08:53:09.1501990Z * [new branch] bf/bug-static-input -> origin/bf/bug-static-input 2025-12-04T08:53:09.1502171Z * [new branch] bf/cg-backend -> origin/bf/cg-backend 2025-12-04T08:53:09.1502350Z * [new branch] bf/cg-nccl-test -> origin/bf/cg-nccl-test 2025-12-04T08:53:09.1502536Z * [new branch] bf/cg-remove-check -> origin/bf/cg-remove-check 2025-12-04T08:53:09.1502737Z * [new branch] bf/clean-torchbench-hf -> origin/bf/clean-torchbench-hf 2025-12-04T08:53:09.1503009Z * [new branch] bf/combo-debug-log -> origin/bf/combo-debug-log 2025-12-04T08:53:09.1503237Z * [new branch] bf/cudagraph -> origin/bf/cudagraph 2025-12-04T08:53:09.1503468Z * [new branch] bf/cudagraph-disable-input-mutation -> origin/bf/cudagraph-disable-input-mutation 2025-12-04T08:53:09.1503891Z * [new branch] bf/cudagraph-enable-input-mutation-support-benchmark -> origin/bf/cudagraph-enable-input-mutation-support-benchmark 2025-12-04T08:53:09.1504215Z * [new branch] bf/cudagraph-partition -> origin/bf/cudagraph-partition 2025-12-04T08:53:09.1504424Z * [new branch] bf/donated-buffer-bench -> origin/bf/donated-buffer-bench 2025-12-04T08:53:09.1504634Z * [new branch] bf/dynamo-partition -> origin/bf/dynamo-partition 2025-12-04T08:53:09.1504821Z * [new branch] bf/lite -> origin/bf/lite 2025-12-04T08:53:09.1504996Z * [new branch] bf/pa-non-divisible -> origin/bf/pa-non-divisible 2025-12-04T08:53:09.1505228Z * [new branch] bf/partition-cache-free-symbols -> origin/bf/partition-cache-free-symbols 2025-12-04T08:53:09.1505482Z * [new branch] bf/partition-memory-plan -> origin/bf/partition-memory-plan 2025-12-04T08:53:09.1505698Z * [new branch] bf/partition-move-cpu -> origin/bf/partition-move-cpu 2025-12-04T08:53:09.1505922Z * [new branch] bf/partition-view-fallback -> origin/bf/partition-view-fallback 2025-12-04T08:53:09.1506147Z * [new branch] bf/remove-check-55b0c39d -> origin/bf/remove-check-55b0c39d 2025-12-04T08:53:09.1506349Z * [new branch] bf/timm-nov-26-2025 -> origin/bf/timm-nov-26-2025 2025-12-04T08:53:09.1506569Z * [new branch] bf/transformer-pin-4-57-3 -> origin/bf/transformer-pin-4-57-3 2025-12-04T08:53:09.1506795Z * [new branch] bisect_perf_hf_T5_3acc6eac492 -> origin/bisect_perf_hf_T5_3acc6eac492 2025-12-04T08:53:09.1507028Z * [new branch] bisect_perf_hf_T5_3fcf66f61fb -> origin/bisect_perf_hf_T5_3fcf66f61fb 2025-12-04T08:53:09.1507255Z * [new branch] bisect_perf_hf_T5_4009d154129 -> origin/bisect_perf_hf_T5_4009d154129 2025-12-04T08:53:09.1507479Z * [new branch] bisect_perf_hf_T5_40d0740e73d -> origin/bisect_perf_hf_T5_40d0740e73d 2025-12-04T08:53:09.1507698Z * [new branch] bisect_perf_hf_T5_5268754e -> origin/bisect_perf_hf_T5_5268754e 2025-12-04T08:53:09.1507915Z * [new branch] bisect_perf_hf_T5_7d89a8d385c -> origin/bisect_perf_hf_T5_7d89a8d385c 2025-12-04T08:53:09.1508132Z * [new branch] bisect_perf_hf_T5_b7a25c1ee7c -> origin/bisect_perf_hf_T5_b7a25c1ee7c 2025-12-04T08:53:09.1508356Z * [new branch] bisect_perf_hf_T5_c25b201583f -> origin/bisect_perf_hf_T5_c25b201583f 2025-12-04T08:53:09.1508573Z * [new branch] bisect_perf_hf_T5_c93e57efac0 -> origin/bisect_perf_hf_T5_c93e57efac0 2025-12-04T08:53:09.1508786Z * [new branch] bisect_perf_hf_T5_ca9813ea149 -> origin/bisect_perf_hf_T5_ca9813ea149 2025-12-04T08:53:09.1509002Z * [new branch] bisect_perf_hf_T5_d65f194a -> origin/bisect_perf_hf_T5_d65f194a 2025-12-04T08:53:09.1509224Z * [new branch] bisect_perf_hf_T5_da94ab0b -> origin/bisect_perf_hf_T5_da94ab0b 2025-12-04T08:53:09.1509436Z * [new branch] bisect_perf_hf_T5_da94ab0b_new -> origin/bisect_perf_hf_T5_da94ab0b_new 2025-12-04T08:53:09.1509659Z * [new branch] bisect_perf_hf_T5_db4e8a1d8a8 -> origin/bisect_perf_hf_T5_db4e8a1d8a8 2025-12-04T08:53:09.1509875Z * [new branch] bisect_perf_hf_T5_e0d97e936a2 -> origin/bisect_perf_hf_T5_e0d97e936a2 2025-12-04T08:53:09.1510093Z * [new branch] bisect_perf_hf_T5_f23621ec563 -> origin/bisect_perf_hf_T5_f23621ec563 2025-12-04T08:53:09.1510307Z * [new branch] brister/fx_device_type -> origin/brister/fx_device_type 2025-12-04T08:53:09.1510529Z * [new branch] brister/test_inductor_all_fx -> origin/brister/test_inductor_all_fx 2025-12-04T08:53:09.1510816Z * [new branch] brister/tiled_reduction_no_numel_check -> origin/brister/tiled_reduction_no_numel_check 2025-12-04T08:53:09.1511080Z * [new branch] bwd-backup -> origin/bwd-backup 2025-12-04T08:53:09.1511256Z * [new branch] c57382a49 -> origin/c57382a49 2025-12-04T08:53:09.1511424Z * [new branch] ca_0431d47eaa -> origin/ca_0431d47eaa 2025-12-04T08:53:09.1511611Z * [new branch] ca_fix_0431d47eaa -> origin/ca_fix_0431d47eaa 2025-12-04T08:53:09.1511819Z * [new branch] camyllh/test_setup_hooks_push -> origin/camyllh/test_setup_hooks_push 2025-12-04T08:53:09.1512032Z * [new branch] cccclai-patch-1 -> origin/cccclai-patch-1 2025-12-04T08:53:09.1512283Z * [new branch] cherry-pick-159969-by-pytorch_bot_bot_ -> origin/cherry-pick-159969-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1512581Z * [new branch] cherry-pick-160586-by-pytorch_bot_bot_ -> origin/cherry-pick-160586-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1512866Z * [new branch] cherry-pick-162208-by-pytorch_bot_bot_ -> origin/cherry-pick-162208-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1513273Z * [new branch] cherry-pick-163169-by-pytorch_bot_bot_ -> origin/cherry-pick-163169-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1513554Z * [new branch] cherry-pick-165086-by-pytorch_bot_bot_ -> origin/cherry-pick-165086-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1513828Z * [new branch] cherry-pick-165514-by-pytorch_bot_bot_ -> origin/cherry-pick-165514-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1514110Z * [new branch] cherry-pick-165601-by-pytorch_bot_bot_ -> origin/cherry-pick-165601-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1514390Z * [new branch] cherry-pick-165667-by-pytorch_bot_bot_ -> origin/cherry-pick-165667-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1514668Z * [new branch] cherry-pick-165815-by-pytorch_bot_bot_ -> origin/cherry-pick-165815-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1514958Z * [new branch] cherry-pick-165922-by-pytorch_bot_bot_ -> origin/cherry-pick-165922-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1515234Z * [new branch] cherry-pick-166148-by-pytorch_bot_bot_ -> origin/cherry-pick-166148-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1515508Z * [new branch] cherry-pick-166181-by-pytorch_bot_bot_ -> origin/cherry-pick-166181-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1515787Z * [new branch] cherry-pick-166404-by-pytorch_bot_bot_ -> origin/cherry-pick-166404-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1516068Z * [new branch] cherry-pick-166427-by-pytorch_bot_bot_ -> origin/cherry-pick-166427-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1516340Z * [new branch] cherry-pick-166480-by-pytorch_bot_bot_ -> origin/cherry-pick-166480-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1516618Z * [new branch] cherry-pick-166570-by-pytorch_bot_bot_ -> origin/cherry-pick-166570-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1516905Z * [new branch] cherry-pick-166993-by-pytorch_bot_bot_ -> origin/cherry-pick-166993-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1517176Z * [new branch] cherry-pick-167111-by-pytorch_bot_bot_ -> origin/cherry-pick-167111-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1517452Z * [new branch] cherry-pick-167478-by-pytorch_bot_bot_ -> origin/cherry-pick-167478-by-pytorch_bot_bot_ 2025-12-04T08:53:09.1517699Z * [new branch] cherry_pick_166036_166040 -> origin/cherry_pick_166036_166040 2025-12-04T08:53:09.1517891Z * [new branch] cherry_pick_166457 -> origin/cherry_pick_166457 2025-12-04T08:53:09.1518076Z * [new branch] cherrypick_166338 -> origin/cherrypick_166338 2025-12-04T08:53:09.1518261Z * [new branch] cherrypick_166458 -> origin/cherrypick_166458 2025-12-04T08:53:09.1518488Z * [new branch] cherrypick_166586 -> origin/cherrypick_166586 2025-12-04T08:53:09.1518848Z * [new branch] cherrypick_166956 -> origin/cherrypick_166956 2025-12-04T08:53:09.1519028Z * [new branch] ci_attn -> origin/ci_attn 2025-12-04T08:53:09.1519200Z * [new branch] codex-testing -> origin/codex-testing 2025-12-04T08:53:09.1519469Z * [new branch] codex/add-check_memory_overlap-helper-functions -> origin/codex/add-check_memory_overlap-helper-functions 2025-12-04T08:53:09.1519784Z * [new branch] codex/fix-issue-121219-in-pytorch -> origin/codex/fix-issue-121219-in-pytorch 2025-12-04T08:53:09.1520105Z * [new branch] codex/investigate-segfaults-in-get_tensor_storage_id -> origin/codex/investigate-segfaults-in-get_tensor_storage_id 2025-12-04T08:53:09.1520485Z * [new branch] codex/refactor-lintrunner-config-to-use-uv-run -> origin/codex/refactor-lintrunner-config-to-use-uv-run 2025-12-04T08:53:09.1520762Z * [new branch] compatiblpy39util -> origin/compatiblpy39util 2025-12-04T08:53:09.1520947Z * [new branch] cond_hop_device -> origin/cond_hop_device 2025-12-04T08:53:09.1521134Z * [new branch] context_test -> origin/context_test 2025-12-04T08:53:09.1521392Z * [new branch] copilot/code-style-cleanup-python-pip -> origin/copilot/code-style-cleanup-python-pip 2025-12-04T08:53:09.1521635Z * [new branch] cpio/fix_new_ami_tests -> origin/cpio/fix_new_ami_tests 2025-12-04T08:53:09.1521855Z * [new branch] cpp-docs-dependency-upgrade -> origin/cpp-docs-dependency-upgrade 2025-12-04T08:53:09.1522083Z * [new branch] csl/always_produce_xml -> origin/csl/always_produce_xml 2025-12-04T08:53:09.1522284Z * [new branch] csl/build_test_more_procs -> origin/csl/build_test_more_procs 2025-12-04T08:53:09.1522498Z * [new branch] csl/build_test_more_procs2 -> origin/csl/build_test_more_procs2 2025-12-04T08:53:09.1522689Z * [new branch] csl/clean_up -> origin/csl/clean_up 2025-12-04T08:53:09.1522911Z * [new branch] csl/fix_retry_segfault_exit -> origin/csl/fix_retry_segfault_exit 2025-12-04T08:53:09.1523162Z * [new branch] csl/katex -> origin/csl/katex 2025-12-04T08:53:09.1523333Z * [new branch] csl/larger_runner -> origin/csl/larger_runner 2025-12-04T08:53:09.1523510Z * [new branch] csl/lint_testing -> origin/csl/lint_testing 2025-12-04T08:53:09.1523688Z * [new branch] csl/lint_thing -> origin/csl/lint_thing 2025-12-04T08:53:09.1523878Z * [new branch] csl/lintrunner_stuff -> origin/csl/lintrunner_stuff 2025-12-04T08:53:09.1524067Z * [new branch] csl/manually_gen_json -> origin/csl/manually_gen_json 2025-12-04T08:53:09.1524252Z * [new branch] csl/mps_sharding -> origin/csl/mps_sharding 2025-12-04T08:53:09.1524435Z * [new branch] csl/multistage_docker -> origin/csl/multistage_docker 2025-12-04T08:53:09.1524627Z * [new branch] csl/print_timing -> origin/csl/print_timing 2025-12-04T08:53:09.1524813Z * [new branch] csl/remove_experiment -> origin/csl/remove_experiment 2025-12-04T08:53:09.1525022Z * [new branch] csl/remove_maybe_unused_var -> origin/csl/remove_maybe_unused_var 2025-12-04T08:53:09.1525258Z * [new branch] csl/remove_repo_specific_autolabel -> origin/csl/remove_repo_specific_autolabel 2025-12-04T08:53:09.1525494Z * [new branch] csl/remove_run_parallel -> origin/csl/remove_run_parallel 2025-12-04T08:53:09.1525698Z * [new branch] csl/remove_unused_vars -> origin/csl/remove_unused_vars 2025-12-04T08:53:09.1525884Z * [new branch] csl/revert_open -> origin/csl/revert_open 2025-12-04T08:53:09.1526114Z * [new branch] csl/skip_build -> origin/csl/skip_build 2025-12-04T08:53:09.1526340Z * [new branch] csl/smaller_avx_amx_runenrs -> origin/csl/smaller_avx_amx_runenrs 2025-12-04T08:53:09.1526537Z * [new branch] csl/td_job_level -> origin/csl/td_job_level 2025-12-04T08:53:09.1526752Z * [new branch] csl/test_cuda_build_large_runner -> origin/csl/test_cuda_build_large_runner 2025-12-04T08:53:09.1527006Z * [new branch] csl/test_owners_autograd_dispatch_nn -> origin/csl/test_owners_autograd_dispatch_nn 2025-12-04T08:53:09.1527263Z * [new branch] csl/test_owners_higher_confidence -> origin/csl/test_owners_higher_confidence 2025-12-04T08:53:09.1527495Z * [new branch] csl/upload_json_running -> origin/csl/upload_json_running 2025-12-04T08:53:09.1527682Z * [new branch] csl/win_sccache -> origin/csl/win_sccache 2025-12-04T08:53:09.1527862Z * [new branch] csl/xml_stuff -> origin/csl/xml_stuff 2025-12-04T08:53:09.1528038Z * [new branch] cublasrelax2 -> origin/cublasrelax2 2025-12-04T08:53:09.1528211Z * [new branch] cuda_mempool -> origin/cuda_mempool 2025-12-04T08:53:09.1528400Z * [new branch] custom_lowering_dict -> origin/custom_lowering_dict 2025-12-04T08:53:09.1528608Z * [new branch] d4l3k/debug_plane_frtrace -> origin/d4l3k/debug_plane_frtrace 2025-12-04T08:53:09.1528797Z * [new branch] daxia6/2.8o3 -> origin/daxia6/2.8o3 2025-12-04T08:53:09.1528970Z * [new branch] debug-guard -> origin/debug-guard 2025-12-04T08:53:09.1529152Z * [new branch] delete-quant-docs -> origin/delete-quant-docs 2025-12-04T08:53:09.1529481Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.57.0 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.57.0 2025-12-04T08:53:09.1529946Z * [new branch] dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.57.1 -> origin/dependabot/pip/dot-ci/docker/ci_commit_pins/main/transformers-4.57.1 2025-12-04T08:53:09.1530289Z * [new branch] desertfire/test_cpp_wrapper -> origin/desertfire/test_cpp_wrapper 2025-12-04T08:53:09.1530533Z * [new branch] desertfire/triton-cpu-for-aarch64 -> origin/desertfire/triton-cpu-for-aarch64 2025-12-04T08:53:09.1530770Z * [new branch] dev/dhruva/flex_attn_opt -> origin/dev/dhruva/flex_attn_opt 2025-12-04T08:53:09.1530978Z * [new branch] dev/joona/MPSNDArrayAdd -> origin/dev/joona/MPSNDArrayAdd 2025-12-04T08:53:09.1531172Z * [new branch] dev/joona/Unranked -> origin/dev/joona/Unranked 2025-12-04T08:53:09.1531355Z * [new branch] dev/joona/cat -> origin/dev/joona/cat 2025-12-04T08:53:09.1531555Z * [new branch] dev/joona/embeddingbag -> origin/dev/joona/embeddingbag 2025-12-04T08:53:09.1531763Z * [new branch] dev/joona/fix_sdpa_memtest -> origin/dev/joona/fix_sdpa_memtest 2025-12-04T08:53:09.1531996Z * [new branch] dev/joona/getTensorsString -> origin/dev/joona/getTensorsString 2025-12-04T08:53:09.1532218Z * [new branch] dev/joona/mps_linear_macos14 -> origin/dev/joona/mps_linear_macos14 2025-12-04T08:53:09.1532424Z * [new branch] dev/joona/scalar_clamp -> origin/dev/joona/scalar_clamp 2025-12-04T08:53:09.1532608Z * [new branch] dev/joona/sdpa -> origin/dev/joona/sdpa 2025-12-04T08:53:09.1532791Z * [new branch] dev/joona/sdpa_api -> origin/dev/joona/sdpa_api 2025-12-04T08:53:09.1533050Z * [new branch] dev/joona/type_inf -> origin/dev/joona/type_inf 2025-12-04T08:53:09.1533249Z * [new branch] dev/joona/ulpAssertClose -> origin/dev/joona/ulpAssertClose 2025-12-04T08:53:09.1533483Z * [new branch] dev/joona/upsize3d -> origin/dev/joona/upsize3d 2025-12-04T08:53:09.1533696Z * [new branch] disp_counter -> origin/disp_counter 2025-12-04T08:53:09.1533874Z * [new branch] divyanshk-patch-1 -> origin/divyanshk-patch-1 2025-12-04T08:53:09.1534051Z * [new branch] docs -> origin/docs 2025-12-04T08:53:09.1534214Z * [new branch] documentation -> origin/documentation 2025-12-04T08:53:09.1534395Z * [new branch] eager_model_benchmarks -> origin/eager_model_benchmarks 2025-12-04T08:53:09.1534606Z * [new branch] embg/test_inductor_ci_control -> origin/embg/test_inductor_ci_control 2025-12-04T08:53:09.1534838Z * [new branch] embg/triton_l2_prefetch_128B -> origin/embg/triton_l2_prefetch_128B 2025-12-04T08:53:09.1535055Z * [new branch] embg/triton_l2_prefetch_256B -> origin/embg/triton_l2_prefetch_256B 2025-12-04T08:53:09.1535249Z * [new branch] eqy-patch-1 -> origin/eqy-patch-1 2025-12-04T08:53:09.1535419Z * [new branch] eqy-patch-2 -> origin/eqy-patch-2 2025-12-04T08:53:09.1535587Z * [new branch] eqy-patch-3 -> origin/eqy-patch-3 2025-12-04T08:53:09.1535755Z * [new branch] eqy-patch-4 -> origin/eqy-patch-4 2025-12-04T08:53:09.1535922Z * [new branch] eqy-patch-5 -> origin/eqy-patch-5 2025-12-04T08:53:09.1536090Z * [new branch] eqy-patch-6 -> origin/eqy-patch-6 2025-12-04T08:53:09.1536270Z * [new branch] exclamaforte/amd-ma -> origin/exclamaforte/amd-ma 2025-12-04T08:53:09.1536513Z * [new branch] exclamaforte/combo-kernels-perf-run -> origin/exclamaforte/combo-kernels-perf-run 2025-12-04T08:53:09.1536774Z * [new branch] exclamaforte/do_bench_refactor -> origin/exclamaforte/do_bench_refactor 2025-12-04T08:53:09.1537034Z * [new branch] exclamaforte/enable-mem-dep-fusion -> origin/exclamaforte/enable-mem-dep-fusion 2025-12-04T08:53:09.1537327Z * [new branch] exclamaforte/fix-exhaustive-autotuning -> origin/exclamaforte/fix-exhaustive-autotuning 2025-12-04T08:53:09.1537629Z * [new branch] exclamaforte/fix-trace-parsing-fx-svg -> origin/exclamaforte/fix-trace-parsing-fx-svg 2025-12-04T08:53:09.1537938Z * [new branch] exclamaforte/force-pointwise-cat-perf-run -> origin/exclamaforte/force-pointwise-cat-perf-run 2025-12-04T08:53:09.1538206Z * [new branch] exclamaforte/fusion-data -> origin/exclamaforte/fusion-data 2025-12-04T08:53:09.1538442Z * [new branch] exclamaforte/gemm-benchmark-run -> origin/exclamaforte/gemm-benchmark-run 2025-12-04T08:53:09.1538696Z * [new branch] exclamaforte/gemm-export-model -> origin/exclamaforte/gemm-export-model 2025-12-04T08:53:09.1538927Z * [new branch] exclamaforte/gemm-model -> origin/exclamaforte/gemm-model 2025-12-04T08:53:09.1539207Z * [new branch] exclamaforte/gemm-model-all-data-collection -> origin/exclamaforte/gemm-model-all-data-collection 2025-12-04T08:53:09.1539475Z * [new branch] exclamaforte/gemm-to-amd -> origin/exclamaforte/gemm-to-amd 2025-12-04T08:53:09.1539698Z * [new branch] exclamaforte/just-gemm-model -> origin/exclamaforte/just-gemm-model 2025-12-04T08:53:09.1539974Z * [new branch] exclamaforte/just-gemm-model-no-refactor -> origin/exclamaforte/just-gemm-model-no-refactor 2025-12-04T08:53:09.1540246Z * [new branch] exclamaforte/profile-diff-algo -> origin/exclamaforte/profile-diff-algo 2025-12-04T08:53:09.1540508Z * [new branch] exclamaforte/profiler-visualization -> origin/exclamaforte/profiler-visualization 2025-12-04T08:53:09.1540783Z * [new branch] exclamaforte/test_cpp_wrapper_mode -> origin/exclamaforte/test_cpp_wrapper_mode 2025-12-04T08:53:09.1541082Z * [new branch] exclamaforte/update-autotune-configs -> origin/exclamaforte/update-autotune-configs 2025-12-04T08:53:09.1541404Z * [new branch] exclamaforte/update-autotune-configs-2 -> origin/exclamaforte/update-autotune-configs-2 2025-12-04T08:53:09.1541636Z * [new branch] exec -> origin/exec 2025-12-04T08:53:09.1541810Z * [new branch] experimental-mosaic -> origin/experimental-mosaic 2025-12-04T08:53:09.1542001Z * [new branch] export-D61047529 -> origin/export-D61047529 2025-12-04T08:53:09.1542177Z * [new branch] export-D71412006 -> origin/export-D71412006 2025-12-04T08:53:09.1542348Z * [new branch] export-D73042989 -> origin/export-D73042989 2025-12-04T08:53:09.1542598Z * [new branch] export-D78957093 -> origin/export-D78957093 2025-12-04T08:53:09.1542777Z * [new branch] export-D78996107 -> origin/export-D78996107 2025-12-04T08:53:09.1543010Z * [new branch] export-D80823877 -> origin/export-D80823877 2025-12-04T08:53:09.1543186Z * [new branch] export-D80958642 -> origin/export-D80958642 2025-12-04T08:53:09.1543369Z * [new branch] export-D81054193 -> origin/export-D81054193 2025-12-04T08:53:09.1543539Z * [new branch] export-D81204584 -> origin/export-D81204584 2025-12-04T08:53:09.1543715Z * [new branch] export-D81429090 -> origin/export-D81429090 2025-12-04T08:53:09.1543889Z * [new branch] export-D82250826 -> origin/export-D82250826 2025-12-04T08:53:09.1544061Z * [new branch] export-D82253817 -> origin/export-D82253817 2025-12-04T08:53:09.1544237Z * [new branch] export-D83541846 -> origin/export-D83541846 2025-12-04T08:53:09.1544407Z * [new branch] export-D83627170 -> origin/export-D83627170 2025-12-04T08:53:09.1544579Z * [new branch] export-D83766701 -> origin/export-D83766701 2025-12-04T08:53:09.1544759Z * [new branch] export-D83768878 -> origin/export-D83768878 2025-12-04T08:53:09.1544931Z * [new branch] export-D83769447 -> origin/export-D83769447 2025-12-04T08:53:09.1545108Z * [new branch] export-D84089824 -> origin/export-D84089824 2025-12-04T08:53:09.1545279Z * [new branch] export-D84213020 -> origin/export-D84213020 2025-12-04T08:53:09.1545451Z * [new branch] export-D84373821 -> origin/export-D84373821 2025-12-04T08:53:09.1545623Z * [new branch] export-D84612194 -> origin/export-D84612194 2025-12-04T08:53:09.1545810Z * [new branch] export-D84890985 -> origin/export-D84890985 2025-12-04T08:53:09.1545979Z * [new branch] export-D85122326 -> origin/export-D85122326 2025-12-04T08:53:09.1546152Z * [new branch] export-D86256198 -> origin/export-D86256198 2025-12-04T08:53:09.1546326Z * [new branch] export-D86460608 -> origin/export-D86460608 2025-12-04T08:53:09.1546494Z * [new branch] export-D86474796 -> origin/export-D86474796 2025-12-04T08:53:09.1546669Z * [new branch] export-D86712396 -> origin/export-D86712396 2025-12-04T08:53:09.1546842Z * [new branch] export-D87022129 -> origin/export-D87022129 2025-12-04T08:53:09.1547010Z * [new branch] export-D87838959 -> origin/export-D87838959 2025-12-04T08:53:09.1547181Z * [new branch] export-D88319437 -> origin/export-D88319437 2025-12-04T08:53:09.1547409Z * [new branch] exported-model-train-idempotent -> origin/exported-model-train-idempotent 2025-12-04T08:53:09.1547641Z * [new branch] ezyang-titan-october -> origin/ezyang-titan-october 2025-12-04T08:53:09.1547887Z * [new branch] ezyang-titan-october2 -> origin/ezyang-titan-october2 2025-12-04T08:53:09.1548112Z * [new branch] ezyang-war -> origin/ezyang-war 2025-12-04T08:53:09.1548314Z * [new branch] ezyang/wip-aot-descriptors -> origin/ezyang/wip-aot-descriptors 2025-12-04T08:53:09.1548509Z * [new branch] fa_u8_brgemm -> origin/fa_u8_brgemm 2025-12-04T08:53:09.1548694Z * [new branch] fadeputr/sequence_fbgemm -> origin/fadeputr/sequence_fbgemm 2025-12-04T08:53:09.1548894Z * [new branch] fastmath_baseline -> origin/fastmath_baseline 2025-12-04T08:53:09.1549073Z * [new branch] fbcode/warm -> origin/fbcode/warm 2025-12-04T08:53:09.1549234Z * [new branch] fca -> origin/fca 2025-12-04T08:53:09.1549394Z * [new branch] fca2_ca5984c -> origin/fca2_ca5984c 2025-12-04T08:53:09.1549561Z * [new branch] fca5 -> origin/fca5 2025-12-04T08:53:09.1549738Z * [new branch] feature/justknobs-cpp -> origin/feature/justknobs-cpp 2025-12-04T08:53:09.1549946Z * [new branch] feature/numa-forkserver -> origin/feature/numa-forkserver 2025-12-04T08:53:09.1550140Z * [new branch] ffast_math_baseline -> origin/ffast_math_baseline 2025-12-04T08:53:09.1550318Z * [new branch] ffast_math_target -> origin/ffast_math_target 2025-12-04T08:53:09.1550499Z * [new branch] findhao/base_commit -> origin/findhao/base_commit 2025-12-04T08:53:09.1550695Z * [new branch] findhao/base_commit1 -> origin/findhao/base_commit1 2025-12-04T08:53:09.1550882Z * [new branch] findhao/multistream2 -> origin/findhao/multistream2 2025-12-04T08:53:09.1551071Z * [new branch] findhao/multistream5 -> origin/findhao/multistream5 2025-12-04T08:53:09.1551259Z * [new branch] findhao/multistream6 -> origin/findhao/multistream6 2025-12-04T08:53:09.1551463Z * [new branch] findhao/operatorbench3 -> origin/findhao/operatorbench3 2025-12-04T08:53:09.1551666Z * [new branch] findhao/operatorbench5 -> origin/findhao/operatorbench5 2025-12-04T08:53:09.1551861Z * [new branch] findhao/tritonparse -> origin/findhao/tritonparse 2025-12-04T08:53:09.1552075Z * [new branch] fix-ck-gemm-template-format -> origin/fix-ck-gemm-template-format 2025-12-04T08:53:09.1552291Z * [new branch] fix-config-ignore -> origin/fix-config-ignore 2025-12-04T08:53:09.1552469Z * [new branch] fix-dict-guard -> origin/fix-dict-guard 2025-12-04T08:53:09.1552643Z * [new branch] fix_addmm_issue -> origin/fix_addmm_issue 2025-12-04T08:53:09.1552839Z * [new branch] fix_amd_missing_cluster_dims -> origin/fix_amd_missing_cluster_dims 2025-12-04T08:53:09.1553088Z * [new branch] fix_bench_bwd_pass -> origin/fix_bench_bwd_pass 2025-12-04T08:53:09.1553282Z * [new branch] fix_mem_profiler_config -> origin/fix_mem_profiler_config 2025-12-04T08:53:09.1553471Z * [new branch] fix_nvrtc_discovery -> origin/fix_nvrtc_discovery 2025-12-04T08:53:09.1553644Z * [new branch] fix_op_runner -> origin/fix_op_runner 2025-12-04T08:53:09.1553815Z * [new branch] fix_ubn_159469 -> origin/fix_ubn_159469 2025-12-04T08:53:09.1553987Z * [new branch] fixes-triage -> origin/fixes-triage 2025-12-04T08:53:09.1554162Z * [new branch] fixflashinfer -> origin/fixflashinfer 2025-12-04T08:53:09.1554343Z * [new branch] flash_decoding_cpu -> origin/flash_decoding_cpu 2025-12-04T08:53:09.1554523Z * [new branch] flex-flash -> origin/flex-flash 2025-12-04T08:53:09.1554763Z * [new branch] flex_attention_functorch_grad -> origin/flex_attention_functorch_grad 2025-12-04T08:53:09.1554999Z * [new branch] flex_flash -> origin/flex_flash 2025-12-04T08:53:09.1555204Z * [new branch] fmassa/fix_memeff_sharding_rule -> origin/fmassa/fix_memeff_sharding_rule 2025-12-04T08:53:09.1555448Z * [new branch] fmassa/tests_comm_compute_scheduler -> origin/fmassa/tests_comm_compute_scheduler 2025-12-04T08:53:09.1555664Z * [new branch] forkserver_fix -> origin/forkserver_fix 2025-12-04T08:53:09.1555845Z * [new branch] fsdp2_trace_rules -> origin/fsdp2_trace_rules 2025-12-04T08:53:09.1556018Z * [new branch] fx_cpp -> origin/fx_cpp 2025-12-04T08:53:09.1556183Z * [new branch] fy/fix-win -> origin/fy/fix-win 2025-12-04T08:53:09.1556354Z * [new branch] galv-patch-1 -> origin/galv-patch-1 2025-12-04T08:53:09.1556585Z * [new branch] galv/cudagraphs-conditional-nodes-4 -> origin/galv/cudagraphs-conditional-nodes-4 2025-12-04T08:53:09.1556847Z * [new branch] georgehong/cmakelists-patch -> origin/georgehong/cmakelists-patch 2025-12-04T08:53:09.1557055Z * [new branch] gh/AlnisM/1/base -> origin/gh/AlnisM/1/base 2025-12-04T08:53:09.1557239Z * [new branch] gh/AlnisM/1/head -> origin/gh/AlnisM/1/head 2025-12-04T08:53:09.1557435Z * [new branch] gh/EikanWang/67/base -> origin/gh/EikanWang/67/base 2025-12-04T08:53:09.1557627Z * [new branch] gh/EikanWang/67/head -> origin/gh/EikanWang/67/head 2025-12-04T08:53:09.1557822Z * [new branch] gh/Gasoonjia/1/base -> origin/gh/Gasoonjia/1/base 2025-12-04T08:53:09.1558020Z * [new branch] gh/Gasoonjia/1/head -> origin/gh/Gasoonjia/1/head 2025-12-04T08:53:09.1558205Z * [new branch] gh/H-Huang/131/base -> origin/gh/H-Huang/131/base 2025-12-04T08:53:09.1558394Z * [new branch] gh/H-Huang/131/head -> origin/gh/H-Huang/131/head 2025-12-04T08:53:09.1558585Z * [new branch] gh/H-Huang/131/orig -> origin/gh/H-Huang/131/orig 2025-12-04T08:53:09.1558770Z * [new branch] gh/H-Huang/132/base -> origin/gh/H-Huang/132/base 2025-12-04T08:53:09.1558955Z * [new branch] gh/H-Huang/132/head -> origin/gh/H-Huang/132/head 2025-12-04T08:53:09.1559142Z * [new branch] gh/H-Huang/132/orig -> origin/gh/H-Huang/132/orig 2025-12-04T08:53:09.1559323Z * [new branch] gh/H-Huang/180/base -> origin/gh/H-Huang/180/base 2025-12-04T08:53:09.1559506Z * [new branch] gh/H-Huang/180/head -> origin/gh/H-Huang/180/head 2025-12-04T08:53:09.1559707Z * [new branch] gh/H-Huang/180/orig -> origin/gh/H-Huang/180/orig 2025-12-04T08:53:09.1559887Z * [new branch] gh/H-Huang/182/base -> origin/gh/H-Huang/182/base 2025-12-04T08:53:09.1560074Z * [new branch] gh/H-Huang/182/head -> origin/gh/H-Huang/182/head 2025-12-04T08:53:09.1560262Z * [new branch] gh/H-Huang/182/orig -> origin/gh/H-Huang/182/orig 2025-12-04T08:53:09.1560445Z * [new branch] gh/H-Huang/226/base -> origin/gh/H-Huang/226/base 2025-12-04T08:53:09.1560630Z * [new branch] gh/H-Huang/226/head -> origin/gh/H-Huang/226/head 2025-12-04T08:53:09.1560809Z * [new branch] gh/H-Huang/226/orig -> origin/gh/H-Huang/226/orig 2025-12-04T08:53:09.1560998Z * [new branch] gh/H-Huang/228/base -> origin/gh/H-Huang/228/base 2025-12-04T08:53:09.1561182Z * [new branch] gh/H-Huang/228/head -> origin/gh/H-Huang/228/head 2025-12-04T08:53:09.1561361Z * [new branch] gh/H-Huang/228/orig -> origin/gh/H-Huang/228/orig 2025-12-04T08:53:09.1561589Z * [new branch] gh/IvanKobzarev/150/base -> origin/gh/IvanKobzarev/150/base 2025-12-04T08:53:09.1561805Z * [new branch] gh/IvanKobzarev/150/head -> origin/gh/IvanKobzarev/150/head 2025-12-04T08:53:09.1562042Z * [new branch] gh/IvanKobzarev/150/orig -> origin/gh/IvanKobzarev/150/orig 2025-12-04T08:53:09.1562255Z * [new branch] gh/IvanKobzarev/157/base -> origin/gh/IvanKobzarev/157/base 2025-12-04T08:53:09.1562461Z * [new branch] gh/IvanKobzarev/157/head -> origin/gh/IvanKobzarev/157/head 2025-12-04T08:53:09.1562675Z * [new branch] gh/IvanKobzarev/157/orig -> origin/gh/IvanKobzarev/157/orig 2025-12-04T08:53:09.1562879Z * [new branch] gh/IvanKobzarev/159/base -> origin/gh/IvanKobzarev/159/base 2025-12-04T08:53:09.1563171Z * [new branch] gh/IvanKobzarev/159/head -> origin/gh/IvanKobzarev/159/head 2025-12-04T08:53:09.1563372Z * [new branch] gh/IvanKobzarev/159/orig -> origin/gh/IvanKobzarev/159/orig 2025-12-04T08:53:09.1563581Z * [new branch] gh/IvanKobzarev/162/base -> origin/gh/IvanKobzarev/162/base 2025-12-04T08:53:09.1563791Z * [new branch] gh/IvanKobzarev/162/head -> origin/gh/IvanKobzarev/162/head 2025-12-04T08:53:09.1563990Z * [new branch] gh/IvanKobzarev/162/orig -> origin/gh/IvanKobzarev/162/orig 2025-12-04T08:53:09.1564194Z * [new branch] gh/IvanKobzarev/163/base -> origin/gh/IvanKobzarev/163/base 2025-12-04T08:53:09.1564401Z * [new branch] gh/IvanKobzarev/163/head -> origin/gh/IvanKobzarev/163/head 2025-12-04T08:53:09.1564599Z * [new branch] gh/IvanKobzarev/163/orig -> origin/gh/IvanKobzarev/163/orig 2025-12-04T08:53:09.1564805Z * [new branch] gh/IvanKobzarev/166/base -> origin/gh/IvanKobzarev/166/base 2025-12-04T08:53:09.1565010Z * [new branch] gh/IvanKobzarev/166/head -> origin/gh/IvanKobzarev/166/head 2025-12-04T08:53:09.1565207Z * [new branch] gh/IvanKobzarev/166/orig -> origin/gh/IvanKobzarev/166/orig 2025-12-04T08:53:09.1565416Z * [new branch] gh/IvanKobzarev/167/base -> origin/gh/IvanKobzarev/167/base 2025-12-04T08:53:09.1565621Z * [new branch] gh/IvanKobzarev/167/head -> origin/gh/IvanKobzarev/167/head 2025-12-04T08:53:09.1565822Z * [new branch] gh/IvanKobzarev/167/orig -> origin/gh/IvanKobzarev/167/orig 2025-12-04T08:53:09.1566027Z * [new branch] gh/IvanKobzarev/168/base -> origin/gh/IvanKobzarev/168/base 2025-12-04T08:53:09.1566231Z * [new branch] gh/IvanKobzarev/168/head -> origin/gh/IvanKobzarev/168/head 2025-12-04T08:53:09.1566437Z * [new branch] gh/IvanKobzarev/168/orig -> origin/gh/IvanKobzarev/168/orig 2025-12-04T08:53:09.1566641Z * [new branch] gh/IvanKobzarev/169/base -> origin/gh/IvanKobzarev/169/base 2025-12-04T08:53:09.1566841Z * [new branch] gh/IvanKobzarev/169/head -> origin/gh/IvanKobzarev/169/head 2025-12-04T08:53:09.1567051Z * [new branch] gh/IvanKobzarev/169/orig -> origin/gh/IvanKobzarev/169/orig 2025-12-04T08:53:09.1567257Z * [new branch] gh/IvanKobzarev/170/base -> origin/gh/IvanKobzarev/170/base 2025-12-04T08:53:09.1567459Z * [new branch] gh/IvanKobzarev/170/head -> origin/gh/IvanKobzarev/170/head 2025-12-04T08:53:09.1567666Z * [new branch] gh/IvanKobzarev/170/orig -> origin/gh/IvanKobzarev/170/orig 2025-12-04T08:53:09.1567877Z * [new branch] gh/IvanKobzarev/171/base -> origin/gh/IvanKobzarev/171/base 2025-12-04T08:53:09.1568078Z * [new branch] gh/IvanKobzarev/171/head -> origin/gh/IvanKobzarev/171/head 2025-12-04T08:53:09.1568285Z * [new branch] gh/IvanKobzarev/171/orig -> origin/gh/IvanKobzarev/171/orig 2025-12-04T08:53:09.1568490Z * [new branch] gh/IvanKobzarev/172/base -> origin/gh/IvanKobzarev/172/base 2025-12-04T08:53:09.1568691Z * [new branch] gh/IvanKobzarev/172/head -> origin/gh/IvanKobzarev/172/head 2025-12-04T08:53:09.1568937Z * [new branch] gh/IvanKobzarev/172/orig -> origin/gh/IvanKobzarev/172/orig 2025-12-04T08:53:09.1569180Z * [new branch] gh/IvanKobzarev/173/base -> origin/gh/IvanKobzarev/173/base 2025-12-04T08:53:09.1569381Z * [new branch] gh/IvanKobzarev/173/head -> origin/gh/IvanKobzarev/173/head 2025-12-04T08:53:09.1569585Z * [new branch] gh/IvanKobzarev/173/orig -> origin/gh/IvanKobzarev/173/orig 2025-12-04T08:53:09.1569793Z * [new branch] gh/IvanKobzarev/174/base -> origin/gh/IvanKobzarev/174/base 2025-12-04T08:53:09.1569993Z * [new branch] gh/IvanKobzarev/174/head -> origin/gh/IvanKobzarev/174/head 2025-12-04T08:53:09.1570199Z * [new branch] gh/IvanKobzarev/174/orig -> origin/gh/IvanKobzarev/174/orig 2025-12-04T08:53:09.1570407Z * [new branch] gh/IvanKobzarev/175/base -> origin/gh/IvanKobzarev/175/base 2025-12-04T08:53:09.1570611Z * [new branch] gh/IvanKobzarev/175/head -> origin/gh/IvanKobzarev/175/head 2025-12-04T08:53:09.1570821Z * [new branch] gh/IvanKobzarev/175/orig -> origin/gh/IvanKobzarev/175/orig 2025-12-04T08:53:09.1571026Z * [new branch] gh/IvanKobzarev/176/base -> origin/gh/IvanKobzarev/176/base 2025-12-04T08:53:09.1571230Z * [new branch] gh/IvanKobzarev/176/head -> origin/gh/IvanKobzarev/176/head 2025-12-04T08:53:09.1571435Z * [new branch] gh/IvanKobzarev/176/orig -> origin/gh/IvanKobzarev/176/orig 2025-12-04T08:53:09.1571640Z * [new branch] gh/IvanKobzarev/177/base -> origin/gh/IvanKobzarev/177/base 2025-12-04T08:53:09.1571840Z * [new branch] gh/IvanKobzarev/177/head -> origin/gh/IvanKobzarev/177/head 2025-12-04T08:53:09.1572045Z * [new branch] gh/IvanKobzarev/177/orig -> origin/gh/IvanKobzarev/177/orig 2025-12-04T08:53:09.1572254Z * [new branch] gh/IvanKobzarev/178/base -> origin/gh/IvanKobzarev/178/base 2025-12-04T08:53:09.1572458Z * [new branch] gh/IvanKobzarev/178/head -> origin/gh/IvanKobzarev/178/head 2025-12-04T08:53:09.1572666Z * [new branch] gh/IvanKobzarev/178/orig -> origin/gh/IvanKobzarev/178/orig 2025-12-04T08:53:09.1572870Z * [new branch] gh/IvanKobzarev/179/base -> origin/gh/IvanKobzarev/179/base 2025-12-04T08:53:09.1573122Z * [new branch] gh/IvanKobzarev/179/head -> origin/gh/IvanKobzarev/179/head 2025-12-04T08:53:09.1573325Z * [new branch] gh/IvanKobzarev/179/orig -> origin/gh/IvanKobzarev/179/orig 2025-12-04T08:53:09.1573525Z * [new branch] gh/IvanKobzarev/180/base -> origin/gh/IvanKobzarev/180/base 2025-12-04T08:53:09.1573728Z * [new branch] gh/IvanKobzarev/180/head -> origin/gh/IvanKobzarev/180/head 2025-12-04T08:53:09.1573937Z * [new branch] gh/IvanKobzarev/180/orig -> origin/gh/IvanKobzarev/180/orig 2025-12-04T08:53:09.1574139Z * [new branch] gh/IvanKobzarev/181/base -> origin/gh/IvanKobzarev/181/base 2025-12-04T08:53:09.1574343Z * [new branch] gh/IvanKobzarev/181/head -> origin/gh/IvanKobzarev/181/head 2025-12-04T08:53:09.1574556Z * [new branch] gh/IvanKobzarev/181/orig -> origin/gh/IvanKobzarev/181/orig 2025-12-04T08:53:09.1574756Z * [new branch] gh/IvanKobzarev/182/base -> origin/gh/IvanKobzarev/182/base 2025-12-04T08:53:09.1574959Z * [new branch] gh/IvanKobzarev/182/head -> origin/gh/IvanKobzarev/182/head 2025-12-04T08:53:09.1575164Z * [new branch] gh/IvanKobzarev/182/orig -> origin/gh/IvanKobzarev/182/orig 2025-12-04T08:53:09.1575369Z * [new branch] gh/IvanKobzarev/183/base -> origin/gh/IvanKobzarev/183/base 2025-12-04T08:53:09.1575573Z * [new branch] gh/IvanKobzarev/183/head -> origin/gh/IvanKobzarev/183/head 2025-12-04T08:53:09.1575779Z * [new branch] gh/IvanKobzarev/183/orig -> origin/gh/IvanKobzarev/183/orig 2025-12-04T08:53:09.1576022Z * [new branch] gh/IvanKobzarev/184/base -> origin/gh/IvanKobzarev/184/base 2025-12-04T08:53:09.1576273Z * [new branch] gh/IvanKobzarev/184/head -> origin/gh/IvanKobzarev/184/head 2025-12-04T08:53:09.1576478Z * [new branch] gh/IvanKobzarev/184/orig -> origin/gh/IvanKobzarev/184/orig 2025-12-04T08:53:09.1576684Z * [new branch] gh/NikhilAPatel/1/base -> origin/gh/NikhilAPatel/1/base 2025-12-04T08:53:09.1576891Z * [new branch] gh/NikhilAPatel/1/head -> origin/gh/NikhilAPatel/1/head 2025-12-04T08:53:09.1577096Z * [new branch] gh/NikhilAPatel/2/base -> origin/gh/NikhilAPatel/2/base 2025-12-04T08:53:09.1577295Z * [new branch] gh/NikhilAPatel/2/head -> origin/gh/NikhilAPatel/2/head 2025-12-04T08:53:09.1577499Z * [new branch] gh/NikhilAPatel/4/base -> origin/gh/NikhilAPatel/4/base 2025-12-04T08:53:09.1577703Z * [new branch] gh/NikhilAPatel/4/head -> origin/gh/NikhilAPatel/4/head 2025-12-04T08:53:09.1577905Z * [new branch] gh/NikhilAPatel/5/base -> origin/gh/NikhilAPatel/5/base 2025-12-04T08:53:09.1578109Z * [new branch] gh/NikhilAPatel/5/head -> origin/gh/NikhilAPatel/5/head 2025-12-04T08:53:09.1578308Z * [new branch] gh/NikhilAPatel/5/orig -> origin/gh/NikhilAPatel/5/orig 2025-12-04T08:53:09.1578502Z * [new branch] gh/PaliC/17/base -> origin/gh/PaliC/17/base 2025-12-04T08:53:09.1578688Z * [new branch] gh/PaliC/17/head -> origin/gh/PaliC/17/head 2025-12-04T08:53:09.1578867Z * [new branch] gh/PaliC/17/orig -> origin/gh/PaliC/17/orig 2025-12-04T08:53:09.1579052Z * [new branch] gh/PaliC/18/base -> origin/gh/PaliC/18/base 2025-12-04T08:53:09.1579233Z * [new branch] gh/PaliC/18/head -> origin/gh/PaliC/18/head 2025-12-04T08:53:09.1579417Z * [new branch] gh/PaliC/18/orig -> origin/gh/PaliC/18/orig 2025-12-04T08:53:09.1579597Z * [new branch] gh/PaliC/20/base -> origin/gh/PaliC/20/base 2025-12-04T08:53:09.1579782Z * [new branch] gh/PaliC/20/head -> origin/gh/PaliC/20/head 2025-12-04T08:53:09.1579956Z * [new branch] gh/PaliC/20/orig -> origin/gh/PaliC/20/orig 2025-12-04T08:53:09.1580138Z * [new branch] gh/PaliC/21/base -> origin/gh/PaliC/21/base 2025-12-04T08:53:09.1580316Z * [new branch] gh/PaliC/21/head -> origin/gh/PaliC/21/head 2025-12-04T08:53:09.1580492Z * [new branch] gh/PaliC/21/orig -> origin/gh/PaliC/21/orig 2025-12-04T08:53:09.1580670Z * [new branch] gh/PaliC/23/base -> origin/gh/PaliC/23/base 2025-12-04T08:53:09.1580849Z * [new branch] gh/PaliC/23/head -> origin/gh/PaliC/23/head 2025-12-04T08:53:09.1581028Z * [new branch] gh/PaliC/23/orig -> origin/gh/PaliC/23/orig 2025-12-04T08:53:09.1581207Z * [new branch] gh/PaliC/24/base -> origin/gh/PaliC/24/base 2025-12-04T08:53:09.1581388Z * [new branch] gh/PaliC/24/head -> origin/gh/PaliC/24/head 2025-12-04T08:53:09.1581567Z * [new branch] gh/PaliC/24/orig -> origin/gh/PaliC/24/orig 2025-12-04T08:53:09.1581755Z * [new branch] gh/PaliC/25/head -> origin/gh/PaliC/25/head 2025-12-04T08:53:09.1581933Z * [new branch] gh/PaliC/25/next -> origin/gh/PaliC/25/next 2025-12-04T08:53:09.1582108Z * [new branch] gh/PaliC/25/orig -> origin/gh/PaliC/25/orig 2025-12-04T08:53:09.1582285Z * [new branch] gh/PaliC/26/head -> origin/gh/PaliC/26/head 2025-12-04T08:53:09.1582458Z * [new branch] gh/PaliC/26/next -> origin/gh/PaliC/26/next 2025-12-04T08:53:09.1582640Z * [new branch] gh/PaliC/26/orig -> origin/gh/PaliC/26/orig 2025-12-04T08:53:09.1582845Z * [new branch] gh/PaliC/27/next -> origin/gh/PaliC/27/next 2025-12-04T08:53:09.1583103Z * [new branch] gh/PaliC/28/head -> origin/gh/PaliC/28/head 2025-12-04T08:53:09.1583282Z * [new branch] gh/PaliC/28/next -> origin/gh/PaliC/28/next 2025-12-04T08:53:09.1583455Z * [new branch] gh/PaliC/28/orig -> origin/gh/PaliC/28/orig 2025-12-04T08:53:09.1583625Z * [new branch] gh/PaliC/29/head -> origin/gh/PaliC/29/head 2025-12-04T08:53:09.1583801Z * [new branch] gh/PaliC/29/next -> origin/gh/PaliC/29/next 2025-12-04T08:53:09.1583976Z * [new branch] gh/PaliC/29/orig -> origin/gh/PaliC/29/orig 2025-12-04T08:53:09.1584153Z * [new branch] gh/PaliC/30/head -> origin/gh/PaliC/30/head 2025-12-04T08:53:09.1584325Z * [new branch] gh/PaliC/30/next -> origin/gh/PaliC/30/next 2025-12-04T08:53:09.1584503Z * [new branch] gh/PaliC/30/orig -> origin/gh/PaliC/30/orig 2025-12-04T08:53:09.1584675Z * [new branch] gh/PaliC/31/head -> origin/gh/PaliC/31/head 2025-12-04T08:53:09.1584851Z * [new branch] gh/PaliC/31/next -> origin/gh/PaliC/31/next 2025-12-04T08:53:09.1585028Z * [new branch] gh/PaliC/31/orig -> origin/gh/PaliC/31/orig 2025-12-04T08:53:09.1585212Z * [new branch] gh/PaulZhang12/25/base -> origin/gh/PaulZhang12/25/base 2025-12-04T08:53:09.1585408Z * [new branch] gh/PaulZhang12/25/head -> origin/gh/PaulZhang12/25/head 2025-12-04T08:53:09.1585600Z * [new branch] gh/PaulZhang12/25/orig -> origin/gh/PaulZhang12/25/orig 2025-12-04T08:53:09.1585794Z * [new branch] gh/PaulZhang12/28/base -> origin/gh/PaulZhang12/28/base 2025-12-04T08:53:09.1585984Z * [new branch] gh/PaulZhang12/28/head -> origin/gh/PaulZhang12/28/head 2025-12-04T08:53:09.1586175Z * [new branch] gh/PaulZhang12/28/orig -> origin/gh/PaulZhang12/28/orig 2025-12-04T08:53:09.1586365Z * [new branch] gh/PaulZhang12/31/base -> origin/gh/PaulZhang12/31/base 2025-12-04T08:53:09.1586561Z * [new branch] gh/PaulZhang12/31/head -> origin/gh/PaulZhang12/31/head 2025-12-04T08:53:09.1586748Z * [new branch] gh/PaulZhang12/31/orig -> origin/gh/PaulZhang12/31/orig 2025-12-04T08:53:09.1586939Z * [new branch] gh/PaulZhang12/37/base -> origin/gh/PaulZhang12/37/base 2025-12-04T08:53:09.1587135Z * [new branch] gh/PaulZhang12/37/head -> origin/gh/PaulZhang12/37/head 2025-12-04T08:53:09.1587328Z * [new branch] gh/PaulZhang12/37/orig -> origin/gh/PaulZhang12/37/orig 2025-12-04T08:53:09.1587518Z * [new branch] gh/PaulZhang12/40/base -> origin/gh/PaulZhang12/40/base 2025-12-04T08:53:09.1587708Z * [new branch] gh/PaulZhang12/40/head -> origin/gh/PaulZhang12/40/head 2025-12-04T08:53:09.1587898Z * [new branch] gh/PaulZhang12/40/orig -> origin/gh/PaulZhang12/40/orig 2025-12-04T08:53:09.1588095Z * [new branch] gh/PaulZhang12/42/base -> origin/gh/PaulZhang12/42/base 2025-12-04T08:53:09.1588286Z * [new branch] gh/PaulZhang12/42/head -> origin/gh/PaulZhang12/42/head 2025-12-04T08:53:09.1588474Z * [new branch] gh/PaulZhang12/43/base -> origin/gh/PaulZhang12/43/base 2025-12-04T08:53:09.1588663Z * [new branch] gh/PaulZhang12/43/head -> origin/gh/PaulZhang12/43/head 2025-12-04T08:53:09.1588858Z * [new branch] gh/PaulZhang12/43/orig -> origin/gh/PaulZhang12/43/orig 2025-12-04T08:53:09.1589047Z * [new branch] gh/PaulZhang12/44/base -> origin/gh/PaulZhang12/44/base 2025-12-04T08:53:09.1589235Z * [new branch] gh/PaulZhang12/44/head -> origin/gh/PaulZhang12/44/head 2025-12-04T08:53:09.1589424Z * [new branch] gh/PaulZhang12/45/base -> origin/gh/PaulZhang12/45/base 2025-12-04T08:53:09.1589657Z * [new branch] gh/PaulZhang12/45/head -> origin/gh/PaulZhang12/45/head 2025-12-04T08:53:09.1589877Z * [new branch] gh/PaulZhang12/45/orig -> origin/gh/PaulZhang12/45/orig 2025-12-04T08:53:09.1590067Z * [new branch] gh/PaulZhang12/46/base -> origin/gh/PaulZhang12/46/base 2025-12-04T08:53:09.1590256Z * [new branch] gh/PaulZhang12/46/head -> origin/gh/PaulZhang12/46/head 2025-12-04T08:53:09.1590453Z * [new branch] gh/PaulZhang12/46/orig -> origin/gh/PaulZhang12/46/orig 2025-12-04T08:53:09.1590643Z * [new branch] gh/PaulZhang12/47/base -> origin/gh/PaulZhang12/47/base 2025-12-04T08:53:09.1590834Z * [new branch] gh/PaulZhang12/47/head -> origin/gh/PaulZhang12/47/head 2025-12-04T08:53:09.1591025Z * [new branch] gh/PaulZhang12/47/orig -> origin/gh/PaulZhang12/47/orig 2025-12-04T08:53:09.1591217Z * [new branch] gh/PaulZhang12/48/base -> origin/gh/PaulZhang12/48/base 2025-12-04T08:53:09.1591411Z * [new branch] gh/PaulZhang12/48/head -> origin/gh/PaulZhang12/48/head 2025-12-04T08:53:09.1591608Z * [new branch] gh/PaulZhang12/48/orig -> origin/gh/PaulZhang12/48/orig 2025-12-04T08:53:09.1591796Z * [new branch] gh/SamGinzburg/11/base -> origin/gh/SamGinzburg/11/base 2025-12-04T08:53:09.1591994Z * [new branch] gh/SamGinzburg/11/head -> origin/gh/SamGinzburg/11/head 2025-12-04T08:53:09.1592202Z * [new branch] gh/SherlockNoMad/1/base -> origin/gh/SherlockNoMad/1/base 2025-12-04T08:53:09.1592406Z * [new branch] gh/SherlockNoMad/1/head -> origin/gh/SherlockNoMad/1/head 2025-12-04T08:53:09.1592615Z * [new branch] gh/SherlockNoMad/10/base -> origin/gh/SherlockNoMad/10/base 2025-12-04T08:53:09.1592832Z * [new branch] gh/SherlockNoMad/10/head -> origin/gh/SherlockNoMad/10/head 2025-12-04T08:53:09.1593105Z * [new branch] gh/SherlockNoMad/10/orig -> origin/gh/SherlockNoMad/10/orig 2025-12-04T08:53:09.1593316Z * [new branch] gh/SherlockNoMad/11/base -> origin/gh/SherlockNoMad/11/base 2025-12-04T08:53:09.1593524Z * [new branch] gh/SherlockNoMad/11/head -> origin/gh/SherlockNoMad/11/head 2025-12-04T08:53:09.1593729Z * [new branch] gh/SherlockNoMad/11/orig -> origin/gh/SherlockNoMad/11/orig 2025-12-04T08:53:09.1593937Z * [new branch] gh/SherlockNoMad/12/base -> origin/gh/SherlockNoMad/12/base 2025-12-04T08:53:09.1594144Z * [new branch] gh/SherlockNoMad/12/head -> origin/gh/SherlockNoMad/12/head 2025-12-04T08:53:09.1594346Z * [new branch] gh/SherlockNoMad/12/orig -> origin/gh/SherlockNoMad/12/orig 2025-12-04T08:53:09.1594558Z * [new branch] gh/SherlockNoMad/15/base -> origin/gh/SherlockNoMad/15/base 2025-12-04T08:53:09.1594764Z * [new branch] gh/SherlockNoMad/15/head -> origin/gh/SherlockNoMad/15/head 2025-12-04T08:53:09.1594967Z * [new branch] gh/SherlockNoMad/15/orig -> origin/gh/SherlockNoMad/15/orig 2025-12-04T08:53:09.1595175Z * [new branch] gh/SherlockNoMad/17/base -> origin/gh/SherlockNoMad/17/base 2025-12-04T08:53:09.1595384Z * [new branch] gh/SherlockNoMad/17/head -> origin/gh/SherlockNoMad/17/head 2025-12-04T08:53:09.1595585Z * [new branch] gh/SherlockNoMad/17/orig -> origin/gh/SherlockNoMad/17/orig 2025-12-04T08:53:09.1595793Z * [new branch] gh/SherlockNoMad/18/base -> origin/gh/SherlockNoMad/18/base 2025-12-04T08:53:09.1596001Z * [new branch] gh/SherlockNoMad/18/head -> origin/gh/SherlockNoMad/18/head 2025-12-04T08:53:09.1596203Z * [new branch] gh/SherlockNoMad/18/orig -> origin/gh/SherlockNoMad/18/orig 2025-12-04T08:53:09.1596415Z * [new branch] gh/SherlockNoMad/19/base -> origin/gh/SherlockNoMad/19/base 2025-12-04T08:53:09.1596658Z * [new branch] gh/SherlockNoMad/19/head -> origin/gh/SherlockNoMad/19/head 2025-12-04T08:53:09.1596892Z * [new branch] gh/SherlockNoMad/19/orig -> origin/gh/SherlockNoMad/19/orig 2025-12-04T08:53:09.1597099Z * [new branch] gh/SherlockNoMad/2/base -> origin/gh/SherlockNoMad/2/base 2025-12-04T08:53:09.1597306Z * [new branch] gh/SherlockNoMad/2/head -> origin/gh/SherlockNoMad/2/head 2025-12-04T08:53:09.1597507Z * [new branch] gh/SherlockNoMad/20/base -> origin/gh/SherlockNoMad/20/base 2025-12-04T08:53:09.1597715Z * [new branch] gh/SherlockNoMad/20/head -> origin/gh/SherlockNoMad/20/head 2025-12-04T08:53:09.1597920Z * [new branch] gh/SherlockNoMad/20/orig -> origin/gh/SherlockNoMad/20/orig 2025-12-04T08:53:09.1598125Z * [new branch] gh/SherlockNoMad/21/base -> origin/gh/SherlockNoMad/21/base 2025-12-04T08:53:09.1598334Z * [new branch] gh/SherlockNoMad/21/head -> origin/gh/SherlockNoMad/21/head 2025-12-04T08:53:09.1598541Z * [new branch] gh/SherlockNoMad/21/orig -> origin/gh/SherlockNoMad/21/orig 2025-12-04T08:53:09.1598867Z * [new branch] gh/SherlockNoMad/3/base -> origin/gh/SherlockNoMad/3/base 2025-12-04T08:53:09.1599124Z * [new branch] gh/SherlockNoMad/3/head -> origin/gh/SherlockNoMad/3/head 2025-12-04T08:53:09.1619546Z * [new branch] gh/SherlockNoMad/4/base -> origin/gh/SherlockNoMad/4/base 2025-12-04T08:53:09.1619887Z * [new branch] gh/SherlockNoMad/4/head -> origin/gh/SherlockNoMad/4/head 2025-12-04T08:53:09.1620102Z * [new branch] gh/SherlockNoMad/5/base -> origin/gh/SherlockNoMad/5/base 2025-12-04T08:53:09.1620314Z * [new branch] gh/SherlockNoMad/5/head -> origin/gh/SherlockNoMad/5/head 2025-12-04T08:53:09.1620555Z * [new branch] gh/Sidharth123-cpu/24/base -> origin/gh/Sidharth123-cpu/24/base 2025-12-04T08:53:09.1620819Z * [new branch] gh/Sidharth123-cpu/25/base -> origin/gh/Sidharth123-cpu/25/base 2025-12-04T08:53:09.1621079Z * [new branch] gh/Sidharth123-cpu/26/base -> origin/gh/Sidharth123-cpu/26/base 2025-12-04T08:53:09.1621341Z * [new branch] gh/Sidharth123-cpu/27/base -> origin/gh/Sidharth123-cpu/27/base 2025-12-04T08:53:09.1621600Z * [new branch] gh/StrongerXi/1/base -> origin/gh/StrongerXi/1/base 2025-12-04T08:53:09.1621798Z * [new branch] gh/StrongerXi/1/head -> origin/gh/StrongerXi/1/head 2025-12-04T08:53:09.1622007Z * [new branch] gh/StrongerXi/71/base -> origin/gh/StrongerXi/71/base 2025-12-04T08:53:09.1622211Z * [new branch] gh/StrongerXi/71/head -> origin/gh/StrongerXi/71/head 2025-12-04T08:53:09.1622420Z * [new branch] gh/StrongerXi/72/base -> origin/gh/StrongerXi/72/base 2025-12-04T08:53:09.1622628Z * [new branch] gh/StrongerXi/72/head -> origin/gh/StrongerXi/72/head 2025-12-04T08:53:09.1622828Z * [new branch] gh/StrongerXi/73/base -> origin/gh/StrongerXi/73/base 2025-12-04T08:53:09.1623130Z * [new branch] gh/StrongerXi/73/head -> origin/gh/StrongerXi/73/head 2025-12-04T08:53:09.1623330Z * [new branch] gh/StrongerXi/73/orig -> origin/gh/StrongerXi/73/orig 2025-12-04T08:53:09.1623522Z * [new branch] gh/XilunWu/160/base -> origin/gh/XilunWu/160/base 2025-12-04T08:53:09.1623718Z * [new branch] gh/XilunWu/160/head -> origin/gh/XilunWu/160/head 2025-12-04T08:53:09.1623911Z * [new branch] gh/XilunWu/160/orig -> origin/gh/XilunWu/160/orig 2025-12-04T08:53:09.1624097Z * [new branch] gh/XilunWu/163/base -> origin/gh/XilunWu/163/base 2025-12-04T08:53:09.1624287Z * [new branch] gh/XilunWu/163/head -> origin/gh/XilunWu/163/head 2025-12-04T08:53:09.1624481Z * [new branch] gh/XilunWu/163/orig -> origin/gh/XilunWu/163/orig 2025-12-04T08:53:09.1624746Z * [new branch] gh/XilunWu/168/base -> origin/gh/XilunWu/168/base 2025-12-04T08:53:09.1624958Z * [new branch] gh/XilunWu/168/head -> origin/gh/XilunWu/168/head 2025-12-04T08:53:09.1625139Z * [new branch] gh/XilunWu/168/orig -> origin/gh/XilunWu/168/orig 2025-12-04T08:53:09.1625315Z * [new branch] gh/XilunWu/169/base -> origin/gh/XilunWu/169/base 2025-12-04T08:53:09.1625500Z * [new branch] gh/XilunWu/169/head -> origin/gh/XilunWu/169/head 2025-12-04T08:53:09.1625684Z * [new branch] gh/XilunWu/169/orig -> origin/gh/XilunWu/169/orig 2025-12-04T08:53:09.1625860Z * [new branch] gh/XilunWu/170/base -> origin/gh/XilunWu/170/base 2025-12-04T08:53:09.1626034Z * [new branch] gh/XilunWu/170/head -> origin/gh/XilunWu/170/head 2025-12-04T08:53:09.1626210Z * [new branch] gh/XilunWu/170/orig -> origin/gh/XilunWu/170/orig 2025-12-04T08:53:09.1626388Z * [new branch] gh/XilunWu/171/base -> origin/gh/XilunWu/171/base 2025-12-04T08:53:09.1626566Z * [new branch] gh/XilunWu/171/head -> origin/gh/XilunWu/171/head 2025-12-04T08:53:09.1626742Z * [new branch] gh/XilunWu/171/orig -> origin/gh/XilunWu/171/orig 2025-12-04T08:53:09.1626917Z * [new branch] gh/XilunWu/173/base -> origin/gh/XilunWu/173/base 2025-12-04T08:53:09.1627091Z * [new branch] gh/XilunWu/173/head -> origin/gh/XilunWu/173/head 2025-12-04T08:53:09.1627266Z * [new branch] gh/XilunWu/173/orig -> origin/gh/XilunWu/173/orig 2025-12-04T08:53:09.1627447Z * [new branch] gh/XilunWu/175/base -> origin/gh/XilunWu/175/base 2025-12-04T08:53:09.1627622Z * [new branch] gh/XilunWu/175/head -> origin/gh/XilunWu/175/head 2025-12-04T08:53:09.1627797Z * [new branch] gh/XilunWu/175/orig -> origin/gh/XilunWu/175/orig 2025-12-04T08:53:09.1627976Z * [new branch] gh/XilunWu/176/base -> origin/gh/XilunWu/176/base 2025-12-04T08:53:09.1628160Z * [new branch] gh/XilunWu/176/head -> origin/gh/XilunWu/176/head 2025-12-04T08:53:09.1628345Z * [new branch] gh/XilunWu/176/orig -> origin/gh/XilunWu/176/orig 2025-12-04T08:53:09.1628525Z * [new branch] gh/XuehaiPan/14/base -> origin/gh/XuehaiPan/14/base 2025-12-04T08:53:09.1628710Z * [new branch] gh/XuehaiPan/14/head -> origin/gh/XuehaiPan/14/head 2025-12-04T08:53:09.1628901Z * [new branch] gh/XuehaiPan/14/orig -> origin/gh/XuehaiPan/14/orig 2025-12-04T08:53:09.1629083Z * [new branch] gh/XuehaiPan/179/base -> origin/gh/XuehaiPan/179/base 2025-12-04T08:53:09.1629269Z * [new branch] gh/XuehaiPan/179/head -> origin/gh/XuehaiPan/179/head 2025-12-04T08:53:09.1629455Z * [new branch] gh/XuehaiPan/179/orig -> origin/gh/XuehaiPan/179/orig 2025-12-04T08:53:09.1629640Z * [new branch] gh/XuehaiPan/249/base -> origin/gh/XuehaiPan/249/base 2025-12-04T08:53:09.1629826Z * [new branch] gh/XuehaiPan/249/head -> origin/gh/XuehaiPan/249/head 2025-12-04T08:53:09.1630010Z * [new branch] gh/XuehaiPan/249/orig -> origin/gh/XuehaiPan/249/orig 2025-12-04T08:53:09.1630192Z * [new branch] gh/XuehaiPan/253/base -> origin/gh/XuehaiPan/253/base 2025-12-04T08:53:09.1630379Z * [new branch] gh/XuehaiPan/253/head -> origin/gh/XuehaiPan/253/head 2025-12-04T08:53:09.1630567Z * [new branch] gh/XuehaiPan/253/orig -> origin/gh/XuehaiPan/253/orig 2025-12-04T08:53:09.1630754Z * [new branch] gh/XuehaiPan/254/base -> origin/gh/XuehaiPan/254/base 2025-12-04T08:53:09.1630943Z * [new branch] gh/XuehaiPan/254/head -> origin/gh/XuehaiPan/254/head 2025-12-04T08:53:09.1631127Z * [new branch] gh/XuehaiPan/254/orig -> origin/gh/XuehaiPan/254/orig 2025-12-04T08:53:09.1631352Z * [new branch] gh/XuehaiPan/255/base -> origin/gh/XuehaiPan/255/base 2025-12-04T08:53:09.1631574Z * [new branch] gh/XuehaiPan/255/head -> origin/gh/XuehaiPan/255/head 2025-12-04T08:53:09.1631769Z * [new branch] gh/XuehaiPan/255/orig -> origin/gh/XuehaiPan/255/orig 2025-12-04T08:53:09.1631958Z * [new branch] gh/XuehaiPan/271/base -> origin/gh/XuehaiPan/271/base 2025-12-04T08:53:09.1632154Z * [new branch] gh/XuehaiPan/271/head -> origin/gh/XuehaiPan/271/head 2025-12-04T08:53:09.1632348Z * [new branch] gh/XuehaiPan/271/orig -> origin/gh/XuehaiPan/271/orig 2025-12-04T08:53:09.1632538Z * [new branch] gh/XuehaiPan/343/base -> origin/gh/XuehaiPan/343/base 2025-12-04T08:53:09.1632732Z * [new branch] gh/XuehaiPan/343/head -> origin/gh/XuehaiPan/343/head 2025-12-04T08:53:09.1632984Z * [new branch] gh/XuehaiPan/343/orig -> origin/gh/XuehaiPan/343/orig 2025-12-04T08:53:09.1633176Z * [new branch] gh/XuehaiPan/347/base -> origin/gh/XuehaiPan/347/base 2025-12-04T08:53:09.1633373Z * [new branch] gh/XuehaiPan/347/head -> origin/gh/XuehaiPan/347/head 2025-12-04T08:53:09.1633562Z * [new branch] gh/XuehaiPan/347/orig -> origin/gh/XuehaiPan/347/orig 2025-12-04T08:53:09.1633757Z * [new branch] gh/XuehaiPan/348/base -> origin/gh/XuehaiPan/348/base 2025-12-04T08:53:09.1633951Z * [new branch] gh/XuehaiPan/348/head -> origin/gh/XuehaiPan/348/head 2025-12-04T08:53:09.1634140Z * [new branch] gh/XuehaiPan/348/orig -> origin/gh/XuehaiPan/348/orig 2025-12-04T08:53:09.1634333Z * [new branch] gh/XuehaiPan/350/base -> origin/gh/XuehaiPan/350/base 2025-12-04T08:53:09.1634526Z * [new branch] gh/XuehaiPan/350/head -> origin/gh/XuehaiPan/350/head 2025-12-04T08:53:09.1634721Z * [new branch] gh/XuehaiPan/350/orig -> origin/gh/XuehaiPan/350/orig 2025-12-04T08:53:09.1634913Z * [new branch] gh/XuehaiPan/365/base -> origin/gh/XuehaiPan/365/base 2025-12-04T08:53:09.1635110Z * [new branch] gh/XuehaiPan/365/head -> origin/gh/XuehaiPan/365/head 2025-12-04T08:53:09.1635300Z * [new branch] gh/XuehaiPan/365/orig -> origin/gh/XuehaiPan/365/orig 2025-12-04T08:53:09.1635494Z * [new branch] gh/XuehaiPan/366/base -> origin/gh/XuehaiPan/366/base 2025-12-04T08:53:09.1635688Z * [new branch] gh/XuehaiPan/366/head -> origin/gh/XuehaiPan/366/head 2025-12-04T08:53:09.1635877Z * [new branch] gh/XuehaiPan/370/base -> origin/gh/XuehaiPan/370/base 2025-12-04T08:53:09.1636071Z * [new branch] gh/XuehaiPan/370/head -> origin/gh/XuehaiPan/370/head 2025-12-04T08:53:09.1636265Z * [new branch] gh/XuehaiPan/370/orig -> origin/gh/XuehaiPan/370/orig 2025-12-04T08:53:09.1636460Z * [new branch] gh/XuehaiPan/390/base -> origin/gh/XuehaiPan/390/base 2025-12-04T08:53:09.1636657Z * [new branch] gh/XuehaiPan/390/head -> origin/gh/XuehaiPan/390/head 2025-12-04T08:53:09.1636852Z * [new branch] gh/XuehaiPan/390/orig -> origin/gh/XuehaiPan/390/orig 2025-12-04T08:53:09.1637041Z * [new branch] gh/XuehaiPan/391/base -> origin/gh/XuehaiPan/391/base 2025-12-04T08:53:09.1637237Z * [new branch] gh/XuehaiPan/391/head -> origin/gh/XuehaiPan/391/head 2025-12-04T08:53:09.1637430Z * [new branch] gh/XuehaiPan/391/orig -> origin/gh/XuehaiPan/391/orig 2025-12-04T08:53:09.1637619Z * [new branch] gh/XuehaiPan/392/base -> origin/gh/XuehaiPan/392/base 2025-12-04T08:53:09.1637813Z * [new branch] gh/XuehaiPan/392/head -> origin/gh/XuehaiPan/392/head 2025-12-04T08:53:09.1638003Z * [new branch] gh/XuehaiPan/392/orig -> origin/gh/XuehaiPan/392/orig 2025-12-04T08:53:09.1638237Z * [new branch] gh/XuehaiPan/394/base -> origin/gh/XuehaiPan/394/base 2025-12-04T08:53:09.1638468Z * [new branch] gh/XuehaiPan/394/head -> origin/gh/XuehaiPan/394/head 2025-12-04T08:53:09.1638659Z * [new branch] gh/XuehaiPan/394/orig -> origin/gh/XuehaiPan/394/orig 2025-12-04T08:53:09.1638853Z * [new branch] gh/XuehaiPan/397/base -> origin/gh/XuehaiPan/397/base 2025-12-04T08:53:09.1639047Z * [new branch] gh/XuehaiPan/397/head -> origin/gh/XuehaiPan/397/head 2025-12-04T08:53:09.1639236Z * [new branch] gh/XuehaiPan/397/orig -> origin/gh/XuehaiPan/397/orig 2025-12-04T08:53:09.1639428Z * [new branch] gh/XuehaiPan/398/base -> origin/gh/XuehaiPan/398/base 2025-12-04T08:53:09.1639618Z * [new branch] gh/XuehaiPan/398/head -> origin/gh/XuehaiPan/398/head 2025-12-04T08:53:09.1639806Z * [new branch] gh/XuehaiPan/398/orig -> origin/gh/XuehaiPan/398/orig 2025-12-04T08:53:09.1640000Z * [new branch] gh/XuehaiPan/399/base -> origin/gh/XuehaiPan/399/base 2025-12-04T08:53:09.1640196Z * [new branch] gh/XuehaiPan/399/head -> origin/gh/XuehaiPan/399/head 2025-12-04T08:53:09.1640384Z * [new branch] gh/XuehaiPan/399/orig -> origin/gh/XuehaiPan/399/orig 2025-12-04T08:53:09.1640575Z * [new branch] gh/XuehaiPan/400/base -> origin/gh/XuehaiPan/400/base 2025-12-04T08:53:09.1640769Z * [new branch] gh/XuehaiPan/400/head -> origin/gh/XuehaiPan/400/head 2025-12-04T08:53:09.1640957Z * [new branch] gh/XuehaiPan/400/orig -> origin/gh/XuehaiPan/400/orig 2025-12-04T08:53:09.1641156Z * [new branch] gh/ZhiweiYan-96/39/base -> origin/gh/ZhiweiYan-96/39/base 2025-12-04T08:53:09.1641358Z * [new branch] gh/ZhiweiYan-96/39/head -> origin/gh/ZhiweiYan-96/39/head 2025-12-04T08:53:09.1641553Z * [new branch] gh/ZhiweiYan-96/39/orig -> origin/gh/ZhiweiYan-96/39/orig 2025-12-04T08:53:09.1641749Z * [new branch] gh/ZhiweiYan-96/44/base -> origin/gh/ZhiweiYan-96/44/base 2025-12-04T08:53:09.1641949Z * [new branch] gh/ZhiweiYan-96/44/head -> origin/gh/ZhiweiYan-96/44/head 2025-12-04T08:53:09.1642139Z * [new branch] gh/ZhiweiYan-96/45/base -> origin/gh/ZhiweiYan-96/45/base 2025-12-04T08:53:09.1642334Z * [new branch] gh/ZhiweiYan-96/45/head -> origin/gh/ZhiweiYan-96/45/head 2025-12-04T08:53:09.1642525Z * [new branch] gh/ZhiweiYan-96/49/base -> origin/gh/ZhiweiYan-96/49/base 2025-12-04T08:53:09.1642719Z * [new branch] gh/ZhiweiYan-96/49/head -> origin/gh/ZhiweiYan-96/49/head 2025-12-04T08:53:09.1642915Z * [new branch] gh/ZhiweiYan-96/62/base -> origin/gh/ZhiweiYan-96/62/base 2025-12-04T08:53:09.1643151Z * [new branch] gh/ZhiweiYan-96/62/head -> origin/gh/ZhiweiYan-96/62/head 2025-12-04T08:53:09.1643347Z * [new branch] gh/ZhiweiYan-96/66/base -> origin/gh/ZhiweiYan-96/66/base 2025-12-04T08:53:09.1643544Z * [new branch] gh/ZhiweiYan-96/66/head -> origin/gh/ZhiweiYan-96/66/head 2025-12-04T08:53:09.1643733Z * [new branch] gh/ZhiweiYan-96/67/base -> origin/gh/ZhiweiYan-96/67/base 2025-12-04T08:53:09.1643929Z * [new branch] gh/ZhiweiYan-96/67/head -> origin/gh/ZhiweiYan-96/67/head 2025-12-04T08:53:09.1644125Z * [new branch] gh/ZhiweiYan-96/68/base -> origin/gh/ZhiweiYan-96/68/base 2025-12-04T08:53:09.1644319Z * [new branch] gh/ZhiweiYan-96/68/head -> origin/gh/ZhiweiYan-96/68/head 2025-12-04T08:53:09.1644515Z * [new branch] gh/ZhiweiYan-96/68/orig -> origin/gh/ZhiweiYan-96/68/orig 2025-12-04T08:53:09.1644708Z * [new branch] gh/aakhundov/1/base -> origin/gh/aakhundov/1/base 2025-12-04T08:53:09.1644895Z * [new branch] gh/aakhundov/1/head -> origin/gh/aakhundov/1/head 2025-12-04T08:53:09.1645124Z * [new branch] gh/aakhundov/2/base -> origin/gh/aakhundov/2/base 2025-12-04T08:53:09.1645353Z * [new branch] gh/aakhundov/2/head -> origin/gh/aakhundov/2/head 2025-12-04T08:53:09.1645544Z * [new branch] gh/aditew01/openblas -> origin/gh/aditew01/openblas 2025-12-04T08:53:09.1645741Z * [new branch] gh/aditew01/sbgemm -> origin/gh/aditew01/sbgemm 2025-12-04T08:53:09.1645931Z * [new branch] gh/aditew01/vecbf16 -> origin/gh/aditew01/vecbf16 2025-12-04T08:53:09.1646115Z * [new branch] gh/albanD/4/base -> origin/gh/albanD/4/base 2025-12-04T08:53:09.1646298Z * [new branch] gh/albanD/4/head -> origin/gh/albanD/4/head 2025-12-04T08:53:09.1646479Z * [new branch] gh/albanD/4/orig -> origin/gh/albanD/4/orig 2025-12-04T08:53:09.1646747Z * [new branch] gh/alexbrauckmann/paddedtensor_faketensor_init -> origin/gh/alexbrauckmann/paddedtensor_faketensor_init 2025-12-04T08:53:09.1647034Z * [new branch] gh/alexsamardzic/12/base -> origin/gh/alexsamardzic/12/base 2025-12-04T08:53:09.1647248Z * [new branch] gh/alexsamardzic/12/head -> origin/gh/alexsamardzic/12/head 2025-12-04T08:53:09.1647452Z * [new branch] gh/alexsamardzic/12/orig -> origin/gh/alexsamardzic/12/orig 2025-12-04T08:53:09.1647661Z * [new branch] gh/alexsamardzic/14/base -> origin/gh/alexsamardzic/14/base 2025-12-04T08:53:09.1647863Z * [new branch] gh/alexsamardzic/14/head -> origin/gh/alexsamardzic/14/head 2025-12-04T08:53:09.1648067Z * [new branch] gh/alexsamardzic/14/orig -> origin/gh/alexsamardzic/14/orig 2025-12-04T08:53:09.1648271Z * [new branch] gh/alexsamardzic/15/base -> origin/gh/alexsamardzic/15/base 2025-12-04T08:53:09.1648471Z * [new branch] gh/alexsamardzic/15/head -> origin/gh/alexsamardzic/15/head 2025-12-04T08:53:09.1648677Z * [new branch] gh/alexsamardzic/15/orig -> origin/gh/alexsamardzic/15/orig 2025-12-04T08:53:09.1648876Z * [new branch] gh/amjames/18/base -> origin/gh/amjames/18/base 2025-12-04T08:53:09.1649059Z * [new branch] gh/amjames/18/head -> origin/gh/amjames/18/head 2025-12-04T08:53:09.1649244Z * [new branch] gh/amjames/18/orig -> origin/gh/amjames/18/orig 2025-12-04T08:53:09.1649436Z * [new branch] gh/andrewor14/35/base -> origin/gh/andrewor14/35/base 2025-12-04T08:53:09.1649625Z * [new branch] gh/andrewor14/35/head -> origin/gh/andrewor14/35/head 2025-12-04T08:53:09.1649817Z * [new branch] gh/andrewor14/35/orig -> origin/gh/andrewor14/35/orig 2025-12-04T08:53:09.1650007Z * [new branch] gh/andrewor14/50/base -> origin/gh/andrewor14/50/base 2025-12-04T08:53:09.1650193Z * [new branch] gh/andrewor14/50/head -> origin/gh/andrewor14/50/head 2025-12-04T08:53:09.1650386Z * [new branch] gh/andrewor14/50/orig -> origin/gh/andrewor14/50/orig 2025-12-04T08:53:09.1650579Z * [new branch] gh/andyanwang/30/base -> origin/gh/andyanwang/30/base 2025-12-04T08:53:09.1650766Z * [new branch] gh/andyanwang/30/orig -> origin/gh/andyanwang/30/orig 2025-12-04T08:53:09.1650956Z * [new branch] gh/andyanwang/31/base -> origin/gh/andyanwang/31/base 2025-12-04T08:53:09.1651150Z * [new branch] gh/andyanwang/31/orig -> origin/gh/andyanwang/31/orig 2025-12-04T08:53:09.1651339Z * [new branch] gh/andyanwang/39/base -> origin/gh/andyanwang/39/base 2025-12-04T08:53:09.1651532Z * [new branch] gh/andyanwang/39/head -> origin/gh/andyanwang/39/head 2025-12-04T08:53:09.1651724Z * [new branch] gh/andyanwang/39/orig -> origin/gh/andyanwang/39/orig 2025-12-04T08:53:09.1651913Z * [new branch] gh/andyanwang/42/base -> origin/gh/andyanwang/42/base 2025-12-04T08:53:09.1652137Z * [new branch] gh/andyanwang/42/head -> origin/gh/andyanwang/42/head 2025-12-04T08:53:09.1652348Z * [new branch] gh/andyanwang/42/orig -> origin/gh/andyanwang/42/orig 2025-12-04T08:53:09.1652543Z * [new branch] gh/andyanwang/45/base -> origin/gh/andyanwang/45/base 2025-12-04T08:53:09.1652735Z * [new branch] gh/andyanwang/45/head -> origin/gh/andyanwang/45/head 2025-12-04T08:53:09.1652925Z * [new branch] gh/andyanwang/45/orig -> origin/gh/andyanwang/45/orig 2025-12-04T08:53:09.1653163Z * [new branch] gh/angelayi/107/base -> origin/gh/angelayi/107/base 2025-12-04T08:53:09.1653355Z * [new branch] gh/angelayi/107/head -> origin/gh/angelayi/107/head 2025-12-04T08:53:09.1653543Z * [new branch] gh/angelayi/114/base -> origin/gh/angelayi/114/base 2025-12-04T08:53:09.1653733Z * [new branch] gh/angelayi/114/head -> origin/gh/angelayi/114/head 2025-12-04T08:53:09.1653923Z * [new branch] gh/angelayi/114/orig -> origin/gh/angelayi/114/orig 2025-12-04T08:53:09.1654111Z * [new branch] gh/angelayi/116/base -> origin/gh/angelayi/116/base 2025-12-04T08:53:09.1654299Z * [new branch] gh/angelayi/116/head -> origin/gh/angelayi/116/head 2025-12-04T08:53:09.1654487Z * [new branch] gh/angelayi/116/orig -> origin/gh/angelayi/116/orig 2025-12-04T08:53:09.1654671Z * [new branch] gh/angelayi/122/base -> origin/gh/angelayi/122/base 2025-12-04T08:53:09.1654858Z * [new branch] gh/angelayi/122/head -> origin/gh/angelayi/122/head 2025-12-04T08:53:09.1655039Z * [new branch] gh/angelayi/122/orig -> origin/gh/angelayi/122/orig 2025-12-04T08:53:09.1655218Z * [new branch] gh/angelayi/124/base -> origin/gh/angelayi/124/base 2025-12-04T08:53:09.1655412Z * [new branch] gh/angelayi/124/head -> origin/gh/angelayi/124/head 2025-12-04T08:53:09.1655600Z * [new branch] gh/angelayi/124/orig -> origin/gh/angelayi/124/orig 2025-12-04T08:53:09.1655788Z * [new branch] gh/angelayi/128/base -> origin/gh/angelayi/128/base 2025-12-04T08:53:09.1655978Z * [new branch] gh/angelayi/128/head -> origin/gh/angelayi/128/head 2025-12-04T08:53:09.1656168Z * [new branch] gh/angelayi/128/orig -> origin/gh/angelayi/128/orig 2025-12-04T08:53:09.1656352Z * [new branch] gh/angelayi/131/base -> origin/gh/angelayi/131/base 2025-12-04T08:53:09.1656540Z * [new branch] gh/angelayi/131/head -> origin/gh/angelayi/131/head 2025-12-04T08:53:09.1656727Z * [new branch] gh/angelayi/131/orig -> origin/gh/angelayi/131/orig 2025-12-04T08:53:09.1656915Z * [new branch] gh/angelayi/132/base -> origin/gh/angelayi/132/base 2025-12-04T08:53:09.1657105Z * [new branch] gh/angelayi/132/head -> origin/gh/angelayi/132/head 2025-12-04T08:53:09.1657292Z * [new branch] gh/angelayi/132/orig -> origin/gh/angelayi/132/orig 2025-12-04T08:53:09.1657480Z * [new branch] gh/angelayi/133/base -> origin/gh/angelayi/133/base 2025-12-04T08:53:09.1657669Z * [new branch] gh/angelayi/133/head -> origin/gh/angelayi/133/head 2025-12-04T08:53:09.1657855Z * [new branch] gh/angelayi/133/orig -> origin/gh/angelayi/133/orig 2025-12-04T08:53:09.1658043Z * [new branch] gh/angelayi/134/base -> origin/gh/angelayi/134/base 2025-12-04T08:53:09.1658230Z * [new branch] gh/angelayi/134/head -> origin/gh/angelayi/134/head 2025-12-04T08:53:09.1658411Z * [new branch] gh/angelayi/134/orig -> origin/gh/angelayi/134/orig 2025-12-04T08:53:09.1658598Z * [new branch] gh/angelayi/135/base -> origin/gh/angelayi/135/base 2025-12-04T08:53:09.1658841Z * [new branch] gh/angelayi/135/head -> origin/gh/angelayi/135/head 2025-12-04T08:53:09.1659023Z * [new branch] gh/angelayi/135/orig -> origin/gh/angelayi/135/orig 2025-12-04T08:53:09.1659256Z * [new branch] gh/angelayi/136/base -> origin/gh/angelayi/136/base 2025-12-04T08:53:09.1659441Z * [new branch] gh/angelayi/136/head -> origin/gh/angelayi/136/head 2025-12-04T08:53:09.1659622Z * [new branch] gh/angelayi/136/orig -> origin/gh/angelayi/136/orig 2025-12-04T08:53:09.1659810Z * [new branch] gh/angelayi/137/base -> origin/gh/angelayi/137/base 2025-12-04T08:53:09.1659995Z * [new branch] gh/angelayi/137/head -> origin/gh/angelayi/137/head 2025-12-04T08:53:09.1660178Z * [new branch] gh/angelayi/137/orig -> origin/gh/angelayi/137/orig 2025-12-04T08:53:09.1660365Z * [new branch] gh/angelayi/138/base -> origin/gh/angelayi/138/base 2025-12-04T08:53:09.1660551Z * [new branch] gh/angelayi/138/head -> origin/gh/angelayi/138/head 2025-12-04T08:53:09.1660734Z * [new branch] gh/angelayi/138/orig -> origin/gh/angelayi/138/orig 2025-12-04T08:53:09.1660923Z * [new branch] gh/angelayi/139/base -> origin/gh/angelayi/139/base 2025-12-04T08:53:09.1661105Z * [new branch] gh/angelayi/139/head -> origin/gh/angelayi/139/head 2025-12-04T08:53:09.1661292Z * [new branch] gh/angelayi/139/orig -> origin/gh/angelayi/139/orig 2025-12-04T08:53:09.1661477Z * [new branch] gh/angelayi/140/base -> origin/gh/angelayi/140/base 2025-12-04T08:53:09.1661664Z * [new branch] gh/angelayi/140/head -> origin/gh/angelayi/140/head 2025-12-04T08:53:09.1661850Z * [new branch] gh/angelayi/140/orig -> origin/gh/angelayi/140/orig 2025-12-04T08:53:09.1662038Z * [new branch] gh/angelayi/141/base -> origin/gh/angelayi/141/base 2025-12-04T08:53:09.1662223Z * [new branch] gh/angelayi/141/head -> origin/gh/angelayi/141/head 2025-12-04T08:53:09.1662410Z * [new branch] gh/angelayi/141/orig -> origin/gh/angelayi/141/orig 2025-12-04T08:53:09.1662598Z * [new branch] gh/angelayi/142/base -> origin/gh/angelayi/142/base 2025-12-04T08:53:09.1662779Z * [new branch] gh/angelayi/142/head -> origin/gh/angelayi/142/head 2025-12-04T08:53:09.1663003Z * [new branch] gh/angelayi/142/orig -> origin/gh/angelayi/142/orig 2025-12-04T08:53:09.1663192Z * [new branch] gh/angelayi/143/base -> origin/gh/angelayi/143/base 2025-12-04T08:53:09.1663378Z * [new branch] gh/angelayi/143/head -> origin/gh/angelayi/143/head 2025-12-04T08:53:09.1663565Z * [new branch] gh/angelayi/143/orig -> origin/gh/angelayi/143/orig 2025-12-04T08:53:09.1663840Z * [new branch] gh/angelayi/144/base -> origin/gh/angelayi/144/base 2025-12-04T08:53:09.1664027Z * [new branch] gh/angelayi/144/head -> origin/gh/angelayi/144/head 2025-12-04T08:53:09.1664213Z * [new branch] gh/angelayi/144/orig -> origin/gh/angelayi/144/orig 2025-12-04T08:53:09.1664407Z * [new branch] gh/anijain2305/753/base -> origin/gh/anijain2305/753/base 2025-12-04T08:53:09.1664599Z * [new branch] gh/anijain2305/753/head -> origin/gh/anijain2305/753/head 2025-12-04T08:53:09.1664794Z * [new branch] gh/anijain2305/753/orig -> origin/gh/anijain2305/753/orig 2025-12-04T08:53:09.1664989Z * [new branch] gh/anijain2305/810/base -> origin/gh/anijain2305/810/base 2025-12-04T08:53:09.1665178Z * [new branch] gh/anijain2305/810/head -> origin/gh/anijain2305/810/head 2025-12-04T08:53:09.1665368Z * [new branch] gh/anijain2305/810/orig -> origin/gh/anijain2305/810/orig 2025-12-04T08:53:09.1665560Z * [new branch] gh/anijain2305/854/base -> origin/gh/anijain2305/854/base 2025-12-04T08:53:09.1665803Z * [new branch] gh/anijain2305/854/head -> origin/gh/anijain2305/854/head 2025-12-04T08:53:09.1666034Z * [new branch] gh/anijain2305/854/orig -> origin/gh/anijain2305/854/orig 2025-12-04T08:53:09.1666228Z * [new branch] gh/anijain2305/864/base -> origin/gh/anijain2305/864/base 2025-12-04T08:53:09.1666414Z * [new branch] gh/anijain2305/864/head -> origin/gh/anijain2305/864/head 2025-12-04T08:53:09.1666603Z * [new branch] gh/anijain2305/864/orig -> origin/gh/anijain2305/864/orig 2025-12-04T08:53:09.1666790Z * [new branch] gh/anijain2305/870/base -> origin/gh/anijain2305/870/base 2025-12-04T08:53:09.1666979Z * [new branch] gh/anijain2305/870/head -> origin/gh/anijain2305/870/head 2025-12-04T08:53:09.1667170Z * [new branch] gh/anijain2305/870/orig -> origin/gh/anijain2305/870/orig 2025-12-04T08:53:09.1667361Z * [new branch] gh/anijain2305/873/base -> origin/gh/anijain2305/873/base 2025-12-04T08:53:09.1667554Z * [new branch] gh/anijain2305/873/head -> origin/gh/anijain2305/873/head 2025-12-04T08:53:09.1667747Z * [new branch] gh/anijain2305/873/orig -> origin/gh/anijain2305/873/orig 2025-12-04T08:53:09.1667935Z * [new branch] gh/anijain2305/894/base -> origin/gh/anijain2305/894/base 2025-12-04T08:53:09.1668127Z * [new branch] gh/anijain2305/894/head -> origin/gh/anijain2305/894/head 2025-12-04T08:53:09.1668321Z * [new branch] gh/anijain2305/894/orig -> origin/gh/anijain2305/894/orig 2025-12-04T08:53:09.1668507Z * [new branch] gh/anijain2305/895/base -> origin/gh/anijain2305/895/base 2025-12-04T08:53:09.1668698Z * [new branch] gh/anijain2305/895/head -> origin/gh/anijain2305/895/head 2025-12-04T08:53:09.1668893Z * [new branch] gh/anijain2305/895/orig -> origin/gh/anijain2305/895/orig 2025-12-04T08:53:09.1669085Z * [new branch] gh/anijain2305/910/base -> origin/gh/anijain2305/910/base 2025-12-04T08:53:09.1669279Z * [new branch] gh/anijain2305/910/head -> origin/gh/anijain2305/910/head 2025-12-04T08:53:09.1669470Z * [new branch] gh/anijain2305/910/orig -> origin/gh/anijain2305/910/orig 2025-12-04T08:53:09.1669659Z * [new branch] gh/anijain2305/919/base -> origin/gh/anijain2305/919/base 2025-12-04T08:53:09.1669850Z * [new branch] gh/anijain2305/919/head -> origin/gh/anijain2305/919/head 2025-12-04T08:53:09.1670042Z * [new branch] gh/anijain2305/919/orig -> origin/gh/anijain2305/919/orig 2025-12-04T08:53:09.1670232Z * [new branch] gh/anijain2305/922/base -> origin/gh/anijain2305/922/base 2025-12-04T08:53:09.1670424Z * [new branch] gh/anijain2305/922/head -> origin/gh/anijain2305/922/head 2025-12-04T08:53:09.1670613Z * [new branch] gh/anijain2305/922/orig -> origin/gh/anijain2305/922/orig 2025-12-04T08:53:09.1670801Z * [new branch] gh/anijain2305/932/base -> origin/gh/anijain2305/932/base 2025-12-04T08:53:09.1670992Z * [new branch] gh/anijain2305/932/head -> origin/gh/anijain2305/932/head 2025-12-04T08:53:09.1671182Z * [new branch] gh/anijain2305/932/orig -> origin/gh/anijain2305/932/orig 2025-12-04T08:53:09.1671370Z * [new branch] gh/anijain2305/940/base -> origin/gh/anijain2305/940/base 2025-12-04T08:53:09.1671561Z * [new branch] gh/anijain2305/940/head -> origin/gh/anijain2305/940/head 2025-12-04T08:53:09.1671747Z * [new branch] gh/anijain2305/940/orig -> origin/gh/anijain2305/940/orig 2025-12-04T08:53:09.1671937Z * [new branch] gh/anijain2305/941/base -> origin/gh/anijain2305/941/base 2025-12-04T08:53:09.1672127Z * [new branch] gh/anijain2305/941/head -> origin/gh/anijain2305/941/head 2025-12-04T08:53:09.1672355Z * [new branch] gh/anijain2305/941/orig -> origin/gh/anijain2305/941/orig 2025-12-04T08:53:09.1672542Z * [new branch] gh/anijain2305/942/base -> origin/gh/anijain2305/942/base 2025-12-04T08:53:09.1672759Z * [new branch] gh/anijain2305/942/head -> origin/gh/anijain2305/942/head 2025-12-04T08:53:09.1672980Z * [new branch] gh/anijain2305/942/orig -> origin/gh/anijain2305/942/orig 2025-12-04T08:53:09.1673174Z * [new branch] gh/anijain2305/943/base -> origin/gh/anijain2305/943/base 2025-12-04T08:53:09.1673364Z * [new branch] gh/anijain2305/943/head -> origin/gh/anijain2305/943/head 2025-12-04T08:53:09.1673552Z * [new branch] gh/anijain2305/943/orig -> origin/gh/anijain2305/943/orig 2025-12-04T08:53:09.1673742Z * [new branch] gh/anijain2305/944/base -> origin/gh/anijain2305/944/base 2025-12-04T08:53:09.1673937Z * [new branch] gh/anijain2305/944/head -> origin/gh/anijain2305/944/head 2025-12-04T08:53:09.1674128Z * [new branch] gh/anijain2305/944/orig -> origin/gh/anijain2305/944/orig 2025-12-04T08:53:09.1674322Z * [new branch] gh/anijain2305/945/base -> origin/gh/anijain2305/945/base 2025-12-04T08:53:09.1674515Z * [new branch] gh/anijain2305/945/head -> origin/gh/anijain2305/945/head 2025-12-04T08:53:09.1674702Z * [new branch] gh/anijain2305/945/orig -> origin/gh/anijain2305/945/orig 2025-12-04T08:53:09.1674893Z * [new branch] gh/anijain2305/946/base -> origin/gh/anijain2305/946/base 2025-12-04T08:53:09.1675083Z * [new branch] gh/anijain2305/946/head -> origin/gh/anijain2305/946/head 2025-12-04T08:53:09.1675270Z * [new branch] gh/anijain2305/946/orig -> origin/gh/anijain2305/946/orig 2025-12-04T08:53:09.1675461Z * [new branch] gh/anijain2305/947/base -> origin/gh/anijain2305/947/base 2025-12-04T08:53:09.1675652Z * [new branch] gh/anijain2305/947/head -> origin/gh/anijain2305/947/head 2025-12-04T08:53:09.1675841Z * [new branch] gh/anijain2305/947/orig -> origin/gh/anijain2305/947/orig 2025-12-04T08:53:09.1676033Z * [new branch] gh/anijain2305/948/base -> origin/gh/anijain2305/948/base 2025-12-04T08:53:09.1676221Z * [new branch] gh/anijain2305/948/head -> origin/gh/anijain2305/948/head 2025-12-04T08:53:09.1676412Z * [new branch] gh/anijain2305/948/orig -> origin/gh/anijain2305/948/orig 2025-12-04T08:53:09.1676601Z * [new branch] gh/anijain2305/949/base -> origin/gh/anijain2305/949/base 2025-12-04T08:53:09.1676788Z * [new branch] gh/anijain2305/949/head -> origin/gh/anijain2305/949/head 2025-12-04T08:53:09.1676979Z * [new branch] gh/anijain2305/949/orig -> origin/gh/anijain2305/949/orig 2025-12-04T08:53:09.1677171Z * [new branch] gh/anijain2305/950/base -> origin/gh/anijain2305/950/base 2025-12-04T08:53:09.1677357Z * [new branch] gh/anijain2305/950/head -> origin/gh/anijain2305/950/head 2025-12-04T08:53:09.1677551Z * [new branch] gh/anijain2305/950/orig -> origin/gh/anijain2305/950/orig 2025-12-04T08:53:09.1677742Z * [new branch] gh/anijain2305/951/base -> origin/gh/anijain2305/951/base 2025-12-04T08:53:09.1677930Z * [new branch] gh/anijain2305/951/head -> origin/gh/anijain2305/951/head 2025-12-04T08:53:09.1678120Z * [new branch] gh/anijain2305/951/orig -> origin/gh/anijain2305/951/orig 2025-12-04T08:53:09.1678309Z * [new branch] gh/anijain2305/952/base -> origin/gh/anijain2305/952/base 2025-12-04T08:53:09.1678496Z * [new branch] gh/anijain2305/952/head -> origin/gh/anijain2305/952/head 2025-12-04T08:53:09.1678687Z * [new branch] gh/anijain2305/952/orig -> origin/gh/anijain2305/952/orig 2025-12-04T08:53:09.1678880Z * [new branch] gh/anijain2305/953/base -> origin/gh/anijain2305/953/base 2025-12-04T08:53:09.1679111Z * [new branch] gh/anijain2305/953/head -> origin/gh/anijain2305/953/head 2025-12-04T08:53:09.1679301Z * [new branch] gh/anijain2305/953/orig -> origin/gh/anijain2305/953/orig 2025-12-04T08:53:09.1679531Z * [new branch] gh/anijain2305/954/base -> origin/gh/anijain2305/954/base 2025-12-04T08:53:09.1679723Z * [new branch] gh/anijain2305/954/head -> origin/gh/anijain2305/954/head 2025-12-04T08:53:09.1679914Z * [new branch] gh/anijain2305/954/orig -> origin/gh/anijain2305/954/orig 2025-12-04T08:53:09.1680103Z * [new branch] gh/anijain2305/955/base -> origin/gh/anijain2305/955/base 2025-12-04T08:53:09.1680291Z * [new branch] gh/anijain2305/955/head -> origin/gh/anijain2305/955/head 2025-12-04T08:53:09.1680483Z * [new branch] gh/anijain2305/955/orig -> origin/gh/anijain2305/955/orig 2025-12-04T08:53:09.1680673Z * [new branch] gh/anijain2305/956/base -> origin/gh/anijain2305/956/base 2025-12-04T08:53:09.1680865Z * [new branch] gh/anijain2305/956/head -> origin/gh/anijain2305/956/head 2025-12-04T08:53:09.1681060Z * [new branch] gh/anijain2305/956/orig -> origin/gh/anijain2305/956/orig 2025-12-04T08:53:09.1681249Z * [new branch] gh/anijain2305/957/base -> origin/gh/anijain2305/957/base 2025-12-04T08:53:09.1681443Z * [new branch] gh/anijain2305/957/head -> origin/gh/anijain2305/957/head 2025-12-04T08:53:09.1681633Z * [new branch] gh/anijain2305/957/orig -> origin/gh/anijain2305/957/orig 2025-12-04T08:53:09.1681819Z * [new branch] gh/anijain2305/958/base -> origin/gh/anijain2305/958/base 2025-12-04T08:53:09.1682008Z * [new branch] gh/anijain2305/958/head -> origin/gh/anijain2305/958/head 2025-12-04T08:53:09.1682199Z * [new branch] gh/anijain2305/958/orig -> origin/gh/anijain2305/958/orig 2025-12-04T08:53:09.1682387Z * [new branch] gh/anijain2305/959/base -> origin/gh/anijain2305/959/base 2025-12-04T08:53:09.1682581Z * [new branch] gh/anijain2305/959/head -> origin/gh/anijain2305/959/head 2025-12-04T08:53:09.1682774Z * [new branch] gh/anijain2305/959/orig -> origin/gh/anijain2305/959/orig 2025-12-04T08:53:09.1683011Z * [new branch] gh/anijain2305/960/base -> origin/gh/anijain2305/960/base 2025-12-04T08:53:09.1683204Z * [new branch] gh/anijain2305/960/head -> origin/gh/anijain2305/960/head 2025-12-04T08:53:09.1683396Z * [new branch] gh/anijain2305/960/orig -> origin/gh/anijain2305/960/orig 2025-12-04T08:53:09.1683585Z * [new branch] gh/anijain2305/961/base -> origin/gh/anijain2305/961/base 2025-12-04T08:53:09.1683777Z * [new branch] gh/anijain2305/961/head -> origin/gh/anijain2305/961/head 2025-12-04T08:53:09.1683971Z * [new branch] gh/anijain2305/961/orig -> origin/gh/anijain2305/961/orig 2025-12-04T08:53:09.1684161Z * [new branch] gh/anijain2305/962/base -> origin/gh/anijain2305/962/base 2025-12-04T08:53:09.1684353Z * [new branch] gh/anijain2305/962/head -> origin/gh/anijain2305/962/head 2025-12-04T08:53:09.1684545Z * [new branch] gh/anijain2305/962/orig -> origin/gh/anijain2305/962/orig 2025-12-04T08:53:09.1684735Z * [new branch] gh/anijain2305/963/base -> origin/gh/anijain2305/963/base 2025-12-04T08:53:09.1684931Z * [new branch] gh/anijain2305/963/head -> origin/gh/anijain2305/963/head 2025-12-04T08:53:09.1685118Z * [new branch] gh/anijain2305/963/orig -> origin/gh/anijain2305/963/orig 2025-12-04T08:53:09.1685307Z * [new branch] gh/anijain2305/964/base -> origin/gh/anijain2305/964/base 2025-12-04T08:53:09.1685499Z * [new branch] gh/anijain2305/964/head -> origin/gh/anijain2305/964/head 2025-12-04T08:53:09.1685686Z * [new branch] gh/anijain2305/964/orig -> origin/gh/anijain2305/964/orig 2025-12-04T08:53:09.1685920Z * [new branch] gh/anijain2305/965/base -> origin/gh/anijain2305/965/base 2025-12-04T08:53:09.1686152Z * [new branch] gh/anijain2305/965/head -> origin/gh/anijain2305/965/head 2025-12-04T08:53:09.1686339Z * [new branch] gh/anijain2305/965/orig -> origin/gh/anijain2305/965/orig 2025-12-04T08:53:09.1686528Z * [new branch] gh/anijain2305/966/base -> origin/gh/anijain2305/966/base 2025-12-04T08:53:09.1686721Z * [new branch] gh/anijain2305/966/head -> origin/gh/anijain2305/966/head 2025-12-04T08:53:09.1686909Z * [new branch] gh/anijain2305/966/orig -> origin/gh/anijain2305/966/orig 2025-12-04T08:53:09.1687102Z * [new branch] gh/anijain2305/967/base -> origin/gh/anijain2305/967/base 2025-12-04T08:53:09.1687294Z * [new branch] gh/anijain2305/967/head -> origin/gh/anijain2305/967/head 2025-12-04T08:53:09.1687483Z * [new branch] gh/anijain2305/967/orig -> origin/gh/anijain2305/967/orig 2025-12-04T08:53:09.1687675Z * [new branch] gh/anijain2305/968/base -> origin/gh/anijain2305/968/base 2025-12-04T08:53:09.1687869Z * [new branch] gh/anijain2305/968/head -> origin/gh/anijain2305/968/head 2025-12-04T08:53:09.1688057Z * [new branch] gh/anijain2305/968/orig -> origin/gh/anijain2305/968/orig 2025-12-04T08:53:09.1688245Z * [new branch] gh/anijain2305/969/base -> origin/gh/anijain2305/969/base 2025-12-04T08:53:09.1688434Z * [new branch] gh/anijain2305/969/head -> origin/gh/anijain2305/969/head 2025-12-04T08:53:09.1688622Z * [new branch] gh/anijain2305/969/orig -> origin/gh/anijain2305/969/orig 2025-12-04T08:53:09.1688816Z * [new branch] gh/anijain2305/970/base -> origin/gh/anijain2305/970/base 2025-12-04T08:53:09.1689005Z * [new branch] gh/anijain2305/970/head -> origin/gh/anijain2305/970/head 2025-12-04T08:53:09.1689193Z * [new branch] gh/anijain2305/970/orig -> origin/gh/anijain2305/970/orig 2025-12-04T08:53:09.1689384Z * [new branch] gh/anjali411/216/base -> origin/gh/anjali411/216/base 2025-12-04T08:53:09.1689571Z * [new branch] gh/anjali411/216/head -> origin/gh/anjali411/216/head 2025-12-04T08:53:09.1689759Z * [new branch] gh/anjali411/216/orig -> origin/gh/anjali411/216/orig 2025-12-04T08:53:09.1689944Z * [new branch] gh/anshul-si/1/base -> origin/gh/anshul-si/1/base 2025-12-04T08:53:09.1690126Z * [new branch] gh/anshul-si/1/head -> origin/gh/anshul-si/1/head 2025-12-04T08:53:09.1690307Z * [new branch] gh/anshul-si/2/base -> origin/gh/anshul-si/2/base 2025-12-04T08:53:09.1690489Z * [new branch] gh/anshul-si/2/head -> origin/gh/anshul-si/2/head 2025-12-04T08:53:09.1690666Z * [new branch] gh/anshul-si/3/base -> origin/gh/anshul-si/3/base 2025-12-04T08:53:09.1690850Z * [new branch] gh/anshul-si/3/head -> origin/gh/anshul-si/3/head 2025-12-04T08:53:09.1691035Z * [new branch] gh/anshul-si/4/base -> origin/gh/anshul-si/4/base 2025-12-04T08:53:09.1691216Z * [new branch] gh/anshul-si/4/head -> origin/gh/anshul-si/4/head 2025-12-04T08:53:09.1691399Z * [new branch] gh/anshul-si/5/base -> origin/gh/anshul-si/5/base 2025-12-04T08:53:09.1691578Z * [new branch] gh/anshul-si/5/head -> origin/gh/anshul-si/5/head 2025-12-04T08:53:09.1691760Z * [new branch] gh/anshul-si/53/base -> origin/gh/anshul-si/53/base 2025-12-04T08:53:09.1691949Z * [new branch] gh/anshul-si/53/head -> origin/gh/anshul-si/53/head 2025-12-04T08:53:09.1692143Z * [new branch] gh/anshul-si/58/base -> origin/gh/anshul-si/58/base 2025-12-04T08:53:09.1692323Z * [new branch] gh/anshul-si/58/head -> origin/gh/anshul-si/58/head 2025-12-04T08:53:09.1692537Z * [new branch] gh/anshul-si/66/base -> origin/gh/anshul-si/66/base 2025-12-04T08:53:09.1692755Z * [new branch] gh/anshul-si/66/head -> origin/gh/anshul-si/66/head 2025-12-04T08:53:09.1692981Z * [new branch] gh/anshul-si/66/orig -> origin/gh/anshul-si/66/orig 2025-12-04T08:53:09.1693164Z * [new branch] gh/anshul-si/67/base -> origin/gh/anshul-si/67/base 2025-12-04T08:53:09.1693344Z * [new branch] gh/anshul-si/67/head -> origin/gh/anshul-si/67/head 2025-12-04T08:53:09.1693521Z * [new branch] gh/anshul-si/67/orig -> origin/gh/anshul-si/67/orig 2025-12-04T08:53:09.1693705Z * [new branch] gh/anshul-si/68/base -> origin/gh/anshul-si/68/base 2025-12-04T08:53:09.1693884Z * [new branch] gh/anshul-si/68/head -> origin/gh/anshul-si/68/head 2025-12-04T08:53:09.1694064Z * [new branch] gh/anshul-si/68/orig -> origin/gh/anshul-si/68/orig 2025-12-04T08:53:09.1694247Z * [new branch] gh/anshul-si/69/base -> origin/gh/anshul-si/69/base 2025-12-04T08:53:09.1694426Z * [new branch] gh/anshul-si/69/head -> origin/gh/anshul-si/69/head 2025-12-04T08:53:09.1694613Z * [new branch] gh/anshul-si/69/orig -> origin/gh/anshul-si/69/orig 2025-12-04T08:53:09.1694792Z * [new branch] gh/anshul-si/70/base -> origin/gh/anshul-si/70/base 2025-12-04T08:53:09.1694968Z * [new branch] gh/anshul-si/70/head -> origin/gh/anshul-si/70/head 2025-12-04T08:53:09.1695152Z * [new branch] gh/anshul-si/70/orig -> origin/gh/anshul-si/70/orig 2025-12-04T08:53:09.1695334Z * [new branch] gh/anshul-si/71/base -> origin/gh/anshul-si/71/base 2025-12-04T08:53:09.1695511Z * [new branch] gh/anshul-si/71/head -> origin/gh/anshul-si/71/head 2025-12-04T08:53:09.1695691Z * [new branch] gh/anshul-si/71/orig -> origin/gh/anshul-si/71/orig 2025-12-04T08:53:09.1695879Z * [new branch] gh/anshul-si/72/base -> origin/gh/anshul-si/72/base 2025-12-04T08:53:09.1696064Z * [new branch] gh/anshul-si/72/head -> origin/gh/anshul-si/72/head 2025-12-04T08:53:09.1696246Z * [new branch] gh/anshul-si/72/orig -> origin/gh/anshul-si/72/orig 2025-12-04T08:53:09.1696426Z * [new branch] gh/anshul-si/73/base -> origin/gh/anshul-si/73/base 2025-12-04T08:53:09.1696604Z * [new branch] gh/anshul-si/73/head -> origin/gh/anshul-si/73/head 2025-12-04T08:53:09.1696784Z * [new branch] gh/anshul-si/73/orig -> origin/gh/anshul-si/73/orig 2025-12-04T08:53:09.1696966Z * [new branch] gh/aorenste/132/base -> origin/gh/aorenste/132/base 2025-12-04T08:53:09.1697154Z * [new branch] gh/aorenste/132/head -> origin/gh/aorenste/132/head 2025-12-04T08:53:09.1697335Z * [new branch] gh/aorenste/134/base -> origin/gh/aorenste/134/base 2025-12-04T08:53:09.1697519Z * [new branch] gh/aorenste/134/head -> origin/gh/aorenste/134/head 2025-12-04T08:53:09.1697703Z * [new branch] gh/aorenste/134/orig -> origin/gh/aorenste/134/orig 2025-12-04T08:53:09.1697883Z * [new branch] gh/aorenste/139/base -> origin/gh/aorenste/139/base 2025-12-04T08:53:09.1698061Z * [new branch] gh/aorenste/139/head -> origin/gh/aorenste/139/head 2025-12-04T08:53:09.1698243Z * [new branch] gh/aorenste/139/orig -> origin/gh/aorenste/139/orig 2025-12-04T08:53:09.1698430Z * [new branch] gh/aorenste/141/base -> origin/gh/aorenste/141/base 2025-12-04T08:53:09.1698613Z * [new branch] gh/aorenste/141/head -> origin/gh/aorenste/141/head 2025-12-04T08:53:09.1698795Z * [new branch] gh/aorenste/145/base -> origin/gh/aorenste/145/base 2025-12-04T08:53:09.1698977Z * [new branch] gh/aorenste/145/head -> origin/gh/aorenste/145/head 2025-12-04T08:53:09.1699216Z * [new branch] gh/aorenste/145/orig -> origin/gh/aorenste/145/orig 2025-12-04T08:53:09.1699448Z * [new branch] gh/aorenste/146/base -> origin/gh/aorenste/146/base 2025-12-04T08:53:09.1699631Z * [new branch] gh/aorenste/146/head -> origin/gh/aorenste/146/head 2025-12-04T08:53:09.1699809Z * [new branch] gh/aorenste/146/orig -> origin/gh/aorenste/146/orig 2025-12-04T08:53:09.1699991Z * [new branch] gh/aorenste/147/base -> origin/gh/aorenste/147/base 2025-12-04T08:53:09.1700178Z * [new branch] gh/aorenste/147/head -> origin/gh/aorenste/147/head 2025-12-04T08:53:09.1700362Z * [new branch] gh/aorenste/147/orig -> origin/gh/aorenste/147/orig 2025-12-04T08:53:09.1700544Z * [new branch] gh/aorenste/148/base -> origin/gh/aorenste/148/base 2025-12-04T08:53:09.1700726Z * [new branch] gh/aorenste/148/head -> origin/gh/aorenste/148/head 2025-12-04T08:53:09.1700909Z * [new branch] gh/aorenste/148/orig -> origin/gh/aorenste/148/orig 2025-12-04T08:53:09.1701096Z * [new branch] gh/aorenste/149/base -> origin/gh/aorenste/149/base 2025-12-04T08:53:09.1701283Z * [new branch] gh/aorenste/149/head -> origin/gh/aorenste/149/head 2025-12-04T08:53:09.1701461Z * [new branch] gh/aorenste/149/orig -> origin/gh/aorenste/149/orig 2025-12-04T08:53:09.1701640Z * [new branch] gh/aorenste/150/base -> origin/gh/aorenste/150/base 2025-12-04T08:53:09.1701820Z * [new branch] gh/aorenste/150/head -> origin/gh/aorenste/150/head 2025-12-04T08:53:09.1702009Z * [new branch] gh/aorenste/150/orig -> origin/gh/aorenste/150/orig 2025-12-04T08:53:09.1702189Z * [new branch] gh/aorenste/151/base -> origin/gh/aorenste/151/base 2025-12-04T08:53:09.1702367Z * [new branch] gh/aorenste/151/head -> origin/gh/aorenste/151/head 2025-12-04T08:53:09.1702552Z * [new branch] gh/aorenste/151/orig -> origin/gh/aorenste/151/orig 2025-12-04T08:53:09.1702738Z * [new branch] gh/aorenste/152/base -> origin/gh/aorenste/152/base 2025-12-04T08:53:09.1702917Z * [new branch] gh/aorenste/152/head -> origin/gh/aorenste/152/head 2025-12-04T08:53:09.1703139Z * [new branch] gh/aorenste/152/orig -> origin/gh/aorenste/152/orig 2025-12-04T08:53:09.1703320Z * [new branch] gh/aorenste/153/base -> origin/gh/aorenste/153/base 2025-12-04T08:53:09.1703502Z * [new branch] gh/aorenste/153/head -> origin/gh/aorenste/153/head 2025-12-04T08:53:09.1703687Z * [new branch] gh/aorenste/153/orig -> origin/gh/aorenste/153/orig 2025-12-04T08:53:09.1703873Z * [new branch] gh/aorenste/154/base -> origin/gh/aorenste/154/base 2025-12-04T08:53:09.1704055Z * [new branch] gh/aorenste/154/head -> origin/gh/aorenste/154/head 2025-12-04T08:53:09.1704235Z * [new branch] gh/aorenste/154/orig -> origin/gh/aorenste/154/orig 2025-12-04T08:53:09.1704421Z * [new branch] gh/aorenste/155/base -> origin/gh/aorenste/155/base 2025-12-04T08:53:09.1704603Z * [new branch] gh/aorenste/155/head -> origin/gh/aorenste/155/head 2025-12-04T08:53:09.1704787Z * [new branch] gh/aorenste/155/orig -> origin/gh/aorenste/155/orig 2025-12-04T08:53:09.1704970Z * [new branch] gh/aorenste/156/base -> origin/gh/aorenste/156/base 2025-12-04T08:53:09.1705155Z * [new branch] gh/aorenste/156/head -> origin/gh/aorenste/156/head 2025-12-04T08:53:09.1705340Z * [new branch] gh/aorenste/156/orig -> origin/gh/aorenste/156/orig 2025-12-04T08:53:09.1705522Z * [new branch] gh/aorenste/157/base -> origin/gh/aorenste/157/base 2025-12-04T08:53:09.1705748Z * [new branch] gh/aorenste/157/head -> origin/gh/aorenste/157/head 2025-12-04T08:53:09.1705930Z * [new branch] gh/aorenste/157/orig -> origin/gh/aorenste/157/orig 2025-12-04T08:53:09.1706155Z * [new branch] gh/aorenste/158/base -> origin/gh/aorenste/158/base 2025-12-04T08:53:09.1706338Z * [new branch] gh/aorenste/158/head -> origin/gh/aorenste/158/head 2025-12-04T08:53:09.1706518Z * [new branch] gh/aorenste/158/orig -> origin/gh/aorenste/158/orig 2025-12-04T08:53:09.1706698Z * [new branch] gh/aorenste/159/base -> origin/gh/aorenste/159/base 2025-12-04T08:53:09.1706881Z * [new branch] gh/aorenste/159/head -> origin/gh/aorenste/159/head 2025-12-04T08:53:09.1707071Z * [new branch] gh/aorenste/159/orig -> origin/gh/aorenste/159/orig 2025-12-04T08:53:09.1707262Z * [new branch] gh/avikchaudhuri/1/base -> origin/gh/avikchaudhuri/1/base 2025-12-04T08:53:09.1707459Z * [new branch] gh/avikchaudhuri/1/head -> origin/gh/avikchaudhuri/1/head 2025-12-04T08:53:09.1707655Z * [new branch] gh/avikchaudhuri/2/base -> origin/gh/avikchaudhuri/2/base 2025-12-04T08:53:09.1707851Z * [new branch] gh/avikchaudhuri/2/head -> origin/gh/avikchaudhuri/2/head 2025-12-04T08:53:09.1708040Z * [new branch] gh/avikchaudhuri/2/orig -> origin/gh/avikchaudhuri/2/orig 2025-12-04T08:53:09.1708228Z * [new branch] gh/bdhirsh/666/base -> origin/gh/bdhirsh/666/base 2025-12-04T08:53:09.1708406Z * [new branch] gh/bdhirsh/666/head -> origin/gh/bdhirsh/666/head 2025-12-04T08:53:09.1708587Z * [new branch] gh/bdhirsh/666/orig -> origin/gh/bdhirsh/666/orig 2025-12-04T08:53:09.1708768Z * [new branch] gh/bdhirsh/668/base -> origin/gh/bdhirsh/668/base 2025-12-04T08:53:09.1708946Z * [new branch] gh/bdhirsh/668/head -> origin/gh/bdhirsh/668/head 2025-12-04T08:53:09.1709126Z * [new branch] gh/bdhirsh/668/orig -> origin/gh/bdhirsh/668/orig 2025-12-04T08:53:09.1709308Z * [new branch] gh/bdhirsh/669/base -> origin/gh/bdhirsh/669/base 2025-12-04T08:53:09.1709489Z * [new branch] gh/bdhirsh/669/head -> origin/gh/bdhirsh/669/head 2025-12-04T08:53:09.1709669Z * [new branch] gh/bdhirsh/669/orig -> origin/gh/bdhirsh/669/orig 2025-12-04T08:53:09.1709847Z * [new branch] gh/bdhirsh/670/base -> origin/gh/bdhirsh/670/base 2025-12-04T08:53:09.1710025Z * [new branch] gh/bdhirsh/670/head -> origin/gh/bdhirsh/670/head 2025-12-04T08:53:09.1710210Z * [new branch] gh/bdhirsh/670/orig -> origin/gh/bdhirsh/670/orig 2025-12-04T08:53:09.1710386Z * [new branch] gh/bdhirsh/672/base -> origin/gh/bdhirsh/672/base 2025-12-04T08:53:09.1710568Z * [new branch] gh/bdhirsh/672/head -> origin/gh/bdhirsh/672/head 2025-12-04T08:53:09.1710747Z * [new branch] gh/bdhirsh/672/orig -> origin/gh/bdhirsh/672/orig 2025-12-04T08:53:09.1710927Z * [new branch] gh/bdhirsh/675/base -> origin/gh/bdhirsh/675/base 2025-12-04T08:53:09.1711104Z * [new branch] gh/bdhirsh/675/head -> origin/gh/bdhirsh/675/head 2025-12-04T08:53:09.1711282Z * [new branch] gh/bdhirsh/675/orig -> origin/gh/bdhirsh/675/orig 2025-12-04T08:53:09.1711459Z * [new branch] gh/bdhirsh/676/base -> origin/gh/bdhirsh/676/base 2025-12-04T08:53:09.1711639Z * [new branch] gh/bdhirsh/676/head -> origin/gh/bdhirsh/676/head 2025-12-04T08:53:09.1711816Z * [new branch] gh/bdhirsh/676/orig -> origin/gh/bdhirsh/676/orig 2025-12-04T08:53:09.1711993Z * [new branch] gh/bdhirsh/677/base -> origin/gh/bdhirsh/677/base 2025-12-04T08:53:09.1712171Z * [new branch] gh/bdhirsh/677/head -> origin/gh/bdhirsh/677/head 2025-12-04T08:53:09.1712276Z * [new branch] gh/bdhirsh/677/orig -> origin/gh/bdhirsh/677/orig 2025-12-04T08:53:09.1712386Z * [new branch] gh/bdhirsh/678/base -> origin/gh/bdhirsh/678/base 2025-12-04T08:53:09.1712459Z * [new branch] gh/bdhirsh/678/head -> origin/gh/bdhirsh/678/head 2025-12-04T08:53:09.1712528Z * [new branch] gh/bdhirsh/678/orig -> origin/gh/bdhirsh/678/orig 2025-12-04T08:53:09.1712600Z * [new branch] gh/bdhirsh/679/base -> origin/gh/bdhirsh/679/base 2025-12-04T08:53:09.1712669Z * [new branch] gh/bdhirsh/679/head -> origin/gh/bdhirsh/679/head 2025-12-04T08:53:09.1712738Z * [new branch] gh/bdhirsh/679/orig -> origin/gh/bdhirsh/679/orig 2025-12-04T08:53:09.1712807Z * [new branch] gh/bdhirsh/680/base -> origin/gh/bdhirsh/680/base 2025-12-04T08:53:09.1712879Z * [new branch] gh/bdhirsh/680/head -> origin/gh/bdhirsh/680/head 2025-12-04T08:53:09.1713000Z * [new branch] gh/bdhirsh/680/orig -> origin/gh/bdhirsh/680/orig 2025-12-04T08:53:09.1713078Z * [new branch] gh/bdhirsh/681/base -> origin/gh/bdhirsh/681/base 2025-12-04T08:53:09.1713148Z * [new branch] gh/bdhirsh/681/head -> origin/gh/bdhirsh/681/head 2025-12-04T08:53:09.1713218Z * [new branch] gh/bdhirsh/681/orig -> origin/gh/bdhirsh/681/orig 2025-12-04T08:53:09.1713313Z * [new branch] gh/benjaminglass1/101/base -> origin/gh/benjaminglass1/101/base 2025-12-04T08:53:09.1713401Z * [new branch] gh/benjaminglass1/101/head -> origin/gh/benjaminglass1/101/head 2025-12-04T08:53:09.1713488Z * [new branch] gh/benjaminglass1/101/orig -> origin/gh/benjaminglass1/101/orig 2025-12-04T08:53:09.1713575Z * [new branch] gh/benjaminglass1/102/base -> origin/gh/benjaminglass1/102/base 2025-12-04T08:53:09.1713661Z * [new branch] gh/benjaminglass1/102/head -> origin/gh/benjaminglass1/102/head 2025-12-04T08:53:09.1713754Z * [new branch] gh/benjaminglass1/102/orig -> origin/gh/benjaminglass1/102/orig 2025-12-04T08:53:09.1713844Z * [new branch] gh/benjaminglass1/106/base -> origin/gh/benjaminglass1/106/base 2025-12-04T08:53:09.1713929Z * [new branch] gh/benjaminglass1/106/head -> origin/gh/benjaminglass1/106/head 2025-12-04T08:53:09.1714015Z * [new branch] gh/benjaminglass1/106/orig -> origin/gh/benjaminglass1/106/orig 2025-12-04T08:53:09.1714099Z * [new branch] gh/benjaminglass1/107/base -> origin/gh/benjaminglass1/107/base 2025-12-04T08:53:09.1714184Z * [new branch] gh/benjaminglass1/107/head -> origin/gh/benjaminglass1/107/head 2025-12-04T08:53:09.1714270Z * [new branch] gh/benjaminglass1/107/orig -> origin/gh/benjaminglass1/107/orig 2025-12-04T08:53:09.1714354Z * [new branch] gh/benjaminglass1/108/base -> origin/gh/benjaminglass1/108/base 2025-12-04T08:53:09.1714441Z * [new branch] gh/benjaminglass1/108/head -> origin/gh/benjaminglass1/108/head 2025-12-04T08:53:09.1714532Z * [new branch] gh/benjaminglass1/108/orig -> origin/gh/benjaminglass1/108/orig 2025-12-04T08:53:09.1714620Z * [new branch] gh/benjaminglass1/109/base -> origin/gh/benjaminglass1/109/base 2025-12-04T08:53:09.1714707Z * [new branch] gh/benjaminglass1/109/head -> origin/gh/benjaminglass1/109/head 2025-12-04T08:53:09.1714794Z * [new branch] gh/benjaminglass1/109/orig -> origin/gh/benjaminglass1/109/orig 2025-12-04T08:53:09.1714879Z * [new branch] gh/benjaminglass1/97/base -> origin/gh/benjaminglass1/97/base 2025-12-04T08:53:09.1714963Z * [new branch] gh/benjaminglass1/97/head -> origin/gh/benjaminglass1/97/head 2025-12-04T08:53:09.1715047Z * [new branch] gh/benjaminglass1/97/orig -> origin/gh/benjaminglass1/97/orig 2025-12-04T08:53:09.1715178Z * [new branch] gh/bobrenjc93/570/base -> origin/gh/bobrenjc93/570/base 2025-12-04T08:53:09.1715255Z * [new branch] gh/bobrenjc93/570/head -> origin/gh/bobrenjc93/570/head 2025-12-04T08:53:09.1715373Z * [new branch] gh/bobrenjc93/570/orig -> origin/gh/bobrenjc93/570/orig 2025-12-04T08:53:09.1715447Z * [new branch] gh/bobrenjc93/604/base -> origin/gh/bobrenjc93/604/base 2025-12-04T08:53:09.1715524Z * [new branch] gh/bobrenjc93/604/head -> origin/gh/bobrenjc93/604/head 2025-12-04T08:53:09.1715597Z * [new branch] gh/bobrenjc93/604/orig -> origin/gh/bobrenjc93/604/orig 2025-12-04T08:53:09.1715670Z * [new branch] gh/bobrenjc93/638/base -> origin/gh/bobrenjc93/638/base 2025-12-04T08:53:09.1715744Z * [new branch] gh/bobrenjc93/638/head -> origin/gh/bobrenjc93/638/head 2025-12-04T08:53:09.1715818Z * [new branch] gh/bobrenjc93/638/orig -> origin/gh/bobrenjc93/638/orig 2025-12-04T08:53:09.1715893Z * [new branch] gh/bobrenjc93/653/base -> origin/gh/bobrenjc93/653/base 2025-12-04T08:53:09.1715971Z * [new branch] gh/bobrenjc93/653/head -> origin/gh/bobrenjc93/653/head 2025-12-04T08:53:09.1716044Z * [new branch] gh/bobrenjc93/653/orig -> origin/gh/bobrenjc93/653/orig 2025-12-04T08:53:09.1716115Z * [new branch] gh/bobrenjc93/654/base -> origin/gh/bobrenjc93/654/base 2025-12-04T08:53:09.1716194Z * [new branch] gh/bobrenjc93/654/head -> origin/gh/bobrenjc93/654/head 2025-12-04T08:53:09.1716269Z * [new branch] gh/bobrenjc93/654/orig -> origin/gh/bobrenjc93/654/orig 2025-12-04T08:53:09.1716343Z * [new branch] gh/bobrenjc93/657/base -> origin/gh/bobrenjc93/657/base 2025-12-04T08:53:09.1716417Z * [new branch] gh/bobrenjc93/657/head -> origin/gh/bobrenjc93/657/head 2025-12-04T08:53:09.1716490Z * [new branch] gh/bobrenjc93/657/orig -> origin/gh/bobrenjc93/657/orig 2025-12-04T08:53:09.1716567Z * [new branch] gh/bobrenjc93/672/base -> origin/gh/bobrenjc93/672/base 2025-12-04T08:53:09.1716642Z * [new branch] gh/bobrenjc93/672/head -> origin/gh/bobrenjc93/672/head 2025-12-04T08:53:09.1716714Z * [new branch] gh/bobrenjc93/672/orig -> origin/gh/bobrenjc93/672/orig 2025-12-04T08:53:09.1716790Z * [new branch] gh/bobrenjc93/679/base -> origin/gh/bobrenjc93/679/base 2025-12-04T08:53:09.1716863Z * [new branch] gh/bobrenjc93/679/head -> origin/gh/bobrenjc93/679/head 2025-12-04T08:53:09.1716938Z * [new branch] gh/bobrenjc93/679/orig -> origin/gh/bobrenjc93/679/orig 2025-12-04T08:53:09.1717013Z * [new branch] gh/bobrenjc93/680/base -> origin/gh/bobrenjc93/680/base 2025-12-04T08:53:09.1717086Z * [new branch] gh/bobrenjc93/680/head -> origin/gh/bobrenjc93/680/head 2025-12-04T08:53:09.1717160Z * [new branch] gh/bobrenjc93/680/orig -> origin/gh/bobrenjc93/680/orig 2025-12-04T08:53:09.1717232Z * [new branch] gh/bobrenjc93/681/base -> origin/gh/bobrenjc93/681/base 2025-12-04T08:53:09.1717306Z * [new branch] gh/bobrenjc93/681/head -> origin/gh/bobrenjc93/681/head 2025-12-04T08:53:09.1717378Z * [new branch] gh/bobrenjc93/681/orig -> origin/gh/bobrenjc93/681/orig 2025-12-04T08:53:09.1717453Z * [new branch] gh/bobrenjc93/682/base -> origin/gh/bobrenjc93/682/base 2025-12-04T08:53:09.1717527Z * [new branch] gh/bobrenjc93/682/head -> origin/gh/bobrenjc93/682/head 2025-12-04T08:53:09.1717599Z * [new branch] gh/bobrenjc93/682/orig -> origin/gh/bobrenjc93/682/orig 2025-12-04T08:53:09.1717673Z * [new branch] gh/bobrenjc93/683/base -> origin/gh/bobrenjc93/683/base 2025-12-04T08:53:09.1717746Z * [new branch] gh/bobrenjc93/683/head -> origin/gh/bobrenjc93/683/head 2025-12-04T08:53:09.1717845Z * [new branch] gh/bobrenjc93/683/orig -> origin/gh/bobrenjc93/683/orig 2025-12-04T08:53:09.1717918Z * [new branch] gh/bobrenjc93/684/base -> origin/gh/bobrenjc93/684/base 2025-12-04T08:53:09.1718018Z * [new branch] gh/bobrenjc93/684/head -> origin/gh/bobrenjc93/684/head 2025-12-04T08:53:09.1718092Z * [new branch] gh/bobrenjc93/684/orig -> origin/gh/bobrenjc93/684/orig 2025-12-04T08:53:09.1718164Z * [new branch] gh/bobrenjc93/685/base -> origin/gh/bobrenjc93/685/base 2025-12-04T08:53:09.1718237Z * [new branch] gh/bobrenjc93/685/head -> origin/gh/bobrenjc93/685/head 2025-12-04T08:53:09.1718312Z * [new branch] gh/bobrenjc93/685/orig -> origin/gh/bobrenjc93/685/orig 2025-12-04T08:53:09.1718383Z * [new branch] gh/bobrenjc93/686/base -> origin/gh/bobrenjc93/686/base 2025-12-04T08:53:09.1718455Z * [new branch] gh/bobrenjc93/686/head -> origin/gh/bobrenjc93/686/head 2025-12-04T08:53:09.1718530Z * [new branch] gh/bobrenjc93/686/orig -> origin/gh/bobrenjc93/686/orig 2025-12-04T08:53:09.1718603Z * [new branch] gh/bobrenjc93/687/base -> origin/gh/bobrenjc93/687/base 2025-12-04T08:53:09.1718675Z * [new branch] gh/bobrenjc93/687/head -> origin/gh/bobrenjc93/687/head 2025-12-04T08:53:09.1718747Z * [new branch] gh/bobrenjc93/687/orig -> origin/gh/bobrenjc93/687/orig 2025-12-04T08:53:09.1718819Z * [new branch] gh/bobrenjc93/688/base -> origin/gh/bobrenjc93/688/base 2025-12-04T08:53:09.1718891Z * [new branch] gh/bobrenjc93/688/head -> origin/gh/bobrenjc93/688/head 2025-12-04T08:53:09.1718968Z * [new branch] gh/bobrenjc93/688/orig -> origin/gh/bobrenjc93/688/orig 2025-12-04T08:53:09.1719041Z * [new branch] gh/bobrenjc93/689/base -> origin/gh/bobrenjc93/689/base 2025-12-04T08:53:09.1719114Z * [new branch] gh/bobrenjc93/689/head -> origin/gh/bobrenjc93/689/head 2025-12-04T08:53:09.1719189Z * [new branch] gh/bobrenjc93/689/orig -> origin/gh/bobrenjc93/689/orig 2025-12-04T08:53:09.1719262Z * [new branch] gh/bobrenjc93/690/base -> origin/gh/bobrenjc93/690/base 2025-12-04T08:53:09.1719335Z * [new branch] gh/bobrenjc93/690/head -> origin/gh/bobrenjc93/690/head 2025-12-04T08:53:09.1719409Z * [new branch] gh/bobrenjc93/690/orig -> origin/gh/bobrenjc93/690/orig 2025-12-04T08:53:09.1719482Z * [new branch] gh/bobrenjc93/691/base -> origin/gh/bobrenjc93/691/base 2025-12-04T08:53:09.1719555Z * [new branch] gh/bobrenjc93/691/head -> origin/gh/bobrenjc93/691/head 2025-12-04T08:53:09.1719633Z * [new branch] gh/bobrenjc93/691/orig -> origin/gh/bobrenjc93/691/orig 2025-12-04T08:53:09.1719705Z * [new branch] gh/bobrenjc93/692/base -> origin/gh/bobrenjc93/692/base 2025-12-04T08:53:09.1719781Z * [new branch] gh/bobrenjc93/692/head -> origin/gh/bobrenjc93/692/head 2025-12-04T08:53:09.1719852Z * [new branch] gh/bobrenjc93/692/orig -> origin/gh/bobrenjc93/692/orig 2025-12-04T08:53:09.1719925Z * [new branch] gh/bobrenjc93/693/base -> origin/gh/bobrenjc93/693/base 2025-12-04T08:53:09.1720001Z * [new branch] gh/bobrenjc93/693/head -> origin/gh/bobrenjc93/693/head 2025-12-04T08:53:09.1720073Z * [new branch] gh/bobrenjc93/693/orig -> origin/gh/bobrenjc93/693/orig 2025-12-04T08:53:09.1720145Z * [new branch] gh/bobrenjc93/694/base -> origin/gh/bobrenjc93/694/base 2025-12-04T08:53:09.1720218Z * [new branch] gh/bobrenjc93/694/head -> origin/gh/bobrenjc93/694/head 2025-12-04T08:53:09.1720293Z * [new branch] gh/bobrenjc93/694/orig -> origin/gh/bobrenjc93/694/orig 2025-12-04T08:53:09.1720367Z * [new branch] gh/bobrenjc93/695/base -> origin/gh/bobrenjc93/695/base 2025-12-04T08:53:09.1720466Z * [new branch] gh/bobrenjc93/695/head -> origin/gh/bobrenjc93/695/head 2025-12-04T08:53:09.1720538Z * [new branch] gh/bobrenjc93/695/orig -> origin/gh/bobrenjc93/695/orig 2025-12-04T08:53:09.1720636Z * [new branch] gh/c00w/23/base -> origin/gh/c00w/23/base 2025-12-04T08:53:09.1720705Z * [new branch] gh/c00w/23/head -> origin/gh/c00w/23/head 2025-12-04T08:53:09.1720769Z * [new branch] gh/c00w/53/base -> origin/gh/c00w/53/base 2025-12-04T08:53:09.1720831Z * [new branch] gh/c00w/53/head -> origin/gh/c00w/53/head 2025-12-04T08:53:09.1720899Z * [new branch] gh/c00w/53/orig -> origin/gh/c00w/53/orig 2025-12-04T08:53:09.1720962Z * [new branch] gh/c00w/54/base -> origin/gh/c00w/54/base 2025-12-04T08:53:09.1721025Z * [new branch] gh/c00w/54/head -> origin/gh/c00w/54/head 2025-12-04T08:53:09.1721090Z * [new branch] gh/c00w/54/orig -> origin/gh/c00w/54/orig 2025-12-04T08:53:09.1721153Z * [new branch] gh/c00w/56/base -> origin/gh/c00w/56/base 2025-12-04T08:53:09.1721216Z * [new branch] gh/c00w/56/head -> origin/gh/c00w/56/head 2025-12-04T08:53:09.1721280Z * [new branch] gh/c00w/56/orig -> origin/gh/c00w/56/orig 2025-12-04T08:53:09.1721342Z * [new branch] gh/c00w/57/base -> origin/gh/c00w/57/base 2025-12-04T08:53:09.1721406Z * [new branch] gh/c00w/57/head -> origin/gh/c00w/57/head 2025-12-04T08:53:09.1721467Z * [new branch] gh/c00w/57/orig -> origin/gh/c00w/57/orig 2025-12-04T08:53:09.1721531Z * [new branch] gh/c00w/58/base -> origin/gh/c00w/58/base 2025-12-04T08:53:09.1721596Z * [new branch] gh/c00w/58/head -> origin/gh/c00w/58/head 2025-12-04T08:53:09.1721659Z * [new branch] gh/c00w/58/orig -> origin/gh/c00w/58/orig 2025-12-04T08:53:09.1721732Z * [new branch] gh/clee2000/1/base -> origin/gh/clee2000/1/base 2025-12-04T08:53:09.1721805Z * [new branch] gh/clee2000/1/head -> origin/gh/clee2000/1/head 2025-12-04T08:53:09.1721874Z * [new branch] gh/clee2000/1/orig -> origin/gh/clee2000/1/orig 2025-12-04T08:53:09.1721952Z * [new branch] gh/coconutruben/1/base -> origin/gh/coconutruben/1/base 2025-12-04T08:53:09.1722030Z * [new branch] gh/coconutruben/1/head -> origin/gh/coconutruben/1/head 2025-12-04T08:53:09.1722111Z * [new branch] gh/coconutruben/55/base -> origin/gh/coconutruben/55/base 2025-12-04T08:53:09.1722190Z * [new branch] gh/coconutruben/55/head -> origin/gh/coconutruben/55/head 2025-12-04T08:53:09.1722266Z * [new branch] gh/coconutruben/55/orig -> origin/gh/coconutruben/55/orig 2025-12-04T08:53:09.1722342Z * [new branch] gh/coconutruben/57/base -> origin/gh/coconutruben/57/base 2025-12-04T08:53:09.1722419Z * [new branch] gh/coconutruben/57/head -> origin/gh/coconutruben/57/head 2025-12-04T08:53:09.1722497Z * [new branch] gh/coconutruben/57/orig -> origin/gh/coconutruben/57/orig 2025-12-04T08:53:09.1722572Z * [new branch] gh/coconutruben/70/base -> origin/gh/coconutruben/70/base 2025-12-04T08:53:09.1722647Z * [new branch] gh/coconutruben/70/head -> origin/gh/coconutruben/70/head 2025-12-04T08:53:09.1722726Z * [new branch] gh/coconutruben/70/orig -> origin/gh/coconutruben/70/orig 2025-12-04T08:53:09.1722803Z * [new branch] gh/coconutruben/71/base -> origin/gh/coconutruben/71/base 2025-12-04T08:53:09.1722878Z * [new branch] gh/coconutruben/71/head -> origin/gh/coconutruben/71/head 2025-12-04T08:53:09.1722992Z * [new branch] gh/coconutruben/71/orig -> origin/gh/coconutruben/71/orig 2025-12-04T08:53:09.1723118Z * [new branch] gh/coconutruben/72/base -> origin/gh/coconutruben/72/base 2025-12-04T08:53:09.1723195Z * [new branch] gh/coconutruben/72/head -> origin/gh/coconutruben/72/head 2025-12-04T08:53:09.1723309Z * [new branch] gh/coconutruben/72/orig -> origin/gh/coconutruben/72/orig 2025-12-04T08:53:09.1723385Z * [new branch] gh/coconutruben/73/base -> origin/gh/coconutruben/73/base 2025-12-04T08:53:09.1723465Z * [new branch] gh/coconutruben/73/head -> origin/gh/coconutruben/73/head 2025-12-04T08:53:09.1723542Z * [new branch] gh/coconutruben/73/orig -> origin/gh/coconutruben/73/orig 2025-12-04T08:53:09.1723617Z * [new branch] gh/coconutruben/74/base -> origin/gh/coconutruben/74/base 2025-12-04T08:53:09.1723693Z * [new branch] gh/coconutruben/74/head -> origin/gh/coconutruben/74/head 2025-12-04T08:53:09.1723768Z * [new branch] gh/coconutruben/74/orig -> origin/gh/coconutruben/74/orig 2025-12-04T08:53:09.1723845Z * [new branch] gh/coconutruben/79/base -> origin/gh/coconutruben/79/base 2025-12-04T08:53:09.1723923Z * [new branch] gh/coconutruben/79/head -> origin/gh/coconutruben/79/head 2025-12-04T08:53:09.1723997Z * [new branch] gh/coconutruben/79/orig -> origin/gh/coconutruben/79/orig 2025-12-04T08:53:09.1724073Z * [new branch] gh/coconutruben/80/base -> origin/gh/coconutruben/80/base 2025-12-04T08:53:09.1724149Z * [new branch] gh/coconutruben/80/head -> origin/gh/coconutruben/80/head 2025-12-04T08:53:09.1724224Z * [new branch] gh/coconutruben/80/orig -> origin/gh/coconutruben/80/orig 2025-12-04T08:53:09.1724298Z * [new branch] gh/coconutruben/82/base -> origin/gh/coconutruben/82/base 2025-12-04T08:53:09.1724379Z * [new branch] gh/coconutruben/82/head -> origin/gh/coconutruben/82/head 2025-12-04T08:53:09.1724454Z * [new branch] gh/coconutruben/82/orig -> origin/gh/coconutruben/82/orig 2025-12-04T08:53:09.1724531Z * [new branch] gh/coconutruben/83/base -> origin/gh/coconutruben/83/base 2025-12-04T08:53:09.1724610Z * [new branch] gh/coconutruben/83/head -> origin/gh/coconutruben/83/head 2025-12-04T08:53:09.1724685Z * [new branch] gh/coconutruben/83/orig -> origin/gh/coconutruben/83/orig 2025-12-04T08:53:09.1724760Z * [new branch] gh/coconutruben/84/base -> origin/gh/coconutruben/84/base 2025-12-04T08:53:09.1724835Z * [new branch] gh/coconutruben/84/head -> origin/gh/coconutruben/84/head 2025-12-04T08:53:09.1724913Z * [new branch] gh/coconutruben/84/orig -> origin/gh/coconutruben/84/orig 2025-12-04T08:53:09.1724992Z * [new branch] gh/coconutruben/85/base -> origin/gh/coconutruben/85/base 2025-12-04T08:53:09.1725068Z * [new branch] gh/coconutruben/85/head -> origin/gh/coconutruben/85/head 2025-12-04T08:53:09.1725146Z * [new branch] gh/coconutruben/85/orig -> origin/gh/coconutruben/85/orig 2025-12-04T08:53:09.1725225Z * [new branch] gh/coconutruben/86/base -> origin/gh/coconutruben/86/base 2025-12-04T08:53:09.1725303Z * [new branch] gh/coconutruben/86/head -> origin/gh/coconutruben/86/head 2025-12-04T08:53:09.1725380Z * [new branch] gh/coconutruben/86/orig -> origin/gh/coconutruben/86/orig 2025-12-04T08:53:09.1725461Z * [new branch] gh/colinchan15/1/base -> origin/gh/colinchan15/1/base 2025-12-04T08:53:09.1725537Z * [new branch] gh/colinchan15/1/head -> origin/gh/colinchan15/1/head 2025-12-04T08:53:09.1725611Z * [new branch] gh/colinchan15/2/base -> origin/gh/colinchan15/2/base 2025-12-04T08:53:09.1725690Z * [new branch] gh/colinchan15/2/head -> origin/gh/colinchan15/2/head 2025-12-04T08:53:09.1725763Z * [new branch] gh/colinchan15/3/base -> origin/gh/colinchan15/3/base 2025-12-04T08:53:09.1725863Z * [new branch] gh/colinchan15/3/head -> origin/gh/colinchan15/3/head 2025-12-04T08:53:09.1725981Z * [new branch] gh/colinchan15/6/base -> origin/gh/colinchan15/6/base 2025-12-04T08:53:09.1726055Z * [new branch] gh/colinchan15/6/head -> origin/gh/colinchan15/6/head 2025-12-04T08:53:09.1726123Z * [new branch] gh/d4l3k/1/base -> origin/gh/d4l3k/1/base 2025-12-04T08:53:09.1726189Z * [new branch] gh/d4l3k/1/head -> origin/gh/d4l3k/1/head 2025-12-04T08:53:09.1726253Z * [new branch] gh/d4l3k/2/base -> origin/gh/d4l3k/2/base 2025-12-04T08:53:09.1726319Z * [new branch] gh/d4l3k/2/head -> origin/gh/d4l3k/2/head 2025-12-04T08:53:09.1726384Z * [new branch] gh/d4l3k/2/orig -> origin/gh/d4l3k/2/orig 2025-12-04T08:53:09.1726447Z * [new branch] gh/d4l3k/3/base -> origin/gh/d4l3k/3/base 2025-12-04T08:53:09.1726514Z * [new branch] gh/d4l3k/3/head -> origin/gh/d4l3k/3/head 2025-12-04T08:53:09.1726578Z * [new branch] gh/d4l3k/3/orig -> origin/gh/d4l3k/3/orig 2025-12-04T08:53:09.1726644Z * [new branch] gh/d4l3k/4/base -> origin/gh/d4l3k/4/base 2025-12-04T08:53:09.1726709Z * [new branch] gh/d4l3k/4/head -> origin/gh/d4l3k/4/head 2025-12-04T08:53:09.1726772Z * [new branch] gh/d4l3k/4/orig -> origin/gh/d4l3k/4/orig 2025-12-04T08:53:09.1726836Z * [new branch] gh/d4l3k/5/base -> origin/gh/d4l3k/5/base 2025-12-04T08:53:09.1726903Z * [new branch] gh/d4l3k/5/orig -> origin/gh/d4l3k/5/orig 2025-12-04T08:53:09.1726991Z * [new branch] gh/davidberard98/392/base -> origin/gh/davidberard98/392/base 2025-12-04T08:53:09.1727077Z * [new branch] gh/davidberard98/392/head -> origin/gh/davidberard98/392/head 2025-12-04T08:53:09.1727165Z * [new branch] gh/davidberard98/392/orig -> origin/gh/davidberard98/392/orig 2025-12-04T08:53:09.1727249Z * [new branch] gh/davidberard98/399/base -> origin/gh/davidberard98/399/base 2025-12-04T08:53:09.1727330Z * [new branch] gh/davidberard98/399/head -> origin/gh/davidberard98/399/head 2025-12-04T08:53:09.1727413Z * [new branch] gh/davidberard98/399/orig -> origin/gh/davidberard98/399/orig 2025-12-04T08:53:09.1727490Z * [new branch] gh/desertfire/605/base -> origin/gh/desertfire/605/base 2025-12-04T08:53:09.1727566Z * [new branch] gh/desertfire/605/head -> origin/gh/desertfire/605/head 2025-12-04T08:53:09.1727644Z * [new branch] gh/desertfire/605/orig -> origin/gh/desertfire/605/orig 2025-12-04T08:53:09.1727719Z * [new branch] gh/desertfire/606/base -> origin/gh/desertfire/606/base 2025-12-04T08:53:09.1727793Z * [new branch] gh/desertfire/606/head -> origin/gh/desertfire/606/head 2025-12-04T08:53:09.1727870Z * [new branch] gh/desertfire/606/orig -> origin/gh/desertfire/606/orig 2025-12-04T08:53:09.1727946Z * [new branch] gh/desertfire/607/base -> origin/gh/desertfire/607/base 2025-12-04T08:53:09.1728023Z * [new branch] gh/desertfire/607/head -> origin/gh/desertfire/607/head 2025-12-04T08:53:09.1728099Z * [new branch] gh/desertfire/607/orig -> origin/gh/desertfire/607/orig 2025-12-04T08:53:09.1728173Z * [new branch] gh/desertfire/608/base -> origin/gh/desertfire/608/base 2025-12-04T08:53:09.1728249Z * [new branch] gh/desertfire/608/head -> origin/gh/desertfire/608/head 2025-12-04T08:53:09.1728325Z * [new branch] gh/desertfire/608/orig -> origin/gh/desertfire/608/orig 2025-12-04T08:53:09.1728400Z * [new branch] gh/desertfire/609/base -> origin/gh/desertfire/609/base 2025-12-04T08:53:09.1728478Z * [new branch] gh/desertfire/609/head -> origin/gh/desertfire/609/head 2025-12-04T08:53:09.1728583Z * [new branch] gh/desertfire/609/orig -> origin/gh/desertfire/609/orig 2025-12-04T08:53:09.1728686Z * [new branch] gh/desertfire/610/base -> origin/gh/desertfire/610/base 2025-12-04T08:53:09.1728763Z * [new branch] gh/desertfire/610/head -> origin/gh/desertfire/610/head 2025-12-04T08:53:09.1728836Z * [new branch] gh/desertfire/610/orig -> origin/gh/desertfire/610/orig 2025-12-04T08:53:09.1728910Z * [new branch] gh/desertfire/611/base -> origin/gh/desertfire/611/base 2025-12-04T08:53:09.1728986Z * [new branch] gh/desertfire/611/head -> origin/gh/desertfire/611/head 2025-12-04T08:53:09.1729058Z * [new branch] gh/desertfire/611/orig -> origin/gh/desertfire/611/orig 2025-12-04T08:53:09.1729131Z * [new branch] gh/desertfire/612/base -> origin/gh/desertfire/612/base 2025-12-04T08:53:09.1729213Z * [new branch] gh/desertfire/612/head -> origin/gh/desertfire/612/head 2025-12-04T08:53:09.1729288Z * [new branch] gh/desertfire/612/orig -> origin/gh/desertfire/612/orig 2025-12-04T08:53:09.1729365Z * [new branch] gh/desertfire/613/base -> origin/gh/desertfire/613/base 2025-12-04T08:53:09.1729442Z * [new branch] gh/desertfire/613/head -> origin/gh/desertfire/613/head 2025-12-04T08:53:09.1729515Z * [new branch] gh/desertfire/613/orig -> origin/gh/desertfire/613/orig 2025-12-04T08:53:09.1729589Z * [new branch] gh/desertfire/614/base -> origin/gh/desertfire/614/base 2025-12-04T08:53:09.1729666Z * [new branch] gh/desertfire/614/head -> origin/gh/desertfire/614/head 2025-12-04T08:53:09.1729740Z * [new branch] gh/desertfire/614/orig -> origin/gh/desertfire/614/orig 2025-12-04T08:53:09.1729820Z * [new branch] gh/desertfire/615/base -> origin/gh/desertfire/615/base 2025-12-04T08:53:09.1729896Z * [new branch] gh/desertfire/615/head -> origin/gh/desertfire/615/head 2025-12-04T08:53:09.1729972Z * [new branch] gh/desertfire/615/orig -> origin/gh/desertfire/615/orig 2025-12-04T08:53:09.1730050Z * [new branch] gh/desertfire/616/base -> origin/gh/desertfire/616/base 2025-12-04T08:53:09.1730124Z * [new branch] gh/desertfire/616/head -> origin/gh/desertfire/616/head 2025-12-04T08:53:09.1730200Z * [new branch] gh/desertfire/616/orig -> origin/gh/desertfire/616/orig 2025-12-04T08:53:09.1730276Z * [new branch] gh/desertfire/617/base -> origin/gh/desertfire/617/base 2025-12-04T08:53:09.1730350Z * [new branch] gh/desertfire/617/head -> origin/gh/desertfire/617/head 2025-12-04T08:53:09.1730423Z * [new branch] gh/desertfire/617/orig -> origin/gh/desertfire/617/orig 2025-12-04T08:53:09.1730498Z * [new branch] gh/dharakk/1/base -> origin/gh/dharakk/1/base 2025-12-04T08:53:09.1730570Z * [new branch] gh/dharakk/1/head -> origin/gh/dharakk/1/head 2025-12-04T08:53:09.1730647Z * [new branch] gh/drisspg/170/base -> origin/gh/drisspg/170/base 2025-12-04T08:53:09.1730722Z * [new branch] gh/drisspg/170/head -> origin/gh/drisspg/170/head 2025-12-04T08:53:09.1730792Z * [new branch] gh/drisspg/170/orig -> origin/gh/drisspg/170/orig 2025-12-04T08:53:09.1730863Z * [new branch] gh/drisspg/182/base -> origin/gh/drisspg/182/base 2025-12-04T08:53:09.1730935Z * [new branch] gh/drisspg/182/head -> origin/gh/drisspg/182/head 2025-12-04T08:53:09.1731005Z * [new branch] gh/drisspg/183/base -> origin/gh/drisspg/183/base 2025-12-04T08:53:09.1731074Z * [new branch] gh/drisspg/183/head -> origin/gh/drisspg/183/head 2025-12-04T08:53:09.1731147Z * [new branch] gh/drisspg/184/base -> origin/gh/drisspg/184/base 2025-12-04T08:53:09.1731250Z * [new branch] gh/drisspg/184/head -> origin/gh/drisspg/184/head 2025-12-04T08:53:09.1731342Z * [new branch] gh/drisspg/185/base -> origin/gh/drisspg/185/base 2025-12-04T08:53:09.1731414Z * [new branch] gh/drisspg/185/head -> origin/gh/drisspg/185/head 2025-12-04T08:53:09.1731484Z * [new branch] gh/drisspg/194/base -> origin/gh/drisspg/194/base 2025-12-04T08:53:09.1731556Z * [new branch] gh/drisspg/194/head -> origin/gh/drisspg/194/head 2025-12-04T08:53:09.1731626Z * [new branch] gh/drisspg/194/orig -> origin/gh/drisspg/194/orig 2025-12-04T08:53:09.1731695Z * [new branch] gh/drisspg/200/base -> origin/gh/drisspg/200/base 2025-12-04T08:53:09.1731766Z * [new branch] gh/drisspg/200/head -> origin/gh/drisspg/200/head 2025-12-04T08:53:09.1731837Z * [new branch] gh/drisspg/200/orig -> origin/gh/drisspg/200/orig 2025-12-04T08:53:09.1731909Z * [new branch] gh/drisspg/218/base -> origin/gh/drisspg/218/base 2025-12-04T08:53:09.1731984Z * [new branch] gh/drisspg/218/head -> origin/gh/drisspg/218/head 2025-12-04T08:53:09.1732056Z * [new branch] gh/drisspg/218/orig -> origin/gh/drisspg/218/orig 2025-12-04T08:53:09.1732127Z * [new branch] gh/drisspg/219/base -> origin/gh/drisspg/219/base 2025-12-04T08:53:09.1732199Z * [new branch] gh/drisspg/219/head -> origin/gh/drisspg/219/head 2025-12-04T08:53:09.1732269Z * [new branch] gh/drisspg/219/orig -> origin/gh/drisspg/219/orig 2025-12-04T08:53:09.1732338Z * [new branch] gh/drisspg/220/base -> origin/gh/drisspg/220/base 2025-12-04T08:53:09.1732412Z * [new branch] gh/drisspg/220/head -> origin/gh/drisspg/220/head 2025-12-04T08:53:09.1732483Z * [new branch] gh/drisspg/220/orig -> origin/gh/drisspg/220/orig 2025-12-04T08:53:09.1732557Z * [new branch] gh/drisspg/221/base -> origin/gh/drisspg/221/base 2025-12-04T08:53:09.1732632Z * [new branch] gh/drisspg/221/head -> origin/gh/drisspg/221/head 2025-12-04T08:53:09.1732703Z * [new branch] gh/drisspg/221/orig -> origin/gh/drisspg/221/orig 2025-12-04T08:53:09.1732773Z * [new branch] gh/drisspg/222/base -> origin/gh/drisspg/222/base 2025-12-04T08:53:09.1732847Z * [new branch] gh/drisspg/222/head -> origin/gh/drisspg/222/head 2025-12-04T08:53:09.1732918Z * [new branch] gh/drisspg/222/orig -> origin/gh/drisspg/222/orig 2025-12-04T08:53:09.1733036Z * [new branch] gh/drisspg/223/base -> origin/gh/drisspg/223/base 2025-12-04T08:53:09.1733361Z * [new branch] gh/drisspg/223/head -> origin/gh/drisspg/223/head 2025-12-04T08:53:09.1733430Z * [new branch] gh/drisspg/223/orig -> origin/gh/drisspg/223/orig 2025-12-04T08:53:09.1733503Z * [new branch] gh/drisspg/224/base -> origin/gh/drisspg/224/base 2025-12-04T08:53:09.1733573Z * [new branch] gh/drisspg/224/head -> origin/gh/drisspg/224/head 2025-12-04T08:53:09.1733644Z * [new branch] gh/drisspg/224/orig -> origin/gh/drisspg/224/orig 2025-12-04T08:53:09.1733715Z * [new branch] gh/drisspg/225/base -> origin/gh/drisspg/225/base 2025-12-04T08:53:09.1733784Z * [new branch] gh/drisspg/225/head -> origin/gh/drisspg/225/head 2025-12-04T08:53:09.1733853Z * [new branch] gh/drisspg/225/orig -> origin/gh/drisspg/225/orig 2025-12-04T08:53:09.1733923Z * [new branch] gh/drisspg/226/base -> origin/gh/drisspg/226/base 2025-12-04T08:53:09.1733992Z * [new branch] gh/drisspg/226/head -> origin/gh/drisspg/226/head 2025-12-04T08:53:09.1734063Z * [new branch] gh/drisspg/226/orig -> origin/gh/drisspg/226/orig 2025-12-04T08:53:09.1734170Z * [new branch] gh/drisspg/227/base -> origin/gh/drisspg/227/base 2025-12-04T08:53:09.1734278Z * [new branch] gh/drisspg/227/head -> origin/gh/drisspg/227/head 2025-12-04T08:53:09.1734348Z * [new branch] gh/drisspg/227/orig -> origin/gh/drisspg/227/orig 2025-12-04T08:53:09.1734422Z * [new branch] gh/drisspg/228/base -> origin/gh/drisspg/228/base 2025-12-04T08:53:09.1734492Z * [new branch] gh/drisspg/228/head -> origin/gh/drisspg/228/head 2025-12-04T08:53:09.1734561Z * [new branch] gh/drisspg/228/orig -> origin/gh/drisspg/228/orig 2025-12-04T08:53:09.1734633Z * [new branch] gh/drisspg/229/base -> origin/gh/drisspg/229/base 2025-12-04T08:53:09.1734702Z * [new branch] gh/drisspg/229/head -> origin/gh/drisspg/229/head 2025-12-04T08:53:09.1734771Z * [new branch] gh/drisspg/229/orig -> origin/gh/drisspg/229/orig 2025-12-04T08:53:09.1734843Z * [new branch] gh/drisspg/230/base -> origin/gh/drisspg/230/base 2025-12-04T08:53:09.1734914Z * [new branch] gh/drisspg/230/head -> origin/gh/drisspg/230/head 2025-12-04T08:53:09.1734985Z * [new branch] gh/drisspg/230/orig -> origin/gh/drisspg/230/orig 2025-12-04T08:53:09.1735059Z * [new branch] gh/dsjohns2/1/base -> origin/gh/dsjohns2/1/base 2025-12-04T08:53:09.1735130Z * [new branch] gh/dsjohns2/1/head -> origin/gh/dsjohns2/1/head 2025-12-04T08:53:09.1735211Z * [new branch] gh/dzmitry-huba/1/base -> origin/gh/dzmitry-huba/1/base 2025-12-04T08:53:09.1735287Z * [new branch] gh/dzmitry-huba/1/head -> origin/gh/dzmitry-huba/1/head 2025-12-04T08:53:09.1735366Z * [new branch] gh/dzmitry-huba/12/base -> origin/gh/dzmitry-huba/12/base 2025-12-04T08:53:09.1735445Z * [new branch] gh/dzmitry-huba/12/head -> origin/gh/dzmitry-huba/12/head 2025-12-04T08:53:09.1735523Z * [new branch] gh/dzmitry-huba/12/orig -> origin/gh/dzmitry-huba/12/orig 2025-12-04T08:53:09.1735601Z * [new branch] gh/dzmitry-huba/13/base -> origin/gh/dzmitry-huba/13/base 2025-12-04T08:53:09.1735678Z * [new branch] gh/dzmitry-huba/13/head -> origin/gh/dzmitry-huba/13/head 2025-12-04T08:53:09.1735754Z * [new branch] gh/dzmitry-huba/13/orig -> origin/gh/dzmitry-huba/13/orig 2025-12-04T08:53:09.1735831Z * [new branch] gh/dzmitry-huba/14/base -> origin/gh/dzmitry-huba/14/base 2025-12-04T08:53:09.1735910Z * [new branch] gh/dzmitry-huba/14/head -> origin/gh/dzmitry-huba/14/head 2025-12-04T08:53:09.1735984Z * [new branch] gh/dzmitry-huba/14/orig -> origin/gh/dzmitry-huba/14/orig 2025-12-04T08:53:09.1736059Z * [new branch] gh/dzmitry-huba/15/base -> origin/gh/dzmitry-huba/15/base 2025-12-04T08:53:09.1736140Z * [new branch] gh/dzmitry-huba/15/head -> origin/gh/dzmitry-huba/15/head 2025-12-04T08:53:09.1736216Z * [new branch] gh/dzmitry-huba/15/orig -> origin/gh/dzmitry-huba/15/orig 2025-12-04T08:53:09.1736292Z * [new branch] gh/dzmitry-huba/16/base -> origin/gh/dzmitry-huba/16/base 2025-12-04T08:53:09.1736370Z * [new branch] gh/dzmitry-huba/16/head -> origin/gh/dzmitry-huba/16/head 2025-12-04T08:53:09.1736447Z * [new branch] gh/dzmitry-huba/16/orig -> origin/gh/dzmitry-huba/16/orig 2025-12-04T08:53:09.1736525Z * [new branch] gh/dzmitry-huba/17/base -> origin/gh/dzmitry-huba/17/base 2025-12-04T08:53:09.1736603Z * [new branch] gh/dzmitry-huba/17/head -> origin/gh/dzmitry-huba/17/head 2025-12-04T08:53:09.1736678Z * [new branch] gh/dzmitry-huba/17/orig -> origin/gh/dzmitry-huba/17/orig 2025-12-04T08:53:09.1736759Z * [new branch] gh/dzmitry-huba/2/base -> origin/gh/dzmitry-huba/2/base 2025-12-04T08:53:09.1736873Z * [new branch] gh/dzmitry-huba/2/head -> origin/gh/dzmitry-huba/2/head 2025-12-04T08:53:09.1736982Z * [new branch] gh/dzmitry-huba/3/base -> origin/gh/dzmitry-huba/3/base 2025-12-04T08:53:09.1737063Z * [new branch] gh/dzmitry-huba/3/head -> origin/gh/dzmitry-huba/3/head 2025-12-04T08:53:09.1737139Z * [new branch] gh/eellison/808/base -> origin/gh/eellison/808/base 2025-12-04T08:53:09.1737214Z * [new branch] gh/eellison/808/head -> origin/gh/eellison/808/head 2025-12-04T08:53:09.1737290Z * [new branch] gh/eellison/808/orig -> origin/gh/eellison/808/orig 2025-12-04T08:53:09.1737362Z * [new branch] gh/eellison/822/base -> origin/gh/eellison/822/base 2025-12-04T08:53:09.1737435Z * [new branch] gh/eellison/822/head -> origin/gh/eellison/822/head 2025-12-04T08:53:09.1737511Z * [new branch] gh/eellison/822/orig -> origin/gh/eellison/822/orig 2025-12-04T08:53:09.1737584Z * [new branch] gh/eellison/823/base -> origin/gh/eellison/823/base 2025-12-04T08:53:09.1737658Z * [new branch] gh/eellison/823/head -> origin/gh/eellison/823/head 2025-12-04T08:53:09.1737732Z * [new branch] gh/eellison/823/orig -> origin/gh/eellison/823/orig 2025-12-04T08:53:09.1737804Z * [new branch] gh/eellison/862/base -> origin/gh/eellison/862/base 2025-12-04T08:53:09.1737876Z * [new branch] gh/eellison/862/head -> origin/gh/eellison/862/head 2025-12-04T08:53:09.1737954Z * [new branch] gh/eellison/862/orig -> origin/gh/eellison/862/orig 2025-12-04T08:53:09.1738025Z * [new branch] gh/eellison/863/base -> origin/gh/eellison/863/base 2025-12-04T08:53:09.1738096Z * [new branch] gh/eellison/863/head -> origin/gh/eellison/863/head 2025-12-04T08:53:09.1738171Z * [new branch] gh/eellison/863/orig -> origin/gh/eellison/863/orig 2025-12-04T08:53:09.1738244Z * [new branch] gh/eellison/864/base -> origin/gh/eellison/864/base 2025-12-04T08:53:09.1738323Z * [new branch] gh/eellison/864/head -> origin/gh/eellison/864/head 2025-12-04T08:53:09.1738394Z * [new branch] gh/eellison/864/orig -> origin/gh/eellison/864/orig 2025-12-04T08:53:09.1738467Z * [new branch] gh/eellison/865/base -> origin/gh/eellison/865/base 2025-12-04T08:53:09.1738541Z * [new branch] gh/eellison/865/head -> origin/gh/eellison/865/head 2025-12-04T08:53:09.1738611Z * [new branch] gh/eellison/865/orig -> origin/gh/eellison/865/orig 2025-12-04T08:53:09.1738682Z * [new branch] gh/eellison/866/base -> origin/gh/eellison/866/base 2025-12-04T08:53:09.1738757Z * [new branch] gh/eellison/866/head -> origin/gh/eellison/866/head 2025-12-04T08:53:09.1738829Z * [new branch] gh/eellison/866/orig -> origin/gh/eellison/866/orig 2025-12-04T08:53:09.1738902Z * [new branch] gh/eellison/867/base -> origin/gh/eellison/867/base 2025-12-04T08:53:09.1738976Z * [new branch] gh/eellison/867/head -> origin/gh/eellison/867/head 2025-12-04T08:53:09.1739047Z * [new branch] gh/eellison/867/orig -> origin/gh/eellison/867/orig 2025-12-04T08:53:09.1739117Z * [new branch] gh/eellison/868/base -> origin/gh/eellison/868/base 2025-12-04T08:53:09.1739189Z * [new branch] gh/eellison/868/head -> origin/gh/eellison/868/head 2025-12-04T08:53:09.1739261Z * [new branch] gh/eellison/868/orig -> origin/gh/eellison/868/orig 2025-12-04T08:53:09.1739332Z * [new branch] gh/eellison/869/base -> origin/gh/eellison/869/base 2025-12-04T08:53:09.1739404Z * [new branch] gh/eellison/869/head -> origin/gh/eellison/869/head 2025-12-04T08:53:09.1739474Z * [new branch] gh/eellison/869/orig -> origin/gh/eellison/869/orig 2025-12-04T08:53:09.1739569Z * [new branch] gh/eellison/870/base -> origin/gh/eellison/870/base 2025-12-04T08:53:09.1739675Z * [new branch] gh/eellison/870/head -> origin/gh/eellison/870/head 2025-12-04T08:53:09.1739746Z * [new branch] gh/eellison/870/orig -> origin/gh/eellison/870/orig 2025-12-04T08:53:09.1739820Z * [new branch] gh/eellison/871/base -> origin/gh/eellison/871/base 2025-12-04T08:53:09.1739890Z * [new branch] gh/eellison/871/head -> origin/gh/eellison/871/head 2025-12-04T08:53:09.1739960Z * [new branch] gh/eellison/871/orig -> origin/gh/eellison/871/orig 2025-12-04T08:53:09.1740032Z * [new branch] gh/eellison/872/base -> origin/gh/eellison/872/base 2025-12-04T08:53:09.1740103Z * [new branch] gh/eellison/872/head -> origin/gh/eellison/872/head 2025-12-04T08:53:09.1740175Z * [new branch] gh/eellison/872/orig -> origin/gh/eellison/872/orig 2025-12-04T08:53:09.1740246Z * [new branch] gh/eellison/873/base -> origin/gh/eellison/873/base 2025-12-04T08:53:09.1740319Z * [new branch] gh/eellison/873/head -> origin/gh/eellison/873/head 2025-12-04T08:53:09.1740389Z * [new branch] gh/eellison/873/orig -> origin/gh/eellison/873/orig 2025-12-04T08:53:09.1740463Z * [new branch] gh/eellison/874/base -> origin/gh/eellison/874/base 2025-12-04T08:53:09.1740534Z * [new branch] gh/eellison/874/head -> origin/gh/eellison/874/head 2025-12-04T08:53:09.1740606Z * [new branch] gh/eellison/874/orig -> origin/gh/eellison/874/orig 2025-12-04T08:53:09.1740677Z * [new branch] gh/eellison/875/base -> origin/gh/eellison/875/base 2025-12-04T08:53:09.1740748Z * [new branch] gh/eellison/875/head -> origin/gh/eellison/875/head 2025-12-04T08:53:09.1740821Z * [new branch] gh/eellison/875/orig -> origin/gh/eellison/875/orig 2025-12-04T08:53:09.1740893Z * [new branch] gh/eellison/876/base -> origin/gh/eellison/876/base 2025-12-04T08:53:09.1740965Z * [new branch] gh/eellison/876/head -> origin/gh/eellison/876/head 2025-12-04T08:53:09.1741036Z * [new branch] gh/eellison/876/orig -> origin/gh/eellison/876/orig 2025-12-04T08:53:09.1741109Z * [new branch] gh/eellison/877/base -> origin/gh/eellison/877/base 2025-12-04T08:53:09.1741180Z * [new branch] gh/eellison/877/head -> origin/gh/eellison/877/head 2025-12-04T08:53:09.1741253Z * [new branch] gh/eellison/877/orig -> origin/gh/eellison/877/orig 2025-12-04T08:53:09.1741326Z * [new branch] gh/eellison/878/base -> origin/gh/eellison/878/base 2025-12-04T08:53:09.1741397Z * [new branch] gh/eellison/878/head -> origin/gh/eellison/878/head 2025-12-04T08:53:09.1741471Z * [new branch] gh/eellison/878/orig -> origin/gh/eellison/878/orig 2025-12-04T08:53:09.1741541Z * [new branch] gh/eellison/879/base -> origin/gh/eellison/879/base 2025-12-04T08:53:09.1741613Z * [new branch] gh/eellison/879/head -> origin/gh/eellison/879/head 2025-12-04T08:53:09.1741687Z * [new branch] gh/eellison/879/orig -> origin/gh/eellison/879/orig 2025-12-04T08:53:09.1741757Z * [new branch] gh/eellison/880/base -> origin/gh/eellison/880/base 2025-12-04T08:53:09.1741828Z * [new branch] gh/eellison/880/head -> origin/gh/eellison/880/head 2025-12-04T08:53:09.1741902Z * [new branch] gh/eellison/880/orig -> origin/gh/eellison/880/orig 2025-12-04T08:53:09.1741974Z * [new branch] gh/eellison/881/base -> origin/gh/eellison/881/base 2025-12-04T08:53:09.1742046Z * [new branch] gh/eellison/881/head -> origin/gh/eellison/881/head 2025-12-04T08:53:09.1742150Z * [new branch] gh/eellison/881/orig -> origin/gh/eellison/881/orig 2025-12-04T08:53:09.1742220Z * [new branch] gh/eellison/882/base -> origin/gh/eellison/882/base 2025-12-04T08:53:09.1742318Z * [new branch] gh/eellison/882/head -> origin/gh/eellison/882/head 2025-12-04T08:53:09.1742391Z * [new branch] gh/eellison/882/orig -> origin/gh/eellison/882/orig 2025-12-04T08:53:09.1742462Z * [new branch] gh/eellison/883/base -> origin/gh/eellison/883/base 2025-12-04T08:53:09.1742533Z * [new branch] gh/eellison/883/head -> origin/gh/eellison/883/head 2025-12-04T08:53:09.1742605Z * [new branch] gh/eellison/883/orig -> origin/gh/eellison/883/orig 2025-12-04T08:53:09.1742675Z * [new branch] gh/eellison/884/base -> origin/gh/eellison/884/base 2025-12-04T08:53:09.1742747Z * [new branch] gh/eellison/884/head -> origin/gh/eellison/884/head 2025-12-04T08:53:09.1742824Z * [new branch] gh/eellison/884/orig -> origin/gh/eellison/884/orig 2025-12-04T08:53:09.1742891Z * [new branch] gh/etaf/147/base -> origin/gh/etaf/147/base 2025-12-04T08:53:09.1743002Z * [new branch] gh/etaf/147/head -> origin/gh/etaf/147/head 2025-12-04T08:53:09.1743069Z * [new branch] gh/etaf/154/base -> origin/gh/etaf/154/base 2025-12-04T08:53:09.1743134Z * [new branch] gh/etaf/154/head -> origin/gh/etaf/154/head 2025-12-04T08:53:09.1743201Z * [new branch] gh/etaf/154/orig -> origin/gh/etaf/154/orig 2025-12-04T08:53:09.1743265Z * [new branch] gh/etaf/156/base -> origin/gh/etaf/156/base 2025-12-04T08:53:09.1743330Z * [new branch] gh/etaf/156/head -> origin/gh/etaf/156/head 2025-12-04T08:53:09.1743398Z * [new branch] gh/etaf/156/orig -> origin/gh/etaf/156/orig 2025-12-04T08:53:09.1743468Z * [new branch] gh/etaf/157/base -> origin/gh/etaf/157/base 2025-12-04T08:53:09.1743533Z * [new branch] gh/etaf/157/head -> origin/gh/etaf/157/head 2025-12-04T08:53:09.1743603Z * [new branch] gh/etaf/157/orig -> origin/gh/etaf/157/orig 2025-12-04T08:53:09.1743667Z * [new branch] gh/etaf/158/base -> origin/gh/etaf/158/base 2025-12-04T08:53:09.1743731Z * [new branch] gh/etaf/158/head -> origin/gh/etaf/158/head 2025-12-04T08:53:09.1743797Z * [new branch] gh/etaf/158/orig -> origin/gh/etaf/158/orig 2025-12-04T08:53:09.1743861Z * [new branch] gh/etaf/159/base -> origin/gh/etaf/159/base 2025-12-04T08:53:09.1743926Z * [new branch] gh/etaf/159/head -> origin/gh/etaf/159/head 2025-12-04T08:53:09.1743993Z * [new branch] gh/etaf/159/orig -> origin/gh/etaf/159/orig 2025-12-04T08:53:09.1744060Z * [new branch] gh/etaf/160/base -> origin/gh/etaf/160/base 2025-12-04T08:53:09.1744126Z * [new branch] gh/etaf/160/head -> origin/gh/etaf/160/head 2025-12-04T08:53:09.1744194Z * [new branch] gh/etaf/160/orig -> origin/gh/etaf/160/orig 2025-12-04T08:53:09.1744259Z * [new branch] gh/etaf/161/base -> origin/gh/etaf/161/base 2025-12-04T08:53:09.1744324Z * [new branch] gh/etaf/161/head -> origin/gh/etaf/161/head 2025-12-04T08:53:09.1744389Z * [new branch] gh/etaf/161/orig -> origin/gh/etaf/161/orig 2025-12-04T08:53:09.1744453Z * [new branch] gh/etaf/166/base -> origin/gh/etaf/166/base 2025-12-04T08:53:09.1744521Z * [new branch] gh/etaf/166/head -> origin/gh/etaf/166/head 2025-12-04T08:53:09.1744585Z * [new branch] gh/etaf/166/orig -> origin/gh/etaf/166/orig 2025-12-04T08:53:09.1744648Z * [new branch] gh/etaf/167/base -> origin/gh/etaf/167/base 2025-12-04T08:53:09.1744757Z * [new branch] gh/etaf/167/head -> origin/gh/etaf/167/head 2025-12-04T08:53:09.1744860Z * [new branch] gh/etaf/167/orig -> origin/gh/etaf/167/orig 2025-12-04T08:53:09.1744926Z * [new branch] gh/etaf/168/base -> origin/gh/etaf/168/base 2025-12-04T08:53:09.1744995Z * [new branch] gh/etaf/168/head -> origin/gh/etaf/168/head 2025-12-04T08:53:09.1745060Z * [new branch] gh/etaf/168/orig -> origin/gh/etaf/168/orig 2025-12-04T08:53:09.1745123Z * [new branch] gh/etaf/172/base -> origin/gh/etaf/172/base 2025-12-04T08:53:09.1745189Z * [new branch] gh/etaf/172/head -> origin/gh/etaf/172/head 2025-12-04T08:53:09.1745252Z * [new branch] gh/etaf/172/orig -> origin/gh/etaf/172/orig 2025-12-04T08:53:09.1745317Z * [new branch] gh/etaf/173/base -> origin/gh/etaf/173/base 2025-12-04T08:53:09.1745386Z * [new branch] gh/etaf/173/head -> origin/gh/etaf/173/head 2025-12-04T08:53:09.1745451Z * [new branch] gh/etaf/173/orig -> origin/gh/etaf/173/orig 2025-12-04T08:53:09.1745518Z * [new branch] gh/etaf/174/base -> origin/gh/etaf/174/base 2025-12-04T08:53:09.1745586Z * [new branch] gh/etaf/174/head -> origin/gh/etaf/174/head 2025-12-04T08:53:09.1745650Z * [new branch] gh/etaf/175/base -> origin/gh/etaf/175/base 2025-12-04T08:53:09.1745714Z * [new branch] gh/etaf/175/head -> origin/gh/etaf/175/head 2025-12-04T08:53:09.1745780Z * [new branch] gh/etaf/175/orig -> origin/gh/etaf/175/orig 2025-12-04T08:53:09.1745844Z * [new branch] gh/etaf/176/base -> origin/gh/etaf/176/base 2025-12-04T08:53:09.1745908Z * [new branch] gh/etaf/176/head -> origin/gh/etaf/176/head 2025-12-04T08:53:09.1745976Z * [new branch] gh/etaf/176/orig -> origin/gh/etaf/176/orig 2025-12-04T08:53:09.1746042Z * [new branch] gh/etaf/177/base -> origin/gh/etaf/177/base 2025-12-04T08:53:09.1746112Z * [new branch] gh/etaf/177/head -> origin/gh/etaf/177/head 2025-12-04T08:53:09.1746177Z * [new branch] gh/etaf/177/orig -> origin/gh/etaf/177/orig 2025-12-04T08:53:09.1746242Z * [new branch] gh/etaf/178/base -> origin/gh/etaf/178/base 2025-12-04T08:53:09.1746308Z * [new branch] gh/etaf/178/head -> origin/gh/etaf/178/head 2025-12-04T08:53:09.1746372Z * [new branch] gh/etaf/178/orig -> origin/gh/etaf/178/orig 2025-12-04T08:53:09.1746436Z * [new branch] gh/etaf/179/base -> origin/gh/etaf/179/base 2025-12-04T08:53:09.1746501Z * [new branch] gh/etaf/179/head -> origin/gh/etaf/179/head 2025-12-04T08:53:09.1746566Z * [new branch] gh/etaf/179/orig -> origin/gh/etaf/179/orig 2025-12-04T08:53:09.1746630Z * [new branch] gh/etaf/180/base -> origin/gh/etaf/180/base 2025-12-04T08:53:09.1746697Z * [new branch] gh/etaf/180/head -> origin/gh/etaf/180/head 2025-12-04T08:53:09.1746764Z * [new branch] gh/etaf/180/orig -> origin/gh/etaf/180/orig 2025-12-04T08:53:09.1746842Z * [new branch] gh/exclamaforte/1/base -> origin/gh/exclamaforte/1/base 2025-12-04T08:53:09.1746922Z * [new branch] gh/exclamaforte/1/head -> origin/gh/exclamaforte/1/head 2025-12-04T08:53:09.1746997Z * [new branch] gh/exclamaforte/2/base -> origin/gh/exclamaforte/2/base 2025-12-04T08:53:09.1747072Z * [new branch] gh/exclamaforte/2/head -> origin/gh/exclamaforte/2/head 2025-12-04T08:53:09.1747155Z * [new branch] gh/exclamaforte/3/base -> origin/gh/exclamaforte/3/base 2025-12-04T08:53:09.1747269Z * [new branch] gh/exclamaforte/3/head -> origin/gh/exclamaforte/3/head 2025-12-04T08:53:09.1747344Z * [new branch] gh/exclamaforte/4/base -> origin/gh/exclamaforte/4/base 2025-12-04T08:53:09.1747449Z * [new branch] gh/exclamaforte/4/head -> origin/gh/exclamaforte/4/head 2025-12-04T08:53:09.1747521Z * [new branch] gh/ezyang/2374/base -> origin/gh/ezyang/2374/base 2025-12-04T08:53:09.1747592Z * [new branch] gh/ezyang/2374/head -> origin/gh/ezyang/2374/head 2025-12-04T08:53:09.1747664Z * [new branch] gh/ezyang/2374/orig -> origin/gh/ezyang/2374/orig 2025-12-04T08:53:09.1747733Z * [new branch] gh/ezyang/2973/base -> origin/gh/ezyang/2973/base 2025-12-04T08:53:09.1747803Z * [new branch] gh/ezyang/2973/head -> origin/gh/ezyang/2973/head 2025-12-04T08:53:09.1747871Z * [new branch] gh/ezyang/2973/orig -> origin/gh/ezyang/2973/orig 2025-12-04T08:53:09.1747940Z * [new branch] gh/ezyang/2974/base -> origin/gh/ezyang/2974/base 2025-12-04T08:53:09.1748009Z * [new branch] gh/ezyang/2974/head -> origin/gh/ezyang/2974/head 2025-12-04T08:53:09.1748080Z * [new branch] gh/ezyang/2974/orig -> origin/gh/ezyang/2974/orig 2025-12-04T08:53:09.1748150Z * [new branch] gh/ezyang/3131/base -> origin/gh/ezyang/3131/base 2025-12-04T08:53:09.1748222Z * [new branch] gh/ezyang/3131/head -> origin/gh/ezyang/3131/head 2025-12-04T08:53:09.1748289Z * [new branch] gh/ezyang/3131/orig -> origin/gh/ezyang/3131/orig 2025-12-04T08:53:09.1748356Z * [new branch] gh/ezyang/3139/base -> origin/gh/ezyang/3139/base 2025-12-04T08:53:09.1748426Z * [new branch] gh/ezyang/3139/head -> origin/gh/ezyang/3139/head 2025-12-04T08:53:09.1748495Z * [new branch] gh/ezyang/3139/orig -> origin/gh/ezyang/3139/orig 2025-12-04T08:53:09.1748564Z * [new branch] gh/ezyang/3140/base -> origin/gh/ezyang/3140/base 2025-12-04T08:53:09.1748635Z * [new branch] gh/ezyang/3140/head -> origin/gh/ezyang/3140/head 2025-12-04T08:53:09.1748706Z * [new branch] gh/ezyang/3140/orig -> origin/gh/ezyang/3140/orig 2025-12-04T08:53:09.1748776Z * [new branch] gh/ezyang/3143/base -> origin/gh/ezyang/3143/base 2025-12-04T08:53:09.1748844Z * [new branch] gh/ezyang/3143/head -> origin/gh/ezyang/3143/head 2025-12-04T08:53:09.1748911Z * [new branch] gh/ezyang/3143/orig -> origin/gh/ezyang/3143/orig 2025-12-04T08:53:09.1748980Z * [new branch] gh/ezyang/3144/base -> origin/gh/ezyang/3144/base 2025-12-04T08:53:09.1749049Z * [new branch] gh/ezyang/3144/head -> origin/gh/ezyang/3144/head 2025-12-04T08:53:09.1749117Z * [new branch] gh/ezyang/3144/orig -> origin/gh/ezyang/3144/orig 2025-12-04T08:53:09.1749186Z * [new branch] gh/ezyang/3167/base -> origin/gh/ezyang/3167/base 2025-12-04T08:53:09.1749256Z * [new branch] gh/ezyang/3167/head -> origin/gh/ezyang/3167/head 2025-12-04T08:53:09.1749325Z * [new branch] gh/ezyang/3167/orig -> origin/gh/ezyang/3167/orig 2025-12-04T08:53:09.1749394Z * [new branch] gh/ezyang/3173/base -> origin/gh/ezyang/3173/base 2025-12-04T08:53:09.1749467Z * [new branch] gh/ezyang/3173/head -> origin/gh/ezyang/3173/head 2025-12-04T08:53:09.1749535Z * [new branch] gh/ezyang/3173/orig -> origin/gh/ezyang/3173/orig 2025-12-04T08:53:09.1749602Z * [new branch] gh/ezyang/3175/base -> origin/gh/ezyang/3175/base 2025-12-04T08:53:09.1749670Z * [new branch] gh/ezyang/3175/head -> origin/gh/ezyang/3175/head 2025-12-04T08:53:09.1749738Z * [new branch] gh/ezyang/3175/orig -> origin/gh/ezyang/3175/orig 2025-12-04T08:53:09.1749835Z * [new branch] gh/ezyang/3182/base -> origin/gh/ezyang/3182/base 2025-12-04T08:53:09.1749903Z * [new branch] gh/ezyang/3182/head -> origin/gh/ezyang/3182/head 2025-12-04T08:53:09.1750003Z * [new branch] gh/ezyang/3182/orig -> origin/gh/ezyang/3182/orig 2025-12-04T08:53:09.1750073Z * [new branch] gh/ezyang/3185/base -> origin/gh/ezyang/3185/base 2025-12-04T08:53:09.1750143Z * [new branch] gh/ezyang/3185/head -> origin/gh/ezyang/3185/head 2025-12-04T08:53:09.1750213Z * [new branch] gh/ezyang/3185/orig -> origin/gh/ezyang/3185/orig 2025-12-04T08:53:09.1750284Z * [new branch] gh/ezyang/3189/base -> origin/gh/ezyang/3189/base 2025-12-04T08:53:09.1750352Z * [new branch] gh/ezyang/3189/head -> origin/gh/ezyang/3189/head 2025-12-04T08:53:09.1750420Z * [new branch] gh/ezyang/3189/orig -> origin/gh/ezyang/3189/orig 2025-12-04T08:53:09.1750491Z * [new branch] gh/ezyang/3191/base -> origin/gh/ezyang/3191/base 2025-12-04T08:53:09.1750561Z * [new branch] gh/ezyang/3191/head -> origin/gh/ezyang/3191/head 2025-12-04T08:53:09.1750631Z * [new branch] gh/ezyang/3191/orig -> origin/gh/ezyang/3191/orig 2025-12-04T08:53:09.1750701Z * [new branch] gh/ezyang/3192/base -> origin/gh/ezyang/3192/base 2025-12-04T08:53:09.1750772Z * [new branch] gh/ezyang/3192/head -> origin/gh/ezyang/3192/head 2025-12-04T08:53:09.1750841Z * [new branch] gh/ezyang/3192/orig -> origin/gh/ezyang/3192/orig 2025-12-04T08:53:09.1750911Z * [new branch] gh/ezyang/3193/base -> origin/gh/ezyang/3193/base 2025-12-04T08:53:09.1750978Z * [new branch] gh/ezyang/3193/head -> origin/gh/ezyang/3193/head 2025-12-04T08:53:09.1751046Z * [new branch] gh/ezyang/3193/orig -> origin/gh/ezyang/3193/orig 2025-12-04T08:53:09.1751118Z * [new branch] gh/ezyang/3194/base -> origin/gh/ezyang/3194/base 2025-12-04T08:53:09.1751185Z * [new branch] gh/ezyang/3194/head -> origin/gh/ezyang/3194/head 2025-12-04T08:53:09.1751257Z * [new branch] gh/ezyang/3194/orig -> origin/gh/ezyang/3194/orig 2025-12-04T08:53:09.1751324Z * [new branch] gh/ezyang/3195/base -> origin/gh/ezyang/3195/base 2025-12-04T08:53:09.1751393Z * [new branch] gh/ezyang/3195/head -> origin/gh/ezyang/3195/head 2025-12-04T08:53:09.1751464Z * [new branch] gh/ezyang/3195/orig -> origin/gh/ezyang/3195/orig 2025-12-04T08:53:09.1751531Z * [new branch] gh/ezyang/3196/base -> origin/gh/ezyang/3196/base 2025-12-04T08:53:09.1751599Z * [new branch] gh/ezyang/3196/head -> origin/gh/ezyang/3196/head 2025-12-04T08:53:09.1751667Z * [new branch] gh/ezyang/3196/orig -> origin/gh/ezyang/3196/orig 2025-12-04T08:53:09.1751737Z * [new branch] gh/ezyang/3197/base -> origin/gh/ezyang/3197/base 2025-12-04T08:53:09.1751805Z * [new branch] gh/ezyang/3197/head -> origin/gh/ezyang/3197/head 2025-12-04T08:53:09.1751879Z * [new branch] gh/ezyang/3197/orig -> origin/gh/ezyang/3197/orig 2025-12-04T08:53:09.1751949Z * [new branch] gh/ezyang/3198/base -> origin/gh/ezyang/3198/base 2025-12-04T08:53:09.1752017Z * [new branch] gh/ezyang/3198/head -> origin/gh/ezyang/3198/head 2025-12-04T08:53:09.1752088Z * [new branch] gh/ezyang/3198/orig -> origin/gh/ezyang/3198/orig 2025-12-04T08:53:09.1752155Z * [new branch] gh/ezyang/3199/base -> origin/gh/ezyang/3199/base 2025-12-04T08:53:09.1752223Z * [new branch] gh/ezyang/3199/head -> origin/gh/ezyang/3199/head 2025-12-04T08:53:09.1752292Z * [new branch] gh/ezyang/3199/orig -> origin/gh/ezyang/3199/orig 2025-12-04T08:53:09.1752387Z * [new branch] gh/ezyang/3200/base -> origin/gh/ezyang/3200/base 2025-12-04T08:53:09.1752456Z * [new branch] gh/ezyang/3200/head -> origin/gh/ezyang/3200/head 2025-12-04T08:53:09.1752556Z * [new branch] gh/ezyang/3200/orig -> origin/gh/ezyang/3200/orig 2025-12-04T08:53:09.1752625Z * [new branch] gh/ezyang/3201/base -> origin/gh/ezyang/3201/base 2025-12-04T08:53:09.1770669Z * [new branch] gh/ezyang/3201/head -> origin/gh/ezyang/3201/head 2025-12-04T08:53:09.1770817Z * [new branch] gh/ezyang/3201/orig -> origin/gh/ezyang/3201/orig 2025-12-04T08:53:09.1770900Z * [new branch] gh/ezyang/3202/base -> origin/gh/ezyang/3202/base 2025-12-04T08:53:09.1770974Z * [new branch] gh/ezyang/3202/head -> origin/gh/ezyang/3202/head 2025-12-04T08:53:09.1771045Z * [new branch] gh/ezyang/3202/orig -> origin/gh/ezyang/3202/orig 2025-12-04T08:53:09.1771135Z * [new branch] gh/ezyang/3203/base -> origin/gh/ezyang/3203/base 2025-12-04T08:53:09.1771204Z * [new branch] gh/ezyang/3203/head -> origin/gh/ezyang/3203/head 2025-12-04T08:53:09.1771281Z * [new branch] gh/ezyang/3203/orig -> origin/gh/ezyang/3203/orig 2025-12-04T08:53:09.1771356Z * [new branch] gh/ezyang/3204/base -> origin/gh/ezyang/3204/base 2025-12-04T08:53:09.1771424Z * [new branch] gh/ezyang/3204/head -> origin/gh/ezyang/3204/head 2025-12-04T08:53:09.1771493Z * [new branch] gh/ezyang/3204/orig -> origin/gh/ezyang/3204/orig 2025-12-04T08:53:09.1771573Z * [new branch] gh/ezyang/3205/base -> origin/gh/ezyang/3205/base 2025-12-04T08:53:09.1771643Z * [new branch] gh/ezyang/3205/head -> origin/gh/ezyang/3205/head 2025-12-04T08:53:09.1771712Z * [new branch] gh/ezyang/3205/orig -> origin/gh/ezyang/3205/orig 2025-12-04T08:53:09.1771785Z * [new branch] gh/ezyang/3206/base -> origin/gh/ezyang/3206/base 2025-12-04T08:53:09.1771857Z * [new branch] gh/ezyang/3206/head -> origin/gh/ezyang/3206/head 2025-12-04T08:53:09.1771928Z * [new branch] gh/ezyang/3206/orig -> origin/gh/ezyang/3206/orig 2025-12-04T08:53:09.1771999Z * [new branch] gh/ezyang/3207/base -> origin/gh/ezyang/3207/base 2025-12-04T08:53:09.1772067Z * [new branch] gh/ezyang/3207/head -> origin/gh/ezyang/3207/head 2025-12-04T08:53:09.1772136Z * [new branch] gh/ezyang/3207/orig -> origin/gh/ezyang/3207/orig 2025-12-04T08:53:09.1772203Z * [new branch] gh/ezyang/3208/base -> origin/gh/ezyang/3208/base 2025-12-04T08:53:09.1772271Z * [new branch] gh/ezyang/3208/head -> origin/gh/ezyang/3208/head 2025-12-04T08:53:09.1772340Z * [new branch] gh/ezyang/3208/orig -> origin/gh/ezyang/3208/orig 2025-12-04T08:53:09.1772416Z * [new branch] gh/ezyang/3209/base -> origin/gh/ezyang/3209/base 2025-12-04T08:53:09.1772488Z * [new branch] gh/ezyang/3209/head -> origin/gh/ezyang/3209/head 2025-12-04T08:53:09.1772559Z * [new branch] gh/ezyang/3209/orig -> origin/gh/ezyang/3209/orig 2025-12-04T08:53:09.1772636Z * [new branch] gh/fadara01/3/base -> origin/gh/fadara01/3/base 2025-12-04T08:53:09.1772708Z * [new branch] gh/fadara01/3/head -> origin/gh/fadara01/3/head 2025-12-04T08:53:09.1772787Z * [new branch] gh/fadara01/3/orig -> origin/gh/fadara01/3/orig 2025-12-04T08:53:09.1772858Z * [new branch] gh/fadara01/5/base -> origin/gh/fadara01/5/base 2025-12-04T08:53:09.1773014Z * [new branch] gh/fadara01/5/head -> origin/gh/fadara01/5/head 2025-12-04T08:53:09.1773095Z * [new branch] gh/fadara01/5/orig -> origin/gh/fadara01/5/orig 2025-12-04T08:53:09.1773233Z * [new branch] gh/fadara01/6/base -> origin/gh/fadara01/6/base 2025-12-04T08:53:09.1773301Z * [new branch] gh/fadara01/6/head -> origin/gh/fadara01/6/head 2025-12-04T08:53:09.1773421Z * [new branch] gh/fadara01/6/orig -> origin/gh/fadara01/6/orig 2025-12-04T08:53:09.1773491Z * [new branch] gh/fadara01/7/base -> origin/gh/fadara01/7/base 2025-12-04T08:53:09.1773565Z * [new branch] gh/fadara01/7/head -> origin/gh/fadara01/7/head 2025-12-04T08:53:09.1773643Z * [new branch] gh/fadara01/7/orig -> origin/gh/fadara01/7/orig 2025-12-04T08:53:09.1773714Z * [new branch] gh/fadara01/8/base -> origin/gh/fadara01/8/base 2025-12-04T08:53:09.1773785Z * [new branch] gh/fadara01/8/head -> origin/gh/fadara01/8/head 2025-12-04T08:53:09.1773862Z * [new branch] gh/fadara01/8/orig -> origin/gh/fadara01/8/orig 2025-12-04T08:53:09.1773934Z * [new branch] gh/fadara01/9/base -> origin/gh/fadara01/9/base 2025-12-04T08:53:09.1774009Z * [new branch] gh/fadara01/9/head -> origin/gh/fadara01/9/head 2025-12-04T08:53:09.1774083Z * [new branch] gh/fadara01/9/orig -> origin/gh/fadara01/9/orig 2025-12-04T08:53:09.1774154Z * [new branch] gh/fduwjj/182/base -> origin/gh/fduwjj/182/base 2025-12-04T08:53:09.1774229Z * [new branch] gh/fduwjj/182/head -> origin/gh/fduwjj/182/head 2025-12-04T08:53:09.1774299Z * [new branch] gh/fduwjj/182/orig -> origin/gh/fduwjj/182/orig 2025-12-04T08:53:09.1774373Z * [new branch] gh/fduwjj/211/base -> origin/gh/fduwjj/211/base 2025-12-04T08:53:09.1774451Z * [new branch] gh/fduwjj/211/head -> origin/gh/fduwjj/211/head 2025-12-04T08:53:09.1774526Z * [new branch] gh/fduwjj/211/orig -> origin/gh/fduwjj/211/orig 2025-12-04T08:53:09.1774598Z * [new branch] gh/fduwjj/212/base -> origin/gh/fduwjj/212/base 2025-12-04T08:53:09.1774669Z * [new branch] gh/fduwjj/212/head -> origin/gh/fduwjj/212/head 2025-12-04T08:53:09.1774740Z * [new branch] gh/fduwjj/212/orig -> origin/gh/fduwjj/212/orig 2025-12-04T08:53:09.1774809Z * [new branch] gh/fduwjj/213/base -> origin/gh/fduwjj/213/base 2025-12-04T08:53:09.1774881Z * [new branch] gh/fduwjj/213/head -> origin/gh/fduwjj/213/head 2025-12-04T08:53:09.1774949Z * [new branch] gh/fduwjj/213/orig -> origin/gh/fduwjj/213/orig 2025-12-04T08:53:09.1775020Z * [new branch] gh/fduwjj/226/base -> origin/gh/fduwjj/226/base 2025-12-04T08:53:09.1775091Z * [new branch] gh/fduwjj/226/head -> origin/gh/fduwjj/226/head 2025-12-04T08:53:09.1775163Z * [new branch] gh/fduwjj/226/orig -> origin/gh/fduwjj/226/orig 2025-12-04T08:53:09.1775234Z * [new branch] gh/fduwjj/229/base -> origin/gh/fduwjj/229/base 2025-12-04T08:53:09.1775307Z * [new branch] gh/fduwjj/229/head -> origin/gh/fduwjj/229/head 2025-12-04T08:53:09.1775380Z * [new branch] gh/fduwjj/229/orig -> origin/gh/fduwjj/229/orig 2025-12-04T08:53:09.1775448Z * [new branch] gh/fduwjj/233/base -> origin/gh/fduwjj/233/base 2025-12-04T08:53:09.1775518Z * [new branch] gh/fduwjj/233/head -> origin/gh/fduwjj/233/head 2025-12-04T08:53:09.1775586Z * [new branch] gh/fduwjj/233/orig -> origin/gh/fduwjj/233/orig 2025-12-04T08:53:09.1775655Z * [new branch] gh/fduwjj/234/base -> origin/gh/fduwjj/234/base 2025-12-04T08:53:09.1775728Z * [new branch] gh/fduwjj/234/head -> origin/gh/fduwjj/234/head 2025-12-04T08:53:09.1775796Z * [new branch] gh/fduwjj/234/orig -> origin/gh/fduwjj/234/orig 2025-12-04T08:53:09.1775893Z * [new branch] gh/fduwjj/235/base -> origin/gh/fduwjj/235/base 2025-12-04T08:53:09.1775962Z * [new branch] gh/fduwjj/235/head -> origin/gh/fduwjj/235/head 2025-12-04T08:53:09.1776055Z * [new branch] gh/fduwjj/235/orig -> origin/gh/fduwjj/235/orig 2025-12-04T08:53:09.1776124Z * [new branch] gh/fduwjj/236/base -> origin/gh/fduwjj/236/base 2025-12-04T08:53:09.1776191Z * [new branch] gh/fduwjj/236/head -> origin/gh/fduwjj/236/head 2025-12-04T08:53:09.1776260Z * [new branch] gh/fduwjj/236/orig -> origin/gh/fduwjj/236/orig 2025-12-04T08:53:09.1776328Z * [new branch] gh/fduwjj/237/base -> origin/gh/fduwjj/237/base 2025-12-04T08:53:09.1776395Z * [new branch] gh/fduwjj/237/head -> origin/gh/fduwjj/237/head 2025-12-04T08:53:09.1776466Z * [new branch] gh/fduwjj/237/orig -> origin/gh/fduwjj/237/orig 2025-12-04T08:53:09.1776535Z * [new branch] gh/fduwjj/238/base -> origin/gh/fduwjj/238/base 2025-12-04T08:53:09.1776606Z * [new branch] gh/fduwjj/238/head -> origin/gh/fduwjj/238/head 2025-12-04T08:53:09.1776674Z * [new branch] gh/fduwjj/238/orig -> origin/gh/fduwjj/238/orig 2025-12-04T08:53:09.1776741Z * [new branch] gh/fduwjj/239/base -> origin/gh/fduwjj/239/base 2025-12-04T08:53:09.1776809Z * [new branch] gh/fduwjj/239/head -> origin/gh/fduwjj/239/head 2025-12-04T08:53:09.1776877Z * [new branch] gh/fduwjj/239/orig -> origin/gh/fduwjj/239/orig 2025-12-04T08:53:09.1776949Z * [new branch] gh/fegin/332/base -> origin/gh/fegin/332/base 2025-12-04T08:53:09.1777020Z * [new branch] gh/fegin/332/head -> origin/gh/fegin/332/head 2025-12-04T08:53:09.1777087Z * [new branch] gh/fegin/332/orig -> origin/gh/fegin/332/orig 2025-12-04T08:53:09.1777155Z * [new branch] gh/fegin/333/base -> origin/gh/fegin/333/base 2025-12-04T08:53:09.1777223Z * [new branch] gh/fegin/333/head -> origin/gh/fegin/333/head 2025-12-04T08:53:09.1777291Z * [new branch] gh/fegin/333/orig -> origin/gh/fegin/333/orig 2025-12-04T08:53:09.1777356Z * [new branch] gh/fegin/334/base -> origin/gh/fegin/334/base 2025-12-04T08:53:09.1777423Z * [new branch] gh/fegin/334/head -> origin/gh/fegin/334/head 2025-12-04T08:53:09.1777489Z * [new branch] gh/fegin/334/orig -> origin/gh/fegin/334/orig 2025-12-04T08:53:09.1777554Z * [new branch] gh/fegin/335/base -> origin/gh/fegin/335/base 2025-12-04T08:53:09.1777622Z * [new branch] gh/fegin/335/head -> origin/gh/fegin/335/head 2025-12-04T08:53:09.1777688Z * [new branch] gh/fegin/335/orig -> origin/gh/fegin/335/orig 2025-12-04T08:53:09.1777756Z * [new branch] gh/fffrog/160/base -> origin/gh/fffrog/160/base 2025-12-04T08:53:09.1777829Z * [new branch] gh/fffrog/160/head -> origin/gh/fffrog/160/head 2025-12-04T08:53:09.1777899Z * [new branch] gh/fffrog/177/base -> origin/gh/fffrog/177/base 2025-12-04T08:53:09.1777968Z * [new branch] gh/fffrog/177/head -> origin/gh/fffrog/177/head 2025-12-04T08:53:09.1778039Z * [new branch] gh/fffrog/177/orig -> origin/gh/fffrog/177/orig 2025-12-04T08:53:09.1778106Z * [new branch] gh/fffrog/178/base -> origin/gh/fffrog/178/base 2025-12-04T08:53:09.1778173Z * [new branch] gh/fffrog/178/head -> origin/gh/fffrog/178/head 2025-12-04T08:53:09.1778242Z * [new branch] gh/fffrog/178/orig -> origin/gh/fffrog/178/orig 2025-12-04T08:53:09.1778309Z * [new branch] gh/fffrog/181/base -> origin/gh/fffrog/181/base 2025-12-04T08:53:09.1778377Z * [new branch] gh/fffrog/181/head -> origin/gh/fffrog/181/head 2025-12-04T08:53:09.1778472Z * [new branch] gh/fffrog/181/orig -> origin/gh/fffrog/181/orig 2025-12-04T08:53:09.1778579Z * [new branch] gh/fffrog/183/base -> origin/gh/fffrog/183/base 2025-12-04T08:53:09.1778649Z * [new branch] gh/fffrog/183/head -> origin/gh/fffrog/183/head 2025-12-04T08:53:09.1778718Z * [new branch] gh/fffrog/183/orig -> origin/gh/fffrog/183/orig 2025-12-04T08:53:09.1778786Z * [new branch] gh/fxdawnn/10/base -> origin/gh/fxdawnn/10/base 2025-12-04T08:53:09.1778857Z * [new branch] gh/fxdawnn/10/head -> origin/gh/fxdawnn/10/head 2025-12-04T08:53:09.1778924Z * [new branch] gh/fxdawnn/10/orig -> origin/gh/fxdawnn/10/orig 2025-12-04T08:53:09.1778992Z * [new branch] gh/fxdawnn/11/base -> origin/gh/fxdawnn/11/base 2025-12-04T08:53:09.1779063Z * [new branch] gh/fxdawnn/11/head -> origin/gh/fxdawnn/11/head 2025-12-04T08:53:09.1779133Z * [new branch] gh/fxdawnn/11/orig -> origin/gh/fxdawnn/11/orig 2025-12-04T08:53:09.1779202Z * [new branch] gh/fxdawnn/12/base -> origin/gh/fxdawnn/12/base 2025-12-04T08:53:09.1779273Z * [new branch] gh/fxdawnn/12/head -> origin/gh/fxdawnn/12/head 2025-12-04T08:53:09.1779341Z * [new branch] gh/fxdawnn/12/orig -> origin/gh/fxdawnn/12/orig 2025-12-04T08:53:09.1779408Z * [new branch] gh/fxdawnn/13/base -> origin/gh/fxdawnn/13/base 2025-12-04T08:53:09.1779477Z * [new branch] gh/fxdawnn/13/head -> origin/gh/fxdawnn/13/head 2025-12-04T08:53:09.1779544Z * [new branch] gh/fxdawnn/13/orig -> origin/gh/fxdawnn/13/orig 2025-12-04T08:53:09.1779612Z * [new branch] gh/fxdawnn/14/base -> origin/gh/fxdawnn/14/base 2025-12-04T08:53:09.1779681Z * [new branch] gh/fxdawnn/14/head -> origin/gh/fxdawnn/14/head 2025-12-04T08:53:09.1779751Z * [new branch] gh/fxdawnn/14/orig -> origin/gh/fxdawnn/14/orig 2025-12-04T08:53:09.1779821Z * [new branch] gh/fxdawnn/15/base -> origin/gh/fxdawnn/15/base 2025-12-04T08:53:09.1779892Z * [new branch] gh/fxdawnn/15/head -> origin/gh/fxdawnn/15/head 2025-12-04T08:53:09.1779960Z * [new branch] gh/fxdawnn/15/orig -> origin/gh/fxdawnn/15/orig 2025-12-04T08:53:09.1780029Z * [new branch] gh/fxdawnn/6/base -> origin/gh/fxdawnn/6/base 2025-12-04T08:53:09.1780097Z * [new branch] gh/fxdawnn/6/head -> origin/gh/fxdawnn/6/head 2025-12-04T08:53:09.1780165Z * [new branch] gh/fxdawnn/6/orig -> origin/gh/fxdawnn/6/orig 2025-12-04T08:53:09.1780234Z * [new branch] gh/fxdawnn/7/base -> origin/gh/fxdawnn/7/base 2025-12-04T08:53:09.1780301Z * [new branch] gh/fxdawnn/7/head -> origin/gh/fxdawnn/7/head 2025-12-04T08:53:09.1780371Z * [new branch] gh/fxdawnn/7/orig -> origin/gh/fxdawnn/7/orig 2025-12-04T08:53:09.1780442Z * [new branch] gh/fxdawnn/9/base -> origin/gh/fxdawnn/9/base 2025-12-04T08:53:09.1780510Z * [new branch] gh/fxdawnn/9/head -> origin/gh/fxdawnn/9/head 2025-12-04T08:53:09.1780577Z * [new branch] gh/fxdawnn/9/orig -> origin/gh/fxdawnn/9/orig 2025-12-04T08:53:09.1780646Z * [new branch] gh/galv/1/base -> origin/gh/galv/1/base 2025-12-04T08:53:09.1780712Z * [new branch] gh/galv/1/head -> origin/gh/galv/1/head 2025-12-04T08:53:09.1780777Z * [new branch] gh/galv/1/orig -> origin/gh/galv/1/orig 2025-12-04T08:53:09.1780842Z * [new branch] gh/galv/2/base -> origin/gh/galv/2/base 2025-12-04T08:53:09.1780904Z * [new branch] gh/galv/2/head -> origin/gh/galv/2/head 2025-12-04T08:53:09.1780997Z * [new branch] gh/galv/2/orig -> origin/gh/galv/2/orig 2025-12-04T08:53:09.1781063Z * [new branch] gh/galv/3/base -> origin/gh/galv/3/base 2025-12-04T08:53:09.1781154Z * [new branch] gh/galv/3/head -> origin/gh/galv/3/head 2025-12-04T08:53:09.1781217Z * [new branch] gh/galv/3/orig -> origin/gh/galv/3/orig 2025-12-04T08:53:09.1781298Z * [new branch] gh/guangyey/134/base -> origin/gh/guangyey/134/base 2025-12-04T08:53:09.1781373Z * [new branch] gh/guangyey/134/head -> origin/gh/guangyey/134/head 2025-12-04T08:53:09.1781445Z * [new branch] gh/guangyey/134/orig -> origin/gh/guangyey/134/orig 2025-12-04T08:53:09.1781518Z * [new branch] gh/guangyey/163/base -> origin/gh/guangyey/163/base 2025-12-04T08:53:09.1781589Z * [new branch] gh/guangyey/163/head -> origin/gh/guangyey/163/head 2025-12-04T08:53:09.1781664Z * [new branch] gh/guangyey/163/orig -> origin/gh/guangyey/163/orig 2025-12-04T08:53:09.1781736Z * [new branch] gh/guangyey/168/base -> origin/gh/guangyey/168/base 2025-12-04T08:53:09.1781808Z * [new branch] gh/guangyey/168/head -> origin/gh/guangyey/168/head 2025-12-04T08:53:09.1781879Z * [new branch] gh/guangyey/168/orig -> origin/gh/guangyey/168/orig 2025-12-04T08:53:09.1781950Z * [new branch] gh/guangyey/169/base -> origin/gh/guangyey/169/base 2025-12-04T08:53:09.1782022Z * [new branch] gh/guangyey/169/head -> origin/gh/guangyey/169/head 2025-12-04T08:53:09.1782093Z * [new branch] gh/guangyey/169/orig -> origin/gh/guangyey/169/orig 2025-12-04T08:53:09.1782163Z * [new branch] gh/guangyey/170/base -> origin/gh/guangyey/170/base 2025-12-04T08:53:09.1782234Z * [new branch] gh/guangyey/170/head -> origin/gh/guangyey/170/head 2025-12-04T08:53:09.1782309Z * [new branch] gh/guangyey/170/orig -> origin/gh/guangyey/170/orig 2025-12-04T08:53:09.1782380Z * [new branch] gh/guangyey/171/base -> origin/gh/guangyey/171/base 2025-12-04T08:53:09.1782452Z * [new branch] gh/guangyey/171/head -> origin/gh/guangyey/171/head 2025-12-04T08:53:09.1782525Z * [new branch] gh/guangyey/171/orig -> origin/gh/guangyey/171/orig 2025-12-04T08:53:09.1782597Z * [new branch] gh/guangyey/178/base -> origin/gh/guangyey/178/base 2025-12-04T08:53:09.1782669Z * [new branch] gh/guangyey/178/head -> origin/gh/guangyey/178/head 2025-12-04T08:53:09.1782741Z * [new branch] gh/guangyey/178/orig -> origin/gh/guangyey/178/orig 2025-12-04T08:53:09.1782811Z * [new branch] gh/guangyey/182/base -> origin/gh/guangyey/182/base 2025-12-04T08:53:09.1782881Z * [new branch] gh/guangyey/182/head -> origin/gh/guangyey/182/head 2025-12-04T08:53:09.1782987Z * [new branch] gh/guangyey/182/orig -> origin/gh/guangyey/182/orig 2025-12-04T08:53:09.1783060Z * [new branch] gh/guangyey/183/base -> origin/gh/guangyey/183/base 2025-12-04T08:53:09.1783133Z * [new branch] gh/guangyey/183/head -> origin/gh/guangyey/183/head 2025-12-04T08:53:09.1783203Z * [new branch] gh/guangyey/183/orig -> origin/gh/guangyey/183/orig 2025-12-04T08:53:09.1783273Z * [new branch] gh/guangyey/185/base -> origin/gh/guangyey/185/base 2025-12-04T08:53:09.1783343Z * [new branch] gh/guangyey/185/head -> origin/gh/guangyey/185/head 2025-12-04T08:53:09.1783413Z * [new branch] gh/guangyey/185/orig -> origin/gh/guangyey/185/orig 2025-12-04T08:53:09.1783483Z * [new branch] gh/guangyey/186/base -> origin/gh/guangyey/186/base 2025-12-04T08:53:09.1783554Z * [new branch] gh/guangyey/186/head -> origin/gh/guangyey/186/head 2025-12-04T08:53:09.1783705Z * [new branch] gh/guangyey/186/orig -> origin/gh/guangyey/186/orig 2025-12-04T08:53:09.1783819Z * [new branch] gh/guangyey/187/base -> origin/gh/guangyey/187/base 2025-12-04T08:53:09.1783891Z * [new branch] gh/guangyey/187/head -> origin/gh/guangyey/187/head 2025-12-04T08:53:09.1783962Z * [new branch] gh/guangyey/187/orig -> origin/gh/guangyey/187/orig 2025-12-04T08:53:09.1784032Z * [new branch] gh/guangyey/188/base -> origin/gh/guangyey/188/base 2025-12-04T08:53:09.1784104Z * [new branch] gh/guangyey/188/head -> origin/gh/guangyey/188/head 2025-12-04T08:53:09.1784174Z * [new branch] gh/guangyey/188/orig -> origin/gh/guangyey/188/orig 2025-12-04T08:53:09.1784245Z * [new branch] gh/guangyey/190/base -> origin/gh/guangyey/190/base 2025-12-04T08:53:09.1784316Z * [new branch] gh/guangyey/190/head -> origin/gh/guangyey/190/head 2025-12-04T08:53:09.1784388Z * [new branch] gh/guangyey/190/orig -> origin/gh/guangyey/190/orig 2025-12-04T08:53:09.1784459Z * [new branch] gh/guangyey/208/base -> origin/gh/guangyey/208/base 2025-12-04T08:53:09.1784533Z * [new branch] gh/guangyey/208/head -> origin/gh/guangyey/208/head 2025-12-04T08:53:09.1784604Z * [new branch] gh/guangyey/208/orig -> origin/gh/guangyey/208/orig 2025-12-04T08:53:09.1784673Z * [new branch] gh/guangyey/228/base -> origin/gh/guangyey/228/base 2025-12-04T08:53:09.1784745Z * [new branch] gh/guangyey/228/head -> origin/gh/guangyey/228/head 2025-12-04T08:53:09.1784815Z * [new branch] gh/guangyey/228/orig -> origin/gh/guangyey/228/orig 2025-12-04T08:53:09.1784888Z * [new branch] gh/guangyey/230/base -> origin/gh/guangyey/230/base 2025-12-04T08:53:09.1784957Z * [new branch] gh/guangyey/230/head -> origin/gh/guangyey/230/head 2025-12-04T08:53:09.1785029Z * [new branch] gh/guangyey/230/orig -> origin/gh/guangyey/230/orig 2025-12-04T08:53:09.1785103Z * [new branch] gh/guangyey/231/base -> origin/gh/guangyey/231/base 2025-12-04T08:53:09.1785173Z * [new branch] gh/guangyey/231/head -> origin/gh/guangyey/231/head 2025-12-04T08:53:09.1785245Z * [new branch] gh/guangyey/231/orig -> origin/gh/guangyey/231/orig 2025-12-04T08:53:09.1785317Z * [new branch] gh/guangyey/232/base -> origin/gh/guangyey/232/base 2025-12-04T08:53:09.1785388Z * [new branch] gh/guangyey/232/head -> origin/gh/guangyey/232/head 2025-12-04T08:53:09.1785459Z * [new branch] gh/guangyey/232/orig -> origin/gh/guangyey/232/orig 2025-12-04T08:53:09.1785530Z * [new branch] gh/guangyey/233/base -> origin/gh/guangyey/233/base 2025-12-04T08:53:09.1785601Z * [new branch] gh/guangyey/233/head -> origin/gh/guangyey/233/head 2025-12-04T08:53:09.1785672Z * [new branch] gh/guangyey/233/orig -> origin/gh/guangyey/233/orig 2025-12-04T08:53:09.1785744Z * [new branch] gh/guangyey/234/base -> origin/gh/guangyey/234/base 2025-12-04T08:53:09.1785815Z * [new branch] gh/guangyey/234/head -> origin/gh/guangyey/234/head 2025-12-04T08:53:09.1785887Z * [new branch] gh/guangyey/234/orig -> origin/gh/guangyey/234/orig 2025-12-04T08:53:09.1785959Z * [new branch] gh/guangyey/235/base -> origin/gh/guangyey/235/base 2025-12-04T08:53:09.1786030Z * [new branch] gh/guangyey/235/head -> origin/gh/guangyey/235/head 2025-12-04T08:53:09.1786101Z * [new branch] gh/guangyey/235/orig -> origin/gh/guangyey/235/orig 2025-12-04T08:53:09.1786174Z * [new branch] gh/guangyey/236/base -> origin/gh/guangyey/236/base 2025-12-04T08:53:09.1786245Z * [new branch] gh/guangyey/236/head -> origin/gh/guangyey/236/head 2025-12-04T08:53:09.1786345Z * [new branch] gh/guangyey/236/orig -> origin/gh/guangyey/236/orig 2025-12-04T08:53:09.1786452Z * [new branch] gh/guangyey/237/base -> origin/gh/guangyey/237/base 2025-12-04T08:53:09.1786524Z * [new branch] gh/guangyey/237/head -> origin/gh/guangyey/237/head 2025-12-04T08:53:09.1786598Z * [new branch] gh/guangyey/237/orig -> origin/gh/guangyey/237/orig 2025-12-04T08:53:09.1786669Z * [new branch] gh/guangyey/238/base -> origin/gh/guangyey/238/base 2025-12-04T08:53:09.1786740Z * [new branch] gh/guangyey/238/head -> origin/gh/guangyey/238/head 2025-12-04T08:53:09.1786812Z * [new branch] gh/guangyey/239/base -> origin/gh/guangyey/239/base 2025-12-04T08:53:09.1786882Z * [new branch] gh/guangyey/239/head -> origin/gh/guangyey/239/head 2025-12-04T08:53:09.1786952Z * [new branch] gh/guangyey/239/orig -> origin/gh/guangyey/239/orig 2025-12-04T08:53:09.1787025Z * [new branch] gh/guangyey/240/base -> origin/gh/guangyey/240/base 2025-12-04T08:53:09.1787096Z * [new branch] gh/guangyey/240/head -> origin/gh/guangyey/240/head 2025-12-04T08:53:09.1787168Z * [new branch] gh/guangyey/240/orig -> origin/gh/guangyey/240/orig 2025-12-04T08:53:09.1787241Z * [new branch] gh/guangyey/241/base -> origin/gh/guangyey/241/base 2025-12-04T08:53:09.1787312Z * [new branch] gh/guangyey/241/head -> origin/gh/guangyey/241/head 2025-12-04T08:53:09.1787382Z * [new branch] gh/guangyey/241/orig -> origin/gh/guangyey/241/orig 2025-12-04T08:53:09.1787455Z * [new branch] gh/guangyey/242/base -> origin/gh/guangyey/242/base 2025-12-04T08:53:09.1787525Z * [new branch] gh/guangyey/242/head -> origin/gh/guangyey/242/head 2025-12-04T08:53:09.1787597Z * [new branch] gh/guangyey/242/orig -> origin/gh/guangyey/242/orig 2025-12-04T08:53:09.1787669Z * [new branch] gh/guangyey/243/base -> origin/gh/guangyey/243/base 2025-12-04T08:53:09.1787741Z * [new branch] gh/guangyey/243/head -> origin/gh/guangyey/243/head 2025-12-04T08:53:09.1787815Z * [new branch] gh/guangyey/243/orig -> origin/gh/guangyey/243/orig 2025-12-04T08:53:09.1787884Z * [new branch] gh/guangyey/244/base -> origin/gh/guangyey/244/base 2025-12-04T08:53:09.1787954Z * [new branch] gh/guangyey/244/head -> origin/gh/guangyey/244/head 2025-12-04T08:53:09.1788026Z * [new branch] gh/guangyey/244/orig -> origin/gh/guangyey/244/orig 2025-12-04T08:53:09.1788096Z * [new branch] gh/guangyey/245/base -> origin/gh/guangyey/245/base 2025-12-04T08:53:09.1788165Z * [new branch] gh/guangyey/245/head -> origin/gh/guangyey/245/head 2025-12-04T08:53:09.1788239Z * [new branch] gh/guangyey/245/orig -> origin/gh/guangyey/245/orig 2025-12-04T08:53:09.1788311Z * [new branch] gh/guangyey/246/base -> origin/gh/guangyey/246/base 2025-12-04T08:53:09.1788383Z * [new branch] gh/guangyey/246/head -> origin/gh/guangyey/246/head 2025-12-04T08:53:09.1788456Z * [new branch] gh/guangyey/246/orig -> origin/gh/guangyey/246/orig 2025-12-04T08:53:09.1788526Z * [new branch] gh/guangyey/247/base -> origin/gh/guangyey/247/base 2025-12-04T08:53:09.1788596Z * [new branch] gh/guangyey/247/head -> origin/gh/guangyey/247/head 2025-12-04T08:53:09.1788666Z * [new branch] gh/guangyey/247/orig -> origin/gh/guangyey/247/orig 2025-12-04T08:53:09.1788736Z * [new branch] gh/guangyey/248/base -> origin/gh/guangyey/248/base 2025-12-04T08:53:09.1788807Z * [new branch] gh/guangyey/248/head -> origin/gh/guangyey/248/head 2025-12-04T08:53:09.1788908Z * [new branch] gh/guangyey/248/orig -> origin/gh/guangyey/248/orig 2025-12-04T08:53:09.1788980Z * [new branch] gh/guangyey/249/base -> origin/gh/guangyey/249/base 2025-12-04T08:53:09.1789086Z * [new branch] gh/guangyey/249/head -> origin/gh/guangyey/249/head 2025-12-04T08:53:09.1789160Z * [new branch] gh/guangyey/249/orig -> origin/gh/guangyey/249/orig 2025-12-04T08:53:09.1789230Z * [new branch] gh/guangyey/250/base -> origin/gh/guangyey/250/base 2025-12-04T08:53:09.1789301Z * [new branch] gh/guangyey/250/head -> origin/gh/guangyey/250/head 2025-12-04T08:53:09.1789374Z * [new branch] gh/guangyey/250/orig -> origin/gh/guangyey/250/orig 2025-12-04T08:53:09.1789446Z * [new branch] gh/guangyey/251/base -> origin/gh/guangyey/251/base 2025-12-04T08:53:09.1789518Z * [new branch] gh/guangyey/251/head -> origin/gh/guangyey/251/head 2025-12-04T08:53:09.1789591Z * [new branch] gh/guangyey/251/orig -> origin/gh/guangyey/251/orig 2025-12-04T08:53:09.1789664Z * [new branch] gh/guangyey/252/base -> origin/gh/guangyey/252/base 2025-12-04T08:53:09.1789735Z * [new branch] gh/guangyey/252/head -> origin/gh/guangyey/252/head 2025-12-04T08:53:09.1789805Z * [new branch] gh/guangyey/252/orig -> origin/gh/guangyey/252/orig 2025-12-04T08:53:09.1789875Z * [new branch] gh/guangyey/253/base -> origin/gh/guangyey/253/base 2025-12-04T08:53:09.1789947Z * [new branch] gh/guangyey/253/head -> origin/gh/guangyey/253/head 2025-12-04T08:53:09.1790017Z * [new branch] gh/guangyey/253/orig -> origin/gh/guangyey/253/orig 2025-12-04T08:53:09.1790089Z * [new branch] gh/guangyey/254/base -> origin/gh/guangyey/254/base 2025-12-04T08:53:09.1790161Z * [new branch] gh/guangyey/254/head -> origin/gh/guangyey/254/head 2025-12-04T08:53:09.1790233Z * [new branch] gh/guangyey/254/orig -> origin/gh/guangyey/254/orig 2025-12-04T08:53:09.1790305Z * [new branch] gh/guangyey/255/base -> origin/gh/guangyey/255/base 2025-12-04T08:53:09.1790379Z * [new branch] gh/guangyey/255/head -> origin/gh/guangyey/255/head 2025-12-04T08:53:09.1790450Z * [new branch] gh/guangyey/255/orig -> origin/gh/guangyey/255/orig 2025-12-04T08:53:09.1790548Z * [new branch] gh/guilhermeleobas/107/base -> origin/gh/guilhermeleobas/107/base 2025-12-04T08:53:09.1790643Z * [new branch] gh/guilhermeleobas/107/head -> origin/gh/guilhermeleobas/107/head 2025-12-04T08:53:09.1790731Z * [new branch] gh/guilhermeleobas/107/orig -> origin/gh/guilhermeleobas/107/orig 2025-12-04T08:53:09.1790823Z * [new branch] gh/guilhermeleobas/108/base -> origin/gh/guilhermeleobas/108/base 2025-12-04T08:53:09.1790913Z * [new branch] gh/guilhermeleobas/108/head -> origin/gh/guilhermeleobas/108/head 2025-12-04T08:53:09.1791003Z * [new branch] gh/guilhermeleobas/108/orig -> origin/gh/guilhermeleobas/108/orig 2025-12-04T08:53:09.1791094Z * [new branch] gh/guilhermeleobas/150/base -> origin/gh/guilhermeleobas/150/base 2025-12-04T08:53:09.1791183Z * [new branch] gh/guilhermeleobas/150/head -> origin/gh/guilhermeleobas/150/head 2025-12-04T08:53:09.1791271Z * [new branch] gh/guilhermeleobas/150/orig -> origin/gh/guilhermeleobas/150/orig 2025-12-04T08:53:09.1791361Z * [new branch] gh/guilhermeleobas/168/base -> origin/gh/guilhermeleobas/168/base 2025-12-04T08:53:09.1791450Z * [new branch] gh/guilhermeleobas/168/head -> origin/gh/guilhermeleobas/168/head 2025-12-04T08:53:09.1791538Z * [new branch] gh/guilhermeleobas/168/orig -> origin/gh/guilhermeleobas/168/orig 2025-12-04T08:53:09.1791628Z * [new branch] gh/guilhermeleobas/169/base -> origin/gh/guilhermeleobas/169/base 2025-12-04T08:53:09.1791744Z * [new branch] gh/guilhermeleobas/169/head -> origin/gh/guilhermeleobas/169/head 2025-12-04T08:53:09.1791856Z * [new branch] gh/guilhermeleobas/169/orig -> origin/gh/guilhermeleobas/169/orig 2025-12-04T08:53:09.1791946Z * [new branch] gh/guilhermeleobas/170/base -> origin/gh/guilhermeleobas/170/base 2025-12-04T08:53:09.1792034Z * [new branch] gh/guilhermeleobas/170/head -> origin/gh/guilhermeleobas/170/head 2025-12-04T08:53:09.1792124Z * [new branch] gh/guilhermeleobas/170/orig -> origin/gh/guilhermeleobas/170/orig 2025-12-04T08:53:09.1792213Z * [new branch] gh/guilhermeleobas/171/base -> origin/gh/guilhermeleobas/171/base 2025-12-04T08:53:09.1792300Z * [new branch] gh/guilhermeleobas/171/head -> origin/gh/guilhermeleobas/171/head 2025-12-04T08:53:09.1792388Z * [new branch] gh/guilhermeleobas/171/orig -> origin/gh/guilhermeleobas/171/orig 2025-12-04T08:53:09.1792478Z * [new branch] gh/guilhermeleobas/173/base -> origin/gh/guilhermeleobas/173/base 2025-12-04T08:53:09.1792566Z * [new branch] gh/guilhermeleobas/173/head -> origin/gh/guilhermeleobas/173/head 2025-12-04T08:53:09.1792656Z * [new branch] gh/guilhermeleobas/173/orig -> origin/gh/guilhermeleobas/173/orig 2025-12-04T08:53:09.1792743Z * [new branch] gh/guilhermeleobas/193/base -> origin/gh/guilhermeleobas/193/base 2025-12-04T08:53:09.1792830Z * [new branch] gh/guilhermeleobas/193/head -> origin/gh/guilhermeleobas/193/head 2025-12-04T08:53:09.1792919Z * [new branch] gh/guilhermeleobas/193/orig -> origin/gh/guilhermeleobas/193/orig 2025-12-04T08:53:09.1793048Z * [new branch] gh/guilhermeleobas/204/base -> origin/gh/guilhermeleobas/204/base 2025-12-04T08:53:09.1793137Z * [new branch] gh/guilhermeleobas/204/head -> origin/gh/guilhermeleobas/204/head 2025-12-04T08:53:09.1793228Z * [new branch] gh/guilhermeleobas/204/orig -> origin/gh/guilhermeleobas/204/orig 2025-12-04T08:53:09.1793317Z * [new branch] gh/guilhermeleobas/211/base -> origin/gh/guilhermeleobas/211/base 2025-12-04T08:53:09.1793405Z * [new branch] gh/guilhermeleobas/211/head -> origin/gh/guilhermeleobas/211/head 2025-12-04T08:53:09.1793495Z * [new branch] gh/guilhermeleobas/211/orig -> origin/gh/guilhermeleobas/211/orig 2025-12-04T08:53:09.1793582Z * [new branch] gh/guilhermeleobas/226/base -> origin/gh/guilhermeleobas/226/base 2025-12-04T08:53:09.1793671Z * [new branch] gh/guilhermeleobas/226/head -> origin/gh/guilhermeleobas/226/head 2025-12-04T08:53:09.1793758Z * [new branch] gh/guilhermeleobas/226/orig -> origin/gh/guilhermeleobas/226/orig 2025-12-04T08:53:09.1793845Z * [new branch] gh/guilhermeleobas/236/base -> origin/gh/guilhermeleobas/236/base 2025-12-04T08:53:09.1793933Z * [new branch] gh/guilhermeleobas/236/head -> origin/gh/guilhermeleobas/236/head 2025-12-04T08:53:09.1794024Z * [new branch] gh/guilhermeleobas/236/orig -> origin/gh/guilhermeleobas/236/orig 2025-12-04T08:53:09.1794112Z * [new branch] gh/guilhermeleobas/247/base -> origin/gh/guilhermeleobas/247/base 2025-12-04T08:53:09.1794201Z * [new branch] gh/guilhermeleobas/247/head -> origin/gh/guilhermeleobas/247/head 2025-12-04T08:53:09.1794287Z * [new branch] gh/guilhermeleobas/247/orig -> origin/gh/guilhermeleobas/247/orig 2025-12-04T08:53:09.1794374Z * [new branch] gh/guilhermeleobas/248/base -> origin/gh/guilhermeleobas/248/base 2025-12-04T08:53:09.1794464Z * [new branch] gh/guilhermeleobas/248/head -> origin/gh/guilhermeleobas/248/head 2025-12-04T08:53:09.1794552Z * [new branch] gh/guilhermeleobas/248/orig -> origin/gh/guilhermeleobas/248/orig 2025-12-04T08:53:09.1794686Z * [new branch] gh/guilhermeleobas/250/base -> origin/gh/guilhermeleobas/250/base 2025-12-04T08:53:09.1794810Z * [new branch] gh/guilhermeleobas/250/head -> origin/gh/guilhermeleobas/250/head 2025-12-04T08:53:09.1794899Z * [new branch] gh/guilhermeleobas/250/orig -> origin/gh/guilhermeleobas/250/orig 2025-12-04T08:53:09.1794985Z * [new branch] gh/guilhermeleobas/253/base -> origin/gh/guilhermeleobas/253/base 2025-12-04T08:53:09.1795073Z * [new branch] gh/guilhermeleobas/253/head -> origin/gh/guilhermeleobas/253/head 2025-12-04T08:53:09.1795160Z * [new branch] gh/guilhermeleobas/253/orig -> origin/gh/guilhermeleobas/253/orig 2025-12-04T08:53:09.1795248Z * [new branch] gh/guilhermeleobas/254/base -> origin/gh/guilhermeleobas/254/base 2025-12-04T08:53:09.1795339Z * [new branch] gh/guilhermeleobas/254/head -> origin/gh/guilhermeleobas/254/head 2025-12-04T08:53:09.1795427Z * [new branch] gh/guilhermeleobas/254/orig -> origin/gh/guilhermeleobas/254/orig 2025-12-04T08:53:09.1795517Z * [new branch] gh/guilhermeleobas/255/base -> origin/gh/guilhermeleobas/255/base 2025-12-04T08:53:09.1795606Z * [new branch] gh/guilhermeleobas/255/head -> origin/gh/guilhermeleobas/255/head 2025-12-04T08:53:09.1795694Z * [new branch] gh/guilhermeleobas/255/orig -> origin/gh/guilhermeleobas/255/orig 2025-12-04T08:53:09.1795781Z * [new branch] gh/guilhermeleobas/256/base -> origin/gh/guilhermeleobas/256/base 2025-12-04T08:53:09.1795869Z * [new branch] gh/guilhermeleobas/256/head -> origin/gh/guilhermeleobas/256/head 2025-12-04T08:53:09.1795956Z * [new branch] gh/guilhermeleobas/256/orig -> origin/gh/guilhermeleobas/256/orig 2025-12-04T08:53:09.1796043Z * [new branch] gh/guilhermeleobas/257/base -> origin/gh/guilhermeleobas/257/base 2025-12-04T08:53:09.1796133Z * [new branch] gh/guilhermeleobas/257/head -> origin/gh/guilhermeleobas/257/head 2025-12-04T08:53:09.1796221Z * [new branch] gh/guilhermeleobas/257/orig -> origin/gh/guilhermeleobas/257/orig 2025-12-04T08:53:09.1796310Z * [new branch] gh/guilhermeleobas/258/base -> origin/gh/guilhermeleobas/258/base 2025-12-04T08:53:09.1796397Z * [new branch] gh/guilhermeleobas/258/head -> origin/gh/guilhermeleobas/258/head 2025-12-04T08:53:09.1796484Z * [new branch] gh/guilhermeleobas/258/orig -> origin/gh/guilhermeleobas/258/orig 2025-12-04T08:53:09.1796573Z * [new branch] gh/guilhermeleobas/259/base -> origin/gh/guilhermeleobas/259/base 2025-12-04T08:53:09.1796661Z * [new branch] gh/guilhermeleobas/259/head -> origin/gh/guilhermeleobas/259/head 2025-12-04T08:53:09.1796748Z * [new branch] gh/guilhermeleobas/259/orig -> origin/gh/guilhermeleobas/259/orig 2025-12-04T08:53:09.1796839Z * [new branch] gh/guilhermeleobas/260/base -> origin/gh/guilhermeleobas/260/base 2025-12-04T08:53:09.1796926Z * [new branch] gh/guilhermeleobas/260/head -> origin/gh/guilhermeleobas/260/head 2025-12-04T08:53:09.1797017Z * [new branch] gh/guilhermeleobas/260/orig -> origin/gh/guilhermeleobas/260/orig 2025-12-04T08:53:09.1797104Z * [new branch] gh/guilhermeleobas/261/base -> origin/gh/guilhermeleobas/261/base 2025-12-04T08:53:09.1797190Z * [new branch] gh/guilhermeleobas/261/head -> origin/gh/guilhermeleobas/261/head 2025-12-04T08:53:09.1797279Z * [new branch] gh/guilhermeleobas/261/orig -> origin/gh/guilhermeleobas/261/orig 2025-12-04T08:53:09.1797366Z * [new branch] gh/guilhermeleobas/262/base -> origin/gh/guilhermeleobas/262/base 2025-12-04T08:53:09.1797454Z * [new branch] gh/guilhermeleobas/262/head -> origin/gh/guilhermeleobas/262/head 2025-12-04T08:53:09.1797544Z * [new branch] gh/guilhermeleobas/262/orig -> origin/gh/guilhermeleobas/262/orig 2025-12-04T08:53:09.1797663Z * [new branch] gh/guilhermeleobas/263/base -> origin/gh/guilhermeleobas/263/base 2025-12-04T08:53:09.1797773Z * [new branch] gh/guilhermeleobas/263/head -> origin/gh/guilhermeleobas/263/head 2025-12-04T08:53:09.1797864Z * [new branch] gh/guilhermeleobas/263/orig -> origin/gh/guilhermeleobas/263/orig 2025-12-04T08:53:09.1797951Z * [new branch] gh/guilhermeleobas/264/base -> origin/gh/guilhermeleobas/264/base 2025-12-04T08:53:09.1798037Z * [new branch] gh/guilhermeleobas/264/head -> origin/gh/guilhermeleobas/264/head 2025-12-04T08:53:09.1798126Z * [new branch] gh/guilhermeleobas/264/orig -> origin/gh/guilhermeleobas/264/orig 2025-12-04T08:53:09.1798212Z * [new branch] gh/guilhermeleobas/265/base -> origin/gh/guilhermeleobas/265/base 2025-12-04T08:53:09.1798299Z * [new branch] gh/guilhermeleobas/265/head -> origin/gh/guilhermeleobas/265/head 2025-12-04T08:53:09.1798389Z * [new branch] gh/guilhermeleobas/265/orig -> origin/gh/guilhermeleobas/265/orig 2025-12-04T08:53:09.1798478Z * [new branch] gh/guilhermeleobas/266/base -> origin/gh/guilhermeleobas/266/base 2025-12-04T08:53:09.1798566Z * [new branch] gh/guilhermeleobas/266/head -> origin/gh/guilhermeleobas/266/head 2025-12-04T08:53:09.1798654Z * [new branch] gh/guilhermeleobas/266/orig -> origin/gh/guilhermeleobas/266/orig 2025-12-04T08:53:09.1798741Z * [new branch] gh/guilhermeleobas/267/base -> origin/gh/guilhermeleobas/267/base 2025-12-04T08:53:09.1798830Z * [new branch] gh/guilhermeleobas/267/head -> origin/gh/guilhermeleobas/267/head 2025-12-04T08:53:09.1798916Z * [new branch] gh/guilhermeleobas/267/orig -> origin/gh/guilhermeleobas/267/orig 2025-12-04T08:53:09.1799000Z * [new branch] gh/hameerabbasi/1/base -> origin/gh/hameerabbasi/1/base 2025-12-04T08:53:09.1799079Z * [new branch] gh/hameerabbasi/1/head -> origin/gh/hameerabbasi/1/head 2025-12-04T08:53:09.1799156Z * [new branch] gh/hameerabbasi/2/base -> origin/gh/hameerabbasi/2/base 2025-12-04T08:53:09.1799233Z * [new branch] gh/hameerabbasi/2/head -> origin/gh/hameerabbasi/2/head 2025-12-04T08:53:09.1799311Z * [new branch] gh/hameerabbasi/2/orig -> origin/gh/hameerabbasi/2/orig 2025-12-04T08:53:09.1799386Z * [new branch] gh/hameerabbasi/3/base -> origin/gh/hameerabbasi/3/base 2025-12-04T08:53:09.1799461Z * [new branch] gh/hameerabbasi/3/head -> origin/gh/hameerabbasi/3/head 2025-12-04T08:53:09.1799538Z * [new branch] gh/hameerabbasi/3/orig -> origin/gh/hameerabbasi/3/orig 2025-12-04T08:53:09.1799613Z * [new branch] gh/hameerabbasi/4/base -> origin/gh/hameerabbasi/4/base 2025-12-04T08:53:09.1799688Z * [new branch] gh/hameerabbasi/4/head -> origin/gh/hameerabbasi/4/head 2025-12-04T08:53:09.1799766Z * [new branch] gh/hameerabbasi/4/orig -> origin/gh/hameerabbasi/4/orig 2025-12-04T08:53:09.1799839Z * [new branch] gh/huydhn/1/next -> origin/gh/huydhn/1/next 2025-12-04T08:53:09.1799907Z * [new branch] gh/huydhn/2/next -> origin/gh/huydhn/2/next 2025-12-04T08:53:09.1799978Z * [new branch] gh/huydhn/3/next -> origin/gh/huydhn/3/next 2025-12-04T08:53:09.1800047Z * [new branch] gh/huydhn/4/next -> origin/gh/huydhn/4/next 2025-12-04T08:53:09.1800115Z * [new branch] gh/huydhn/5/next -> origin/gh/huydhn/5/next 2025-12-04T08:53:09.1800179Z * [new branch] gh/huydhn/6/next -> origin/gh/huydhn/6/next 2025-12-04T08:53:09.1800246Z * [new branch] gh/int3/97/base -> origin/gh/int3/97/base 2025-12-04T08:53:09.1800313Z * [new branch] gh/int3/97/head -> origin/gh/int3/97/head 2025-12-04T08:53:09.1800422Z * [new branch] gh/isuruf/101/base -> origin/gh/isuruf/101/base 2025-12-04T08:53:09.1800520Z * [new branch] gh/isuruf/101/head -> origin/gh/isuruf/101/head 2025-12-04T08:53:09.1800591Z * [new branch] gh/isuruf/146/base -> origin/gh/isuruf/146/base 2025-12-04T08:53:09.1800659Z * [new branch] gh/isuruf/146/head -> origin/gh/isuruf/146/head 2025-12-04T08:53:09.1800728Z * [new branch] gh/isuruf/146/orig -> origin/gh/isuruf/146/orig 2025-12-04T08:53:09.1800796Z * [new branch] gh/isuruf/158/base -> origin/gh/isuruf/158/base 2025-12-04T08:53:09.1800862Z * [new branch] gh/isuruf/158/head -> origin/gh/isuruf/158/head 2025-12-04T08:53:09.1800929Z * [new branch] gh/isuruf/159/base -> origin/gh/isuruf/159/base 2025-12-04T08:53:09.1800997Z * [new branch] gh/isuruf/159/head -> origin/gh/isuruf/159/head 2025-12-04T08:53:09.1801066Z * [new branch] gh/isuruf/160/base -> origin/gh/isuruf/160/base 2025-12-04T08:53:09.1801133Z * [new branch] gh/isuruf/160/head -> origin/gh/isuruf/160/head 2025-12-04T08:53:09.1801200Z * [new branch] gh/isuruf/160/orig -> origin/gh/isuruf/160/orig 2025-12-04T08:53:09.1801269Z * [new branch] gh/isuruf/81/base -> origin/gh/isuruf/81/base 2025-12-04T08:53:09.1801336Z * [new branch] gh/isuruf/81/head -> origin/gh/isuruf/81/head 2025-12-04T08:53:09.1801403Z * [new branch] gh/isuruf/81/orig -> origin/gh/isuruf/81/orig 2025-12-04T08:53:09.1801476Z * [new branch] gh/jamesjwu/176/base -> origin/gh/jamesjwu/176/base 2025-12-04T08:53:09.1801548Z * [new branch] gh/jamesjwu/176/head -> origin/gh/jamesjwu/176/head 2025-12-04T08:53:09.1801620Z * [new branch] gh/jamesjwu/176/orig -> origin/gh/jamesjwu/176/orig 2025-12-04T08:53:09.1801691Z * [new branch] gh/jamesjwu/187/base -> origin/gh/jamesjwu/187/base 2025-12-04T08:53:09.1801762Z * [new branch] gh/jamesjwu/187/head -> origin/gh/jamesjwu/187/head 2025-12-04T08:53:09.1801834Z * [new branch] gh/jamesjwu/187/orig -> origin/gh/jamesjwu/187/orig 2025-12-04T08:53:09.1801903Z * [new branch] gh/jamesjwu/196/base -> origin/gh/jamesjwu/196/base 2025-12-04T08:53:09.1801974Z * [new branch] gh/jamesjwu/196/head -> origin/gh/jamesjwu/196/head 2025-12-04T08:53:09.1802044Z * [new branch] gh/jamesjwu/196/orig -> origin/gh/jamesjwu/196/orig 2025-12-04T08:53:09.1802114Z * [new branch] gh/jamesjwu/198/base -> origin/gh/jamesjwu/198/base 2025-12-04T08:53:09.1802186Z * [new branch] gh/jamesjwu/198/head -> origin/gh/jamesjwu/198/head 2025-12-04T08:53:09.1802257Z * [new branch] gh/jamesjwu/198/orig -> origin/gh/jamesjwu/198/orig 2025-12-04T08:53:09.1802327Z * [new branch] gh/jamesjwu/207/base -> origin/gh/jamesjwu/207/base 2025-12-04T08:53:09.1802399Z * [new branch] gh/jamesjwu/207/head -> origin/gh/jamesjwu/207/head 2025-12-04T08:53:09.1802469Z * [new branch] gh/jamesjwu/207/orig -> origin/gh/jamesjwu/207/orig 2025-12-04T08:53:09.1802538Z * [new branch] gh/jamesjwu/208/base -> origin/gh/jamesjwu/208/base 2025-12-04T08:53:09.1802609Z * [new branch] gh/jamesjwu/208/head -> origin/gh/jamesjwu/208/head 2025-12-04T08:53:09.1802679Z * [new branch] gh/jamesjwu/208/orig -> origin/gh/jamesjwu/208/orig 2025-12-04T08:53:09.1802751Z * [new branch] gh/jamesjwu/52/base -> origin/gh/jamesjwu/52/base 2025-12-04T08:53:09.1802823Z * [new branch] gh/jamesjwu/52/head -> origin/gh/jamesjwu/52/head 2025-12-04T08:53:09.1802893Z * [new branch] gh/jamesjwu/53/base -> origin/gh/jamesjwu/53/base 2025-12-04T08:53:09.1803021Z * [new branch] gh/jamesjwu/53/head -> origin/gh/jamesjwu/53/head 2025-12-04T08:53:09.1803132Z * [new branch] gh/jamesjwu/54/base -> origin/gh/jamesjwu/54/base 2025-12-04T08:53:09.1803202Z * [new branch] gh/jamesjwu/54/head -> origin/gh/jamesjwu/54/head 2025-12-04T08:53:09.1803272Z * [new branch] gh/jamesjwu/55/base -> origin/gh/jamesjwu/55/base 2025-12-04T08:53:09.1803343Z * [new branch] gh/jamesjwu/55/head -> origin/gh/jamesjwu/55/head 2025-12-04T08:53:09.1803411Z * [new branch] gh/jamesjwu/56/base -> origin/gh/jamesjwu/56/base 2025-12-04T08:53:09.1803485Z * [new branch] gh/jamesjwu/56/head -> origin/gh/jamesjwu/56/head 2025-12-04T08:53:09.1803553Z * [new branch] gh/jamesjwu/57/base -> origin/gh/jamesjwu/57/base 2025-12-04T08:53:09.1803621Z * [new branch] gh/jamesjwu/57/head -> origin/gh/jamesjwu/57/head 2025-12-04T08:53:09.1803697Z * [new branch] gh/jamesjwu/58/base -> origin/gh/jamesjwu/58/base 2025-12-04T08:53:09.1803768Z * [new branch] gh/jamesjwu/58/head -> origin/gh/jamesjwu/58/head 2025-12-04T08:53:09.1803838Z * [new branch] gh/jamesjwu/59/base -> origin/gh/jamesjwu/59/base 2025-12-04T08:53:09.1803907Z * [new branch] gh/jamesjwu/59/head -> origin/gh/jamesjwu/59/head 2025-12-04T08:53:09.1803976Z * [new branch] gh/jamesjwu/60/base -> origin/gh/jamesjwu/60/base 2025-12-04T08:53:09.1804044Z * [new branch] gh/jamesjwu/60/head -> origin/gh/jamesjwu/60/head 2025-12-04T08:53:09.1804116Z * [new branch] gh/jamesjwu/61/base -> origin/gh/jamesjwu/61/base 2025-12-04T08:53:09.1804186Z * [new branch] gh/jamesjwu/61/head -> origin/gh/jamesjwu/61/head 2025-12-04T08:53:09.1804255Z * [new branch] gh/jamesjwu/62/base -> origin/gh/jamesjwu/62/base 2025-12-04T08:53:09.1804326Z * [new branch] gh/jamesjwu/62/head -> origin/gh/jamesjwu/62/head 2025-12-04T08:53:09.1804397Z * [new branch] gh/jamesjwu/63/base -> origin/gh/jamesjwu/63/base 2025-12-04T08:53:09.1804465Z * [new branch] gh/jamesjwu/63/head -> origin/gh/jamesjwu/63/head 2025-12-04T08:53:09.1804536Z * [new branch] gh/jamesjwu/64/base -> origin/gh/jamesjwu/64/base 2025-12-04T08:53:09.1804605Z * [new branch] gh/jamesjwu/64/head -> origin/gh/jamesjwu/64/head 2025-12-04T08:53:09.1804674Z * [new branch] gh/jamesjwu/65/base -> origin/gh/jamesjwu/65/base 2025-12-04T08:53:09.1804745Z * [new branch] gh/jamesjwu/65/head -> origin/gh/jamesjwu/65/head 2025-12-04T08:53:09.1804816Z * [new branch] gh/janeyx99/165/base -> origin/gh/janeyx99/165/base 2025-12-04T08:53:09.1804886Z * [new branch] gh/janeyx99/165/head -> origin/gh/janeyx99/165/head 2025-12-04T08:53:09.1804960Z * [new branch] gh/janeyx99/165/orig -> origin/gh/janeyx99/165/orig 2025-12-04T08:53:09.1805030Z * [new branch] gh/janeyx99/201/base -> origin/gh/janeyx99/201/base 2025-12-04T08:53:09.1805102Z * [new branch] gh/janeyx99/201/head -> origin/gh/janeyx99/201/head 2025-12-04T08:53:09.1805171Z * [new branch] gh/janeyx99/201/orig -> origin/gh/janeyx99/201/orig 2025-12-04T08:53:09.1805241Z * [new branch] gh/janeyx99/225/base -> origin/gh/janeyx99/225/base 2025-12-04T08:53:09.1805311Z * [new branch] gh/janeyx99/225/head -> origin/gh/janeyx99/225/head 2025-12-04T08:53:09.1805381Z * [new branch] gh/janeyx99/225/orig -> origin/gh/janeyx99/225/orig 2025-12-04T08:53:09.1805451Z * [new branch] gh/janeyx99/299/base -> origin/gh/janeyx99/299/base 2025-12-04T08:53:09.1805523Z * [new branch] gh/janeyx99/299/head -> origin/gh/janeyx99/299/head 2025-12-04T08:53:09.1805627Z * [new branch] gh/janeyx99/299/orig -> origin/gh/janeyx99/299/orig 2025-12-04T08:53:09.1805720Z * [new branch] gh/janeyx99/302/base -> origin/gh/janeyx99/302/base 2025-12-04T08:53:09.1805793Z * [new branch] gh/janeyx99/302/head -> origin/gh/janeyx99/302/head 2025-12-04T08:53:09.1805862Z * [new branch] gh/janeyx99/303/base -> origin/gh/janeyx99/303/base 2025-12-04T08:53:09.1805932Z * [new branch] gh/janeyx99/303/head -> origin/gh/janeyx99/303/head 2025-12-04T08:53:09.1806004Z * [new branch] gh/janeyx99/305/base -> origin/gh/janeyx99/305/base 2025-12-04T08:53:09.1806073Z * [new branch] gh/janeyx99/305/head -> origin/gh/janeyx99/305/head 2025-12-04T08:53:09.1806143Z * [new branch] gh/janeyx99/306/base -> origin/gh/janeyx99/306/base 2025-12-04T08:53:09.1806215Z * [new branch] gh/janeyx99/306/head -> origin/gh/janeyx99/306/head 2025-12-04T08:53:09.1806287Z * [new branch] gh/janeyx99/314/base -> origin/gh/janeyx99/314/base 2025-12-04T08:53:09.1806358Z * [new branch] gh/janeyx99/314/head -> origin/gh/janeyx99/314/head 2025-12-04T08:53:09.1806431Z * [new branch] gh/janeyx99/314/orig -> origin/gh/janeyx99/314/orig 2025-12-04T08:53:09.1806499Z * [new branch] gh/janeyx99/315/base -> origin/gh/janeyx99/315/base 2025-12-04T08:53:09.1806568Z * [new branch] gh/janeyx99/315/head -> origin/gh/janeyx99/315/head 2025-12-04T08:53:09.1806639Z * [new branch] gh/janeyx99/315/orig -> origin/gh/janeyx99/315/orig 2025-12-04T08:53:09.1806710Z * [new branch] gh/janeyx99/316/base -> origin/gh/janeyx99/316/base 2025-12-04T08:53:09.1806782Z * [new branch] gh/janeyx99/316/head -> origin/gh/janeyx99/316/head 2025-12-04T08:53:09.1806850Z * [new branch] gh/janeyx99/316/orig -> origin/gh/janeyx99/316/orig 2025-12-04T08:53:09.1806921Z * [new branch] gh/janeyx99/317/base -> origin/gh/janeyx99/317/base 2025-12-04T08:53:09.1806993Z * [new branch] gh/janeyx99/317/head -> origin/gh/janeyx99/317/head 2025-12-04T08:53:09.1807062Z * [new branch] gh/janeyx99/317/orig -> origin/gh/janeyx99/317/orig 2025-12-04T08:53:09.1807130Z * [new branch] gh/janeyx99/325/base -> origin/gh/janeyx99/325/base 2025-12-04T08:53:09.1807200Z * [new branch] gh/janeyx99/325/head -> origin/gh/janeyx99/325/head 2025-12-04T08:53:09.1807269Z * [new branch] gh/janeyx99/325/orig -> origin/gh/janeyx99/325/orig 2025-12-04T08:53:09.1807337Z * [new branch] gh/janeyx99/327/base -> origin/gh/janeyx99/327/base 2025-12-04T08:53:09.1807408Z * [new branch] gh/janeyx99/327/head -> origin/gh/janeyx99/327/head 2025-12-04T08:53:09.1807478Z * [new branch] gh/janeyx99/327/orig -> origin/gh/janeyx99/327/orig 2025-12-04T08:53:09.1807547Z * [new branch] gh/janeyx99/328/base -> origin/gh/janeyx99/328/base 2025-12-04T08:53:09.1807619Z * [new branch] gh/janeyx99/328/head -> origin/gh/janeyx99/328/head 2025-12-04T08:53:09.1807687Z * [new branch] gh/janeyx99/328/orig -> origin/gh/janeyx99/328/orig 2025-12-04T08:53:09.1807756Z * [new branch] gh/janeyx99/329/base -> origin/gh/janeyx99/329/base 2025-12-04T08:53:09.1807826Z * [new branch] gh/janeyx99/329/head -> origin/gh/janeyx99/329/head 2025-12-04T08:53:09.1807895Z * [new branch] gh/janeyx99/329/orig -> origin/gh/janeyx99/329/orig 2025-12-04T08:53:09.1807963Z * [new branch] gh/janeyx99/330/base -> origin/gh/janeyx99/330/base 2025-12-04T08:53:09.1808034Z * [new branch] gh/janeyx99/330/head -> origin/gh/janeyx99/330/head 2025-12-04T08:53:09.1808135Z * [new branch] gh/janeyx99/330/orig -> origin/gh/janeyx99/330/orig 2025-12-04T08:53:09.1808206Z * [new branch] gh/janeyx99/331/base -> origin/gh/janeyx99/331/base 2025-12-04T08:53:09.1808303Z * [new branch] gh/janeyx99/331/head -> origin/gh/janeyx99/331/head 2025-12-04T08:53:09.1808373Z * [new branch] gh/janeyx99/331/orig -> origin/gh/janeyx99/331/orig 2025-12-04T08:53:09.1808443Z * [new branch] gh/janeyx99/332/base -> origin/gh/janeyx99/332/base 2025-12-04T08:53:09.1808512Z * [new branch] gh/janeyx99/332/head -> origin/gh/janeyx99/332/head 2025-12-04T08:53:09.1808581Z * [new branch] gh/janeyx99/332/orig -> origin/gh/janeyx99/332/orig 2025-12-04T08:53:09.1808651Z * [new branch] gh/janeyx99/333/base -> origin/gh/janeyx99/333/base 2025-12-04T08:53:09.1808719Z * [new branch] gh/janeyx99/333/head -> origin/gh/janeyx99/333/head 2025-12-04T08:53:09.1808790Z * [new branch] gh/janeyx99/333/orig -> origin/gh/janeyx99/333/orig 2025-12-04T08:53:09.1808861Z * [new branch] gh/janeyx99/88/base -> origin/gh/janeyx99/88/base 2025-12-04T08:53:09.1808932Z * [new branch] gh/janeyx99/88/head -> origin/gh/janeyx99/88/head 2025-12-04T08:53:09.1809000Z * [new branch] gh/janeyx99/88/orig -> origin/gh/janeyx99/88/orig 2025-12-04T08:53:09.1809071Z * [new branch] gh/jansel/360/base -> origin/gh/jansel/360/base 2025-12-04T08:53:09.1809138Z * [new branch] gh/jansel/360/head -> origin/gh/jansel/360/head 2025-12-04T08:53:09.1809205Z * [new branch] gh/jansel/451/base -> origin/gh/jansel/451/base 2025-12-04T08:53:09.1809273Z * [new branch] gh/jansel/451/head -> origin/gh/jansel/451/head 2025-12-04T08:53:09.1809341Z * [new branch] gh/jansel/451/orig -> origin/gh/jansel/451/orig 2025-12-04T08:53:09.1809410Z * [new branch] gh/jansel/462/base -> origin/gh/jansel/462/base 2025-12-04T08:53:09.1809478Z * [new branch] gh/jansel/462/head -> origin/gh/jansel/462/head 2025-12-04T08:53:09.1809546Z * [new branch] gh/jansel/462/orig -> origin/gh/jansel/462/orig 2025-12-04T08:53:09.1809614Z * [new branch] gh/jansel/533/base -> origin/gh/jansel/533/base 2025-12-04T08:53:09.1809682Z * [new branch] gh/jansel/533/head -> origin/gh/jansel/533/head 2025-12-04T08:53:09.1809750Z * [new branch] gh/jansel/533/orig -> origin/gh/jansel/533/orig 2025-12-04T08:53:09.1809817Z * [new branch] gh/jansel/552/base -> origin/gh/jansel/552/base 2025-12-04T08:53:09.1809883Z * [new branch] gh/jansel/552/head -> origin/gh/jansel/552/head 2025-12-04T08:53:09.1809951Z * [new branch] gh/jansel/552/orig -> origin/gh/jansel/552/orig 2025-12-04T08:53:09.1810022Z * [new branch] gh/jansel/553/base -> origin/gh/jansel/553/base 2025-12-04T08:53:09.1810089Z * [new branch] gh/jansel/553/head -> origin/gh/jansel/553/head 2025-12-04T08:53:09.1810156Z * [new branch] gh/jansel/553/orig -> origin/gh/jansel/553/orig 2025-12-04T08:53:09.1810224Z * [new branch] gh/jansel/554/base -> origin/gh/jansel/554/base 2025-12-04T08:53:09.1810291Z * [new branch] gh/jansel/554/head -> origin/gh/jansel/554/head 2025-12-04T08:53:09.1810357Z * [new branch] gh/jansel/554/orig -> origin/gh/jansel/554/orig 2025-12-04T08:53:09.1810425Z * [new branch] gh/jansel/555/base -> origin/gh/jansel/555/base 2025-12-04T08:53:09.1810492Z * [new branch] gh/jansel/555/head -> origin/gh/jansel/555/head 2025-12-04T08:53:09.1810559Z * [new branch] gh/jansel/555/orig -> origin/gh/jansel/555/orig 2025-12-04T08:53:09.1810661Z * [new branch] gh/jansel/556/base -> origin/gh/jansel/556/base 2025-12-04T08:53:09.1810728Z * [new branch] gh/jansel/556/head -> origin/gh/jansel/556/head 2025-12-04T08:53:09.1810821Z * [new branch] gh/jansel/556/orig -> origin/gh/jansel/556/orig 2025-12-04T08:53:09.1810890Z * [new branch] gh/jansel/557/base -> origin/gh/jansel/557/base 2025-12-04T08:53:09.1810956Z * [new branch] gh/jansel/557/head -> origin/gh/jansel/557/head 2025-12-04T08:53:09.1811023Z * [new branch] gh/jansel/557/orig -> origin/gh/jansel/557/orig 2025-12-04T08:53:09.1811091Z * [new branch] gh/jansel/558/base -> origin/gh/jansel/558/base 2025-12-04T08:53:09.1811157Z * [new branch] gh/jansel/558/head -> origin/gh/jansel/558/head 2025-12-04T08:53:09.1811225Z * [new branch] gh/jansel/558/orig -> origin/gh/jansel/558/orig 2025-12-04T08:53:09.1811296Z * [new branch] gh/jansel/559/base -> origin/gh/jansel/559/base 2025-12-04T08:53:09.1811363Z * [new branch] gh/jansel/559/head -> origin/gh/jansel/559/head 2025-12-04T08:53:09.1811434Z * [new branch] gh/jansel/559/orig -> origin/gh/jansel/559/orig 2025-12-04T08:53:09.1811502Z * [new branch] gh/jansel/560/base -> origin/gh/jansel/560/base 2025-12-04T08:53:09.1811569Z * [new branch] gh/jansel/560/head -> origin/gh/jansel/560/head 2025-12-04T08:53:09.1811638Z * [new branch] gh/jansel/560/orig -> origin/gh/jansel/560/orig 2025-12-04T08:53:09.1811704Z * [new branch] gh/jansel/561/base -> origin/gh/jansel/561/base 2025-12-04T08:53:09.1811772Z * [new branch] gh/jansel/561/head -> origin/gh/jansel/561/head 2025-12-04T08:53:09.1811839Z * [new branch] gh/jansel/561/orig -> origin/gh/jansel/561/orig 2025-12-04T08:53:09.1811907Z * [new branch] gh/jansel/562/base -> origin/gh/jansel/562/base 2025-12-04T08:53:09.1811975Z * [new branch] gh/jansel/562/head -> origin/gh/jansel/562/head 2025-12-04T08:53:09.1812045Z * [new branch] gh/jansel/562/orig -> origin/gh/jansel/562/orig 2025-12-04T08:53:09.1812112Z * [new branch] gh/jansel/563/base -> origin/gh/jansel/563/base 2025-12-04T08:53:09.1812180Z * [new branch] gh/jansel/563/head -> origin/gh/jansel/563/head 2025-12-04T08:53:09.1812250Z * [new branch] gh/jansel/563/orig -> origin/gh/jansel/563/orig 2025-12-04T08:53:09.1812317Z * [new branch] gh/jansel/564/base -> origin/gh/jansel/564/base 2025-12-04T08:53:09.1812384Z * [new branch] gh/jansel/564/head -> origin/gh/jansel/564/head 2025-12-04T08:53:09.1812454Z * [new branch] gh/jansel/564/orig -> origin/gh/jansel/564/orig 2025-12-04T08:53:09.1812522Z * [new branch] gh/jansel/565/base -> origin/gh/jansel/565/base 2025-12-04T08:53:09.1812591Z * [new branch] gh/jansel/565/head -> origin/gh/jansel/565/head 2025-12-04T08:53:09.1812661Z * [new branch] gh/jansel/565/orig -> origin/gh/jansel/565/orig 2025-12-04T08:53:09.1812728Z * [new branch] gh/jansel/566/base -> origin/gh/jansel/566/base 2025-12-04T08:53:09.1812795Z * [new branch] gh/jansel/566/head -> origin/gh/jansel/566/head 2025-12-04T08:53:09.1812865Z * [new branch] gh/jansel/566/orig -> origin/gh/jansel/566/orig 2025-12-04T08:53:09.1812982Z * [new branch] gh/jansel/567/base -> origin/gh/jansel/567/base 2025-12-04T08:53:09.1813052Z * [new branch] gh/jansel/567/head -> origin/gh/jansel/567/head 2025-12-04T08:53:09.1813119Z * [new branch] gh/jansel/567/orig -> origin/gh/jansel/567/orig 2025-12-04T08:53:09.1813185Z * [new branch] gh/jansel/568/base -> origin/gh/jansel/568/base 2025-12-04T08:53:09.1813299Z * [new branch] gh/jansel/568/head -> origin/gh/jansel/568/head 2025-12-04T08:53:09.1813404Z * [new branch] gh/jansel/568/orig -> origin/gh/jansel/568/orig 2025-12-04T08:53:09.1813471Z * [new branch] gh/jansel/569/base -> origin/gh/jansel/569/base 2025-12-04T08:53:09.1813539Z * [new branch] gh/jansel/569/head -> origin/gh/jansel/569/head 2025-12-04T08:53:09.1813607Z * [new branch] gh/jansel/569/orig -> origin/gh/jansel/569/orig 2025-12-04T08:53:09.1813673Z * [new branch] gh/jansel/570/base -> origin/gh/jansel/570/base 2025-12-04T08:53:09.1813739Z * [new branch] gh/jansel/570/head -> origin/gh/jansel/570/head 2025-12-04T08:53:09.1813806Z * [new branch] gh/jansel/570/orig -> origin/gh/jansel/570/orig 2025-12-04T08:53:09.1813873Z * [new branch] gh/jansel/571/base -> origin/gh/jansel/571/base 2025-12-04T08:53:09.1813943Z * [new branch] gh/jansel/571/head -> origin/gh/jansel/571/head 2025-12-04T08:53:09.1814011Z * [new branch] gh/jansel/571/orig -> origin/gh/jansel/571/orig 2025-12-04T08:53:09.1814079Z * [new branch] gh/jansel/572/base -> origin/gh/jansel/572/base 2025-12-04T08:53:09.1814146Z * [new branch] gh/jansel/572/head -> origin/gh/jansel/572/head 2025-12-04T08:53:09.1814213Z * [new branch] gh/jansel/572/orig -> origin/gh/jansel/572/orig 2025-12-04T08:53:09.1814280Z * [new branch] gh/jansel/573/base -> origin/gh/jansel/573/base 2025-12-04T08:53:09.1814348Z * [new branch] gh/jansel/573/head -> origin/gh/jansel/573/head 2025-12-04T08:53:09.1814415Z * [new branch] gh/jansel/573/orig -> origin/gh/jansel/573/orig 2025-12-04T08:53:09.1814481Z * [new branch] gh/jansel/574/base -> origin/gh/jansel/574/base 2025-12-04T08:53:09.1814551Z * [new branch] gh/jansel/574/head -> origin/gh/jansel/574/head 2025-12-04T08:53:09.1814619Z * [new branch] gh/jansel/574/orig -> origin/gh/jansel/574/orig 2025-12-04T08:53:09.1814686Z * [new branch] gh/jansel/575/base -> origin/gh/jansel/575/base 2025-12-04T08:53:09.1814754Z * [new branch] gh/jansel/575/head -> origin/gh/jansel/575/head 2025-12-04T08:53:09.1814821Z * [new branch] gh/jansel/575/orig -> origin/gh/jansel/575/orig 2025-12-04T08:53:09.1814889Z * [new branch] gh/jansel/576/base -> origin/gh/jansel/576/base 2025-12-04T08:53:09.1814955Z * [new branch] gh/jansel/576/head -> origin/gh/jansel/576/head 2025-12-04T08:53:09.1815021Z * [new branch] gh/jansel/576/orig -> origin/gh/jansel/576/orig 2025-12-04T08:53:09.1815104Z * [new branch] gh/jbschlosser/247/base -> origin/gh/jbschlosser/247/base 2025-12-04T08:53:09.1815184Z * [new branch] gh/jbschlosser/247/head -> origin/gh/jbschlosser/247/head 2025-12-04T08:53:09.1815262Z * [new branch] gh/jbschlosser/247/orig -> origin/gh/jbschlosser/247/orig 2025-12-04T08:53:09.1815341Z * [new branch] gh/jbschlosser/250/base -> origin/gh/jbschlosser/250/base 2025-12-04T08:53:09.1815416Z * [new branch] gh/jbschlosser/250/head -> origin/gh/jbschlosser/250/head 2025-12-04T08:53:09.1815491Z * [new branch] gh/jbschlosser/250/orig -> origin/gh/jbschlosser/250/orig 2025-12-04T08:53:09.1815564Z * [new branch] gh/jerryzh168/1/base -> origin/gh/jerryzh168/1/base 2025-12-04T08:53:09.1815636Z * [new branch] gh/jerryzh168/1/head -> origin/gh/jerryzh168/1/head 2025-12-04T08:53:09.1815707Z * [new branch] gh/jerryzh168/1/orig -> origin/gh/jerryzh168/1/orig 2025-12-04T08:53:09.1815780Z * [new branch] gh/jiayisunx/59/base -> origin/gh/jiayisunx/59/base 2025-12-04T08:53:09.1815876Z * [new branch] gh/jiayisunx/59/head -> origin/gh/jiayisunx/59/head 2025-12-04T08:53:09.1815971Z * [new branch] gh/jiayisunx/59/orig -> origin/gh/jiayisunx/59/orig 2025-12-04T08:53:09.1816043Z * [new branch] gh/jiayisunx/61/base -> origin/gh/jiayisunx/61/base 2025-12-04T08:53:09.1816114Z * [new branch] gh/jiayisunx/61/head -> origin/gh/jiayisunx/61/head 2025-12-04T08:53:09.1816185Z * [new branch] gh/jiayisunx/61/orig -> origin/gh/jiayisunx/61/orig 2025-12-04T08:53:09.1816256Z * [new branch] gh/jiayisunx/68/base -> origin/gh/jiayisunx/68/base 2025-12-04T08:53:09.1816326Z * [new branch] gh/jiayisunx/68/head -> origin/gh/jiayisunx/68/head 2025-12-04T08:53:09.1816398Z * [new branch] gh/jiayisunx/68/orig -> origin/gh/jiayisunx/68/orig 2025-12-04T08:53:09.1816470Z * [new branch] gh/jiayisunx/77/base -> origin/gh/jiayisunx/77/base 2025-12-04T08:53:09.1816540Z * [new branch] gh/jiayisunx/77/head -> origin/gh/jiayisunx/77/head 2025-12-04T08:53:09.1816613Z * [new branch] gh/jiayisunx/77/orig -> origin/gh/jiayisunx/77/orig 2025-12-04T08:53:09.1816684Z * [new branch] gh/jiayisunx/78/base -> origin/gh/jiayisunx/78/base 2025-12-04T08:53:09.1816755Z * [new branch] gh/jiayisunx/78/head -> origin/gh/jiayisunx/78/head 2025-12-04T08:53:09.1816827Z * [new branch] gh/jiayisunx/78/orig -> origin/gh/jiayisunx/78/orig 2025-12-04T08:53:09.1816898Z * [new branch] gh/jiayisunx/79/base -> origin/gh/jiayisunx/79/base 2025-12-04T08:53:09.1816968Z * [new branch] gh/jiayisunx/79/head -> origin/gh/jiayisunx/79/head 2025-12-04T08:53:09.1817041Z * [new branch] gh/jiayisunx/79/orig -> origin/gh/jiayisunx/79/orig 2025-12-04T08:53:09.1817113Z * [new branch] gh/jiayisunx/82/base -> origin/gh/jiayisunx/82/base 2025-12-04T08:53:09.1817184Z * [new branch] gh/jiayisunx/82/head -> origin/gh/jiayisunx/82/head 2025-12-04T08:53:09.1817256Z * [new branch] gh/jiayisunx/82/orig -> origin/gh/jiayisunx/82/orig 2025-12-04T08:53:09.1817326Z * [new branch] gh/jiayisunx/83/base -> origin/gh/jiayisunx/83/base 2025-12-04T08:53:09.1817397Z * [new branch] gh/jiayisunx/83/head -> origin/gh/jiayisunx/83/head 2025-12-04T08:53:09.1817468Z * [new branch] gh/jiayisunx/83/orig -> origin/gh/jiayisunx/83/orig 2025-12-04T08:53:09.1817539Z * [new branch] gh/jiayisunx/84/base -> origin/gh/jiayisunx/84/base 2025-12-04T08:53:09.1817609Z * [new branch] gh/jiayisunx/84/head -> origin/gh/jiayisunx/84/head 2025-12-04T08:53:09.1817681Z * [new branch] gh/jiayisunx/84/orig -> origin/gh/jiayisunx/84/orig 2025-12-04T08:53:09.1817753Z * [new branch] gh/jiayisunx/85/base -> origin/gh/jiayisunx/85/base 2025-12-04T08:53:09.1817825Z * [new branch] gh/jiayisunx/85/head -> origin/gh/jiayisunx/85/head 2025-12-04T08:53:09.1817898Z * [new branch] gh/jiayisunx/85/orig -> origin/gh/jiayisunx/85/orig 2025-12-04T08:53:09.1817968Z * [new branch] gh/jiayisunx/86/base -> origin/gh/jiayisunx/86/base 2025-12-04T08:53:09.1818040Z * [new branch] gh/jiayisunx/86/head -> origin/gh/jiayisunx/86/head 2025-12-04T08:53:09.1818110Z * [new branch] gh/jiayisunx/86/orig -> origin/gh/jiayisunx/86/orig 2025-12-04T08:53:09.1818181Z * [new branch] gh/jiayisunx/87/base -> origin/gh/jiayisunx/87/base 2025-12-04T08:53:09.1818253Z * [new branch] gh/jiayisunx/87/head -> origin/gh/jiayisunx/87/head 2025-12-04T08:53:09.1818323Z * [new branch] gh/jiayisunx/87/orig -> origin/gh/jiayisunx/87/orig 2025-12-04T08:53:09.1818421Z * [new branch] gh/jiayisunx/88/base -> origin/gh/jiayisunx/88/base 2025-12-04T08:53:09.1818492Z * [new branch] gh/jiayisunx/88/head -> origin/gh/jiayisunx/88/head 2025-12-04T08:53:09.1818599Z * [new branch] gh/jiayisunx/88/orig -> origin/gh/jiayisunx/88/orig 2025-12-04T08:53:09.1818671Z * [new branch] gh/jiayisunx/89/base -> origin/gh/jiayisunx/89/base 2025-12-04T08:53:09.1818743Z * [new branch] gh/jiayisunx/89/head -> origin/gh/jiayisunx/89/head 2025-12-04T08:53:09.1818814Z * [new branch] gh/jiayisunx/89/orig -> origin/gh/jiayisunx/89/orig 2025-12-04T08:53:09.1818885Z * [new branch] gh/jiayisunx/90/base -> origin/gh/jiayisunx/90/base 2025-12-04T08:53:09.1818958Z * [new branch] gh/jiayisunx/90/head -> origin/gh/jiayisunx/90/head 2025-12-04T08:53:09.1819028Z * [new branch] gh/jiayisunx/90/orig -> origin/gh/jiayisunx/90/orig 2025-12-04T08:53:09.1819107Z * [new branch] gh/jjwu@meta.com/1/base -> origin/gh/jjwu@meta.com/1/base 2025-12-04T08:53:09.1819183Z * [new branch] gh/jjwu@meta.com/1/head -> origin/gh/jjwu@meta.com/1/head 2025-12-04T08:53:09.1819252Z * [new branch] gh/jturney/1/base -> origin/gh/jturney/1/base 2025-12-04T08:53:09.1819321Z * [new branch] gh/jturney/1/head -> origin/gh/jturney/1/head 2025-12-04T08:53:09.1819389Z * [new branch] gh/jturney/1/orig -> origin/gh/jturney/1/orig 2025-12-04T08:53:09.1819456Z * [new branch] gh/jturney/2/base -> origin/gh/jturney/2/base 2025-12-04T08:53:09.1819524Z * [new branch] gh/jturney/2/head -> origin/gh/jturney/2/head 2025-12-04T08:53:09.1819590Z * [new branch] gh/jturney/2/orig -> origin/gh/jturney/2/orig 2025-12-04T08:53:09.1819668Z * [new branch] gh/karthickai/10/base -> origin/gh/karthickai/10/base 2025-12-04T08:53:09.1819747Z * [new branch] gh/karthickai/10/head -> origin/gh/karthickai/10/head 2025-12-04T08:53:09.1819822Z * [new branch] gh/karthickai/10/orig -> origin/gh/karthickai/10/orig 2025-12-04T08:53:09.1819896Z * [new branch] gh/karthickai/11/base -> origin/gh/karthickai/11/base 2025-12-04T08:53:09.1819969Z * [new branch] gh/karthickai/11/head -> origin/gh/karthickai/11/head 2025-12-04T08:53:09.1820043Z * [new branch] gh/karthickai/11/orig -> origin/gh/karthickai/11/orig 2025-12-04T08:53:09.1820115Z * [new branch] gh/karthickai/12/base -> origin/gh/karthickai/12/base 2025-12-04T08:53:09.1820188Z * [new branch] gh/karthickai/12/head -> origin/gh/karthickai/12/head 2025-12-04T08:53:09.1820260Z * [new branch] gh/karthickai/12/orig -> origin/gh/karthickai/12/orig 2025-12-04T08:53:09.1820332Z * [new branch] gh/karthickai/13/base -> origin/gh/karthickai/13/base 2025-12-04T08:53:09.1820407Z * [new branch] gh/karthickai/13/head -> origin/gh/karthickai/13/head 2025-12-04T08:53:09.1820481Z * [new branch] gh/karthickai/13/orig -> origin/gh/karthickai/13/orig 2025-12-04T08:53:09.1820554Z * [new branch] gh/karthickai/14/base -> origin/gh/karthickai/14/base 2025-12-04T08:53:09.1820627Z * [new branch] gh/karthickai/14/head -> origin/gh/karthickai/14/head 2025-12-04T08:53:09.1820700Z * [new branch] gh/karthickai/14/orig -> origin/gh/karthickai/14/orig 2025-12-04T08:53:09.1820773Z * [new branch] gh/karthickai/15/base -> origin/gh/karthickai/15/base 2025-12-04T08:53:09.1820848Z * [new branch] gh/karthickai/15/head -> origin/gh/karthickai/15/head 2025-12-04T08:53:09.1820921Z * [new branch] gh/karthickai/15/orig -> origin/gh/karthickai/15/orig 2025-12-04T08:53:09.1820994Z * [new branch] gh/karthickai/16/base -> origin/gh/karthickai/16/base 2025-12-04T08:53:09.1821094Z * [new branch] gh/karthickai/16/head -> origin/gh/karthickai/16/head 2025-12-04T08:53:09.1821191Z * [new branch] gh/karthickai/16/orig -> origin/gh/karthickai/16/orig 2025-12-04T08:53:09.1821265Z * [new branch] gh/karthickai/17/base -> origin/gh/karthickai/17/base 2025-12-04T08:53:09.1821338Z * [new branch] gh/karthickai/17/head -> origin/gh/karthickai/17/head 2025-12-04T08:53:09.1821410Z * [new branch] gh/karthickai/17/orig -> origin/gh/karthickai/17/orig 2025-12-04T08:53:09.1821483Z * [new branch] gh/karthickai/18/base -> origin/gh/karthickai/18/base 2025-12-04T08:53:09.1821556Z * [new branch] gh/karthickai/18/head -> origin/gh/karthickai/18/head 2025-12-04T08:53:09.1821628Z * [new branch] gh/karthickai/18/orig -> origin/gh/karthickai/18/orig 2025-12-04T08:53:09.1821701Z * [new branch] gh/karthickai/19/base -> origin/gh/karthickai/19/base 2025-12-04T08:53:09.1821775Z * [new branch] gh/karthickai/19/head -> origin/gh/karthickai/19/head 2025-12-04T08:53:09.1821848Z * [new branch] gh/karthickai/19/orig -> origin/gh/karthickai/19/orig 2025-12-04T08:53:09.1821921Z * [new branch] gh/karthickai/20/base -> origin/gh/karthickai/20/base 2025-12-04T08:53:09.1821994Z * [new branch] gh/karthickai/20/head -> origin/gh/karthickai/20/head 2025-12-04T08:53:09.1822066Z * [new branch] gh/karthickai/20/orig -> origin/gh/karthickai/20/orig 2025-12-04T08:53:09.1822139Z * [new branch] gh/karthickai/21/base -> origin/gh/karthickai/21/base 2025-12-04T08:53:09.1822211Z * [new branch] gh/karthickai/21/head -> origin/gh/karthickai/21/head 2025-12-04T08:53:09.1822283Z * [new branch] gh/karthickai/21/orig -> origin/gh/karthickai/21/orig 2025-12-04T08:53:09.1822358Z * [new branch] gh/karthickai/22/base -> origin/gh/karthickai/22/base 2025-12-04T08:53:09.1822430Z * [new branch] gh/karthickai/22/head -> origin/gh/karthickai/22/head 2025-12-04T08:53:09.1822504Z * [new branch] gh/karthickai/22/orig -> origin/gh/karthickai/22/orig 2025-12-04T08:53:09.1822577Z * [new branch] gh/karthickai/23/base -> origin/gh/karthickai/23/base 2025-12-04T08:53:09.1822648Z * [new branch] gh/karthickai/23/head -> origin/gh/karthickai/23/head 2025-12-04T08:53:09.1822721Z * [new branch] gh/karthickai/23/orig -> origin/gh/karthickai/23/orig 2025-12-04T08:53:09.1822795Z * [new branch] gh/karthickai/24/base -> origin/gh/karthickai/24/base 2025-12-04T08:53:09.1822868Z * [new branch] gh/karthickai/24/head -> origin/gh/karthickai/24/head 2025-12-04T08:53:09.1822980Z * [new branch] gh/karthickai/24/orig -> origin/gh/karthickai/24/orig 2025-12-04T08:53:09.1823055Z * [new branch] gh/karthickai/25/base -> origin/gh/karthickai/25/base 2025-12-04T08:53:09.1823128Z * [new branch] gh/karthickai/25/head -> origin/gh/karthickai/25/head 2025-12-04T08:53:09.1823202Z * [new branch] gh/karthickai/25/orig -> origin/gh/karthickai/25/orig 2025-12-04T08:53:09.1823274Z * [new branch] gh/karthickai/26/base -> origin/gh/karthickai/26/base 2025-12-04T08:53:09.1823347Z * [new branch] gh/karthickai/26/head -> origin/gh/karthickai/26/head 2025-12-04T08:53:09.1823420Z * [new branch] gh/karthickai/26/orig -> origin/gh/karthickai/26/orig 2025-12-04T08:53:09.1823493Z * [new branch] gh/karthickai/6/base -> origin/gh/karthickai/6/base 2025-12-04T08:53:09.1823565Z * [new branch] gh/karthickai/6/head -> origin/gh/karthickai/6/head 2025-12-04T08:53:09.1823638Z * [new branch] gh/karthickai/6/orig -> origin/gh/karthickai/6/orig 2025-12-04T08:53:09.1823746Z * [new branch] gh/krocki/1/base -> origin/gh/krocki/1/base 2025-12-04T08:53:09.1823813Z * [new branch] gh/krocki/1/head -> origin/gh/krocki/1/head 2025-12-04T08:53:09.1823919Z * [new branch] gh/krocki/1/orig -> origin/gh/krocki/1/orig 2025-12-04T08:53:09.1823986Z * [new branch] gh/krocki/2/base -> origin/gh/krocki/2/base 2025-12-04T08:53:09.1824051Z * [new branch] gh/krocki/2/head -> origin/gh/krocki/2/head 2025-12-04T08:53:09.1824118Z * [new branch] gh/krocki/2/orig -> origin/gh/krocki/2/orig 2025-12-04T08:53:09.1824197Z * [new branch] gh/kurtamohler/60/base -> origin/gh/kurtamohler/60/base 2025-12-04T08:53:09.1824275Z * [new branch] gh/kurtamohler/60/head -> origin/gh/kurtamohler/60/head 2025-12-04T08:53:09.1824351Z * [new branch] gh/kurtamohler/60/orig -> origin/gh/kurtamohler/60/orig 2025-12-04T08:53:09.1824427Z * [new branch] gh/kurtamohler/61/base -> origin/gh/kurtamohler/61/base 2025-12-04T08:53:09.1824503Z * [new branch] gh/kurtamohler/61/head -> origin/gh/kurtamohler/61/head 2025-12-04T08:53:09.1824577Z * [new branch] gh/kurtamohler/61/orig -> origin/gh/kurtamohler/61/orig 2025-12-04T08:53:09.1824651Z * [new branch] gh/kurtamohler/62/base -> origin/gh/kurtamohler/62/base 2025-12-04T08:53:09.1824725Z * [new branch] gh/kurtamohler/62/head -> origin/gh/kurtamohler/62/head 2025-12-04T08:53:09.1824799Z * [new branch] gh/kurtamohler/62/orig -> origin/gh/kurtamohler/62/orig 2025-12-04T08:53:09.1824873Z * [new branch] gh/kurtamohler/63/base -> origin/gh/kurtamohler/63/base 2025-12-04T08:53:09.1824949Z * [new branch] gh/kurtamohler/63/head -> origin/gh/kurtamohler/63/head 2025-12-04T08:53:09.1825023Z * [new branch] gh/kurtamohler/63/orig -> origin/gh/kurtamohler/63/orig 2025-12-04T08:53:09.1825099Z * [new branch] gh/kurtamohler/64/base -> origin/gh/kurtamohler/64/base 2025-12-04T08:53:09.1825175Z * [new branch] gh/kurtamohler/64/head -> origin/gh/kurtamohler/64/head 2025-12-04T08:53:09.1825247Z * [new branch] gh/kurtamohler/64/orig -> origin/gh/kurtamohler/64/orig 2025-12-04T08:53:09.1825320Z * [new branch] gh/kurtamohler/65/base -> origin/gh/kurtamohler/65/base 2025-12-04T08:53:09.1825395Z * [new branch] gh/kurtamohler/65/head -> origin/gh/kurtamohler/65/head 2025-12-04T08:53:09.1825468Z * [new branch] gh/kurtamohler/65/orig -> origin/gh/kurtamohler/65/orig 2025-12-04T08:53:09.1825542Z * [new branch] gh/kurtamohler/66/base -> origin/gh/kurtamohler/66/base 2025-12-04T08:53:09.1825616Z * [new branch] gh/kurtamohler/66/head -> origin/gh/kurtamohler/66/head 2025-12-04T08:53:09.1825689Z * [new branch] gh/kurtamohler/66/orig -> origin/gh/kurtamohler/66/orig 2025-12-04T08:53:09.1825766Z * [new branch] gh/kurtamohler/67/base -> origin/gh/kurtamohler/67/base 2025-12-04T08:53:09.1825841Z * [new branch] gh/kurtamohler/67/head -> origin/gh/kurtamohler/67/head 2025-12-04T08:53:09.1825915Z * [new branch] gh/kurtamohler/67/orig -> origin/gh/kurtamohler/67/orig 2025-12-04T08:53:09.1825986Z * [new branch] gh/kwen2501/130/base -> origin/gh/kwen2501/130/base 2025-12-04T08:53:09.1826056Z * [new branch] gh/kwen2501/130/head -> origin/gh/kwen2501/130/head 2025-12-04T08:53:09.1826126Z * [new branch] gh/kwen2501/130/orig -> origin/gh/kwen2501/130/orig 2025-12-04T08:53:09.1826197Z * [new branch] gh/kwen2501/170/base -> origin/gh/kwen2501/170/base 2025-12-04T08:53:09.1826266Z * [new branch] gh/kwen2501/170/head -> origin/gh/kwen2501/170/head 2025-12-04T08:53:09.1826365Z * [new branch] gh/kwen2501/187/base -> origin/gh/kwen2501/187/base 2025-12-04T08:53:09.1826434Z * [new branch] gh/kwen2501/187/head -> origin/gh/kwen2501/187/head 2025-12-04T08:53:09.1826529Z * [new branch] gh/kwen2501/187/orig -> origin/gh/kwen2501/187/orig 2025-12-04T08:53:09.1826599Z * [new branch] gh/kwen2501/188/base -> origin/gh/kwen2501/188/base 2025-12-04T08:53:09.1826668Z * [new branch] gh/kwen2501/188/head -> origin/gh/kwen2501/188/head 2025-12-04T08:53:09.1826737Z * [new branch] gh/kwen2501/188/orig -> origin/gh/kwen2501/188/orig 2025-12-04T08:53:09.1826806Z * [new branch] gh/kwen2501/211/base -> origin/gh/kwen2501/211/base 2025-12-04T08:53:09.1826875Z * [new branch] gh/kwen2501/211/head -> origin/gh/kwen2501/211/head 2025-12-04T08:53:09.1826944Z * [new branch] gh/kwen2501/224/base -> origin/gh/kwen2501/224/base 2025-12-04T08:53:09.1827014Z * [new branch] gh/kwen2501/224/head -> origin/gh/kwen2501/224/head 2025-12-04T08:53:09.1827083Z * [new branch] gh/kwen2501/224/orig -> origin/gh/kwen2501/224/orig 2025-12-04T08:53:09.1827153Z * [new branch] gh/kwen2501/228/base -> origin/gh/kwen2501/228/base 2025-12-04T08:53:09.1827222Z * [new branch] gh/kwen2501/228/head -> origin/gh/kwen2501/228/head 2025-12-04T08:53:09.1827292Z * [new branch] gh/kwen2501/228/orig -> origin/gh/kwen2501/228/orig 2025-12-04T08:53:09.1827360Z * [new branch] gh/kwen2501/234/base -> origin/gh/kwen2501/234/base 2025-12-04T08:53:09.1827429Z * [new branch] gh/kwen2501/234/head -> origin/gh/kwen2501/234/head 2025-12-04T08:53:09.1827499Z * [new branch] gh/kwen2501/234/orig -> origin/gh/kwen2501/234/orig 2025-12-04T08:53:09.1827568Z * [new branch] gh/kwen2501/235/base -> origin/gh/kwen2501/235/base 2025-12-04T08:53:09.1827639Z * [new branch] gh/kwen2501/235/head -> origin/gh/kwen2501/235/head 2025-12-04T08:53:09.1827707Z * [new branch] gh/kwen2501/235/orig -> origin/gh/kwen2501/235/orig 2025-12-04T08:53:09.1827776Z * [new branch] gh/kwen2501/236/base -> origin/gh/kwen2501/236/base 2025-12-04T08:53:09.1827844Z * [new branch] gh/kwen2501/236/head -> origin/gh/kwen2501/236/head 2025-12-04T08:53:09.1827914Z * [new branch] gh/kwen2501/236/orig -> origin/gh/kwen2501/236/orig 2025-12-04T08:53:09.1827983Z * [new branch] gh/kwen2501/237/base -> origin/gh/kwen2501/237/base 2025-12-04T08:53:09.1828054Z * [new branch] gh/kwen2501/237/head -> origin/gh/kwen2501/237/head 2025-12-04T08:53:09.1828122Z * [new branch] gh/kwen2501/237/orig -> origin/gh/kwen2501/237/orig 2025-12-04T08:53:09.1828192Z * [new branch] gh/kwen2501/238/base -> origin/gh/kwen2501/238/base 2025-12-04T08:53:09.1828262Z * [new branch] gh/kwen2501/238/head -> origin/gh/kwen2501/238/head 2025-12-04T08:53:09.1828330Z * [new branch] gh/kwen2501/238/orig -> origin/gh/kwen2501/238/orig 2025-12-04T08:53:09.1828399Z * [new branch] gh/kwen2501/240/base -> origin/gh/kwen2501/240/base 2025-12-04T08:53:09.1828468Z * [new branch] gh/kwen2501/240/head -> origin/gh/kwen2501/240/head 2025-12-04T08:53:09.1828535Z * [new branch] gh/kwen2501/240/orig -> origin/gh/kwen2501/240/orig 2025-12-04T08:53:09.1828604Z * [new branch] gh/kwen2501/241/base -> origin/gh/kwen2501/241/base 2025-12-04T08:53:09.1828676Z * [new branch] gh/kwen2501/241/head -> origin/gh/kwen2501/241/head 2025-12-04T08:53:09.1828744Z * [new branch] gh/kwen2501/241/orig -> origin/gh/kwen2501/241/orig 2025-12-04T08:53:09.1828813Z * [new branch] gh/kwen2501/247/base -> origin/gh/kwen2501/247/base 2025-12-04T08:53:09.1828907Z * [new branch] gh/kwen2501/247/head -> origin/gh/kwen2501/247/head 2025-12-04T08:53:09.1828975Z * [new branch] gh/kwen2501/247/orig -> origin/gh/kwen2501/247/orig 2025-12-04T08:53:09.1829092Z * [new branch] gh/kwen2501/252/base -> origin/gh/kwen2501/252/base 2025-12-04T08:53:09.1829164Z * [new branch] gh/kwen2501/252/head -> origin/gh/kwen2501/252/head 2025-12-04T08:53:09.1829232Z * [new branch] gh/kwen2501/252/orig -> origin/gh/kwen2501/252/orig 2025-12-04T08:53:09.1829303Z * [new branch] gh/kwen2501/259/base -> origin/gh/kwen2501/259/base 2025-12-04T08:53:09.1829373Z * [new branch] gh/kwen2501/259/head -> origin/gh/kwen2501/259/head 2025-12-04T08:53:09.1829441Z * [new branch] gh/kwen2501/259/orig -> origin/gh/kwen2501/259/orig 2025-12-04T08:53:09.1829510Z * [new branch] gh/kwen2501/260/base -> origin/gh/kwen2501/260/base 2025-12-04T08:53:09.1829581Z * [new branch] gh/kwen2501/260/head -> origin/gh/kwen2501/260/head 2025-12-04T08:53:09.1829649Z * [new branch] gh/kwen2501/260/orig -> origin/gh/kwen2501/260/orig 2025-12-04T08:53:09.1829720Z * [new branch] gh/kwen2501/268/base -> origin/gh/kwen2501/268/base 2025-12-04T08:53:09.1829789Z * [new branch] gh/kwen2501/268/head -> origin/gh/kwen2501/268/head 2025-12-04T08:53:09.1829858Z * [new branch] gh/kwen2501/268/orig -> origin/gh/kwen2501/268/orig 2025-12-04T08:53:09.1829928Z * [new branch] gh/kwen2501/269/base -> origin/gh/kwen2501/269/base 2025-12-04T08:53:09.1829996Z * [new branch] gh/kwen2501/269/head -> origin/gh/kwen2501/269/head 2025-12-04T08:53:09.1830064Z * [new branch] gh/kwen2501/269/orig -> origin/gh/kwen2501/269/orig 2025-12-04T08:53:09.1830134Z * [new branch] gh/kwen2501/270/base -> origin/gh/kwen2501/270/base 2025-12-04T08:53:09.1830203Z * [new branch] gh/kwen2501/270/head -> origin/gh/kwen2501/270/head 2025-12-04T08:53:09.1830274Z * [new branch] gh/kwen2501/270/orig -> origin/gh/kwen2501/270/orig 2025-12-04T08:53:09.1830342Z * [new branch] gh/kwen2501/271/base -> origin/gh/kwen2501/271/base 2025-12-04T08:53:09.1830411Z * [new branch] gh/kwen2501/271/head -> origin/gh/kwen2501/271/head 2025-12-04T08:53:09.1830482Z * [new branch] gh/kwen2501/271/orig -> origin/gh/kwen2501/271/orig 2025-12-04T08:53:09.1830550Z * [new branch] gh/kwen2501/274/base -> origin/gh/kwen2501/274/base 2025-12-04T08:53:09.1830619Z * [new branch] gh/kwen2501/274/head -> origin/gh/kwen2501/274/head 2025-12-04T08:53:09.1830689Z * [new branch] gh/kwen2501/274/orig -> origin/gh/kwen2501/274/orig 2025-12-04T08:53:09.1830757Z * [new branch] gh/kwen2501/275/base -> origin/gh/kwen2501/275/base 2025-12-04T08:53:09.1830827Z * [new branch] gh/kwen2501/275/head -> origin/gh/kwen2501/275/head 2025-12-04T08:53:09.1830896Z * [new branch] gh/kwen2501/275/orig -> origin/gh/kwen2501/275/orig 2025-12-04T08:53:09.1830964Z * [new branch] gh/kwen2501/276/base -> origin/gh/kwen2501/276/base 2025-12-04T08:53:09.1831032Z * [new branch] gh/kwen2501/276/head -> origin/gh/kwen2501/276/head 2025-12-04T08:53:09.1831103Z * [new branch] gh/kwen2501/276/orig -> origin/gh/kwen2501/276/orig 2025-12-04T08:53:09.1831171Z * [new branch] gh/kwen2501/277/base -> origin/gh/kwen2501/277/base 2025-12-04T08:53:09.1831239Z * [new branch] gh/kwen2501/277/head -> origin/gh/kwen2501/277/head 2025-12-04T08:53:09.1831310Z * [new branch] gh/kwen2501/277/orig -> origin/gh/kwen2501/277/orig 2025-12-04T08:53:09.1831377Z * [new branch] gh/kwen2501/278/base -> origin/gh/kwen2501/278/base 2025-12-04T08:53:09.1831472Z * [new branch] gh/kwen2501/278/head -> origin/gh/kwen2501/278/head 2025-12-04T08:53:09.1831567Z * [new branch] gh/kwen2501/278/orig -> origin/gh/kwen2501/278/orig 2025-12-04T08:53:09.1831636Z * [new branch] gh/kwen2501/279/base -> origin/gh/kwen2501/279/base 2025-12-04T08:53:09.1831705Z * [new branch] gh/kwen2501/279/head -> origin/gh/kwen2501/279/head 2025-12-04T08:53:09.1831775Z * [new branch] gh/kwen2501/279/orig -> origin/gh/kwen2501/279/orig 2025-12-04T08:53:09.1831843Z * [new branch] gh/kwen2501/280/base -> origin/gh/kwen2501/280/base 2025-12-04T08:53:09.1831913Z * [new branch] gh/kwen2501/280/head -> origin/gh/kwen2501/280/head 2025-12-04T08:53:09.1831981Z * [new branch] gh/kwen2501/280/orig -> origin/gh/kwen2501/280/orig 2025-12-04T08:53:09.1832050Z * [new branch] gh/kwen2501/281/base -> origin/gh/kwen2501/281/base 2025-12-04T08:53:09.1832120Z * [new branch] gh/kwen2501/281/head -> origin/gh/kwen2501/281/head 2025-12-04T08:53:09.1832189Z * [new branch] gh/kwen2501/281/orig -> origin/gh/kwen2501/281/orig 2025-12-04T08:53:09.1832258Z * [new branch] gh/kwen2501/282/base -> origin/gh/kwen2501/282/base 2025-12-04T08:53:09.1832329Z * [new branch] gh/kwen2501/282/head -> origin/gh/kwen2501/282/head 2025-12-04T08:53:09.1832397Z * [new branch] gh/kwen2501/282/orig -> origin/gh/kwen2501/282/orig 2025-12-04T08:53:09.1832464Z * [new branch] gh/kwen2501/283/base -> origin/gh/kwen2501/283/base 2025-12-04T08:53:09.1832534Z * [new branch] gh/kwen2501/283/head -> origin/gh/kwen2501/283/head 2025-12-04T08:53:09.1832602Z * [new branch] gh/kwen2501/283/orig -> origin/gh/kwen2501/283/orig 2025-12-04T08:53:09.1832671Z * [new branch] gh/kwen2501/284/base -> origin/gh/kwen2501/284/base 2025-12-04T08:53:09.1832743Z * [new branch] gh/kwen2501/284/head -> origin/gh/kwen2501/284/head 2025-12-04T08:53:09.1832813Z * [new branch] gh/kwen2501/284/orig -> origin/gh/kwen2501/284/orig 2025-12-04T08:53:09.1832884Z * [new branch] gh/kwen2501/285/base -> origin/gh/kwen2501/285/base 2025-12-04T08:53:09.1832989Z * [new branch] gh/kwen2501/285/head -> origin/gh/kwen2501/285/head 2025-12-04T08:53:09.1833059Z * [new branch] gh/kwen2501/285/orig -> origin/gh/kwen2501/285/orig 2025-12-04T08:53:09.1833127Z * [new branch] gh/kwen2501/286/base -> origin/gh/kwen2501/286/base 2025-12-04T08:53:09.1833196Z * [new branch] gh/kwen2501/286/head -> origin/gh/kwen2501/286/head 2025-12-04T08:53:09.1833264Z * [new branch] gh/kwen2501/286/orig -> origin/gh/kwen2501/286/orig 2025-12-04T08:53:09.1833335Z * [new branch] gh/kwen2501/287/base -> origin/gh/kwen2501/287/base 2025-12-04T08:53:09.1833403Z * [new branch] gh/kwen2501/287/head -> origin/gh/kwen2501/287/head 2025-12-04T08:53:09.1833472Z * [new branch] gh/kwen2501/287/orig -> origin/gh/kwen2501/287/orig 2025-12-04T08:53:09.1833542Z * [new branch] gh/kwen2501/288/base -> origin/gh/kwen2501/288/base 2025-12-04T08:53:09.1833611Z * [new branch] gh/kwen2501/288/head -> origin/gh/kwen2501/288/head 2025-12-04T08:53:09.1833680Z * [new branch] gh/kwen2501/288/orig -> origin/gh/kwen2501/288/orig 2025-12-04T08:53:09.1833758Z * [new branch] gh/laithsakka/251/base -> origin/gh/laithsakka/251/base 2025-12-04T08:53:09.1833834Z * [new branch] gh/laithsakka/251/head -> origin/gh/laithsakka/251/head 2025-12-04T08:53:09.1833908Z * [new branch] gh/laithsakka/251/orig -> origin/gh/laithsakka/251/orig 2025-12-04T08:53:09.1834025Z * [new branch] gh/laithsakka/276/base -> origin/gh/laithsakka/276/base 2025-12-04T08:53:09.1834100Z * [new branch] gh/laithsakka/276/head -> origin/gh/laithsakka/276/head 2025-12-04T08:53:09.1834209Z * [new branch] gh/laithsakka/276/orig -> origin/gh/laithsakka/276/orig 2025-12-04T08:53:09.1834285Z * [new branch] gh/laithsakka/28/base -> origin/gh/laithsakka/28/base 2025-12-04T08:53:09.1834359Z * [new branch] gh/laithsakka/29/base -> origin/gh/laithsakka/29/base 2025-12-04T08:53:09.1834431Z * [new branch] gh/laithsakka/30/base -> origin/gh/laithsakka/30/base 2025-12-04T08:53:09.1834506Z * [new branch] gh/laithsakka/30/head -> origin/gh/laithsakka/30/head 2025-12-04T08:53:09.1834579Z * [new branch] gh/laithsakka/31/base -> origin/gh/laithsakka/31/base 2025-12-04T08:53:09.1834650Z * [new branch] gh/laithsakka/31/head -> origin/gh/laithsakka/31/head 2025-12-04T08:53:09.1834729Z * [new branch] gh/laithsakka/313/base -> origin/gh/laithsakka/313/base 2025-12-04T08:53:09.1834804Z * [new branch] gh/laithsakka/313/head -> origin/gh/laithsakka/313/head 2025-12-04T08:53:09.1834879Z * [new branch] gh/laithsakka/313/orig -> origin/gh/laithsakka/313/orig 2025-12-04T08:53:09.1834953Z * [new branch] gh/laithsakka/316/base -> origin/gh/laithsakka/316/base 2025-12-04T08:53:09.1835026Z * [new branch] gh/laithsakka/316/head -> origin/gh/laithsakka/316/head 2025-12-04T08:53:09.1835101Z * [new branch] gh/laithsakka/316/orig -> origin/gh/laithsakka/316/orig 2025-12-04T08:53:09.1835173Z * [new branch] gh/laithsakka/317/base -> origin/gh/laithsakka/317/base 2025-12-04T08:53:09.1835246Z * [new branch] gh/laithsakka/317/head -> origin/gh/laithsakka/317/head 2025-12-04T08:53:09.1835318Z * [new branch] gh/laithsakka/317/orig -> origin/gh/laithsakka/317/orig 2025-12-04T08:53:09.1835393Z * [new branch] gh/laithsakka/319/base -> origin/gh/laithsakka/319/base 2025-12-04T08:53:09.1835467Z * [new branch] gh/laithsakka/319/head -> origin/gh/laithsakka/319/head 2025-12-04T08:53:09.1835540Z * [new branch] gh/laithsakka/319/orig -> origin/gh/laithsakka/319/orig 2025-12-04T08:53:09.1835613Z * [new branch] gh/laithsakka/32/base -> origin/gh/laithsakka/32/base 2025-12-04T08:53:09.1835686Z * [new branch] gh/laithsakka/32/head -> origin/gh/laithsakka/32/head 2025-12-04T08:53:09.1835761Z * [new branch] gh/laithsakka/320/base -> origin/gh/laithsakka/320/base 2025-12-04T08:53:09.1835832Z * [new branch] gh/laithsakka/320/head -> origin/gh/laithsakka/320/head 2025-12-04T08:53:09.1835905Z * [new branch] gh/laithsakka/320/orig -> origin/gh/laithsakka/320/orig 2025-12-04T08:53:09.1835979Z * [new branch] gh/laithsakka/321/base -> origin/gh/laithsakka/321/base 2025-12-04T08:53:09.1836053Z * [new branch] gh/laithsakka/321/head -> origin/gh/laithsakka/321/head 2025-12-04T08:53:09.1836126Z * [new branch] gh/laithsakka/321/orig -> origin/gh/laithsakka/321/orig 2025-12-04T08:53:09.1836200Z * [new branch] gh/laithsakka/322/base -> origin/gh/laithsakka/322/base 2025-12-04T08:53:09.1836272Z * [new branch] gh/laithsakka/322/head -> origin/gh/laithsakka/322/head 2025-12-04T08:53:09.1836346Z * [new branch] gh/laithsakka/322/orig -> origin/gh/laithsakka/322/orig 2025-12-04T08:53:09.1836419Z * [new branch] gh/laithsakka/323/base -> origin/gh/laithsakka/323/base 2025-12-04T08:53:09.1836493Z * [new branch] gh/laithsakka/323/head -> origin/gh/laithsakka/323/head 2025-12-04T08:53:09.1836566Z * [new branch] gh/laithsakka/323/orig -> origin/gh/laithsakka/323/orig 2025-12-04T08:53:09.1836663Z * [new branch] gh/laithsakka/324/base -> origin/gh/laithsakka/324/base 2025-12-04T08:53:09.1836736Z * [new branch] gh/laithsakka/324/head -> origin/gh/laithsakka/324/head 2025-12-04T08:53:09.1836839Z * [new branch] gh/laithsakka/324/orig -> origin/gh/laithsakka/324/orig 2025-12-04T08:53:09.1836913Z * [new branch] gh/laithsakka/325/base -> origin/gh/laithsakka/325/base 2025-12-04T08:53:09.1836985Z * [new branch] gh/laithsakka/325/head -> origin/gh/laithsakka/325/head 2025-12-04T08:53:09.1837057Z * [new branch] gh/laithsakka/325/orig -> origin/gh/laithsakka/325/orig 2025-12-04T08:53:09.1837130Z * [new branch] gh/laithsakka/326/base -> origin/gh/laithsakka/326/base 2025-12-04T08:53:09.1837203Z * [new branch] gh/laithsakka/326/head -> origin/gh/laithsakka/326/head 2025-12-04T08:53:09.1837279Z * [new branch] gh/laithsakka/326/orig -> origin/gh/laithsakka/326/orig 2025-12-04T08:53:09.1837353Z * [new branch] gh/laithsakka/327/base -> origin/gh/laithsakka/327/base 2025-12-04T08:53:09.1837427Z * [new branch] gh/laithsakka/327/head -> origin/gh/laithsakka/327/head 2025-12-04T08:53:09.1837502Z * [new branch] gh/laithsakka/327/orig -> origin/gh/laithsakka/327/orig 2025-12-04T08:53:09.1837575Z * [new branch] gh/laithsakka/328/base -> origin/gh/laithsakka/328/base 2025-12-04T08:53:09.1837649Z * [new branch] gh/laithsakka/328/head -> origin/gh/laithsakka/328/head 2025-12-04T08:53:09.1837723Z * [new branch] gh/laithsakka/328/orig -> origin/gh/laithsakka/328/orig 2025-12-04T08:53:09.1837792Z * [new branch] gh/liangel/4/base -> origin/gh/liangel/4/base 2025-12-04T08:53:09.1837860Z * [new branch] gh/liangel/4/head -> origin/gh/liangel/4/head 2025-12-04T08:53:09.1837929Z * [new branch] gh/liangel/4/orig -> origin/gh/liangel/4/orig 2025-12-04T08:53:09.1838006Z * [new branch] gh/lucaskabela/1/base -> origin/gh/lucaskabela/1/base 2025-12-04T08:53:09.1838082Z * [new branch] gh/lucaskabela/1/head -> origin/gh/lucaskabela/1/head 2025-12-04T08:53:09.1838146Z * [new branch] gh/lw/4/base -> origin/gh/lw/4/base 2025-12-04T08:53:09.1838210Z * [new branch] gh/lw/4/head -> origin/gh/lw/4/head 2025-12-04T08:53:09.1838274Z * [new branch] gh/lw/4/orig -> origin/gh/lw/4/orig 2025-12-04T08:53:09.1838335Z * [new branch] gh/lw/5/base -> origin/gh/lw/5/base 2025-12-04T08:53:09.1838395Z * [new branch] gh/lw/5/head -> origin/gh/lw/5/head 2025-12-04T08:53:09.1838456Z * [new branch] gh/lw/5/orig -> origin/gh/lw/5/orig 2025-12-04T08:53:09.1838515Z * [new branch] gh/lw/6/base -> origin/gh/lw/6/base 2025-12-04T08:53:09.1838576Z * [new branch] gh/lw/6/head -> origin/gh/lw/6/head 2025-12-04T08:53:09.1838637Z * [new branch] gh/lw/6/orig -> origin/gh/lw/6/orig 2025-12-04T08:53:09.1838705Z * [new branch] gh/malfet/14/base -> origin/gh/malfet/14/base 2025-12-04T08:53:09.1838777Z * [new branch] gh/malfet/417/base -> origin/gh/malfet/417/base 2025-12-04T08:53:09.1838848Z * [new branch] gh/malfet/417/head -> origin/gh/malfet/417/head 2025-12-04T08:53:09.1838919Z * [new branch] gh/malfet/417/orig -> origin/gh/malfet/417/orig 2025-12-04T08:53:09.1838988Z * [new branch] gh/malfet/506/base -> origin/gh/malfet/506/base 2025-12-04T08:53:09.1839056Z * [new branch] gh/malfet/506/head -> origin/gh/malfet/506/head 2025-12-04T08:53:09.1839122Z * [new branch] gh/malfet/506/orig -> origin/gh/malfet/506/orig 2025-12-04T08:53:09.1839188Z * [new branch] gh/malfet/517/base -> origin/gh/malfet/517/base 2025-12-04T08:53:09.1839295Z * [new branch] gh/malfet/517/head -> origin/gh/malfet/517/head 2025-12-04T08:53:09.1839385Z * [new branch] gh/malfet/528/base -> origin/gh/malfet/528/base 2025-12-04T08:53:09.1839454Z * [new branch] gh/malfet/528/head -> origin/gh/malfet/528/head 2025-12-04T08:53:09.1839521Z * [new branch] gh/malfet/528/orig -> origin/gh/malfet/528/orig 2025-12-04T08:53:09.1839588Z * [new branch] gh/malfet/537/base -> origin/gh/malfet/537/base 2025-12-04T08:53:09.1839655Z * [new branch] gh/malfet/537/head -> origin/gh/malfet/537/head 2025-12-04T08:53:09.1839721Z * [new branch] gh/malfet/537/orig -> origin/gh/malfet/537/orig 2025-12-04T08:53:09.1839788Z * [new branch] gh/malfet/546/base -> origin/gh/malfet/546/base 2025-12-04T08:53:09.1839856Z * [new branch] gh/malfet/546/head -> origin/gh/malfet/546/head 2025-12-04T08:53:09.1839925Z * [new branch] gh/malfet/546/orig -> origin/gh/malfet/546/orig 2025-12-04T08:53:09.1839993Z * [new branch] gh/malfet/565/base -> origin/gh/malfet/565/base 2025-12-04T08:53:09.1840061Z * [new branch] gh/malfet/565/head -> origin/gh/malfet/565/head 2025-12-04T08:53:09.1840127Z * [new branch] gh/malfet/565/orig -> origin/gh/malfet/565/orig 2025-12-04T08:53:09.1840194Z * [new branch] gh/malfet/575/base -> origin/gh/malfet/575/base 2025-12-04T08:53:09.1840262Z * [new branch] gh/malfet/575/head -> origin/gh/malfet/575/head 2025-12-04T08:53:09.1840328Z * [new branch] gh/malfet/575/orig -> origin/gh/malfet/575/orig 2025-12-04T08:53:09.1840396Z * [new branch] gh/malfet/580/base -> origin/gh/malfet/580/base 2025-12-04T08:53:09.1840462Z * [new branch] gh/malfet/580/head -> origin/gh/malfet/580/head 2025-12-04T08:53:09.1840530Z * [new branch] gh/malfet/580/orig -> origin/gh/malfet/580/orig 2025-12-04T08:53:09.1840598Z * [new branch] gh/malfet/581/base -> origin/gh/malfet/581/base 2025-12-04T08:53:09.1840668Z * [new branch] gh/malfet/581/head -> origin/gh/malfet/581/head 2025-12-04T08:53:09.1840734Z * [new branch] gh/malfet/581/orig -> origin/gh/malfet/581/orig 2025-12-04T08:53:09.1840800Z * [new branch] gh/malfet/583/base -> origin/gh/malfet/583/base 2025-12-04T08:53:09.1840869Z * [new branch] gh/malfet/583/head -> origin/gh/malfet/583/head 2025-12-04T08:53:09.1840935Z * [new branch] gh/malfet/583/orig -> origin/gh/malfet/583/orig 2025-12-04T08:53:09.1841002Z * [new branch] gh/malfet/586/base -> origin/gh/malfet/586/base 2025-12-04T08:53:09.1841071Z * [new branch] gh/malfet/586/head -> origin/gh/malfet/586/head 2025-12-04T08:53:09.1841140Z * [new branch] gh/malfet/586/orig -> origin/gh/malfet/586/orig 2025-12-04T08:53:09.1841207Z * [new branch] gh/malfet/587/base -> origin/gh/malfet/587/base 2025-12-04T08:53:09.1841276Z * [new branch] gh/malfet/587/head -> origin/gh/malfet/587/head 2025-12-04T08:53:09.1841344Z * [new branch] gh/malfet/587/orig -> origin/gh/malfet/587/orig 2025-12-04T08:53:09.1841412Z * [new branch] gh/malfet/588/base -> origin/gh/malfet/588/base 2025-12-04T08:53:09.1841479Z * [new branch] gh/malfet/588/head -> origin/gh/malfet/588/head 2025-12-04T08:53:09.1841545Z * [new branch] gh/malfet/588/orig -> origin/gh/malfet/588/orig 2025-12-04T08:53:09.1841613Z * [new branch] gh/malfet/589/base -> origin/gh/malfet/589/base 2025-12-04T08:53:09.1841681Z * [new branch] gh/malfet/589/head -> origin/gh/malfet/589/head 2025-12-04T08:53:09.1841773Z * [new branch] gh/malfet/589/orig -> origin/gh/malfet/589/orig 2025-12-04T08:53:09.1841868Z * [new branch] gh/malfet/590/base -> origin/gh/malfet/590/base 2025-12-04T08:53:09.1841935Z * [new branch] gh/malfet/590/head -> origin/gh/malfet/590/head 2025-12-04T08:53:09.1842003Z * [new branch] gh/malfet/590/orig -> origin/gh/malfet/590/orig 2025-12-04T08:53:09.1842072Z * [new branch] gh/malfet/591/base -> origin/gh/malfet/591/base 2025-12-04T08:53:09.1842139Z * [new branch] gh/malfet/591/head -> origin/gh/malfet/591/head 2025-12-04T08:53:09.1842206Z * [new branch] gh/malfet/591/orig -> origin/gh/malfet/591/orig 2025-12-04T08:53:09.1842276Z * [new branch] gh/malfet/592/base -> origin/gh/malfet/592/base 2025-12-04T08:53:09.1842344Z * [new branch] gh/malfet/592/head -> origin/gh/malfet/592/head 2025-12-04T08:53:09.1842412Z * [new branch] gh/malfet/592/orig -> origin/gh/malfet/592/orig 2025-12-04T08:53:09.1842482Z * [new branch] gh/malfet/593/base -> origin/gh/malfet/593/base 2025-12-04T08:53:09.1842549Z * [new branch] gh/malfet/593/head -> origin/gh/malfet/593/head 2025-12-04T08:53:09.1842615Z * [new branch] gh/malfet/593/orig -> origin/gh/malfet/593/orig 2025-12-04T08:53:09.1842683Z * [new branch] gh/malfet/594/base -> origin/gh/malfet/594/base 2025-12-04T08:53:09.1842750Z * [new branch] gh/malfet/594/head -> origin/gh/malfet/594/head 2025-12-04T08:53:09.1842817Z * [new branch] gh/malfet/594/orig -> origin/gh/malfet/594/orig 2025-12-04T08:53:09.1842884Z * [new branch] gh/malfet/595/base -> origin/gh/malfet/595/base 2025-12-04T08:53:09.1842991Z * [new branch] gh/malfet/595/head -> origin/gh/malfet/595/head 2025-12-04T08:53:09.1843063Z * [new branch] gh/malfet/595/orig -> origin/gh/malfet/595/orig 2025-12-04T08:53:09.1843133Z * [new branch] gh/malfet/596/base -> origin/gh/malfet/596/base 2025-12-04T08:53:09.1843201Z * [new branch] gh/malfet/596/head -> origin/gh/malfet/596/head 2025-12-04T08:53:09.1843271Z * [new branch] gh/malfet/596/orig -> origin/gh/malfet/596/orig 2025-12-04T08:53:09.1843337Z * [new branch] gh/malfet/597/base -> origin/gh/malfet/597/base 2025-12-04T08:53:09.1843404Z * [new branch] gh/malfet/597/head -> origin/gh/malfet/597/head 2025-12-04T08:53:09.1843472Z * [new branch] gh/malfet/597/orig -> origin/gh/malfet/597/orig 2025-12-04T08:53:09.1843539Z * [new branch] gh/malfet/598/base -> origin/gh/malfet/598/base 2025-12-04T08:53:09.1843606Z * [new branch] gh/malfet/598/head -> origin/gh/malfet/598/head 2025-12-04T08:53:09.1843678Z * [new branch] gh/malfet/598/orig -> origin/gh/malfet/598/orig 2025-12-04T08:53:09.1843746Z * [new branch] gh/malfet/599/base -> origin/gh/malfet/599/base 2025-12-04T08:53:09.1843812Z * [new branch] gh/malfet/599/head -> origin/gh/malfet/599/head 2025-12-04T08:53:09.1843879Z * [new branch] gh/malfet/599/orig -> origin/gh/malfet/599/orig 2025-12-04T08:53:09.1843945Z * [new branch] gh/malfet/600/base -> origin/gh/malfet/600/base 2025-12-04T08:53:09.1844012Z * [new branch] gh/malfet/600/head -> origin/gh/malfet/600/head 2025-12-04T08:53:09.1844081Z * [new branch] gh/malfet/600/orig -> origin/gh/malfet/600/orig 2025-12-04T08:53:09.1844147Z * [new branch] gh/malfet/601/base -> origin/gh/malfet/601/base 2025-12-04T08:53:09.1844215Z * [new branch] gh/malfet/601/head -> origin/gh/malfet/601/head 2025-12-04T08:53:09.1844327Z * [new branch] gh/malfet/601/orig -> origin/gh/malfet/601/orig 2025-12-04T08:53:09.1844428Z * [new branch] gh/malfet/602/base -> origin/gh/malfet/602/base 2025-12-04T08:53:09.1844496Z * [new branch] gh/malfet/602/head -> origin/gh/malfet/602/head 2025-12-04T08:53:09.1844565Z * [new branch] gh/malfet/602/orig -> origin/gh/malfet/602/orig 2025-12-04T08:53:09.1844631Z * [new branch] gh/malfet/603/base -> origin/gh/malfet/603/base 2025-12-04T08:53:09.1844699Z * [new branch] gh/malfet/603/head -> origin/gh/malfet/603/head 2025-12-04T08:53:09.1844768Z * [new branch] gh/malfet/603/orig -> origin/gh/malfet/603/orig 2025-12-04T08:53:09.1844835Z * [new branch] gh/malfet/604/base -> origin/gh/malfet/604/base 2025-12-04T08:53:09.1844904Z * [new branch] gh/malfet/604/head -> origin/gh/malfet/604/head 2025-12-04T08:53:09.1844973Z * [new branch] gh/malfet/604/orig -> origin/gh/malfet/604/orig 2025-12-04T08:53:09.1845040Z * [new branch] gh/malfet/605/base -> origin/gh/malfet/605/base 2025-12-04T08:53:09.1845109Z * [new branch] gh/malfet/605/head -> origin/gh/malfet/605/head 2025-12-04T08:53:09.1845176Z * [new branch] gh/malfet/605/orig -> origin/gh/malfet/605/orig 2025-12-04T08:53:09.1845243Z * [new branch] gh/malfet/606/base -> origin/gh/malfet/606/base 2025-12-04T08:53:09.1845311Z * [new branch] gh/malfet/606/head -> origin/gh/malfet/606/head 2025-12-04T08:53:09.1845377Z * [new branch] gh/malfet/606/orig -> origin/gh/malfet/606/orig 2025-12-04T08:53:09.1845443Z * [new branch] gh/malfet/607/base -> origin/gh/malfet/607/base 2025-12-04T08:53:09.1845511Z * [new branch] gh/malfet/607/head -> origin/gh/malfet/607/head 2025-12-04T08:53:09.1845579Z * [new branch] gh/malfet/607/orig -> origin/gh/malfet/607/orig 2025-12-04T08:53:09.1845647Z * [new branch] gh/malfet/608/base -> origin/gh/malfet/608/base 2025-12-04T08:53:09.1845716Z * [new branch] gh/malfet/608/head -> origin/gh/malfet/608/head 2025-12-04T08:53:09.1845785Z * [new branch] gh/malfet/608/orig -> origin/gh/malfet/608/orig 2025-12-04T08:53:09.1845851Z * [new branch] gh/malfet/609/base -> origin/gh/malfet/609/base 2025-12-04T08:53:09.1845920Z * [new branch] gh/malfet/609/head -> origin/gh/malfet/609/head 2025-12-04T08:53:09.1845986Z * [new branch] gh/malfet/609/orig -> origin/gh/malfet/609/orig 2025-12-04T08:53:09.1846052Z * [new branch] gh/malfet/610/base -> origin/gh/malfet/610/base 2025-12-04T08:53:09.1846120Z * [new branch] gh/malfet/610/head -> origin/gh/malfet/610/head 2025-12-04T08:53:09.1846189Z * [new branch] gh/malfet/610/orig -> origin/gh/malfet/610/orig 2025-12-04T08:53:09.1846258Z * [new branch] gh/malfet/611/base -> origin/gh/malfet/611/base 2025-12-04T08:53:09.1846327Z * [new branch] gh/malfet/611/head -> origin/gh/malfet/611/head 2025-12-04T08:53:09.1846394Z * [new branch] gh/malfet/611/orig -> origin/gh/malfet/611/orig 2025-12-04T08:53:09.1846463Z * [new branch] gh/malfet/612/base -> origin/gh/malfet/612/base 2025-12-04T08:53:09.1846529Z * [new branch] gh/malfet/612/head -> origin/gh/malfet/612/head 2025-12-04T08:53:09.1846597Z * [new branch] gh/malfet/612/orig -> origin/gh/malfet/612/orig 2025-12-04T08:53:09.1846665Z * [new branch] gh/malfet/64/base -> origin/gh/malfet/64/base 2025-12-04T08:53:09.1846732Z * [new branch] gh/malfet/64/head -> origin/gh/malfet/64/head 2025-12-04T08:53:09.1846849Z * [new branch] gh/manuelcandales/11/base -> origin/gh/manuelcandales/11/base 2025-12-04T08:53:09.1846937Z * [new branch] gh/manuelcandales/11/head -> origin/gh/manuelcandales/11/head 2025-12-04T08:53:09.1847046Z * [new branch] gh/manuelcandales/11/orig -> origin/gh/manuelcandales/11/orig 2025-12-04T08:53:09.1847115Z * [new branch] gh/markkm/1/base -> origin/gh/markkm/1/base 2025-12-04T08:53:09.1847187Z * [new branch] gh/masnesral/1/base -> origin/gh/masnesral/1/base 2025-12-04T08:53:09.1847260Z * [new branch] gh/masnesral/1/head -> origin/gh/masnesral/1/head 2025-12-04T08:53:09.1847330Z * [new branch] gh/masnesral/1/orig -> origin/gh/masnesral/1/orig 2025-12-04T08:53:09.1847401Z * [new branch] gh/mhorowitz/0/base -> origin/gh/mhorowitz/0/base 2025-12-04T08:53:09.1847470Z * [new branch] gh/mhorowitz/0/head -> origin/gh/mhorowitz/0/head 2025-12-04T08:53:09.1847540Z * [new branch] gh/mhorowitz/1/base -> origin/gh/mhorowitz/1/base 2025-12-04T08:53:09.1847610Z * [new branch] gh/mhorowitz/1/head -> origin/gh/mhorowitz/1/head 2025-12-04T08:53:09.1847681Z * [new branch] gh/mhorowitz/2/base -> origin/gh/mhorowitz/2/base 2025-12-04T08:53:09.1847751Z * [new branch] gh/mhorowitz/2/head -> origin/gh/mhorowitz/2/head 2025-12-04T08:53:09.1847822Z * [new branch] gh/mhorowitz/3/base -> origin/gh/mhorowitz/3/base 2025-12-04T08:53:09.1847892Z * [new branch] gh/mhorowitz/3/head -> origin/gh/mhorowitz/3/head 2025-12-04T08:53:09.1847961Z * [new branch] gh/mhorowitz/4/base -> origin/gh/mhorowitz/4/base 2025-12-04T08:53:09.1848031Z * [new branch] gh/mhorowitz/4/head -> origin/gh/mhorowitz/4/head 2025-12-04T08:53:09.1848100Z * [new branch] gh/mhorowitz/5/base -> origin/gh/mhorowitz/5/base 2025-12-04T08:53:09.1848171Z * [new branch] gh/mhorowitz/5/head -> origin/gh/mhorowitz/5/head 2025-12-04T08:53:09.1848241Z * [new branch] gh/mhorowitz/6/base -> origin/gh/mhorowitz/6/base 2025-12-04T08:53:09.1848311Z * [new branch] gh/mhorowitz/6/head -> origin/gh/mhorowitz/6/head 2025-12-04T08:53:09.1848412Z * [new branch] gh/mikaylagawarecki/234/base -> origin/gh/mikaylagawarecki/234/base 2025-12-04T08:53:09.1848508Z * [new branch] gh/mikaylagawarecki/234/head -> origin/gh/mikaylagawarecki/234/head 2025-12-04T08:53:09.1848601Z * [new branch] gh/mikaylagawarecki/235/base -> origin/gh/mikaylagawarecki/235/base 2025-12-04T08:53:09.1848693Z * [new branch] gh/mikaylagawarecki/235/head -> origin/gh/mikaylagawarecki/235/head 2025-12-04T08:53:09.1848784Z * [new branch] gh/mikaylagawarecki/236/base -> origin/gh/mikaylagawarecki/236/base 2025-12-04T08:53:09.1848876Z * [new branch] gh/mikaylagawarecki/236/head -> origin/gh/mikaylagawarecki/236/head 2025-12-04T08:53:09.1848969Z * [new branch] gh/mikaylagawarecki/237/base -> origin/gh/mikaylagawarecki/237/base 2025-12-04T08:53:09.1849060Z * [new branch] gh/mikaylagawarecki/237/head -> origin/gh/mikaylagawarecki/237/head 2025-12-04T08:53:09.1849151Z * [new branch] gh/mikaylagawarecki/238/base -> origin/gh/mikaylagawarecki/238/base 2025-12-04T08:53:09.1849243Z * [new branch] gh/mikaylagawarecki/238/head -> origin/gh/mikaylagawarecki/238/head 2025-12-04T08:53:09.1849333Z * [new branch] gh/mikaylagawarecki/336/base -> origin/gh/mikaylagawarecki/336/base 2025-12-04T08:53:09.1849424Z * [new branch] gh/mikaylagawarecki/336/head -> origin/gh/mikaylagawarecki/336/head 2025-12-04T08:53:09.1849515Z * [new branch] gh/mikaylagawarecki/336/orig -> origin/gh/mikaylagawarecki/336/orig 2025-12-04T08:53:09.1849641Z * [new branch] gh/mikaylagawarecki/341/base -> origin/gh/mikaylagawarecki/341/base 2025-12-04T08:53:09.1849733Z * [new branch] gh/mikaylagawarecki/341/head -> origin/gh/mikaylagawarecki/341/head 2025-12-04T08:53:09.1849853Z * [new branch] gh/mikaylagawarecki/341/orig -> origin/gh/mikaylagawarecki/341/orig 2025-12-04T08:53:09.1849945Z * [new branch] gh/mikaylagawarecki/342/base -> origin/gh/mikaylagawarecki/342/base 2025-12-04T08:53:09.1850036Z * [new branch] gh/mikaylagawarecki/342/head -> origin/gh/mikaylagawarecki/342/head 2025-12-04T08:53:09.1850126Z * [new branch] gh/mikaylagawarecki/342/orig -> origin/gh/mikaylagawarecki/342/orig 2025-12-04T08:53:09.1850216Z * [new branch] gh/mikaylagawarecki/345/base -> origin/gh/mikaylagawarecki/345/base 2025-12-04T08:53:09.1850308Z * [new branch] gh/mikaylagawarecki/345/head -> origin/gh/mikaylagawarecki/345/head 2025-12-04T08:53:09.1850402Z * [new branch] gh/mikaylagawarecki/345/orig -> origin/gh/mikaylagawarecki/345/orig 2025-12-04T08:53:09.1850493Z * [new branch] gh/mikaylagawarecki/346/base -> origin/gh/mikaylagawarecki/346/base 2025-12-04T08:53:09.1850586Z * [new branch] gh/mikaylagawarecki/346/head -> origin/gh/mikaylagawarecki/346/head 2025-12-04T08:53:09.1850676Z * [new branch] gh/mikaylagawarecki/346/orig -> origin/gh/mikaylagawarecki/346/orig 2025-12-04T08:53:09.1850766Z * [new branch] gh/mikaylagawarecki/347/base -> origin/gh/mikaylagawarecki/347/base 2025-12-04T08:53:09.1850858Z * [new branch] gh/mikaylagawarecki/347/head -> origin/gh/mikaylagawarecki/347/head 2025-12-04T08:53:09.1850948Z * [new branch] gh/mikaylagawarecki/347/orig -> origin/gh/mikaylagawarecki/347/orig 2025-12-04T08:53:09.1851040Z * [new branch] gh/mikaylagawarecki/350/base -> origin/gh/mikaylagawarecki/350/base 2025-12-04T08:53:09.1851132Z * [new branch] gh/mikaylagawarecki/350/head -> origin/gh/mikaylagawarecki/350/head 2025-12-04T08:53:09.1851222Z * [new branch] gh/mikaylagawarecki/350/orig -> origin/gh/mikaylagawarecki/350/orig 2025-12-04T08:53:09.1851314Z * [new branch] gh/mikaylagawarecki/351/base -> origin/gh/mikaylagawarecki/351/base 2025-12-04T08:53:09.1851404Z * [new branch] gh/mikaylagawarecki/351/head -> origin/gh/mikaylagawarecki/351/head 2025-12-04T08:53:09.1851495Z * [new branch] gh/mikaylagawarecki/351/orig -> origin/gh/mikaylagawarecki/351/orig 2025-12-04T08:53:09.1851586Z * [new branch] gh/mikaylagawarecki/352/base -> origin/gh/mikaylagawarecki/352/base 2025-12-04T08:53:09.1851676Z * [new branch] gh/mikaylagawarecki/352/head -> origin/gh/mikaylagawarecki/352/head 2025-12-04T08:53:09.1851767Z * [new branch] gh/mikaylagawarecki/352/orig -> origin/gh/mikaylagawarecki/352/orig 2025-12-04T08:53:09.1851860Z * [new branch] gh/mikaylagawarecki/353/base -> origin/gh/mikaylagawarecki/353/base 2025-12-04T08:53:09.1851951Z * [new branch] gh/mikaylagawarecki/353/head -> origin/gh/mikaylagawarecki/353/head 2025-12-04T08:53:09.1852044Z * [new branch] gh/mikaylagawarecki/353/orig -> origin/gh/mikaylagawarecki/353/orig 2025-12-04T08:53:09.1852135Z * [new branch] gh/mikaylagawarecki/354/base -> origin/gh/mikaylagawarecki/354/base 2025-12-04T08:53:09.1852225Z * [new branch] gh/mikaylagawarecki/354/head -> origin/gh/mikaylagawarecki/354/head 2025-12-04T08:53:09.1852315Z * [new branch] gh/mikaylagawarecki/354/orig -> origin/gh/mikaylagawarecki/354/orig 2025-12-04T08:53:09.1852407Z * [new branch] gh/mikaylagawarecki/356/base -> origin/gh/mikaylagawarecki/356/base 2025-12-04T08:53:09.1852498Z * [new branch] gh/mikaylagawarecki/356/head -> origin/gh/mikaylagawarecki/356/head 2025-12-04T08:53:09.1852620Z * [new branch] gh/mikaylagawarecki/356/orig -> origin/gh/mikaylagawarecki/356/orig 2025-12-04T08:53:09.1852711Z * [new branch] gh/mikaylagawarecki/357/base -> origin/gh/mikaylagawarecki/357/base 2025-12-04T08:53:09.1852830Z * [new branch] gh/mikaylagawarecki/357/head -> origin/gh/mikaylagawarecki/357/head 2025-12-04T08:53:09.1852921Z * [new branch] gh/mikaylagawarecki/357/orig -> origin/gh/mikaylagawarecki/357/orig 2025-12-04T08:53:09.1853060Z * [new branch] gh/mikaylagawarecki/359/base -> origin/gh/mikaylagawarecki/359/base 2025-12-04T08:53:09.1853152Z * [new branch] gh/mikaylagawarecki/359/head -> origin/gh/mikaylagawarecki/359/head 2025-12-04T08:53:09.1853243Z * [new branch] gh/mikaylagawarecki/359/orig -> origin/gh/mikaylagawarecki/359/orig 2025-12-04T08:53:09.1853333Z * [new branch] gh/mikaylagawarecki/360/base -> origin/gh/mikaylagawarecki/360/base 2025-12-04T08:53:09.1853425Z * [new branch] gh/mikaylagawarecki/360/head -> origin/gh/mikaylagawarecki/360/head 2025-12-04T08:53:09.1853517Z * [new branch] gh/mikaylagawarecki/360/orig -> origin/gh/mikaylagawarecki/360/orig 2025-12-04T08:53:09.1853608Z * [new branch] gh/mikaylagawarecki/361/base -> origin/gh/mikaylagawarecki/361/base 2025-12-04T08:53:09.1853698Z * [new branch] gh/mikaylagawarecki/361/head -> origin/gh/mikaylagawarecki/361/head 2025-12-04T08:53:09.1853789Z * [new branch] gh/mikaylagawarecki/361/orig -> origin/gh/mikaylagawarecki/361/orig 2025-12-04T08:53:09.1853880Z * [new branch] gh/mikaylagawarecki/362/base -> origin/gh/mikaylagawarecki/362/base 2025-12-04T08:53:09.1853971Z * [new branch] gh/mikaylagawarecki/362/head -> origin/gh/mikaylagawarecki/362/head 2025-12-04T08:53:09.1854062Z * [new branch] gh/mikaylagawarecki/362/orig -> origin/gh/mikaylagawarecki/362/orig 2025-12-04T08:53:09.1854152Z * [new branch] gh/mikaylagawarecki/363/base -> origin/gh/mikaylagawarecki/363/base 2025-12-04T08:53:09.1854244Z * [new branch] gh/mikaylagawarecki/363/head -> origin/gh/mikaylagawarecki/363/head 2025-12-04T08:53:09.1854336Z * [new branch] gh/mikaylagawarecki/363/orig -> origin/gh/mikaylagawarecki/363/orig 2025-12-04T08:53:09.1854427Z * [new branch] gh/mikaylagawarecki/364/base -> origin/gh/mikaylagawarecki/364/base 2025-12-04T08:53:09.1854518Z * [new branch] gh/mikaylagawarecki/364/head -> origin/gh/mikaylagawarecki/364/head 2025-12-04T08:53:09.1854608Z * [new branch] gh/mikaylagawarecki/364/orig -> origin/gh/mikaylagawarecki/364/orig 2025-12-04T08:53:09.1854698Z * [new branch] gh/mikaylagawarecki/365/base -> origin/gh/mikaylagawarecki/365/base 2025-12-04T08:53:09.1854790Z * [new branch] gh/mikaylagawarecki/365/head -> origin/gh/mikaylagawarecki/365/head 2025-12-04T08:53:09.1854882Z * [new branch] gh/mikaylagawarecki/365/orig -> origin/gh/mikaylagawarecki/365/orig 2025-12-04T08:53:09.1854973Z * [new branch] gh/mikaylagawarecki/366/base -> origin/gh/mikaylagawarecki/366/base 2025-12-04T08:53:09.1855067Z * [new branch] gh/mikaylagawarecki/366/head -> origin/gh/mikaylagawarecki/366/head 2025-12-04T08:53:09.1855158Z * [new branch] gh/mikaylagawarecki/366/orig -> origin/gh/mikaylagawarecki/366/orig 2025-12-04T08:53:09.1855249Z * [new branch] gh/mikaylagawarecki/367/base -> origin/gh/mikaylagawarecki/367/base 2025-12-04T08:53:09.1855340Z * [new branch] gh/mikaylagawarecki/367/head -> origin/gh/mikaylagawarecki/367/head 2025-12-04T08:53:09.1855430Z * [new branch] gh/mikaylagawarecki/367/orig -> origin/gh/mikaylagawarecki/367/orig 2025-12-04T08:53:09.1855521Z * [new branch] gh/mikaylagawarecki/368/base -> origin/gh/mikaylagawarecki/368/base 2025-12-04T08:53:09.1855649Z * [new branch] gh/mikaylagawarecki/368/head -> origin/gh/mikaylagawarecki/368/head 2025-12-04T08:53:09.1855740Z * [new branch] gh/mikaylagawarecki/368/orig -> origin/gh/mikaylagawarecki/368/orig 2025-12-04T08:53:09.1855869Z * [new branch] gh/mikaylagawarecki/369/base -> origin/gh/mikaylagawarecki/369/base 2025-12-04T08:53:09.1855961Z * [new branch] gh/mikaylagawarecki/369/head -> origin/gh/mikaylagawarecki/369/head 2025-12-04T08:53:09.1856051Z * [new branch] gh/mikaylagawarecki/369/orig -> origin/gh/mikaylagawarecki/369/orig 2025-12-04T08:53:09.1856143Z * [new branch] gh/mikaylagawarecki/370/base -> origin/gh/mikaylagawarecki/370/base 2025-12-04T08:53:09.1856233Z * [new branch] gh/mikaylagawarecki/370/head -> origin/gh/mikaylagawarecki/370/head 2025-12-04T08:53:09.1856323Z * [new branch] gh/mikaylagawarecki/370/orig -> origin/gh/mikaylagawarecki/370/orig 2025-12-04T08:53:09.1856416Z * [new branch] gh/mikaylagawarecki/371/base -> origin/gh/mikaylagawarecki/371/base 2025-12-04T08:53:09.1856509Z * [new branch] gh/mikaylagawarecki/371/head -> origin/gh/mikaylagawarecki/371/head 2025-12-04T08:53:09.1856602Z * [new branch] gh/mikaylagawarecki/371/orig -> origin/gh/mikaylagawarecki/371/orig 2025-12-04T08:53:09.1856697Z * [new branch] gh/mikaylagawarecki/372/base -> origin/gh/mikaylagawarecki/372/base 2025-12-04T08:53:09.1856789Z * [new branch] gh/mikaylagawarecki/372/head -> origin/gh/mikaylagawarecki/372/head 2025-12-04T08:53:09.1856886Z * [new branch] gh/mikaylagawarecki/372/orig -> origin/gh/mikaylagawarecki/372/orig 2025-12-04T08:53:09.1856977Z * [new branch] gh/mikaylagawarecki/373/base -> origin/gh/mikaylagawarecki/373/base 2025-12-04T08:53:09.1857069Z * [new branch] gh/mikaylagawarecki/373/head -> origin/gh/mikaylagawarecki/373/head 2025-12-04T08:53:09.1857168Z * [new branch] gh/mikaylagawarecki/373/orig -> origin/gh/mikaylagawarecki/373/orig 2025-12-04T08:53:09.1857258Z * [new branch] gh/mikaylagawarecki/374/base -> origin/gh/mikaylagawarecki/374/base 2025-12-04T08:53:09.1857350Z * [new branch] gh/mikaylagawarecki/374/head -> origin/gh/mikaylagawarecki/374/head 2025-12-04T08:53:09.1857446Z * [new branch] gh/mikaylagawarecki/374/orig -> origin/gh/mikaylagawarecki/374/orig 2025-12-04T08:53:09.1857540Z * [new branch] gh/mikaylagawarecki/375/base -> origin/gh/mikaylagawarecki/375/base 2025-12-04T08:53:09.1857632Z * [new branch] gh/mikaylagawarecki/375/head -> origin/gh/mikaylagawarecki/375/head 2025-12-04T08:53:09.1857728Z * [new branch] gh/mikaylagawarecki/375/orig -> origin/gh/mikaylagawarecki/375/orig 2025-12-04T08:53:09.1857820Z * [new branch] gh/mikaylagawarecki/376/base -> origin/gh/mikaylagawarecki/376/base 2025-12-04T08:53:09.1857916Z * [new branch] gh/mikaylagawarecki/376/head -> origin/gh/mikaylagawarecki/376/head 2025-12-04T08:53:09.1858012Z * [new branch] gh/mikaylagawarecki/376/orig -> origin/gh/mikaylagawarecki/376/orig 2025-12-04T08:53:09.1858104Z * [new branch] gh/mikaylagawarecki/377/base -> origin/gh/mikaylagawarecki/377/base 2025-12-04T08:53:09.1858198Z * [new branch] gh/mikaylagawarecki/377/head -> origin/gh/mikaylagawarecki/377/head 2025-12-04T08:53:09.1858290Z * [new branch] gh/mikaylagawarecki/377/orig -> origin/gh/mikaylagawarecki/377/orig 2025-12-04T08:53:09.1858382Z * [new branch] gh/mikaylagawarecki/378/base -> origin/gh/mikaylagawarecki/378/base 2025-12-04T08:53:09.1858477Z * [new branch] gh/mikaylagawarecki/378/head -> origin/gh/mikaylagawarecki/378/head 2025-12-04T08:53:09.1858569Z * [new branch] gh/mikaylagawarecki/378/orig -> origin/gh/mikaylagawarecki/378/orig 2025-12-04T08:53:09.1858687Z * [new branch] gh/mikaylagawarecki/379/base -> origin/gh/mikaylagawarecki/379/base 2025-12-04T08:53:09.1858785Z * [new branch] gh/mikaylagawarecki/379/head -> origin/gh/mikaylagawarecki/379/head 2025-12-04T08:53:09.1858913Z * [new branch] gh/mikaylagawarecki/379/orig -> origin/gh/mikaylagawarecki/379/orig 2025-12-04T08:53:09.1859006Z * [new branch] gh/mikaylagawarecki/380/base -> origin/gh/mikaylagawarecki/380/base 2025-12-04T08:53:09.1859101Z * [new branch] gh/mikaylagawarecki/380/head -> origin/gh/mikaylagawarecki/380/head 2025-12-04T08:53:09.1859194Z * [new branch] gh/mikaylagawarecki/380/orig -> origin/gh/mikaylagawarecki/380/orig 2025-12-04T08:53:09.1859286Z * [new branch] gh/mikaylagawarecki/381/base -> origin/gh/mikaylagawarecki/381/base 2025-12-04T08:53:09.1859382Z * [new branch] gh/mikaylagawarecki/381/head -> origin/gh/mikaylagawarecki/381/head 2025-12-04T08:53:09.1859476Z * [new branch] gh/mikaylagawarecki/381/orig -> origin/gh/mikaylagawarecki/381/orig 2025-12-04T08:53:09.1859568Z * [new branch] gh/mikaylagawarecki/382/base -> origin/gh/mikaylagawarecki/382/base 2025-12-04T08:53:09.1859665Z * [new branch] gh/mikaylagawarecki/382/head -> origin/gh/mikaylagawarecki/382/head 2025-12-04T08:53:09.1859757Z * [new branch] gh/mikaylagawarecki/382/orig -> origin/gh/mikaylagawarecki/382/orig 2025-12-04T08:53:09.1859852Z * [new branch] gh/mikaylagawarecki/383/base -> origin/gh/mikaylagawarecki/383/base 2025-12-04T08:53:09.1859944Z * [new branch] gh/mikaylagawarecki/383/head -> origin/gh/mikaylagawarecki/383/head 2025-12-04T08:53:09.1860035Z * [new branch] gh/mikaylagawarecki/383/orig -> origin/gh/mikaylagawarecki/383/orig 2025-12-04T08:53:09.1860129Z * [new branch] gh/mikaylagawarecki/384/base -> origin/gh/mikaylagawarecki/384/base 2025-12-04T08:53:09.1860223Z * [new branch] gh/mikaylagawarecki/384/head -> origin/gh/mikaylagawarecki/384/head 2025-12-04T08:53:09.1860315Z * [new branch] gh/mikaylagawarecki/384/orig -> origin/gh/mikaylagawarecki/384/orig 2025-12-04T08:53:09.1860414Z * [new branch] gh/mikaylagawarecki/385/base -> origin/gh/mikaylagawarecki/385/base 2025-12-04T08:53:09.1860507Z * [new branch] gh/mikaylagawarecki/385/head -> origin/gh/mikaylagawarecki/385/head 2025-12-04T08:53:09.1860601Z * [new branch] gh/mikaylagawarecki/385/orig -> origin/gh/mikaylagawarecki/385/orig 2025-12-04T08:53:09.1860696Z * [new branch] gh/mikaylagawarecki/386/base -> origin/gh/mikaylagawarecki/386/base 2025-12-04T08:53:09.1860788Z * [new branch] gh/mikaylagawarecki/386/head -> origin/gh/mikaylagawarecki/386/head 2025-12-04T08:53:09.1860879Z * [new branch] gh/mikaylagawarecki/386/orig -> origin/gh/mikaylagawarecki/386/orig 2025-12-04T08:53:09.1860975Z * [new branch] gh/mikaylagawarecki/387/base -> origin/gh/mikaylagawarecki/387/base 2025-12-04T08:53:09.1861066Z * [new branch] gh/mikaylagawarecki/387/head -> origin/gh/mikaylagawarecki/387/head 2025-12-04T08:53:09.1861161Z * [new branch] gh/mikaylagawarecki/387/orig -> origin/gh/mikaylagawarecki/387/orig 2025-12-04T08:53:09.1861253Z * [new branch] gh/mikaylagawarecki/388/base -> origin/gh/mikaylagawarecki/388/base 2025-12-04T08:53:09.1861346Z * [new branch] gh/mikaylagawarecki/388/head -> origin/gh/mikaylagawarecki/388/head 2025-12-04T08:53:09.1861441Z * [new branch] gh/mikaylagawarecki/388/orig -> origin/gh/mikaylagawarecki/388/orig 2025-12-04T08:53:09.1861532Z * [new branch] gh/mikaylagawarecki/389/base -> origin/gh/mikaylagawarecki/389/base 2025-12-04T08:53:09.1861624Z * [new branch] gh/mikaylagawarecki/389/head -> origin/gh/mikaylagawarecki/389/head 2025-12-04T08:53:09.1861745Z * [new branch] gh/mikaylagawarecki/389/orig -> origin/gh/mikaylagawarecki/389/orig 2025-12-04T08:53:09.1861838Z * [new branch] gh/mikaylagawarecki/390/base -> origin/gh/mikaylagawarecki/390/base 2025-12-04T08:53:09.1861958Z * [new branch] gh/mikaylagawarecki/390/head -> origin/gh/mikaylagawarecki/390/head 2025-12-04T08:53:09.1862056Z * [new branch] gh/mikaylagawarecki/390/orig -> origin/gh/mikaylagawarecki/390/orig 2025-12-04T08:53:09.1862147Z * [new branch] gh/mikaylagawarecki/391/base -> origin/gh/mikaylagawarecki/391/base 2025-12-04T08:53:09.1862239Z * [new branch] gh/mikaylagawarecki/391/head -> origin/gh/mikaylagawarecki/391/head 2025-12-04T08:53:09.1862332Z * [new branch] gh/mikaylagawarecki/391/orig -> origin/gh/mikaylagawarecki/391/orig 2025-12-04T08:53:09.1862423Z * [new branch] gh/mikaylagawarecki/392/base -> origin/gh/mikaylagawarecki/392/base 2025-12-04T08:53:09.1862522Z * [new branch] gh/mikaylagawarecki/392/head -> origin/gh/mikaylagawarecki/392/head 2025-12-04T08:53:09.1862616Z * [new branch] gh/mikaylagawarecki/392/orig -> origin/gh/mikaylagawarecki/392/orig 2025-12-04T08:53:09.1862690Z * [new branch] gh/mlazos/41/base -> origin/gh/mlazos/41/base 2025-12-04T08:53:09.1862765Z * [new branch] gh/mlazos/41/head -> origin/gh/mlazos/41/head 2025-12-04T08:53:09.1862835Z * [new branch] gh/mlazos/41/orig -> origin/gh/mlazos/41/orig 2025-12-04T08:53:09.1862901Z * [new branch] gh/mlazos/42/base -> origin/gh/mlazos/42/base 2025-12-04T08:53:09.1863000Z * [new branch] gh/mlazos/42/head -> origin/gh/mlazos/42/head 2025-12-04T08:53:09.1863068Z * [new branch] gh/mlazos/42/orig -> origin/gh/mlazos/42/orig 2025-12-04T08:53:09.1863134Z * [new branch] gh/mlazos/43/base -> origin/gh/mlazos/43/base 2025-12-04T08:53:09.1863237Z * [new branch] gh/mlazos/43/head -> origin/gh/mlazos/43/head 2025-12-04T08:53:09.1863320Z * [new branch] gh/mlazos/43/orig -> origin/gh/mlazos/43/orig 2025-12-04T08:53:09.1863400Z * [new branch] gh/mlazos/44/base -> origin/gh/mlazos/44/base 2025-12-04T08:53:09.1863508Z * [new branch] gh/mlazos/44/head -> origin/gh/mlazos/44/head 2025-12-04T08:53:09.1863588Z * [new branch] gh/mlazos/44/orig -> origin/gh/mlazos/44/orig 2025-12-04T08:53:09.1863736Z * [new branch] gh/mlazos/47/base -> origin/gh/mlazos/47/base 2025-12-04T08:53:09.1863836Z * [new branch] gh/mlazos/47/head -> origin/gh/mlazos/47/head 2025-12-04T08:53:09.1863916Z * [new branch] gh/mlazos/47/orig -> origin/gh/mlazos/47/orig 2025-12-04T08:53:09.1863995Z * [new branch] gh/mlazos/48/base -> origin/gh/mlazos/48/base 2025-12-04T08:53:09.1864098Z * [new branch] gh/mlazos/48/head -> origin/gh/mlazos/48/head 2025-12-04T08:53:09.1864171Z * [new branch] gh/mlazos/48/orig -> origin/gh/mlazos/48/orig 2025-12-04T08:53:09.1864266Z * [new branch] gh/mlazos/49/base -> origin/gh/mlazos/49/base 2025-12-04T08:53:09.1864368Z * [new branch] gh/mlazos/49/head -> origin/gh/mlazos/49/head 2025-12-04T08:53:09.1864449Z * [new branch] gh/mlazos/49/orig -> origin/gh/mlazos/49/orig 2025-12-04T08:53:09.1864528Z * [new branch] gh/mlazos/50/base -> origin/gh/mlazos/50/base 2025-12-04T08:53:09.1864630Z * [new branch] gh/mlazos/50/head -> origin/gh/mlazos/50/head 2025-12-04T08:53:09.1864702Z * [new branch] gh/mlazos/50/orig -> origin/gh/mlazos/50/orig 2025-12-04T08:53:09.1864813Z * [new branch] gh/mlazos/51/base -> origin/gh/mlazos/51/base 2025-12-04T08:53:09.1864892Z * [new branch] gh/mlazos/51/head -> origin/gh/mlazos/51/head 2025-12-04T08:53:09.1865017Z * [new branch] gh/mlazos/51/orig -> origin/gh/mlazos/51/orig 2025-12-04T08:53:09.1865148Z * [new branch] gh/mlazos/52/base -> origin/gh/mlazos/52/base 2025-12-04T08:53:09.1865227Z * [new branch] gh/mlazos/52/head -> origin/gh/mlazos/52/head 2025-12-04T08:53:09.1865302Z * [new branch] gh/mlazos/52/orig -> origin/gh/mlazos/52/orig 2025-12-04T08:53:09.1865412Z * [new branch] gh/mlazos/53/base -> origin/gh/mlazos/53/base 2025-12-04T08:53:09.1865496Z * [new branch] gh/mlazos/53/head -> origin/gh/mlazos/53/head 2025-12-04T08:53:09.1865578Z * [new branch] gh/mlazos/53/orig -> origin/gh/mlazos/53/orig 2025-12-04T08:53:09.1865672Z * [new branch] gh/mlazos/54/base -> origin/gh/mlazos/54/base 2025-12-04T08:53:09.1865752Z * [new branch] gh/mlazos/54/head -> origin/gh/mlazos/54/head 2025-12-04T08:53:09.1865828Z * [new branch] gh/mlazos/54/orig -> origin/gh/mlazos/54/orig 2025-12-04T08:53:09.1865945Z * [new branch] gh/mlazos/55/base -> origin/gh/mlazos/55/base 2025-12-04T08:53:09.1866024Z * [new branch] gh/mlazos/55/head -> origin/gh/mlazos/55/head 2025-12-04T08:53:09.1866105Z * [new branch] gh/mlazos/55/orig -> origin/gh/mlazos/55/orig 2025-12-04T08:53:09.1866200Z * [new branch] gh/mlazos/56/base -> origin/gh/mlazos/56/base 2025-12-04T08:53:09.1866282Z * [new branch] gh/mlazos/56/head -> origin/gh/mlazos/56/head 2025-12-04T08:53:09.1866380Z * [new branch] gh/mlazos/56/orig -> origin/gh/mlazos/56/orig 2025-12-04T08:53:09.1866477Z * [new branch] gh/mlazos/57/base -> origin/gh/mlazos/57/base 2025-12-04T08:53:09.1866555Z * [new branch] gh/mlazos/57/head -> origin/gh/mlazos/57/head 2025-12-04T08:53:09.1866650Z * [new branch] gh/mlazos/57/orig -> origin/gh/mlazos/57/orig 2025-12-04T08:53:09.1866732Z * [new branch] gh/mlazos/58/base -> origin/gh/mlazos/58/base 2025-12-04T08:53:09.1866811Z * [new branch] gh/mlazos/58/head -> origin/gh/mlazos/58/head 2025-12-04T08:53:09.1866910Z * [new branch] gh/mlazos/58/orig -> origin/gh/mlazos/58/orig 2025-12-04T08:53:09.1867002Z * [new branch] gh/mlazos/59/base -> origin/gh/mlazos/59/base 2025-12-04T08:53:09.1867080Z * [new branch] gh/mlazos/59/head -> origin/gh/mlazos/59/head 2025-12-04T08:53:09.1867180Z * [new branch] gh/mlazos/59/orig -> origin/gh/mlazos/59/orig 2025-12-04T08:53:09.1867260Z * [new branch] gh/mlazos/60/base -> origin/gh/mlazos/60/base 2025-12-04T08:53:09.1867339Z * [new branch] gh/mlazos/60/head -> origin/gh/mlazos/60/head 2025-12-04T08:53:09.1867455Z * [new branch] gh/mlazos/60/orig -> origin/gh/mlazos/60/orig 2025-12-04T08:53:09.1867543Z * [new branch] gh/mlazos/61/base -> origin/gh/mlazos/61/base 2025-12-04T08:53:09.1867622Z * [new branch] gh/mlazos/61/head -> origin/gh/mlazos/61/head 2025-12-04T08:53:09.1867716Z * [new branch] gh/mlazos/61/orig -> origin/gh/mlazos/61/orig 2025-12-04T08:53:09.1867797Z * [new branch] gh/mlazos/62/base -> origin/gh/mlazos/62/base 2025-12-04T08:53:09.1867876Z * [new branch] gh/mlazos/62/head -> origin/gh/mlazos/62/head 2025-12-04T08:53:09.1867983Z * [new branch] gh/mlazos/62/orig -> origin/gh/mlazos/62/orig 2025-12-04T08:53:09.1868070Z * [new branch] gh/mlazos/63/base -> origin/gh/mlazos/63/base 2025-12-04T08:53:09.1868164Z * [new branch] gh/mlazos/63/head -> origin/gh/mlazos/63/head 2025-12-04T08:53:09.1868271Z * [new branch] gh/mlazos/63/orig -> origin/gh/mlazos/63/orig 2025-12-04T08:53:09.1868352Z * [new branch] gh/mlazos/64/base -> origin/gh/mlazos/64/base 2025-12-04T08:53:09.1868471Z * [new branch] gh/mlazos/64/head -> origin/gh/mlazos/64/head 2025-12-04T08:53:09.1868562Z * [new branch] gh/mlazos/64/orig -> origin/gh/mlazos/64/orig 2025-12-04T08:53:09.1868648Z * [new branch] gh/mlazos/65/base -> origin/gh/mlazos/65/base 2025-12-04T08:53:09.1868740Z * [new branch] gh/mlazos/65/head -> origin/gh/mlazos/65/head 2025-12-04T08:53:09.1868828Z * [new branch] gh/mlazos/65/orig -> origin/gh/mlazos/65/orig 2025-12-04T08:53:09.1868912Z * [new branch] gh/mlazos/66/base -> origin/gh/mlazos/66/base 2025-12-04T08:53:09.1869000Z * [new branch] gh/mlazos/66/head -> origin/gh/mlazos/66/head 2025-12-04T08:53:09.1869094Z * [new branch] gh/mlazos/66/orig -> origin/gh/mlazos/66/orig 2025-12-04T08:53:09.1869179Z * [new branch] gh/mlazos/67/base -> origin/gh/mlazos/67/base 2025-12-04T08:53:09.1869283Z * [new branch] gh/mlazos/67/head -> origin/gh/mlazos/67/head 2025-12-04T08:53:09.1869372Z * [new branch] gh/mlazos/67/orig -> origin/gh/mlazos/67/orig 2025-12-04T08:53:09.1869452Z * [new branch] gh/mlazos/68/base -> origin/gh/mlazos/68/base 2025-12-04T08:53:09.1869541Z * [new branch] gh/mlazos/68/head -> origin/gh/mlazos/68/head 2025-12-04T08:53:09.1869631Z * [new branch] gh/mlazos/68/orig -> origin/gh/mlazos/68/orig 2025-12-04T08:53:09.1869732Z * [new branch] gh/mlazos/69/base -> origin/gh/mlazos/69/base 2025-12-04T08:53:09.1869817Z * [new branch] gh/mlazos/69/head -> origin/gh/mlazos/69/head 2025-12-04T08:53:09.1869898Z * [new branch] gh/mlazos/69/orig -> origin/gh/mlazos/69/orig 2025-12-04T08:53:09.1869992Z * [new branch] gh/mlazos/70/base -> origin/gh/mlazos/70/base 2025-12-04T08:53:09.1870068Z * [new branch] gh/mlazos/70/head -> origin/gh/mlazos/70/head 2025-12-04T08:53:09.1870158Z * [new branch] gh/mlazos/70/orig -> origin/gh/mlazos/70/orig 2025-12-04T08:53:09.1870258Z * [new branch] gh/mlazos/71/base -> origin/gh/mlazos/71/base 2025-12-04T08:53:09.1870342Z * [new branch] gh/mlazos/71/head -> origin/gh/mlazos/71/head 2025-12-04T08:53:09.1870421Z * [new branch] gh/mlazos/71/orig -> origin/gh/mlazos/71/orig 2025-12-04T08:53:09.1870515Z * [new branch] gh/mlazos/72/base -> origin/gh/mlazos/72/base 2025-12-04T08:53:09.1870587Z * [new branch] gh/mlazos/72/head -> origin/gh/mlazos/72/head 2025-12-04T08:53:09.1870679Z * [new branch] gh/mlazos/72/orig -> origin/gh/mlazos/72/orig 2025-12-04T08:53:09.1870787Z * [new branch] gh/mlazos/73/base -> origin/gh/mlazos/73/base 2025-12-04T08:53:09.1870868Z * [new branch] gh/mlazos/73/head -> origin/gh/mlazos/73/head 2025-12-04T08:53:09.1870948Z * [new branch] gh/mlazos/73/orig -> origin/gh/mlazos/73/orig 2025-12-04T08:53:09.1871043Z * [new branch] gh/mrmiywj/1/base -> origin/gh/mrmiywj/1/base 2025-12-04T08:53:09.1871117Z * [new branch] gh/mrmiywj/1/head -> origin/gh/mrmiywj/1/head 2025-12-04T08:53:09.1871234Z * [new branch] gh/muchulee8/73/base -> origin/gh/muchulee8/73/base 2025-12-04T08:53:09.1871329Z * [new branch] gh/muchulee8/73/head -> origin/gh/muchulee8/73/head 2025-12-04T08:53:09.1871418Z * [new branch] gh/muchulee8/73/orig -> origin/gh/muchulee8/73/orig 2025-12-04T08:53:09.1871532Z * [new branch] gh/naveenthangudu/1/base -> origin/gh/naveenthangudu/1/base 2025-12-04T08:53:09.1871656Z * [new branch] gh/naveenthangudu/1/head -> origin/gh/naveenthangudu/1/head 2025-12-04T08:53:09.1871768Z * [new branch] gh/naveenthangudu/1/orig -> origin/gh/naveenthangudu/1/orig 2025-12-04T08:53:09.1871909Z * [new branch] gh/naveenthangudu/2/base -> origin/gh/naveenthangudu/2/base 2025-12-04T08:53:09.1872004Z * [new branch] gh/naveenthangudu/2/head -> origin/gh/naveenthangudu/2/head 2025-12-04T08:53:09.1872098Z * [new branch] gh/naveenthangudu/2/orig -> origin/gh/naveenthangudu/2/orig 2025-12-04T08:53:09.1872205Z * [new branch] gh/naveenthangudu/3/base -> origin/gh/naveenthangudu/3/base 2025-12-04T08:53:09.1872297Z * [new branch] gh/naveenthangudu/3/head -> origin/gh/naveenthangudu/3/head 2025-12-04T08:53:09.1872389Z * [new branch] gh/naveenthangudu/3/orig -> origin/gh/naveenthangudu/3/orig 2025-12-04T08:53:09.1872516Z * [new branch] gh/naveenthangudu/4/base -> origin/gh/naveenthangudu/4/base 2025-12-04T08:53:09.1872612Z * [new branch] gh/naveenthangudu/4/head -> origin/gh/naveenthangudu/4/head 2025-12-04T08:53:09.1872719Z * [new branch] gh/naveenthangudu/4/orig -> origin/gh/naveenthangudu/4/orig 2025-12-04T08:53:09.1872811Z * [new branch] gh/naveenthangudu/5/base -> origin/gh/naveenthangudu/5/base 2025-12-04T08:53:09.1872910Z * [new branch] gh/naveenthangudu/5/head -> origin/gh/naveenthangudu/5/head 2025-12-04T08:53:09.1873071Z * [new branch] gh/naveenthangudu/5/orig -> origin/gh/naveenthangudu/5/orig 2025-12-04T08:53:09.1873174Z * [new branch] gh/naveenthangudu/6/base -> origin/gh/naveenthangudu/6/base 2025-12-04T08:53:09.1873270Z * [new branch] gh/naveenthangudu/6/head -> origin/gh/naveenthangudu/6/head 2025-12-04T08:53:09.1873379Z * [new branch] gh/naveenthangudu/6/orig -> origin/gh/naveenthangudu/6/orig 2025-12-04T08:53:09.1873475Z * [new branch] gh/naveenthangudu/7/base -> origin/gh/naveenthangudu/7/base 2025-12-04T08:53:09.1873577Z * [new branch] gh/naveenthangudu/7/head -> origin/gh/naveenthangudu/7/head 2025-12-04T08:53:09.1873693Z * [new branch] gh/naveenthangudu/7/orig -> origin/gh/naveenthangudu/7/orig 2025-12-04T08:53:09.1873793Z * [new branch] gh/naveenthangudu/8/base -> origin/gh/naveenthangudu/8/base 2025-12-04T08:53:09.1873889Z * [new branch] gh/naveenthangudu/8/head -> origin/gh/naveenthangudu/8/head 2025-12-04T08:53:09.1873996Z * [new branch] gh/naveenthangudu/8/orig -> origin/gh/naveenthangudu/8/orig 2025-12-04T08:53:09.1874096Z * [new branch] gh/naveenthangudu/9/base -> origin/gh/naveenthangudu/9/base 2025-12-04T08:53:09.1874219Z * [new branch] gh/naveenthangudu/9/head -> origin/gh/naveenthangudu/9/head 2025-12-04T08:53:09.1874329Z * [new branch] gh/naveenthangudu/9/orig -> origin/gh/naveenthangudu/9/orig 2025-12-04T08:53:09.1874422Z * [new branch] gh/nikitaved/1/base -> origin/gh/nikitaved/1/base 2025-12-04T08:53:09.1874524Z * [new branch] gh/nikitaved/1/head -> origin/gh/nikitaved/1/head 2025-12-04T08:53:09.1874611Z * [new branch] gh/nikitaved/1/orig -> origin/gh/nikitaved/1/orig 2025-12-04T08:53:09.1874705Z * [new branch] gh/nikitaved/10/base -> origin/gh/nikitaved/10/base 2025-12-04T08:53:09.1874800Z * [new branch] gh/nikitaved/10/head -> origin/gh/nikitaved/10/head 2025-12-04T08:53:09.1874896Z * [new branch] gh/nikitaved/10/orig -> origin/gh/nikitaved/10/orig 2025-12-04T08:53:09.1874988Z * [new branch] gh/nikitaved/11/base -> origin/gh/nikitaved/11/base 2025-12-04T08:53:09.1875092Z * [new branch] gh/nikitaved/11/head -> origin/gh/nikitaved/11/head 2025-12-04T08:53:09.1875232Z * [new branch] gh/nikitaved/11/orig -> origin/gh/nikitaved/11/orig 2025-12-04T08:53:09.1875317Z * [new branch] gh/nikitaved/12/base -> origin/gh/nikitaved/12/base 2025-12-04T08:53:09.1875456Z * [new branch] gh/nikitaved/12/head -> origin/gh/nikitaved/12/head 2025-12-04T08:53:09.1875550Z * [new branch] gh/nikitaved/12/orig -> origin/gh/nikitaved/12/orig 2025-12-04T08:53:09.1875644Z * [new branch] gh/nikitaved/13/base -> origin/gh/nikitaved/13/base 2025-12-04T08:53:09.1875756Z * [new branch] gh/nikitaved/13/head -> origin/gh/nikitaved/13/head 2025-12-04T08:53:09.1875840Z * [new branch] gh/nikitaved/13/orig -> origin/gh/nikitaved/13/orig 2025-12-04T08:53:09.1875938Z * [new branch] gh/nikitaved/14/base -> origin/gh/nikitaved/14/base 2025-12-04T08:53:09.1876017Z * [new branch] gh/nikitaved/14/head -> origin/gh/nikitaved/14/head 2025-12-04T08:53:09.1876116Z * [new branch] gh/nikitaved/14/orig -> origin/gh/nikitaved/14/orig 2025-12-04T08:53:09.1876229Z * [new branch] gh/nikitaved/15/base -> origin/gh/nikitaved/15/base 2025-12-04T08:53:09.1876314Z * [new branch] gh/nikitaved/15/head -> origin/gh/nikitaved/15/head 2025-12-04T08:53:09.1876398Z * [new branch] gh/nikitaved/15/orig -> origin/gh/nikitaved/15/orig 2025-12-04T08:53:09.1876496Z * [new branch] gh/nikitaved/16/base -> origin/gh/nikitaved/16/base 2025-12-04T08:53:09.1876573Z * [new branch] gh/nikitaved/16/head -> origin/gh/nikitaved/16/head 2025-12-04T08:53:09.1876672Z * [new branch] gh/nikitaved/16/orig -> origin/gh/nikitaved/16/orig 2025-12-04T08:53:09.1876788Z * [new branch] gh/nikitaved/2/base -> origin/gh/nikitaved/2/base 2025-12-04T08:53:09.1876873Z * [new branch] gh/nikitaved/2/head -> origin/gh/nikitaved/2/head 2025-12-04T08:53:09.1876959Z * [new branch] gh/nikitaved/2/orig -> origin/gh/nikitaved/2/orig 2025-12-04T08:53:09.1877059Z * [new branch] gh/nikitaved/4/base -> origin/gh/nikitaved/4/base 2025-12-04T08:53:09.1877136Z * [new branch] gh/nikitaved/4/head -> origin/gh/nikitaved/4/head 2025-12-04T08:53:09.1877257Z * [new branch] gh/nikitaved/4/orig -> origin/gh/nikitaved/4/orig 2025-12-04T08:53:09.1877343Z * [new branch] gh/nikitaved/5/base -> origin/gh/nikitaved/5/base 2025-12-04T08:53:09.1877426Z * [new branch] gh/nikitaved/5/head -> origin/gh/nikitaved/5/head 2025-12-04T08:53:09.1877523Z * [new branch] gh/nikitaved/5/orig -> origin/gh/nikitaved/5/orig 2025-12-04T08:53:09.1877607Z * [new branch] gh/nikitaved/6/base -> origin/gh/nikitaved/6/base 2025-12-04T08:53:09.1877684Z * [new branch] gh/nikitaved/6/head -> origin/gh/nikitaved/6/head 2025-12-04T08:53:09.1877812Z * [new branch] gh/nikitaved/6/orig -> origin/gh/nikitaved/6/orig 2025-12-04T08:53:09.1877900Z * [new branch] gh/nikitaved/8/base -> origin/gh/nikitaved/8/base 2025-12-04T08:53:09.1877984Z * [new branch] gh/nikitaved/8/head -> origin/gh/nikitaved/8/head 2025-12-04T08:53:09.1878081Z * [new branch] gh/nikitaved/8/orig -> origin/gh/nikitaved/8/orig 2025-12-04T08:53:09.1878164Z * [new branch] gh/nikitaved/9/base -> origin/gh/nikitaved/9/base 2025-12-04T08:53:09.1878241Z * [new branch] gh/nikitaved/9/head -> origin/gh/nikitaved/9/head 2025-12-04T08:53:09.1878361Z * [new branch] gh/nikitaved/9/orig -> origin/gh/nikitaved/9/orig 2025-12-04T08:53:09.1878445Z * [new branch] gh/oulgen/10/base -> origin/gh/oulgen/10/base 2025-12-04T08:53:09.1878527Z * [new branch] gh/oulgen/10/head -> origin/gh/oulgen/10/head 2025-12-04T08:53:09.1878654Z * [new branch] gh/oulgen/10/orig -> origin/gh/oulgen/10/orig 2025-12-04T08:53:09.1878771Z * [new branch] gh/oulgen/11/base -> origin/gh/oulgen/11/base 2025-12-04T08:53:09.1878875Z * [new branch] gh/oulgen/11/head -> origin/gh/oulgen/11/head 2025-12-04T08:53:09.1878964Z * [new branch] gh/oulgen/11/orig -> origin/gh/oulgen/11/orig 2025-12-04T08:53:09.1879048Z * [new branch] gh/oulgen/12/base -> origin/gh/oulgen/12/base 2025-12-04T08:53:09.1879145Z * [new branch] gh/oulgen/12/head -> origin/gh/oulgen/12/head 2025-12-04T08:53:09.1879224Z * [new branch] gh/oulgen/12/orig -> origin/gh/oulgen/12/orig 2025-12-04T08:53:09.1879305Z * [new branch] gh/oulgen/13/base -> origin/gh/oulgen/13/base 2025-12-04T08:53:09.1879405Z * [new branch] gh/oulgen/13/head -> origin/gh/oulgen/13/head 2025-12-04T08:53:09.1879492Z * [new branch] gh/oulgen/13/orig -> origin/gh/oulgen/13/orig 2025-12-04T08:53:09.1879575Z * [new branch] gh/oulgen/14/base -> origin/gh/oulgen/14/base 2025-12-04T08:53:09.1879678Z * [new branch] gh/oulgen/14/head -> origin/gh/oulgen/14/head 2025-12-04T08:53:09.1879758Z * [new branch] gh/oulgen/14/orig -> origin/gh/oulgen/14/orig 2025-12-04T08:53:09.1879837Z * [new branch] gh/oulgen/15/base -> origin/gh/oulgen/15/base 2025-12-04T08:53:09.1879946Z * [new branch] gh/oulgen/15/head -> origin/gh/oulgen/15/head 2025-12-04T08:53:09.1880032Z * [new branch] gh/oulgen/15/orig -> origin/gh/oulgen/15/orig 2025-12-04T08:53:09.1880113Z * [new branch] gh/oulgen/16/base -> origin/gh/oulgen/16/base 2025-12-04T08:53:09.1880213Z * [new branch] gh/oulgen/16/head -> origin/gh/oulgen/16/head 2025-12-04T08:53:09.1880297Z * [new branch] gh/oulgen/16/orig -> origin/gh/oulgen/16/orig 2025-12-04T08:53:09.1880378Z * [new branch] gh/oulgen/17/base -> origin/gh/oulgen/17/base 2025-12-04T08:53:09.1880479Z * [new branch] gh/oulgen/17/head -> origin/gh/oulgen/17/head 2025-12-04T08:53:09.1880566Z * [new branch] gh/oulgen/17/orig -> origin/gh/oulgen/17/orig 2025-12-04T08:53:09.1880668Z * [new branch] gh/oulgen/18/base -> origin/gh/oulgen/18/base 2025-12-04T08:53:09.1880748Z * [new branch] gh/oulgen/18/head -> origin/gh/oulgen/18/head 2025-12-04T08:53:09.1880827Z * [new branch] gh/oulgen/18/orig -> origin/gh/oulgen/18/orig 2025-12-04T08:53:09.1880914Z * [new branch] gh/oulgen/19/base -> origin/gh/oulgen/19/base 2025-12-04T08:53:09.1881007Z * [new branch] gh/oulgen/19/head -> origin/gh/oulgen/19/head 2025-12-04T08:53:09.1881094Z * [new branch] gh/oulgen/19/orig -> origin/gh/oulgen/19/orig 2025-12-04T08:53:09.1881191Z * [new branch] gh/oulgen/20/base -> origin/gh/oulgen/20/base 2025-12-04T08:53:09.1881453Z * [new branch] gh/oulgen/20/head -> origin/gh/oulgen/20/head 2025-12-04T08:53:09.1881533Z * [new branch] gh/oulgen/20/orig -> origin/gh/oulgen/20/orig 2025-12-04T08:53:09.1881619Z * [new branch] gh/oulgen/21/base -> origin/gh/oulgen/21/base 2025-12-04T08:53:09.1881712Z * [new branch] gh/oulgen/21/head -> origin/gh/oulgen/21/head 2025-12-04T08:53:09.1881798Z * [new branch] gh/oulgen/21/orig -> origin/gh/oulgen/21/orig 2025-12-04T08:53:09.1881902Z * [new branch] gh/oulgen/22/base -> origin/gh/oulgen/22/base 2025-12-04T08:53:09.1881983Z * [new branch] gh/oulgen/22/head -> origin/gh/oulgen/22/head 2025-12-04T08:53:09.1882099Z * [new branch] gh/oulgen/22/orig -> origin/gh/oulgen/22/orig 2025-12-04T08:53:09.1882186Z * [new branch] gh/oulgen/23/base -> origin/gh/oulgen/23/base 2025-12-04T08:53:09.1882311Z * [new branch] gh/oulgen/23/head -> origin/gh/oulgen/23/head 2025-12-04T08:53:09.1882409Z * [new branch] gh/oulgen/23/orig -> origin/gh/oulgen/23/orig 2025-12-04T08:53:09.1882488Z * [new branch] gh/oulgen/24/base -> origin/gh/oulgen/24/base 2025-12-04T08:53:09.1882568Z * [new branch] gh/oulgen/24/head -> origin/gh/oulgen/24/head 2025-12-04T08:53:09.1882661Z * [new branch] gh/oulgen/24/orig -> origin/gh/oulgen/24/orig 2025-12-04T08:53:09.1882740Z * [new branch] gh/oulgen/25/base -> origin/gh/oulgen/25/base 2025-12-04T08:53:09.1882832Z * [new branch] gh/oulgen/25/head -> origin/gh/oulgen/25/head 2025-12-04T08:53:09.1882971Z * [new branch] gh/oulgen/25/orig -> origin/gh/oulgen/25/orig 2025-12-04T08:53:09.1883055Z * [new branch] gh/oulgen/26/base -> origin/gh/oulgen/26/base 2025-12-04T08:53:09.1883136Z * [new branch] gh/oulgen/26/head -> origin/gh/oulgen/26/head 2025-12-04T08:53:09.1883236Z * [new branch] gh/oulgen/26/orig -> origin/gh/oulgen/26/orig 2025-12-04T08:53:09.1883312Z * [new branch] gh/oulgen/4/base -> origin/gh/oulgen/4/base 2025-12-04T08:53:09.1883403Z * [new branch] gh/oulgen/4/head -> origin/gh/oulgen/4/head 2025-12-04T08:53:09.1883506Z * [new branch] gh/oulgen/4/orig -> origin/gh/oulgen/4/orig 2025-12-04T08:53:09.1883584Z * [new branch] gh/oulgen/7/base -> origin/gh/oulgen/7/base 2025-12-04T08:53:09.1883662Z * [new branch] gh/oulgen/7/head -> origin/gh/oulgen/7/head 2025-12-04T08:53:09.1883760Z * [new branch] gh/oulgen/7/orig -> origin/gh/oulgen/7/orig 2025-12-04T08:53:09.1883836Z * [new branch] gh/oulgen/8/base -> origin/gh/oulgen/8/base 2025-12-04T08:53:09.1883948Z * [new branch] gh/oulgen/8/head -> origin/gh/oulgen/8/head 2025-12-04T08:53:09.1884026Z * [new branch] gh/oulgen/8/orig -> origin/gh/oulgen/8/orig 2025-12-04T08:53:09.1884106Z * [new branch] gh/oulgen/9/base -> origin/gh/oulgen/9/base 2025-12-04T08:53:09.1884211Z * [new branch] gh/oulgen/9/head -> origin/gh/oulgen/9/head 2025-12-04T08:53:09.1884290Z * [new branch] gh/oulgen/9/orig -> origin/gh/oulgen/9/orig 2025-12-04T08:53:09.1884402Z * [new branch] gh/patvig/mtia-serialization -> origin/gh/patvig/mtia-serialization 2025-12-04T08:53:09.1884517Z * [new branch] gh/pearu/108/base -> origin/gh/pearu/108/base 2025-12-04T08:53:09.1884599Z * [new branch] gh/pearu/108/head -> origin/gh/pearu/108/head 2025-12-04T08:53:09.1884680Z * [new branch] gh/pearu/108/orig -> origin/gh/pearu/108/orig 2025-12-04T08:53:09.1884779Z * [new branch] gh/pearu/109/base -> origin/gh/pearu/109/base 2025-12-04T08:53:09.1884860Z * [new branch] gh/pearu/109/head -> origin/gh/pearu/109/head 2025-12-04T08:53:09.1884932Z * [new branch] gh/pearu/109/orig -> origin/gh/pearu/109/orig 2025-12-04T08:53:09.1885047Z * [new branch] gh/pearu/110/base -> origin/gh/pearu/110/base 2025-12-04T08:53:09.1885126Z * [new branch] gh/pearu/110/head -> origin/gh/pearu/110/head 2025-12-04T08:53:09.1885206Z * [new branch] gh/pearu/110/orig -> origin/gh/pearu/110/orig 2025-12-04T08:53:09.1885306Z * [new branch] gh/pearu/111/base -> origin/gh/pearu/111/base 2025-12-04T08:53:09.1885390Z * [new branch] gh/pearu/111/head -> origin/gh/pearu/111/head 2025-12-04T08:53:09.1885531Z * [new branch] gh/pearu/111/orig -> origin/gh/pearu/111/orig 2025-12-04T08:53:09.1885618Z * [new branch] gh/pearu/112/base -> origin/gh/pearu/112/base 2025-12-04T08:53:09.1885736Z * [new branch] gh/pearu/112/head -> origin/gh/pearu/112/head 2025-12-04T08:53:09.1885830Z * [new branch] gh/pearu/112/orig -> origin/gh/pearu/112/orig 2025-12-04T08:53:09.1885911Z * [new branch] gh/pearu/115/base -> origin/gh/pearu/115/base 2025-12-04T08:53:09.1885991Z * [new branch] gh/pearu/115/head -> origin/gh/pearu/115/head 2025-12-04T08:53:09.1886088Z * [new branch] gh/pearu/115/orig -> origin/gh/pearu/115/orig 2025-12-04T08:53:09.1886180Z * [new branch] gh/pearu/116/base -> origin/gh/pearu/116/base 2025-12-04T08:53:09.1886258Z * [new branch] gh/pearu/116/head -> origin/gh/pearu/116/head 2025-12-04T08:53:09.1886352Z * [new branch] gh/pearu/116/orig -> origin/gh/pearu/116/orig 2025-12-04T08:53:09.1886431Z * [new branch] gh/pearu/117/base -> origin/gh/pearu/117/base 2025-12-04T08:53:09.1886512Z * [new branch] gh/pearu/117/head -> origin/gh/pearu/117/head 2025-12-04T08:53:09.1886614Z * [new branch] gh/pearu/117/orig -> origin/gh/pearu/117/orig 2025-12-04T08:53:09.1886712Z * [new branch] gh/pearu/118/base -> origin/gh/pearu/118/base 2025-12-04T08:53:09.1886791Z * [new branch] gh/pearu/118/head -> origin/gh/pearu/118/head 2025-12-04T08:53:09.1886885Z * [new branch] gh/pearu/118/orig -> origin/gh/pearu/118/orig 2025-12-04T08:53:09.1886965Z * [new branch] gh/pearu/119/base -> origin/gh/pearu/119/base 2025-12-04T08:53:09.1887052Z * [new branch] gh/pearu/119/head -> origin/gh/pearu/119/head 2025-12-04T08:53:09.1887146Z * [new branch] gh/pearu/119/orig -> origin/gh/pearu/119/orig 2025-12-04T08:53:09.1887237Z * [new branch] gh/pearu/139/base -> origin/gh/pearu/139/base 2025-12-04T08:53:09.1887331Z * [new branch] gh/pearu/139/head -> origin/gh/pearu/139/head 2025-12-04T08:53:09.1887411Z * [new branch] gh/pearu/139/orig -> origin/gh/pearu/139/orig 2025-12-04T08:53:09.1887491Z * [new branch] gh/pearu/140/base -> origin/gh/pearu/140/base 2025-12-04T08:53:09.1887579Z * [new branch] gh/pearu/140/head -> origin/gh/pearu/140/head 2025-12-04T08:53:09.1887677Z * [new branch] gh/pearu/140/orig -> origin/gh/pearu/140/orig 2025-12-04T08:53:09.1887763Z * [new branch] gh/pearu/142/base -> origin/gh/pearu/142/base 2025-12-04T08:53:09.1887856Z * [new branch] gh/pearu/142/head -> origin/gh/pearu/142/head 2025-12-04T08:53:09.1887938Z * [new branch] gh/pearu/142/orig -> origin/gh/pearu/142/orig 2025-12-04T08:53:09.1888018Z * [new branch] gh/pearu/143/base -> origin/gh/pearu/143/base 2025-12-04T08:53:09.1888109Z * [new branch] gh/pearu/143/head -> origin/gh/pearu/143/head 2025-12-04T08:53:09.1888203Z * [new branch] gh/pearu/143/orig -> origin/gh/pearu/143/orig 2025-12-04T08:53:09.1888288Z * [new branch] gh/pearu/147/base -> origin/gh/pearu/147/base 2025-12-04T08:53:09.1888383Z * [new branch] gh/pearu/147/head -> origin/gh/pearu/147/head 2025-12-04T08:53:09.1888464Z * [new branch] gh/pearu/147/orig -> origin/gh/pearu/147/orig 2025-12-04T08:53:09.1888556Z * [new branch] gh/pearu/149/base -> origin/gh/pearu/149/base 2025-12-04T08:53:09.1888638Z * [new branch] gh/pearu/149/head -> origin/gh/pearu/149/head 2025-12-04T08:53:09.1888727Z * [new branch] gh/pearu/149/orig -> origin/gh/pearu/149/orig 2025-12-04T08:53:09.1888859Z * [new branch] gh/pearu/150/base -> origin/gh/pearu/150/base 2025-12-04T08:53:09.1888964Z * [new branch] gh/pearu/150/head -> origin/gh/pearu/150/head 2025-12-04T08:53:09.1889050Z * [new branch] gh/pearu/150/orig -> origin/gh/pearu/150/orig 2025-12-04T08:53:09.1889143Z * [new branch] gh/pearu/151/base -> origin/gh/pearu/151/base 2025-12-04T08:53:09.1889216Z * [new branch] gh/pearu/151/head -> origin/gh/pearu/151/head 2025-12-04T08:53:09.1889308Z * [new branch] gh/pearu/151/orig -> origin/gh/pearu/151/orig 2025-12-04T08:53:09.1889407Z * [new branch] gh/pearu/152/base -> origin/gh/pearu/152/base 2025-12-04T08:53:09.1889486Z * [new branch] gh/pearu/152/head -> origin/gh/pearu/152/head 2025-12-04T08:53:09.1889574Z * [new branch] gh/pearu/152/orig -> origin/gh/pearu/152/orig 2025-12-04T08:53:09.1889671Z * [new branch] gh/pearu/153/base -> origin/gh/pearu/153/base 2025-12-04T08:53:09.1889745Z * [new branch] gh/pearu/153/head -> origin/gh/pearu/153/head 2025-12-04T08:53:09.1889836Z * [new branch] gh/pearu/153/orig -> origin/gh/pearu/153/orig 2025-12-04T08:53:09.1889938Z * [new branch] gh/pearu/154/base -> origin/gh/pearu/154/base 2025-12-04T08:53:09.1890026Z * [new branch] gh/pearu/154/head -> origin/gh/pearu/154/head 2025-12-04T08:53:09.1890118Z * [new branch] gh/pearu/154/orig -> origin/gh/pearu/154/orig 2025-12-04T08:53:09.1890197Z * [new branch] gh/pearu/155/base -> origin/gh/pearu/155/base 2025-12-04T08:53:09.1890270Z * [new branch] gh/pearu/155/head -> origin/gh/pearu/155/head 2025-12-04T08:53:09.1890380Z * [new branch] gh/pearu/155/orig -> origin/gh/pearu/155/orig 2025-12-04T08:53:09.1890462Z * [new branch] gh/pearu/156/base -> origin/gh/pearu/156/base 2025-12-04T08:53:09.1890547Z * [new branch] gh/pearu/156/head -> origin/gh/pearu/156/head 2025-12-04T08:53:09.1890640Z * [new branch] gh/pearu/156/orig -> origin/gh/pearu/156/orig 2025-12-04T08:53:09.1890721Z * [new branch] gh/pearu/56/base -> origin/gh/pearu/56/base 2025-12-04T08:53:09.1890794Z * [new branch] gh/pearu/56/head -> origin/gh/pearu/56/head 2025-12-04T08:53:09.1890906Z * [new branch] gh/pearu/56/orig -> origin/gh/pearu/56/orig 2025-12-04T08:53:09.1890993Z * [new branch] gh/pearu/97/base -> origin/gh/pearu/97/base 2025-12-04T08:53:09.1891072Z * [new branch] gh/pearu/97/head -> origin/gh/pearu/97/head 2025-12-04T08:53:09.1891165Z * [new branch] gh/pearu/97/orig -> origin/gh/pearu/97/orig 2025-12-04T08:53:09.1891256Z * [new branch] gh/pianpwk/21/base -> origin/gh/pianpwk/21/base 2025-12-04T08:53:09.1891336Z * [new branch] gh/pianpwk/21/head -> origin/gh/pianpwk/21/head 2025-12-04T08:53:09.1891454Z * [new branch] gh/pianpwk/28/base -> origin/gh/pianpwk/28/base 2025-12-04T08:53:09.1891542Z * [new branch] gh/pianpwk/28/head -> origin/gh/pianpwk/28/head 2025-12-04T08:53:09.1891640Z * [new branch] gh/pianpwk/28/orig -> origin/gh/pianpwk/28/orig 2025-12-04T08:53:09.1891725Z * [new branch] gh/pianpwk/29/base -> origin/gh/pianpwk/29/base 2025-12-04T08:53:09.1891807Z * [new branch] gh/pianpwk/29/head -> origin/gh/pianpwk/29/head 2025-12-04T08:53:09.1895965Z * [new branch] gh/pianpwk/29/orig -> origin/gh/pianpwk/29/orig 2025-12-04T08:53:09.1896061Z * [new branch] gh/pianpwk/30/base -> origin/gh/pianpwk/30/base 2025-12-04T08:53:09.1896190Z * [new branch] gh/pianpwk/30/head -> origin/gh/pianpwk/30/head 2025-12-04T08:53:09.1896265Z * [new branch] gh/pianpwk/30/orig -> origin/gh/pianpwk/30/orig 2025-12-04T08:53:09.1896394Z * [new branch] gh/pianpwk/31/base -> origin/gh/pianpwk/31/base 2025-12-04T08:53:09.1896467Z * [new branch] gh/pianpwk/31/head -> origin/gh/pianpwk/31/head 2025-12-04T08:53:09.1896538Z * [new branch] gh/pianpwk/31/orig -> origin/gh/pianpwk/31/orig 2025-12-04T08:53:09.1896606Z * [new branch] gh/pianpwk/32/base -> origin/gh/pianpwk/32/base 2025-12-04T08:53:09.1896678Z * [new branch] gh/pianpwk/32/head -> origin/gh/pianpwk/32/head 2025-12-04T08:53:09.1896749Z * [new branch] gh/pianpwk/32/orig -> origin/gh/pianpwk/32/orig 2025-12-04T08:53:09.1896818Z * [new branch] gh/pianpwk/33/base -> origin/gh/pianpwk/33/base 2025-12-04T08:53:09.1896890Z * [new branch] gh/pianpwk/33/head -> origin/gh/pianpwk/33/head 2025-12-04T08:53:09.1896961Z * [new branch] gh/pianpwk/33/orig -> origin/gh/pianpwk/33/orig 2025-12-04T08:53:09.1897034Z * [new branch] gh/pianpwk/34/base -> origin/gh/pianpwk/34/base 2025-12-04T08:53:09.1897103Z * [new branch] gh/pianpwk/34/head -> origin/gh/pianpwk/34/head 2025-12-04T08:53:09.1897173Z * [new branch] gh/pianpwk/34/orig -> origin/gh/pianpwk/34/orig 2025-12-04T08:53:09.1897247Z * [new branch] gh/pianpwk/35/base -> origin/gh/pianpwk/35/base 2025-12-04T08:53:09.1897316Z * [new branch] gh/pianpwk/35/head -> origin/gh/pianpwk/35/head 2025-12-04T08:53:09.1897386Z * [new branch] gh/pianpwk/35/orig -> origin/gh/pianpwk/35/orig 2025-12-04T08:53:09.1897454Z * [new branch] gh/rec/141/base -> origin/gh/rec/141/base 2025-12-04T08:53:09.1897523Z * [new branch] gh/rec/141/head -> origin/gh/rec/141/head 2025-12-04T08:53:09.1897589Z * [new branch] gh/rec/153/base -> origin/gh/rec/153/base 2025-12-04T08:53:09.1897656Z * [new branch] gh/rec/153/head -> origin/gh/rec/153/head 2025-12-04T08:53:09.1897721Z * [new branch] gh/rec/153/orig -> origin/gh/rec/153/orig 2025-12-04T08:53:09.1897784Z * [new branch] gh/rec/154/base -> origin/gh/rec/154/base 2025-12-04T08:53:09.1897848Z * [new branch] gh/rec/154/head -> origin/gh/rec/154/head 2025-12-04T08:53:09.1897912Z * [new branch] gh/rec/154/orig -> origin/gh/rec/154/orig 2025-12-04T08:53:09.1897976Z * [new branch] gh/rec/164/base -> origin/gh/rec/164/base 2025-12-04T08:53:09.1898039Z * [new branch] gh/rec/164/head -> origin/gh/rec/164/head 2025-12-04T08:53:09.1898108Z * [new branch] gh/rec/164/orig -> origin/gh/rec/164/orig 2025-12-04T08:53:09.1898173Z * [new branch] gh/rec/166/base -> origin/gh/rec/166/base 2025-12-04T08:53:09.1898240Z * [new branch] gh/rec/166/head -> origin/gh/rec/166/head 2025-12-04T08:53:09.1898309Z * [new branch] gh/rec/166/orig -> origin/gh/rec/166/orig 2025-12-04T08:53:09.1898375Z * [new branch] gh/rec/167/base -> origin/gh/rec/167/base 2025-12-04T08:53:09.1898439Z * [new branch] gh/rec/167/head -> origin/gh/rec/167/head 2025-12-04T08:53:09.1898507Z * [new branch] gh/rec/167/orig -> origin/gh/rec/167/orig 2025-12-04T08:53:09.1898569Z * [new branch] gh/rec/168/base -> origin/gh/rec/168/base 2025-12-04T08:53:09.1898632Z * [new branch] gh/rec/168/head -> origin/gh/rec/168/head 2025-12-04T08:53:09.1898699Z * [new branch] gh/rec/168/orig -> origin/gh/rec/168/orig 2025-12-04T08:53:09.1898790Z * [new branch] gh/rec/169/base -> origin/gh/rec/169/base 2025-12-04T08:53:09.1898881Z * [new branch] gh/rec/169/head -> origin/gh/rec/169/head 2025-12-04T08:53:09.1898949Z * [new branch] gh/rec/169/orig -> origin/gh/rec/169/orig 2025-12-04T08:53:09.1899012Z * [new branch] gh/rec/170/base -> origin/gh/rec/170/base 2025-12-04T08:53:09.1899075Z * [new branch] gh/rec/170/head -> origin/gh/rec/170/head 2025-12-04T08:53:09.1899141Z * [new branch] gh/rec/170/orig -> origin/gh/rec/170/orig 2025-12-04T08:53:09.1899206Z * [new branch] gh/rec/171/base -> origin/gh/rec/171/base 2025-12-04T08:53:09.1899271Z * [new branch] gh/rec/171/head -> origin/gh/rec/171/head 2025-12-04T08:53:09.1899336Z * [new branch] gh/rec/171/orig -> origin/gh/rec/171/orig 2025-12-04T08:53:09.1899400Z * [new branch] gh/rec/172/base -> origin/gh/rec/172/base 2025-12-04T08:53:09.1899468Z * [new branch] gh/rec/172/head -> origin/gh/rec/172/head 2025-12-04T08:53:09.1899532Z * [new branch] gh/rec/172/orig -> origin/gh/rec/172/orig 2025-12-04T08:53:09.1899595Z * [new branch] gh/rec/173/base -> origin/gh/rec/173/base 2025-12-04T08:53:09.1899659Z * [new branch] gh/rec/173/head -> origin/gh/rec/173/head 2025-12-04T08:53:09.1899723Z * [new branch] gh/rec/173/orig -> origin/gh/rec/173/orig 2025-12-04T08:53:09.1899784Z * [new branch] gh/rec/174/base -> origin/gh/rec/174/base 2025-12-04T08:53:09.1899849Z * [new branch] gh/rec/174/head -> origin/gh/rec/174/head 2025-12-04T08:53:09.1899911Z * [new branch] gh/rec/174/orig -> origin/gh/rec/174/orig 2025-12-04T08:53:09.1899977Z * [new branch] gh/rec/175/base -> origin/gh/rec/175/base 2025-12-04T08:53:09.1900043Z * [new branch] gh/rec/175/head -> origin/gh/rec/175/head 2025-12-04T08:53:09.1900109Z * [new branch] gh/rec/175/orig -> origin/gh/rec/175/orig 2025-12-04T08:53:09.1900171Z * [new branch] gh/rec/176/base -> origin/gh/rec/176/base 2025-12-04T08:53:09.1900237Z * [new branch] gh/rec/176/head -> origin/gh/rec/176/head 2025-12-04T08:53:09.1900299Z * [new branch] gh/rec/176/orig -> origin/gh/rec/176/orig 2025-12-04T08:53:09.1900362Z * [new branch] gh/rec/177/base -> origin/gh/rec/177/base 2025-12-04T08:53:09.1900426Z * [new branch] gh/rec/177/head -> origin/gh/rec/177/head 2025-12-04T08:53:09.1900489Z * [new branch] gh/rec/177/orig -> origin/gh/rec/177/orig 2025-12-04T08:53:09.1900579Z * [new branch] gh/robert-hardwick/3/base -> origin/gh/robert-hardwick/3/base 2025-12-04T08:53:09.1900667Z * [new branch] gh/robert-hardwick/3/head -> origin/gh/robert-hardwick/3/head 2025-12-04T08:53:09.1900752Z * [new branch] gh/robert-hardwick/3/orig -> origin/gh/robert-hardwick/3/orig 2025-12-04T08:53:09.1900834Z * [new branch] gh/robert-hardwick/4/base -> origin/gh/robert-hardwick/4/base 2025-12-04T08:53:09.1900917Z * [new branch] gh/robert-hardwick/4/head -> origin/gh/robert-hardwick/4/head 2025-12-04T08:53:09.1901000Z * [new branch] gh/robert-hardwick/4/orig -> origin/gh/robert-hardwick/4/orig 2025-12-04T08:53:09.1901081Z * [new branch] gh/robert-hardwick/5/base -> origin/gh/robert-hardwick/5/base 2025-12-04T08:53:09.1901161Z * [new branch] gh/robert-hardwick/5/head -> origin/gh/robert-hardwick/5/head 2025-12-04T08:53:09.1901242Z * [new branch] gh/robert-hardwick/5/orig -> origin/gh/robert-hardwick/5/orig 2025-12-04T08:53:09.1901350Z * [new branch] gh/robert-hardwick/6/base -> origin/gh/robert-hardwick/6/base 2025-12-04T08:53:09.1901460Z * [new branch] gh/robert-hardwick/6/head -> origin/gh/robert-hardwick/6/head 2025-12-04T08:53:09.1901542Z * [new branch] gh/robert-hardwick/6/orig -> origin/gh/robert-hardwick/6/orig 2025-12-04T08:53:09.1901623Z * [new branch] gh/robert-hardwick/7/base -> origin/gh/robert-hardwick/7/base 2025-12-04T08:53:09.1901705Z * [new branch] gh/robert-hardwick/7/head -> origin/gh/robert-hardwick/7/head 2025-12-04T08:53:09.1901788Z * [new branch] gh/robert-hardwick/7/orig -> origin/gh/robert-hardwick/7/orig 2025-12-04T08:53:09.1901868Z * [new branch] gh/robert-hardwick/8/base -> origin/gh/robert-hardwick/8/base 2025-12-04T08:53:09.1901949Z * [new branch] gh/robert-hardwick/8/head -> origin/gh/robert-hardwick/8/head 2025-12-04T08:53:09.1902029Z * [new branch] gh/robert-hardwick/8/orig -> origin/gh/robert-hardwick/8/orig 2025-12-04T08:53:09.1902112Z * [new branch] gh/robert-hardwick/9/base -> origin/gh/robert-hardwick/9/base 2025-12-04T08:53:09.1902198Z * [new branch] gh/robert-hardwick/9/head -> origin/gh/robert-hardwick/9/head 2025-12-04T08:53:09.1902279Z * [new branch] gh/robert-hardwick/9/orig -> origin/gh/robert-hardwick/9/orig 2025-12-04T08:53:09.1902350Z * [new branch] gh/rtimpe/1/base -> origin/gh/rtimpe/1/base 2025-12-04T08:53:09.1902419Z * [new branch] gh/rtimpe/1/head -> origin/gh/rtimpe/1/head 2025-12-04T08:53:09.1902486Z * [new branch] gh/rtimpe/2/base -> origin/gh/rtimpe/2/base 2025-12-04T08:53:09.1902552Z * [new branch] gh/rtimpe/2/head -> origin/gh/rtimpe/2/head 2025-12-04T08:53:09.1902621Z * [new branch] gh/rtimpe/22/base -> origin/gh/rtimpe/22/base 2025-12-04T08:53:09.1902691Z * [new branch] gh/rtimpe/22/head -> origin/gh/rtimpe/22/head 2025-12-04T08:53:09.1902759Z * [new branch] gh/rtimpe/22/orig -> origin/gh/rtimpe/22/orig 2025-12-04T08:53:09.1902829Z * [new branch] gh/rtimpe/23/base -> origin/gh/rtimpe/23/base 2025-12-04T08:53:09.1902895Z * [new branch] gh/rtimpe/23/head -> origin/gh/rtimpe/23/head 2025-12-04T08:53:09.1903002Z * [new branch] gh/rtimpe/23/orig -> origin/gh/rtimpe/23/orig 2025-12-04T08:53:09.1903073Z * [new branch] gh/rtimpe/24/base -> origin/gh/rtimpe/24/base 2025-12-04T08:53:09.1903139Z * [new branch] gh/rtimpe/24/head -> origin/gh/rtimpe/24/head 2025-12-04T08:53:09.1903206Z * [new branch] gh/rtimpe/24/orig -> origin/gh/rtimpe/24/orig 2025-12-04T08:53:09.1903275Z * [new branch] gh/rtimpe/25/base -> origin/gh/rtimpe/25/base 2025-12-04T08:53:09.1903341Z * [new branch] gh/rtimpe/25/head -> origin/gh/rtimpe/25/head 2025-12-04T08:53:09.1903408Z * [new branch] gh/rtimpe/25/orig -> origin/gh/rtimpe/25/orig 2025-12-04T08:53:09.1903478Z * [new branch] gh/rtimpe/26/base -> origin/gh/rtimpe/26/base 2025-12-04T08:53:09.1903543Z * [new branch] gh/rtimpe/26/head -> origin/gh/rtimpe/26/head 2025-12-04T08:53:09.1903611Z * [new branch] gh/rtimpe/26/orig -> origin/gh/rtimpe/26/orig 2025-12-04T08:53:09.1903679Z * [new branch] gh/rtimpe/27/base -> origin/gh/rtimpe/27/base 2025-12-04T08:53:09.1903744Z * [new branch] gh/rtimpe/27/head -> origin/gh/rtimpe/27/head 2025-12-04T08:53:09.1903811Z * [new branch] gh/rtimpe/27/orig -> origin/gh/rtimpe/27/orig 2025-12-04T08:53:09.1903876Z * [new branch] gh/rtimpe/28/base -> origin/gh/rtimpe/28/base 2025-12-04T08:53:09.1903942Z * [new branch] gh/rtimpe/28/head -> origin/gh/rtimpe/28/head 2025-12-04T08:53:09.1904050Z * [new branch] gh/rtimpe/28/orig -> origin/gh/rtimpe/28/orig 2025-12-04T08:53:09.1904155Z * [new branch] gh/rtimpe/29/base -> origin/gh/rtimpe/29/base 2025-12-04T08:53:09.1904223Z * [new branch] gh/rtimpe/29/head -> origin/gh/rtimpe/29/head 2025-12-04T08:53:09.1904290Z * [new branch] gh/rtimpe/29/orig -> origin/gh/rtimpe/29/orig 2025-12-04T08:53:09.1904356Z * [new branch] gh/rtimpe/3/base -> origin/gh/rtimpe/3/base 2025-12-04T08:53:09.1904422Z * [new branch] gh/rtimpe/3/head -> origin/gh/rtimpe/3/head 2025-12-04T08:53:09.1904488Z * [new branch] gh/rtimpe/30/base -> origin/gh/rtimpe/30/base 2025-12-04T08:53:09.1904556Z * [new branch] gh/rtimpe/30/head -> origin/gh/rtimpe/30/head 2025-12-04T08:53:09.1904621Z * [new branch] gh/rtimpe/30/orig -> origin/gh/rtimpe/30/orig 2025-12-04T08:53:09.1904690Z * [new branch] gh/rtimpe/31/base -> origin/gh/rtimpe/31/base 2025-12-04T08:53:09.1904758Z * [new branch] gh/rtimpe/31/head -> origin/gh/rtimpe/31/head 2025-12-04T08:53:09.1904824Z * [new branch] gh/rtimpe/31/orig -> origin/gh/rtimpe/31/orig 2025-12-04T08:53:09.1904892Z * [new branch] gh/rtimpe/32/base -> origin/gh/rtimpe/32/base 2025-12-04T08:53:09.1904959Z * [new branch] gh/rtimpe/32/head -> origin/gh/rtimpe/32/head 2025-12-04T08:53:09.1905026Z * [new branch] gh/rtimpe/32/orig -> origin/gh/rtimpe/32/orig 2025-12-04T08:53:09.1905096Z * [new branch] gh/rtimpe/33/base -> origin/gh/rtimpe/33/base 2025-12-04T08:53:09.1905162Z * [new branch] gh/rtimpe/33/head -> origin/gh/rtimpe/33/head 2025-12-04T08:53:09.1905229Z * [new branch] gh/rtimpe/33/orig -> origin/gh/rtimpe/33/orig 2025-12-04T08:53:09.1905298Z * [new branch] gh/rtimpe/34/base -> origin/gh/rtimpe/34/base 2025-12-04T08:53:09.1905367Z * [new branch] gh/rtimpe/34/head -> origin/gh/rtimpe/34/head 2025-12-04T08:53:09.1905435Z * [new branch] gh/rtimpe/34/orig -> origin/gh/rtimpe/34/orig 2025-12-04T08:53:09.1905501Z * [new branch] gh/rtimpe/35/base -> origin/gh/rtimpe/35/base 2025-12-04T08:53:09.1905566Z * [new branch] gh/rtimpe/35/head -> origin/gh/rtimpe/35/head 2025-12-04T08:53:09.1905635Z * [new branch] gh/rtimpe/35/orig -> origin/gh/rtimpe/35/orig 2025-12-04T08:53:09.1905702Z * [new branch] gh/rtimpe/4/base -> origin/gh/rtimpe/4/base 2025-12-04T08:53:09.1905769Z * [new branch] gh/rtimpe/4/head -> origin/gh/rtimpe/4/head 2025-12-04T08:53:09.1905851Z * [new branch] gh/ruisizhang123/1/base -> origin/gh/ruisizhang123/1/base 2025-12-04T08:53:09.1905931Z * [new branch] gh/ruisizhang123/1/head -> origin/gh/ruisizhang123/1/head 2025-12-04T08:53:09.1906011Z * [new branch] gh/ruisizhang123/1/orig -> origin/gh/ruisizhang123/1/orig 2025-12-04T08:53:09.1906088Z * [new branch] gh/ruisizhang123/4/base -> origin/gh/ruisizhang123/4/base 2025-12-04T08:53:09.1906164Z * [new branch] gh/ruisizhang123/4/head -> origin/gh/ruisizhang123/4/head 2025-12-04T08:53:09.1906239Z * [new branch] gh/ruisizhang123/4/orig -> origin/gh/ruisizhang123/4/orig 2025-12-04T08:53:09.1906316Z * [new branch] gh/ruisizhang123/5/base -> origin/gh/ruisizhang123/5/base 2025-12-04T08:53:09.1906393Z * [new branch] gh/ruisizhang123/5/head -> origin/gh/ruisizhang123/5/head 2025-12-04T08:53:09.1906468Z * [new branch] gh/ruisizhang123/5/orig -> origin/gh/ruisizhang123/5/orig 2025-12-04T08:53:09.1906543Z * [new branch] gh/ruisizhang123/6/base -> origin/gh/ruisizhang123/6/base 2025-12-04T08:53:09.1906648Z * [new branch] gh/ruisizhang123/6/head -> origin/gh/ruisizhang123/6/head 2025-12-04T08:53:09.1906760Z * [new branch] gh/ruisizhang123/6/orig -> origin/gh/ruisizhang123/6/orig 2025-12-04T08:53:09.1906836Z * [new branch] gh/ruisizhang123/7/base -> origin/gh/ruisizhang123/7/base 2025-12-04T08:53:09.1906910Z * [new branch] gh/ruisizhang123/7/head -> origin/gh/ruisizhang123/7/head 2025-12-04T08:53:09.1906988Z * [new branch] gh/ruisizhang123/7/orig -> origin/gh/ruisizhang123/7/orig 2025-12-04T08:53:09.1907064Z * [new branch] gh/ruisizhang123/8/base -> origin/gh/ruisizhang123/8/base 2025-12-04T08:53:09.1907138Z * [new branch] gh/ruisizhang123/8/head -> origin/gh/ruisizhang123/8/head 2025-12-04T08:53:09.1907215Z * [new branch] gh/ruisizhang123/8/orig -> origin/gh/ruisizhang123/8/orig 2025-12-04T08:53:09.1907292Z * [new branch] gh/ruisizhang123/9/base -> origin/gh/ruisizhang123/9/base 2025-12-04T08:53:09.1907366Z * [new branch] gh/ruisizhang123/9/head -> origin/gh/ruisizhang123/9/head 2025-12-04T08:53:09.1907445Z * [new branch] gh/ruisizhang123/9/orig -> origin/gh/ruisizhang123/9/orig 2025-12-04T08:53:09.1907523Z * [new branch] gh/seemethere/52/base -> origin/gh/seemethere/52/base 2025-12-04T08:53:09.1907598Z * [new branch] gh/seemethere/52/head -> origin/gh/seemethere/52/head 2025-12-04T08:53:09.1907673Z * [new branch] gh/seemethere/52/orig -> origin/gh/seemethere/52/orig 2025-12-04T08:53:09.1907746Z * [new branch] gh/seemethere/53/base -> origin/gh/seemethere/53/base 2025-12-04T08:53:09.1907819Z * [new branch] gh/seemethere/53/head -> origin/gh/seemethere/53/head 2025-12-04T08:53:09.1907893Z * [new branch] gh/seemethere/53/orig -> origin/gh/seemethere/53/orig 2025-12-04T08:53:09.1907969Z * [new branch] gh/seemethere/54/base -> origin/gh/seemethere/54/base 2025-12-04T08:53:09.1908042Z * [new branch] gh/seemethere/54/head -> origin/gh/seemethere/54/head 2025-12-04T08:53:09.1908117Z * [new branch] gh/seemethere/54/orig -> origin/gh/seemethere/54/orig 2025-12-04T08:53:09.1908190Z * [new branch] gh/seemethere/55/base -> origin/gh/seemethere/55/base 2025-12-04T08:53:09.1908261Z * [new branch] gh/seemethere/55/head -> origin/gh/seemethere/55/head 2025-12-04T08:53:09.1908335Z * [new branch] gh/seemethere/55/orig -> origin/gh/seemethere/55/orig 2025-12-04T08:53:09.1908407Z * [new branch] gh/seemethere/59/base -> origin/gh/seemethere/59/base 2025-12-04T08:53:09.1908481Z * [new branch] gh/seemethere/59/head -> origin/gh/seemethere/59/head 2025-12-04T08:53:09.1908553Z * [new branch] gh/seemethere/59/orig -> origin/gh/seemethere/59/orig 2025-12-04T08:53:09.1908628Z * [new branch] gh/seemethere/62/base -> origin/gh/seemethere/62/base 2025-12-04T08:53:09.1908702Z * [new branch] gh/seemethere/62/head -> origin/gh/seemethere/62/head 2025-12-04T08:53:09.1908775Z * [new branch] gh/seemethere/62/orig -> origin/gh/seemethere/62/orig 2025-12-04T08:53:09.1908846Z * [new branch] gh/seemethere/63/base -> origin/gh/seemethere/63/base 2025-12-04T08:53:09.1908919Z * [new branch] gh/seemethere/63/head -> origin/gh/seemethere/63/head 2025-12-04T08:53:09.1908993Z * [new branch] gh/seemethere/63/orig -> origin/gh/seemethere/63/orig 2025-12-04T08:53:09.1909065Z * [new branch] gh/seemethere/71/base -> origin/gh/seemethere/71/base 2025-12-04T08:53:09.1909137Z * [new branch] gh/seemethere/71/head -> origin/gh/seemethere/71/head 2025-12-04T08:53:09.1909208Z * [new branch] gh/seemethere/71/orig -> origin/gh/seemethere/71/orig 2025-12-04T08:53:09.1909309Z * [new branch] gh/seemethere/72/base -> origin/gh/seemethere/72/base 2025-12-04T08:53:09.1909409Z * [new branch] gh/seemethere/72/head -> origin/gh/seemethere/72/head 2025-12-04T08:53:09.1909482Z * [new branch] gh/seemethere/72/orig -> origin/gh/seemethere/72/orig 2025-12-04T08:53:09.1909555Z * [new branch] gh/seemethere/73/base -> origin/gh/seemethere/73/base 2025-12-04T08:53:09.1909628Z * [new branch] gh/seemethere/73/head -> origin/gh/seemethere/73/head 2025-12-04T08:53:09.1909699Z * [new branch] gh/seemethere/73/orig -> origin/gh/seemethere/73/orig 2025-12-04T08:53:09.1909771Z * [new branch] gh/seemethere/74/base -> origin/gh/seemethere/74/base 2025-12-04T08:53:09.1909845Z * [new branch] gh/seemethere/74/head -> origin/gh/seemethere/74/head 2025-12-04T08:53:09.1909918Z * [new branch] gh/seemethere/74/orig -> origin/gh/seemethere/74/orig 2025-12-04T08:53:09.1909992Z * [new branch] gh/seemethere/75/base -> origin/gh/seemethere/75/base 2025-12-04T08:53:09.1910068Z * [new branch] gh/seemethere/75/head -> origin/gh/seemethere/75/head 2025-12-04T08:53:09.1910140Z * [new branch] gh/seemethere/75/orig -> origin/gh/seemethere/75/orig 2025-12-04T08:53:09.1910213Z * [new branch] gh/seemethere/76/base -> origin/gh/seemethere/76/base 2025-12-04T08:53:09.1910285Z * [new branch] gh/seemethere/76/head -> origin/gh/seemethere/76/head 2025-12-04T08:53:09.1910357Z * [new branch] gh/seemethere/76/orig -> origin/gh/seemethere/76/orig 2025-12-04T08:53:09.1910434Z * [new branch] gh/shunting314/145/base -> origin/gh/shunting314/145/base 2025-12-04T08:53:09.1910511Z * [new branch] gh/shunting314/145/head -> origin/gh/shunting314/145/head 2025-12-04T08:53:09.1910586Z * [new branch] gh/shunting314/145/orig -> origin/gh/shunting314/145/orig 2025-12-04T08:53:09.1910663Z * [new branch] gh/shunting314/176/base -> origin/gh/shunting314/176/base 2025-12-04T08:53:09.1910739Z * [new branch] gh/shunting314/176/head -> origin/gh/shunting314/176/head 2025-12-04T08:53:09.1910813Z * [new branch] gh/shunting314/176/orig -> origin/gh/shunting314/176/orig 2025-12-04T08:53:09.1910888Z * [new branch] gh/shunting314/249/base -> origin/gh/shunting314/249/base 2025-12-04T08:53:09.1910962Z * [new branch] gh/shunting314/249/head -> origin/gh/shunting314/249/head 2025-12-04T08:53:09.1911036Z * [new branch] gh/shunting314/249/orig -> origin/gh/shunting314/249/orig 2025-12-04T08:53:09.1911110Z * [new branch] gh/shunting314/253/base -> origin/gh/shunting314/253/base 2025-12-04T08:53:09.1911183Z * [new branch] gh/shunting314/253/head -> origin/gh/shunting314/253/head 2025-12-04T08:53:09.1911259Z * [new branch] gh/shunting314/253/orig -> origin/gh/shunting314/253/orig 2025-12-04T08:53:09.1911334Z * [new branch] gh/shunting314/256/base -> origin/gh/shunting314/256/base 2025-12-04T08:53:09.1911411Z * [new branch] gh/shunting314/256/head -> origin/gh/shunting314/256/head 2025-12-04T08:53:09.1911485Z * [new branch] gh/shunting314/256/orig -> origin/gh/shunting314/256/orig 2025-12-04T08:53:09.1911562Z * [new branch] gh/shunting314/257/base -> origin/gh/shunting314/257/base 2025-12-04T08:53:09.1911636Z * [new branch] gh/shunting314/257/head -> origin/gh/shunting314/257/head 2025-12-04T08:53:09.1911711Z * [new branch] gh/shunting314/257/orig -> origin/gh/shunting314/257/orig 2025-12-04T08:53:09.1911784Z * [new branch] gh/shunting314/258/base -> origin/gh/shunting314/258/base 2025-12-04T08:53:09.1911859Z * [new branch] gh/shunting314/258/head -> origin/gh/shunting314/258/head 2025-12-04T08:53:09.1911962Z * [new branch] gh/shunting314/258/orig -> origin/gh/shunting314/258/orig 2025-12-04T08:53:09.1912062Z * [new branch] gh/shunting314/259/base -> origin/gh/shunting314/259/base 2025-12-04T08:53:09.1912136Z * [new branch] gh/shunting314/259/head -> origin/gh/shunting314/259/head 2025-12-04T08:53:09.1912210Z * [new branch] gh/shunting314/259/orig -> origin/gh/shunting314/259/orig 2025-12-04T08:53:09.1912283Z * [new branch] gh/shunting314/260/base -> origin/gh/shunting314/260/base 2025-12-04T08:53:09.1912356Z * [new branch] gh/shunting314/260/head -> origin/gh/shunting314/260/head 2025-12-04T08:53:09.1912430Z * [new branch] gh/shunting314/260/orig -> origin/gh/shunting314/260/orig 2025-12-04T08:53:09.1912503Z * [new branch] gh/shunting314/261/base -> origin/gh/shunting314/261/base 2025-12-04T08:53:09.1912579Z * [new branch] gh/shunting314/261/head -> origin/gh/shunting314/261/head 2025-12-04T08:53:09.1912656Z * [new branch] gh/shunting314/261/orig -> origin/gh/shunting314/261/orig 2025-12-04T08:53:09.1912730Z * [new branch] gh/shunting314/262/base -> origin/gh/shunting314/262/base 2025-12-04T08:53:09.1912804Z * [new branch] gh/shunting314/262/head -> origin/gh/shunting314/262/head 2025-12-04T08:53:09.1912881Z * [new branch] gh/shunting314/262/orig -> origin/gh/shunting314/262/orig 2025-12-04T08:53:09.1912989Z * [new branch] gh/shunting314/263/base -> origin/gh/shunting314/263/base 2025-12-04T08:53:09.1913064Z * [new branch] gh/shunting314/263/head -> origin/gh/shunting314/263/head 2025-12-04T08:53:09.1913140Z * [new branch] gh/shunting314/263/orig -> origin/gh/shunting314/263/orig 2025-12-04T08:53:09.1913214Z * [new branch] gh/shunting314/264/base -> origin/gh/shunting314/264/base 2025-12-04T08:53:09.1913291Z * [new branch] gh/shunting314/264/head -> origin/gh/shunting314/264/head 2025-12-04T08:53:09.1913364Z * [new branch] gh/shunting314/264/orig -> origin/gh/shunting314/264/orig 2025-12-04T08:53:09.1913439Z * [new branch] gh/shunting314/265/base -> origin/gh/shunting314/265/base 2025-12-04T08:53:09.1913513Z * [new branch] gh/shunting314/265/head -> origin/gh/shunting314/265/head 2025-12-04T08:53:09.1913587Z * [new branch] gh/shunting314/265/orig -> origin/gh/shunting314/265/orig 2025-12-04T08:53:09.1913660Z * [new branch] gh/shunting314/266/base -> origin/gh/shunting314/266/base 2025-12-04T08:53:09.1913736Z * [new branch] gh/shunting314/266/head -> origin/gh/shunting314/266/head 2025-12-04T08:53:09.1913811Z * [new branch] gh/shunting314/266/orig -> origin/gh/shunting314/266/orig 2025-12-04T08:53:09.1913884Z * [new branch] gh/shunting314/267/base -> origin/gh/shunting314/267/base 2025-12-04T08:53:09.1913962Z * [new branch] gh/shunting314/267/head -> origin/gh/shunting314/267/head 2025-12-04T08:53:09.1914036Z * [new branch] gh/shunting314/267/orig -> origin/gh/shunting314/267/orig 2025-12-04T08:53:09.1914109Z * [new branch] gh/shunting314/268/base -> origin/gh/shunting314/268/base 2025-12-04T08:53:09.1914187Z * [new branch] gh/shunting314/268/head -> origin/gh/shunting314/268/head 2025-12-04T08:53:09.1914259Z * [new branch] gh/shunting314/268/orig -> origin/gh/shunting314/268/orig 2025-12-04T08:53:09.1914333Z * [new branch] gh/shunting314/269/base -> origin/gh/shunting314/269/base 2025-12-04T08:53:09.1914408Z * [new branch] gh/shunting314/269/head -> origin/gh/shunting314/269/head 2025-12-04T08:53:09.1914481Z * [new branch] gh/shunting314/269/orig -> origin/gh/shunting314/269/orig 2025-12-04T08:53:09.1914555Z * [new branch] gh/silverguo/1/base -> origin/gh/silverguo/1/base 2025-12-04T08:53:09.1914670Z * [new branch] gh/silverguo/1/head -> origin/gh/silverguo/1/head 2025-12-04T08:53:09.1914781Z * [new branch] gh/silverguo/2/base -> origin/gh/silverguo/2/base 2025-12-04T08:53:09.1914853Z * [new branch] gh/silverguo/2/head -> origin/gh/silverguo/2/head 2025-12-04T08:53:09.1914927Z * [new branch] gh/silverguo/3/base -> origin/gh/silverguo/3/base 2025-12-04T08:53:09.1914998Z * [new branch] gh/silverguo/3/head -> origin/gh/silverguo/3/head 2025-12-04T08:53:09.1915070Z * [new branch] gh/silverguo/4/base -> origin/gh/silverguo/4/base 2025-12-04T08:53:09.1915141Z * [new branch] gh/silverguo/4/head -> origin/gh/silverguo/4/head 2025-12-04T08:53:09.1915216Z * [new branch] gh/slayton58/39/base -> origin/gh/slayton58/39/base 2025-12-04T08:53:09.1915290Z * [new branch] gh/slayton58/39/head -> origin/gh/slayton58/39/head 2025-12-04T08:53:09.1915362Z * [new branch] gh/slayton58/39/orig -> origin/gh/slayton58/39/orig 2025-12-04T08:53:09.1915434Z * [new branch] gh/slayton58/42/base -> origin/gh/slayton58/42/base 2025-12-04T08:53:09.1915507Z * [new branch] gh/slayton58/42/head -> origin/gh/slayton58/42/head 2025-12-04T08:53:09.1915578Z * [new branch] gh/slayton58/42/orig -> origin/gh/slayton58/42/orig 2025-12-04T08:53:09.1915649Z * [new branch] gh/slayton58/43/base -> origin/gh/slayton58/43/base 2025-12-04T08:53:09.1915720Z * [new branch] gh/slayton58/43/head -> origin/gh/slayton58/43/head 2025-12-04T08:53:09.1915791Z * [new branch] gh/slayton58/43/orig -> origin/gh/slayton58/43/orig 2025-12-04T08:53:09.1915860Z * [new branch] gh/slayton58/44/base -> origin/gh/slayton58/44/base 2025-12-04T08:53:09.1915935Z * [new branch] gh/slayton58/44/head -> origin/gh/slayton58/44/head 2025-12-04T08:53:09.1916006Z * [new branch] gh/slayton58/44/orig -> origin/gh/slayton58/44/orig 2025-12-04T08:53:09.1916076Z * [new branch] gh/slayton58/45/base -> origin/gh/slayton58/45/base 2025-12-04T08:53:09.1916147Z * [new branch] gh/slayton58/45/head -> origin/gh/slayton58/45/head 2025-12-04T08:53:09.1916217Z * [new branch] gh/slayton58/45/orig -> origin/gh/slayton58/45/orig 2025-12-04T08:53:09.1916286Z * [new branch] gh/slayton58/46/base -> origin/gh/slayton58/46/base 2025-12-04T08:53:09.1916357Z * [new branch] gh/slayton58/46/head -> origin/gh/slayton58/46/head 2025-12-04T08:53:09.1916426Z * [new branch] gh/slayton58/46/orig -> origin/gh/slayton58/46/orig 2025-12-04T08:53:09.1916497Z * [new branch] gh/slayton58/6/base -> origin/gh/slayton58/6/base 2025-12-04T08:53:09.1916568Z * [new branch] gh/slayton58/6/head -> origin/gh/slayton58/6/head 2025-12-04T08:53:09.1916638Z * [new branch] gh/slayton58/7/base -> origin/gh/slayton58/7/base 2025-12-04T08:53:09.1916711Z * [new branch] gh/slayton58/7/head -> origin/gh/slayton58/7/head 2025-12-04T08:53:09.1916786Z * [new branch] gh/soulitzer/269/base -> origin/gh/soulitzer/269/base 2025-12-04T08:53:09.1916859Z * [new branch] gh/soulitzer/269/head -> origin/gh/soulitzer/269/head 2025-12-04T08:53:09.1916934Z * [new branch] gh/soulitzer/269/orig -> origin/gh/soulitzer/269/orig 2025-12-04T08:53:09.1917007Z * [new branch] gh/soulitzer/276/base -> origin/gh/soulitzer/276/base 2025-12-04T08:53:09.1917078Z * [new branch] gh/soulitzer/276/head -> origin/gh/soulitzer/276/head 2025-12-04T08:53:09.1917151Z * [new branch] gh/soulitzer/276/orig -> origin/gh/soulitzer/276/orig 2025-12-04T08:53:09.1917262Z * [new branch] gh/soulitzer/287/base -> origin/gh/soulitzer/287/base 2025-12-04T08:53:09.1917335Z * [new branch] gh/soulitzer/287/head -> origin/gh/soulitzer/287/head 2025-12-04T08:53:09.1917436Z * [new branch] gh/soulitzer/287/orig -> origin/gh/soulitzer/287/orig 2025-12-04T08:53:09.1917508Z * [new branch] gh/soulitzer/296/base -> origin/gh/soulitzer/296/base 2025-12-04T08:53:09.1917581Z * [new branch] gh/soulitzer/296/head -> origin/gh/soulitzer/296/head 2025-12-04T08:53:09.1917655Z * [new branch] gh/soulitzer/296/orig -> origin/gh/soulitzer/296/orig 2025-12-04T08:53:09.1917726Z * [new branch] gh/soulitzer/299/base -> origin/gh/soulitzer/299/base 2025-12-04T08:53:09.1917799Z * [new branch] gh/soulitzer/299/head -> origin/gh/soulitzer/299/head 2025-12-04T08:53:09.1917872Z * [new branch] gh/soulitzer/299/orig -> origin/gh/soulitzer/299/orig 2025-12-04T08:53:09.1917946Z * [new branch] gh/soulitzer/300/base -> origin/gh/soulitzer/300/base 2025-12-04T08:53:09.1918018Z * [new branch] gh/soulitzer/300/head -> origin/gh/soulitzer/300/head 2025-12-04T08:53:09.1918092Z * [new branch] gh/soulitzer/300/orig -> origin/gh/soulitzer/300/orig 2025-12-04T08:53:09.1918164Z * [new branch] gh/soulitzer/301/base -> origin/gh/soulitzer/301/base 2025-12-04T08:53:09.1918235Z * [new branch] gh/soulitzer/301/head -> origin/gh/soulitzer/301/head 2025-12-04T08:53:09.1918308Z * [new branch] gh/soulitzer/301/orig -> origin/gh/soulitzer/301/orig 2025-12-04T08:53:09.1918379Z * [new branch] gh/soulitzer/313/base -> origin/gh/soulitzer/313/base 2025-12-04T08:53:09.1918453Z * [new branch] gh/soulitzer/313/head -> origin/gh/soulitzer/313/head 2025-12-04T08:53:09.1918524Z * [new branch] gh/soulitzer/313/orig -> origin/gh/soulitzer/313/orig 2025-12-04T08:53:09.1918596Z * [new branch] gh/soulitzer/319/base -> origin/gh/soulitzer/319/base 2025-12-04T08:53:09.1918670Z * [new branch] gh/soulitzer/319/head -> origin/gh/soulitzer/319/head 2025-12-04T08:53:09.1918741Z * [new branch] gh/soulitzer/319/orig -> origin/gh/soulitzer/319/orig 2025-12-04T08:53:09.1918811Z * [new branch] gh/soulitzer/320/base -> origin/gh/soulitzer/320/base 2025-12-04T08:53:09.1918883Z * [new branch] gh/soulitzer/320/head -> origin/gh/soulitzer/320/head 2025-12-04T08:53:09.1918956Z * [new branch] gh/soulitzer/320/orig -> origin/gh/soulitzer/320/orig 2025-12-04T08:53:09.1919027Z * [new branch] gh/soulitzer/336/base -> origin/gh/soulitzer/336/base 2025-12-04T08:53:09.1919101Z * [new branch] gh/soulitzer/336/head -> origin/gh/soulitzer/336/head 2025-12-04T08:53:09.1919172Z * [new branch] gh/soulitzer/336/orig -> origin/gh/soulitzer/336/orig 2025-12-04T08:53:09.1919247Z * [new branch] gh/soulitzer/347/base -> origin/gh/soulitzer/347/base 2025-12-04T08:53:09.1919323Z * [new branch] gh/soulitzer/347/head -> origin/gh/soulitzer/347/head 2025-12-04T08:53:09.1919395Z * [new branch] gh/soulitzer/347/orig -> origin/gh/soulitzer/347/orig 2025-12-04T08:53:09.1919467Z * [new branch] gh/soulitzer/349/base -> origin/gh/soulitzer/349/base 2025-12-04T08:53:09.1919539Z * [new branch] gh/soulitzer/349/head -> origin/gh/soulitzer/349/head 2025-12-04T08:53:09.1919611Z * [new branch] gh/soulitzer/349/orig -> origin/gh/soulitzer/349/orig 2025-12-04T08:53:09.1919682Z * [new branch] gh/soulitzer/350/base -> origin/gh/soulitzer/350/base 2025-12-04T08:53:09.1919753Z * [new branch] gh/soulitzer/350/head -> origin/gh/soulitzer/350/head 2025-12-04T08:53:09.1919825Z * [new branch] gh/soulitzer/350/orig -> origin/gh/soulitzer/350/orig 2025-12-04T08:53:09.1919926Z * [new branch] gh/soulitzer/351/base -> origin/gh/soulitzer/351/base 2025-12-04T08:53:09.1920032Z * [new branch] gh/soulitzer/351/head -> origin/gh/soulitzer/351/head 2025-12-04T08:53:09.1920104Z * [new branch] gh/soulitzer/351/orig -> origin/gh/soulitzer/351/orig 2025-12-04T08:53:09.1920177Z * [new branch] gh/soulitzer/353/base -> origin/gh/soulitzer/353/base 2025-12-04T08:53:09.1920248Z * [new branch] gh/soulitzer/353/head -> origin/gh/soulitzer/353/head 2025-12-04T08:53:09.1920319Z * [new branch] gh/soulitzer/353/orig -> origin/gh/soulitzer/353/orig 2025-12-04T08:53:09.1920390Z * [new branch] gh/soulitzer/358/base -> origin/gh/soulitzer/358/base 2025-12-04T08:53:09.1920461Z * [new branch] gh/soulitzer/358/head -> origin/gh/soulitzer/358/head 2025-12-04T08:53:09.1920534Z * [new branch] gh/soulitzer/358/orig -> origin/gh/soulitzer/358/orig 2025-12-04T08:53:09.1920606Z * [new branch] gh/soulitzer/359/base -> origin/gh/soulitzer/359/base 2025-12-04T08:53:09.1920678Z * [new branch] gh/soulitzer/359/head -> origin/gh/soulitzer/359/head 2025-12-04T08:53:09.1920749Z * [new branch] gh/soulitzer/359/orig -> origin/gh/soulitzer/359/orig 2025-12-04T08:53:09.1920822Z * [new branch] gh/soulitzer/374/base -> origin/gh/soulitzer/374/base 2025-12-04T08:53:09.1920893Z * [new branch] gh/soulitzer/374/head -> origin/gh/soulitzer/374/head 2025-12-04T08:53:09.1920964Z * [new branch] gh/soulitzer/374/orig -> origin/gh/soulitzer/374/orig 2025-12-04T08:53:09.1921037Z * [new branch] gh/soulitzer/375/base -> origin/gh/soulitzer/375/base 2025-12-04T08:53:09.1921109Z * [new branch] gh/soulitzer/375/head -> origin/gh/soulitzer/375/head 2025-12-04T08:53:09.1921186Z * [new branch] gh/soulitzer/375/orig -> origin/gh/soulitzer/375/orig 2025-12-04T08:53:09.1921257Z * [new branch] gh/soulitzer/380/base -> origin/gh/soulitzer/380/base 2025-12-04T08:53:09.1921329Z * [new branch] gh/soulitzer/380/head -> origin/gh/soulitzer/380/head 2025-12-04T08:53:09.1921404Z * [new branch] gh/soulitzer/380/orig -> origin/gh/soulitzer/380/orig 2025-12-04T08:53:09.1921474Z * [new branch] gh/soulitzer/385/base -> origin/gh/soulitzer/385/base 2025-12-04T08:53:09.1921545Z * [new branch] gh/soulitzer/385/head -> origin/gh/soulitzer/385/head 2025-12-04T08:53:09.1921617Z * [new branch] gh/soulitzer/385/orig -> origin/gh/soulitzer/385/orig 2025-12-04T08:53:09.1921689Z * [new branch] gh/soulitzer/386/base -> origin/gh/soulitzer/386/base 2025-12-04T08:53:09.1921762Z * [new branch] gh/soulitzer/386/head -> origin/gh/soulitzer/386/head 2025-12-04T08:53:09.1921835Z * [new branch] gh/soulitzer/386/orig -> origin/gh/soulitzer/386/orig 2025-12-04T08:53:09.1921907Z * [new branch] gh/soulitzer/387/base -> origin/gh/soulitzer/387/base 2025-12-04T08:53:09.1921978Z * [new branch] gh/soulitzer/387/head -> origin/gh/soulitzer/387/head 2025-12-04T08:53:09.1922051Z * [new branch] gh/soulitzer/387/orig -> origin/gh/soulitzer/387/orig 2025-12-04T08:53:09.1922121Z * [new branch] gh/soulitzer/388/base -> origin/gh/soulitzer/388/base 2025-12-04T08:53:09.1922192Z * [new branch] gh/soulitzer/388/head -> origin/gh/soulitzer/388/head 2025-12-04T08:53:09.1922265Z * [new branch] gh/soulitzer/388/orig -> origin/gh/soulitzer/388/orig 2025-12-04T08:53:09.1922338Z * [new branch] gh/soulitzer/389/base -> origin/gh/soulitzer/389/base 2025-12-04T08:53:09.1922408Z * [new branch] gh/soulitzer/389/head -> origin/gh/soulitzer/389/head 2025-12-04T08:53:09.1922514Z * [new branch] gh/soulitzer/389/orig -> origin/gh/soulitzer/389/orig 2025-12-04T08:53:09.1922616Z * [new branch] gh/soulitzer/390/base -> origin/gh/soulitzer/390/base 2025-12-04T08:53:09.1922692Z * [new branch] gh/soulitzer/390/head -> origin/gh/soulitzer/390/head 2025-12-04T08:53:09.1922763Z * [new branch] gh/soulitzer/390/orig -> origin/gh/soulitzer/390/orig 2025-12-04T08:53:09.1922834Z * [new branch] gh/soulitzer/391/base -> origin/gh/soulitzer/391/base 2025-12-04T08:53:09.1922907Z * [new branch] gh/soulitzer/391/head -> origin/gh/soulitzer/391/head 2025-12-04T08:53:09.1923016Z * [new branch] gh/soulitzer/391/orig -> origin/gh/soulitzer/391/orig 2025-12-04T08:53:09.1923090Z * [new branch] gh/soulitzer/392/base -> origin/gh/soulitzer/392/base 2025-12-04T08:53:09.1923162Z * [new branch] gh/soulitzer/392/head -> origin/gh/soulitzer/392/head 2025-12-04T08:53:09.1923236Z * [new branch] gh/soulitzer/392/orig -> origin/gh/soulitzer/392/orig 2025-12-04T08:53:09.1923309Z * [new branch] gh/swolchok/728/next -> origin/gh/swolchok/728/next 2025-12-04T08:53:09.1923380Z * [new branch] gh/swolchok/819/base -> origin/gh/swolchok/819/base 2025-12-04T08:53:09.1923449Z * [new branch] gh/swolchok/819/head -> origin/gh/swolchok/819/head 2025-12-04T08:53:09.1923520Z * [new branch] gh/swolchok/819/orig -> origin/gh/swolchok/819/orig 2025-12-04T08:53:09.1923590Z * [new branch] gh/swolchok/824/base -> origin/gh/swolchok/824/base 2025-12-04T08:53:09.1923660Z * [new branch] gh/swolchok/824/head -> origin/gh/swolchok/824/head 2025-12-04T08:53:09.1923729Z * [new branch] gh/swolchok/824/orig -> origin/gh/swolchok/824/orig 2025-12-04T08:53:09.1923802Z * [new branch] gh/swolchok/829/base -> origin/gh/swolchok/829/base 2025-12-04T08:53:09.1923873Z * [new branch] gh/swolchok/829/head -> origin/gh/swolchok/829/head 2025-12-04T08:53:09.1923945Z * [new branch] gh/swolchok/829/orig -> origin/gh/swolchok/829/orig 2025-12-04T08:53:09.1924020Z * [new branch] gh/swolchok/839/base -> origin/gh/swolchok/839/base 2025-12-04T08:53:09.1924091Z * [new branch] gh/swolchok/839/head -> origin/gh/swolchok/839/head 2025-12-04T08:53:09.1924161Z * [new branch] gh/swolchok/839/orig -> origin/gh/swolchok/839/orig 2025-12-04T08:53:09.1924232Z * [new branch] gh/swolchok/841/base -> origin/gh/swolchok/841/base 2025-12-04T08:53:09.1924303Z * [new branch] gh/swolchok/841/head -> origin/gh/swolchok/841/head 2025-12-04T08:53:09.1924375Z * [new branch] gh/swolchok/841/orig -> origin/gh/swolchok/841/orig 2025-12-04T08:53:09.1924444Z * [new branch] gh/swolchok/842/base -> origin/gh/swolchok/842/base 2025-12-04T08:53:09.1924517Z * [new branch] gh/swolchok/842/head -> origin/gh/swolchok/842/head 2025-12-04T08:53:09.1924591Z * [new branch] gh/swolchok/842/orig -> origin/gh/swolchok/842/orig 2025-12-04T08:53:09.1924662Z * [new branch] gh/swolchok/845/base -> origin/gh/swolchok/845/base 2025-12-04T08:53:09.1924734Z * [new branch] gh/swolchok/845/head -> origin/gh/swolchok/845/head 2025-12-04T08:53:09.1924807Z * [new branch] gh/swolchok/845/orig -> origin/gh/swolchok/845/orig 2025-12-04T08:53:09.1924876Z * [new branch] gh/swolchok/848/base -> origin/gh/swolchok/848/base 2025-12-04T08:53:09.1924947Z * [new branch] gh/swolchok/848/head -> origin/gh/swolchok/848/head 2025-12-04T08:53:09.1925019Z * [new branch] gh/swolchok/848/orig -> origin/gh/swolchok/848/orig 2025-12-04T08:53:09.1925132Z * [new branch] gh/swolchok/856/base -> origin/gh/swolchok/856/base 2025-12-04T08:53:09.1925203Z * [new branch] gh/swolchok/856/head -> origin/gh/swolchok/856/head 2025-12-04T08:53:09.1925318Z * [new branch] gh/swolchok/856/orig -> origin/gh/swolchok/856/orig 2025-12-04T08:53:09.1925390Z * [new branch] gh/swolchok/860/base -> origin/gh/swolchok/860/base 2025-12-04T08:53:09.1925460Z * [new branch] gh/swolchok/860/head -> origin/gh/swolchok/860/head 2025-12-04T08:53:09.1925532Z * [new branch] gh/swolchok/860/orig -> origin/gh/swolchok/860/orig 2025-12-04T08:53:09.1925603Z * [new branch] gh/swolchok/861/base -> origin/gh/swolchok/861/base 2025-12-04T08:53:09.1925674Z * [new branch] gh/swolchok/861/head -> origin/gh/swolchok/861/head 2025-12-04T08:53:09.1925748Z * [new branch] gh/swolchok/861/orig -> origin/gh/swolchok/861/orig 2025-12-04T08:53:09.1925820Z * [new branch] gh/swolchok/862/base -> origin/gh/swolchok/862/base 2025-12-04T08:53:09.1925895Z * [new branch] gh/swolchok/862/head -> origin/gh/swolchok/862/head 2025-12-04T08:53:09.1925968Z * [new branch] gh/swolchok/862/orig -> origin/gh/swolchok/862/orig 2025-12-04T08:53:09.1926039Z * [new branch] gh/swolchok/863/base -> origin/gh/swolchok/863/base 2025-12-04T08:53:09.1926113Z * [new branch] gh/swolchok/863/head -> origin/gh/swolchok/863/head 2025-12-04T08:53:09.1926183Z * [new branch] gh/swolchok/863/orig -> origin/gh/swolchok/863/orig 2025-12-04T08:53:09.1926253Z * [new branch] gh/swolchok/864/base -> origin/gh/swolchok/864/base 2025-12-04T08:53:09.1926324Z * [new branch] gh/swolchok/864/head -> origin/gh/swolchok/864/head 2025-12-04T08:53:09.1926394Z * [new branch] gh/swolchok/864/orig -> origin/gh/swolchok/864/orig 2025-12-04T08:53:09.1926467Z * [new branch] gh/swolchok/865/base -> origin/gh/swolchok/865/base 2025-12-04T08:53:09.1926538Z * [new branch] gh/swolchok/865/head -> origin/gh/swolchok/865/head 2025-12-04T08:53:09.1926609Z * [new branch] gh/swolchok/865/orig -> origin/gh/swolchok/865/orig 2025-12-04T08:53:09.1926679Z * [new branch] gh/swolchok/866/base -> origin/gh/swolchok/866/base 2025-12-04T08:53:09.1926751Z * [new branch] gh/swolchok/866/head -> origin/gh/swolchok/866/head 2025-12-04T08:53:09.1926821Z * [new branch] gh/swolchok/866/orig -> origin/gh/swolchok/866/orig 2025-12-04T08:53:09.1926891Z * [new branch] gh/swolchok/867/base -> origin/gh/swolchok/867/base 2025-12-04T08:53:09.1926963Z * [new branch] gh/swolchok/867/head -> origin/gh/swolchok/867/head 2025-12-04T08:53:09.1927033Z * [new branch] gh/swolchok/867/orig -> origin/gh/swolchok/867/orig 2025-12-04T08:53:09.1927106Z * [new branch] gh/swolchok/868/base -> origin/gh/swolchok/868/base 2025-12-04T08:53:09.1927180Z * [new branch] gh/swolchok/868/head -> origin/gh/swolchok/868/head 2025-12-04T08:53:09.1927252Z * [new branch] gh/swolchok/868/orig -> origin/gh/swolchok/868/orig 2025-12-04T08:53:09.1927324Z * [new branch] gh/swolchok/869/base -> origin/gh/swolchok/869/base 2025-12-04T08:53:09.1927393Z * [new branch] gh/swolchok/869/head -> origin/gh/swolchok/869/head 2025-12-04T08:53:09.1927464Z * [new branch] gh/swolchok/869/orig -> origin/gh/swolchok/869/orig 2025-12-04T08:53:09.1927537Z * [new branch] gh/swolchok/870/base -> origin/gh/swolchok/870/base 2025-12-04T08:53:09.1927607Z * [new branch] gh/swolchok/870/head -> origin/gh/swolchok/870/head 2025-12-04T08:53:09.1927678Z * [new branch] gh/swolchok/870/orig -> origin/gh/swolchok/870/orig 2025-12-04T08:53:09.1927794Z * [new branch] gh/swolchok/871/base -> origin/gh/swolchok/871/base 2025-12-04T08:53:09.1927887Z * [new branch] gh/swolchok/871/head -> origin/gh/swolchok/871/head 2025-12-04T08:53:09.1927959Z * [new branch] gh/swolchok/871/orig -> origin/gh/swolchok/871/orig 2025-12-04T08:53:09.1928032Z * [new branch] gh/teja-rao/4/base -> origin/gh/teja-rao/4/base 2025-12-04T08:53:09.1928102Z * [new branch] gh/teja-rao/4/head -> origin/gh/teja-rao/4/head 2025-12-04T08:53:09.1928170Z * [new branch] gh/teja-rao/4/orig -> origin/gh/teja-rao/4/orig 2025-12-04T08:53:09.1928242Z * [new branch] gh/tianyu-l/2/base -> origin/gh/tianyu-l/2/base 2025-12-04T08:53:09.1928312Z * [new branch] gh/tianyu-l/2/head -> origin/gh/tianyu-l/2/head 2025-12-04T08:53:09.1928381Z * [new branch] gh/tianyu-l/2/orig -> origin/gh/tianyu-l/2/orig 2025-12-04T08:53:09.1928451Z * [new branch] gh/tianyu-l/3/base -> origin/gh/tianyu-l/3/base 2025-12-04T08:53:09.1928519Z * [new branch] gh/tianyu-l/3/orig -> origin/gh/tianyu-l/3/orig 2025-12-04T08:53:09.1928587Z * [new branch] gh/tianyu-l/4/base -> origin/gh/tianyu-l/4/base 2025-12-04T08:53:09.1928656Z * [new branch] gh/tianyu-l/4/head -> origin/gh/tianyu-l/4/head 2025-12-04T08:53:09.1928725Z * [new branch] gh/tianyu-l/4/orig -> origin/gh/tianyu-l/4/orig 2025-12-04T08:53:09.1928816Z * [new branch] gh/tugsbayasgalan/10/base -> origin/gh/tugsbayasgalan/10/base 2025-12-04T08:53:09.1928906Z * [new branch] gh/tugsbayasgalan/10/head -> origin/gh/tugsbayasgalan/10/head 2025-12-04T08:53:09.1928989Z * [new branch] gh/tugsbayasgalan/10/orig -> origin/gh/tugsbayasgalan/10/orig 2025-12-04T08:53:09.1929073Z * [new branch] gh/tugsbayasgalan/13/base -> origin/gh/tugsbayasgalan/13/base 2025-12-04T08:53:09.1929159Z * [new branch] gh/tugsbayasgalan/13/head -> origin/gh/tugsbayasgalan/13/head 2025-12-04T08:53:09.1929241Z * [new branch] gh/tugsbayasgalan/13/orig -> origin/gh/tugsbayasgalan/13/orig 2025-12-04T08:53:09.1929324Z * [new branch] gh/tugsbayasgalan/17/base -> origin/gh/tugsbayasgalan/17/base 2025-12-04T08:53:09.1929407Z * [new branch] gh/tugsbayasgalan/17/head -> origin/gh/tugsbayasgalan/17/head 2025-12-04T08:53:09.1929488Z * [new branch] gh/tugsbayasgalan/17/orig -> origin/gh/tugsbayasgalan/17/orig 2025-12-04T08:53:09.1929572Z * [new branch] gh/tugsbayasgalan/2/base -> origin/gh/tugsbayasgalan/2/base 2025-12-04T08:53:09.1929652Z * [new branch] gh/tugsbayasgalan/2/head -> origin/gh/tugsbayasgalan/2/head 2025-12-04T08:53:09.1929731Z * [new branch] gh/tugsbayasgalan/2/orig -> origin/gh/tugsbayasgalan/2/orig 2025-12-04T08:53:09.1929816Z * [new branch] gh/tugsbayasgalan/28/base -> origin/gh/tugsbayasgalan/28/base 2025-12-04T08:53:09.1929898Z * [new branch] gh/tugsbayasgalan/28/head -> origin/gh/tugsbayasgalan/28/head 2025-12-04T08:53:09.1929981Z * [new branch] gh/tugsbayasgalan/28/orig -> origin/gh/tugsbayasgalan/28/orig 2025-12-04T08:53:09.1930064Z * [new branch] gh/tugsbayasgalan/32/base -> origin/gh/tugsbayasgalan/32/base 2025-12-04T08:53:09.1930146Z * [new branch] gh/tugsbayasgalan/32/head -> origin/gh/tugsbayasgalan/32/head 2025-12-04T08:53:09.1930226Z * [new branch] gh/tugsbayasgalan/32/orig -> origin/gh/tugsbayasgalan/32/orig 2025-12-04T08:53:09.1930308Z * [new branch] gh/tugsbayasgalan/35/base -> origin/gh/tugsbayasgalan/35/base 2025-12-04T08:53:09.1930390Z * [new branch] gh/tugsbayasgalan/35/head -> origin/gh/tugsbayasgalan/35/head 2025-12-04T08:53:09.1930473Z * [new branch] gh/tugsbayasgalan/35/orig -> origin/gh/tugsbayasgalan/35/orig 2025-12-04T08:53:09.1930583Z * [new branch] gh/tugsbayasgalan/36/base -> origin/gh/tugsbayasgalan/36/base 2025-12-04T08:53:09.1930687Z * [new branch] gh/tugsbayasgalan/36/head -> origin/gh/tugsbayasgalan/36/head 2025-12-04T08:53:09.1930772Z * [new branch] gh/tugsbayasgalan/36/orig -> origin/gh/tugsbayasgalan/36/orig 2025-12-04T08:53:09.1930854Z * [new branch] gh/tugsbayasgalan/37/base -> origin/gh/tugsbayasgalan/37/base 2025-12-04T08:53:09.1930935Z * [new branch] gh/tugsbayasgalan/37/head -> origin/gh/tugsbayasgalan/37/head 2025-12-04T08:53:09.1931018Z * [new branch] gh/tugsbayasgalan/37/orig -> origin/gh/tugsbayasgalan/37/orig 2025-12-04T08:53:09.1931099Z * [new branch] gh/tugsbayasgalan/43/base -> origin/gh/tugsbayasgalan/43/base 2025-12-04T08:53:09.1931180Z * [new branch] gh/tugsbayasgalan/43/head -> origin/gh/tugsbayasgalan/43/head 2025-12-04T08:53:09.1931264Z * [new branch] gh/tugsbayasgalan/43/orig -> origin/gh/tugsbayasgalan/43/orig 2025-12-04T08:53:09.1931348Z * [new branch] gh/tugsbayasgalan/48/base -> origin/gh/tugsbayasgalan/48/base 2025-12-04T08:53:09.1931429Z * [new branch] gh/tugsbayasgalan/48/head -> origin/gh/tugsbayasgalan/48/head 2025-12-04T08:53:09.1931512Z * [new branch] gh/tugsbayasgalan/48/orig -> origin/gh/tugsbayasgalan/48/orig 2025-12-04T08:53:09.1931594Z * [new branch] gh/tugsbayasgalan/51/base -> origin/gh/tugsbayasgalan/51/base 2025-12-04T08:53:09.1931676Z * [new branch] gh/tugsbayasgalan/51/head -> origin/gh/tugsbayasgalan/51/head 2025-12-04T08:53:09.1931759Z * [new branch] gh/tugsbayasgalan/51/orig -> origin/gh/tugsbayasgalan/51/orig 2025-12-04T08:53:09.1931840Z * [new branch] gh/tugsbayasgalan/52/base -> origin/gh/tugsbayasgalan/52/base 2025-12-04T08:53:09.1931923Z * [new branch] gh/tugsbayasgalan/52/head -> origin/gh/tugsbayasgalan/52/head 2025-12-04T08:53:09.1932007Z * [new branch] gh/tugsbayasgalan/52/orig -> origin/gh/tugsbayasgalan/52/orig 2025-12-04T08:53:09.1932089Z * [new branch] gh/tugsbayasgalan/53/base -> origin/gh/tugsbayasgalan/53/base 2025-12-04T08:53:09.1932173Z * [new branch] gh/tugsbayasgalan/53/head -> origin/gh/tugsbayasgalan/53/head 2025-12-04T08:53:09.1932254Z * [new branch] gh/tugsbayasgalan/53/orig -> origin/gh/tugsbayasgalan/53/orig 2025-12-04T08:53:09.1932335Z * [new branch] gh/tugsbayasgalan/55/base -> origin/gh/tugsbayasgalan/55/base 2025-12-04T08:53:09.1932418Z * [new branch] gh/tugsbayasgalan/55/head -> origin/gh/tugsbayasgalan/55/head 2025-12-04T08:53:09.1932499Z * [new branch] gh/tugsbayasgalan/55/orig -> origin/gh/tugsbayasgalan/55/orig 2025-12-04T08:53:09.1932580Z * [new branch] gh/tugsbayasgalan/59/base -> origin/gh/tugsbayasgalan/59/base 2025-12-04T08:53:09.1932663Z * [new branch] gh/tugsbayasgalan/59/head -> origin/gh/tugsbayasgalan/59/head 2025-12-04T08:53:09.1932748Z * [new branch] gh/tugsbayasgalan/59/orig -> origin/gh/tugsbayasgalan/59/orig 2025-12-04T08:53:09.1932828Z * [new branch] gh/tugsbayasgalan/6/base -> origin/gh/tugsbayasgalan/6/base 2025-12-04T08:53:09.1932910Z * [new branch] gh/tugsbayasgalan/6/head -> origin/gh/tugsbayasgalan/6/head 2025-12-04T08:53:09.1933023Z * [new branch] gh/tugsbayasgalan/6/orig -> origin/gh/tugsbayasgalan/6/orig 2025-12-04T08:53:09.1933107Z * [new branch] gh/tugsbayasgalan/60/base -> origin/gh/tugsbayasgalan/60/base 2025-12-04T08:53:09.1933191Z * [new branch] gh/tugsbayasgalan/60/head -> origin/gh/tugsbayasgalan/60/head 2025-12-04T08:53:09.1933273Z * [new branch] gh/tugsbayasgalan/60/orig -> origin/gh/tugsbayasgalan/60/orig 2025-12-04T08:53:09.1933392Z * [new branch] gh/tugsbayasgalan/61/base -> origin/gh/tugsbayasgalan/61/base 2025-12-04T08:53:09.1933474Z * [new branch] gh/tugsbayasgalan/61/head -> origin/gh/tugsbayasgalan/61/head 2025-12-04T08:53:09.1933593Z * [new branch] gh/tugsbayasgalan/61/orig -> origin/gh/tugsbayasgalan/61/orig 2025-12-04T08:53:09.1933675Z * [new branch] gh/tugsbayasgalan/63/base -> origin/gh/tugsbayasgalan/63/base 2025-12-04T08:53:09.1933758Z * [new branch] gh/tugsbayasgalan/63/head -> origin/gh/tugsbayasgalan/63/head 2025-12-04T08:53:09.1933840Z * [new branch] gh/tugsbayasgalan/63/orig -> origin/gh/tugsbayasgalan/63/orig 2025-12-04T08:53:09.1933923Z * [new branch] gh/tugsbayasgalan/67/base -> origin/gh/tugsbayasgalan/67/base 2025-12-04T08:53:09.1934004Z * [new branch] gh/tugsbayasgalan/67/head -> origin/gh/tugsbayasgalan/67/head 2025-12-04T08:53:09.1934086Z * [new branch] gh/tugsbayasgalan/67/orig -> origin/gh/tugsbayasgalan/67/orig 2025-12-04T08:53:09.1934170Z * [new branch] gh/tugsbayasgalan/68/base -> origin/gh/tugsbayasgalan/68/base 2025-12-04T08:53:09.1934253Z * [new branch] gh/tugsbayasgalan/68/head -> origin/gh/tugsbayasgalan/68/head 2025-12-04T08:53:09.1934334Z * [new branch] gh/tugsbayasgalan/68/orig -> origin/gh/tugsbayasgalan/68/orig 2025-12-04T08:53:09.1934417Z * [new branch] gh/tugsbayasgalan/7/base -> origin/gh/tugsbayasgalan/7/base 2025-12-04T08:53:09.1934496Z * [new branch] gh/tugsbayasgalan/7/head -> origin/gh/tugsbayasgalan/7/head 2025-12-04T08:53:09.1934575Z * [new branch] gh/tugsbayasgalan/7/orig -> origin/gh/tugsbayasgalan/7/orig 2025-12-04T08:53:09.1934658Z * [new branch] gh/tugsbayasgalan/70/base -> origin/gh/tugsbayasgalan/70/base 2025-12-04T08:53:09.1934741Z * [new branch] gh/tugsbayasgalan/70/head -> origin/gh/tugsbayasgalan/70/head 2025-12-04T08:53:09.1934824Z * [new branch] gh/tugsbayasgalan/70/orig -> origin/gh/tugsbayasgalan/70/orig 2025-12-04T08:53:09.1934908Z * [new branch] gh/tugsbayasgalan/71/base -> origin/gh/tugsbayasgalan/71/base 2025-12-04T08:53:09.1934989Z * [new branch] gh/tugsbayasgalan/71/head -> origin/gh/tugsbayasgalan/71/head 2025-12-04T08:53:09.1935069Z * [new branch] gh/tugsbayasgalan/71/orig -> origin/gh/tugsbayasgalan/71/orig 2025-12-04T08:53:09.1935151Z * [new branch] gh/tugsbayasgalan/72/base -> origin/gh/tugsbayasgalan/72/base 2025-12-04T08:53:09.1935232Z * [new branch] gh/tugsbayasgalan/72/head -> origin/gh/tugsbayasgalan/72/head 2025-12-04T08:53:09.1935314Z * [new branch] gh/tugsbayasgalan/72/orig -> origin/gh/tugsbayasgalan/72/orig 2025-12-04T08:53:09.1935396Z * [new branch] gh/tugsbayasgalan/73/base -> origin/gh/tugsbayasgalan/73/base 2025-12-04T08:53:09.1935478Z * [new branch] gh/tugsbayasgalan/73/head -> origin/gh/tugsbayasgalan/73/head 2025-12-04T08:53:09.1935562Z * [new branch] gh/tugsbayasgalan/73/orig -> origin/gh/tugsbayasgalan/73/orig 2025-12-04T08:53:09.1935646Z * [new branch] gh/tugsbayasgalan/74/base -> origin/gh/tugsbayasgalan/74/base 2025-12-04T08:53:09.1935727Z * [new branch] gh/tugsbayasgalan/74/head -> origin/gh/tugsbayasgalan/74/head 2025-12-04T08:53:09.1935810Z * [new branch] gh/tugsbayasgalan/74/orig -> origin/gh/tugsbayasgalan/74/orig 2025-12-04T08:53:09.1935891Z * [new branch] gh/tugsbayasgalan/75/base -> origin/gh/tugsbayasgalan/75/base 2025-12-04T08:53:09.1935972Z * [new branch] gh/tugsbayasgalan/75/head -> origin/gh/tugsbayasgalan/75/head 2025-12-04T08:53:09.1936055Z * [new branch] gh/tugsbayasgalan/75/orig -> origin/gh/tugsbayasgalan/75/orig 2025-12-04T08:53:09.1936136Z * [new branch] gh/tugsbayasgalan/76/base -> origin/gh/tugsbayasgalan/76/base 2025-12-04T08:53:09.1936245Z * [new branch] gh/tugsbayasgalan/76/head -> origin/gh/tugsbayasgalan/76/head 2025-12-04T08:53:09.1936363Z * [new branch] gh/tugsbayasgalan/76/orig -> origin/gh/tugsbayasgalan/76/orig 2025-12-04T08:53:09.1936447Z * [new branch] gh/tugsbayasgalan/77/base -> origin/gh/tugsbayasgalan/77/base 2025-12-04T08:53:09.1936528Z * [new branch] gh/tugsbayasgalan/77/head -> origin/gh/tugsbayasgalan/77/head 2025-12-04T08:53:09.1936611Z * [new branch] gh/tugsbayasgalan/77/orig -> origin/gh/tugsbayasgalan/77/orig 2025-12-04T08:53:09.1936692Z * [new branch] gh/tugsbayasgalan/78/base -> origin/gh/tugsbayasgalan/78/base 2025-12-04T08:53:09.1936774Z * [new branch] gh/tugsbayasgalan/78/head -> origin/gh/tugsbayasgalan/78/head 2025-12-04T08:53:09.1936857Z * [new branch] gh/tugsbayasgalan/78/orig -> origin/gh/tugsbayasgalan/78/orig 2025-12-04T08:53:09.1936940Z * [new branch] gh/tugsbayasgalan/79/base -> origin/gh/tugsbayasgalan/79/base 2025-12-04T08:53:09.1937022Z * [new branch] gh/tugsbayasgalan/79/head -> origin/gh/tugsbayasgalan/79/head 2025-12-04T08:53:09.1937105Z * [new branch] gh/tugsbayasgalan/79/orig -> origin/gh/tugsbayasgalan/79/orig 2025-12-04T08:53:09.1937185Z * [new branch] gh/tugsbayasgalan/8/base -> origin/gh/tugsbayasgalan/8/base 2025-12-04T08:53:09.1937266Z * [new branch] gh/tugsbayasgalan/8/head -> origin/gh/tugsbayasgalan/8/head 2025-12-04T08:53:09.1937345Z * [new branch] gh/tugsbayasgalan/8/orig -> origin/gh/tugsbayasgalan/8/orig 2025-12-04T08:53:09.1937428Z * [new branch] gh/tugsbayasgalan/80/base -> origin/gh/tugsbayasgalan/80/base 2025-12-04T08:53:09.1937510Z * [new branch] gh/tugsbayasgalan/80/head -> origin/gh/tugsbayasgalan/80/head 2025-12-04T08:53:09.1937591Z * [new branch] gh/tugsbayasgalan/80/orig -> origin/gh/tugsbayasgalan/80/orig 2025-12-04T08:53:09.1937674Z * [new branch] gh/tugsbayasgalan/81/base -> origin/gh/tugsbayasgalan/81/base 2025-12-04T08:53:09.1937758Z * [new branch] gh/tugsbayasgalan/81/head -> origin/gh/tugsbayasgalan/81/head 2025-12-04T08:53:09.1937839Z * [new branch] gh/tugsbayasgalan/81/orig -> origin/gh/tugsbayasgalan/81/orig 2025-12-04T08:53:09.1937922Z * [new branch] gh/tugsbayasgalan/82/base -> origin/gh/tugsbayasgalan/82/base 2025-12-04T08:53:09.1938006Z * [new branch] gh/tugsbayasgalan/82/head -> origin/gh/tugsbayasgalan/82/head 2025-12-04T08:53:09.1938086Z * [new branch] gh/tugsbayasgalan/82/orig -> origin/gh/tugsbayasgalan/82/orig 2025-12-04T08:53:09.1938167Z * [new branch] gh/tugsbayasgalan/83/base -> origin/gh/tugsbayasgalan/83/base 2025-12-04T08:53:09.1938252Z * [new branch] gh/tugsbayasgalan/83/head -> origin/gh/tugsbayasgalan/83/head 2025-12-04T08:53:09.1938334Z * [new branch] gh/tugsbayasgalan/83/orig -> origin/gh/tugsbayasgalan/83/orig 2025-12-04T08:53:09.1938419Z * [new branch] gh/tugsbayasgalan/84/base -> origin/gh/tugsbayasgalan/84/base 2025-12-04T08:53:09.1938500Z * [new branch] gh/tugsbayasgalan/84/head -> origin/gh/tugsbayasgalan/84/head 2025-12-04T08:53:09.1938581Z * [new branch] gh/tugsbayasgalan/84/orig -> origin/gh/tugsbayasgalan/84/orig 2025-12-04T08:53:09.1938663Z * [new branch] gh/tugsbayasgalan/85/base -> origin/gh/tugsbayasgalan/85/base 2025-12-04T08:53:09.1938745Z * [new branch] gh/tugsbayasgalan/85/head -> origin/gh/tugsbayasgalan/85/head 2025-12-04T08:53:09.1938826Z * [new branch] gh/tugsbayasgalan/85/orig -> origin/gh/tugsbayasgalan/85/orig 2025-12-04T08:53:09.1938907Z * [new branch] gh/tugsbayasgalan/86/base -> origin/gh/tugsbayasgalan/86/base 2025-12-04T08:53:09.1938989Z * [new branch] gh/tugsbayasgalan/86/head -> origin/gh/tugsbayasgalan/86/head 2025-12-04T08:53:09.1939097Z * [new branch] gh/tugsbayasgalan/86/orig -> origin/gh/tugsbayasgalan/86/orig 2025-12-04T08:53:09.1939205Z * [new branch] gh/tugsbayasgalan/87/base -> origin/gh/tugsbayasgalan/87/base 2025-12-04T08:53:09.1939288Z * [new branch] gh/tugsbayasgalan/87/head -> origin/gh/tugsbayasgalan/87/head 2025-12-04T08:53:09.1939369Z * [new branch] gh/tugsbayasgalan/87/orig -> origin/gh/tugsbayasgalan/87/orig 2025-12-04T08:53:09.1939451Z * [new branch] gh/tugsbayasgalan/88/base -> origin/gh/tugsbayasgalan/88/base 2025-12-04T08:53:09.1939532Z * [new branch] gh/tugsbayasgalan/88/head -> origin/gh/tugsbayasgalan/88/head 2025-12-04T08:53:09.1939612Z * [new branch] gh/tugsbayasgalan/88/orig -> origin/gh/tugsbayasgalan/88/orig 2025-12-04T08:53:09.1939694Z * [new branch] gh/tugsbayasgalan/89/base -> origin/gh/tugsbayasgalan/89/base 2025-12-04T08:53:09.1939776Z * [new branch] gh/tugsbayasgalan/89/head -> origin/gh/tugsbayasgalan/89/head 2025-12-04T08:53:09.1939859Z * [new branch] gh/tugsbayasgalan/89/orig -> origin/gh/tugsbayasgalan/89/orig 2025-12-04T08:53:09.1939941Z * [new branch] gh/tugsbayasgalan/9/base -> origin/gh/tugsbayasgalan/9/base 2025-12-04T08:53:09.1940021Z * [new branch] gh/tugsbayasgalan/9/head -> origin/gh/tugsbayasgalan/9/head 2025-12-04T08:53:09.1940102Z * [new branch] gh/tugsbayasgalan/9/orig -> origin/gh/tugsbayasgalan/9/orig 2025-12-04T08:53:09.1940184Z * [new branch] gh/tugsbayasgalan/90/base -> origin/gh/tugsbayasgalan/90/base 2025-12-04T08:53:09.1940268Z * [new branch] gh/tugsbayasgalan/90/head -> origin/gh/tugsbayasgalan/90/head 2025-12-04T08:53:09.1940350Z * [new branch] gh/tugsbayasgalan/90/orig -> origin/gh/tugsbayasgalan/90/orig 2025-12-04T08:53:09.1940434Z * [new branch] gh/tugsbayasgalan/91/base -> origin/gh/tugsbayasgalan/91/base 2025-12-04T08:53:09.1940515Z * [new branch] gh/tugsbayasgalan/91/head -> origin/gh/tugsbayasgalan/91/head 2025-12-04T08:53:09.1940598Z * [new branch] gh/tugsbayasgalan/91/orig -> origin/gh/tugsbayasgalan/91/orig 2025-12-04T08:53:09.1940679Z * [new branch] gh/tugsbayasgalan/92/base -> origin/gh/tugsbayasgalan/92/base 2025-12-04T08:53:09.1940761Z * [new branch] gh/tugsbayasgalan/92/head -> origin/gh/tugsbayasgalan/92/head 2025-12-04T08:53:09.1940843Z * [new branch] gh/tugsbayasgalan/92/orig -> origin/gh/tugsbayasgalan/92/orig 2025-12-04T08:53:09.1940924Z * [new branch] gh/tugsbayasgalan/93/base -> origin/gh/tugsbayasgalan/93/base 2025-12-04T08:53:09.1941006Z * [new branch] gh/tugsbayasgalan/93/head -> origin/gh/tugsbayasgalan/93/head 2025-12-04T08:53:09.1941091Z * [new branch] gh/tugsbayasgalan/93/orig -> origin/gh/tugsbayasgalan/93/orig 2025-12-04T08:53:09.1941160Z * [new branch] gh/v0i0/14/base -> origin/gh/v0i0/14/base 2025-12-04T08:53:09.1941226Z * [new branch] gh/v0i0/14/head -> origin/gh/v0i0/14/head 2025-12-04T08:53:09.1941292Z * [new branch] gh/v0i0/14/orig -> origin/gh/v0i0/14/orig 2025-12-04T08:53:09.1941355Z * [new branch] gh/v0i0/15/base -> origin/gh/v0i0/15/base 2025-12-04T08:53:09.1941418Z * [new branch] gh/v0i0/15/head -> origin/gh/v0i0/15/head 2025-12-04T08:53:09.1941481Z * [new branch] gh/v0i0/15/orig -> origin/gh/v0i0/15/orig 2025-12-04T08:53:09.1941543Z * [new branch] gh/v0i0/16/base -> origin/gh/v0i0/16/base 2025-12-04T08:53:09.1941606Z * [new branch] gh/v0i0/16/head -> origin/gh/v0i0/16/head 2025-12-04T08:53:09.1941669Z * [new branch] gh/v0i0/16/orig -> origin/gh/v0i0/16/orig 2025-12-04T08:53:09.1941758Z * [new branch] gh/v0i0/17/base -> origin/gh/v0i0/17/base 2025-12-04T08:53:09.1941822Z * [new branch] gh/v0i0/17/head -> origin/gh/v0i0/17/head 2025-12-04T08:53:09.1941906Z * [new branch] gh/v0i0/17/orig -> origin/gh/v0i0/17/orig 2025-12-04T08:53:09.1941968Z * [new branch] gh/v0i0/18/base -> origin/gh/v0i0/18/base 2025-12-04T08:53:09.1942031Z * [new branch] gh/v0i0/18/head -> origin/gh/v0i0/18/head 2025-12-04T08:53:09.1942092Z * [new branch] gh/v0i0/18/orig -> origin/gh/v0i0/18/orig 2025-12-04T08:53:09.1942154Z * [new branch] gh/v0i0/19/base -> origin/gh/v0i0/19/base 2025-12-04T08:53:09.1942217Z * [new branch] gh/v0i0/19/head -> origin/gh/v0i0/19/head 2025-12-04T08:53:09.1942279Z * [new branch] gh/v0i0/19/orig -> origin/gh/v0i0/19/orig 2025-12-04T08:53:09.1942361Z * [new branch] gh/vishal9-team/1/base -> origin/gh/vishal9-team/1/base 2025-12-04T08:53:09.1942440Z * [new branch] gh/vishal9-team/1/head -> origin/gh/vishal9-team/1/head 2025-12-04T08:53:09.1942515Z * [new branch] gh/vishal9-team/2/base -> origin/gh/vishal9-team/2/base 2025-12-04T08:53:09.1942589Z * [new branch] gh/vishal9-team/2/head -> origin/gh/vishal9-team/2/head 2025-12-04T08:53:09.1942663Z * [new branch] gh/vishal9-team/2/orig -> origin/gh/vishal9-team/2/orig 2025-12-04T08:53:09.1942735Z * [new branch] gh/vishal9-team/3/base -> origin/gh/vishal9-team/3/base 2025-12-04T08:53:09.1942807Z * [new branch] gh/vishal9-team/3/head -> origin/gh/vishal9-team/3/head 2025-12-04T08:53:09.1942882Z * [new branch] gh/vishal9-team/3/orig -> origin/gh/vishal9-team/3/orig 2025-12-04T08:53:09.1942987Z * [new branch] gh/vishal9-team/4/base -> origin/gh/vishal9-team/4/base 2025-12-04T08:53:09.1943063Z * [new branch] gh/vishal9-team/4/head -> origin/gh/vishal9-team/4/head 2025-12-04T08:53:09.1943138Z * [new branch] gh/vishal9-team/4/orig -> origin/gh/vishal9-team/4/orig 2025-12-04T08:53:09.1943204Z * [new branch] gh/vkuzo/1/next -> origin/gh/vkuzo/1/next 2025-12-04T08:53:09.1943271Z * [new branch] gh/vkuzo/2/next -> origin/gh/vkuzo/2/next 2025-12-04T08:53:09.1943335Z * [new branch] gh/vkuzo/3/next -> origin/gh/vkuzo/3/next 2025-12-04T08:53:09.1943409Z * [new branch] gh/wconstab/424/base -> origin/gh/wconstab/424/base 2025-12-04T08:53:09.1943482Z * [new branch] gh/wconstab/424/head -> origin/gh/wconstab/424/head 2025-12-04T08:53:09.1943553Z * [new branch] gh/wconstab/424/orig -> origin/gh/wconstab/424/orig 2025-12-04T08:53:09.1943624Z * [new branch] gh/wconstab/435/base -> origin/gh/wconstab/435/base 2025-12-04T08:53:09.1943697Z * [new branch] gh/wconstab/435/head -> origin/gh/wconstab/435/head 2025-12-04T08:53:09.1943768Z * [new branch] gh/wconstab/435/orig -> origin/gh/wconstab/435/orig 2025-12-04T08:53:09.1943838Z * [new branch] gh/wconstab/444/base -> origin/gh/wconstab/444/base 2025-12-04T08:53:09.1943909Z * [new branch] gh/wconstab/444/head -> origin/gh/wconstab/444/head 2025-12-04T08:53:09.1943978Z * [new branch] gh/wconstab/444/orig -> origin/gh/wconstab/444/orig 2025-12-04T08:53:09.1944047Z * [new branch] gh/wconstab/447/base -> origin/gh/wconstab/447/base 2025-12-04T08:53:09.1944118Z * [new branch] gh/wconstab/447/head -> origin/gh/wconstab/447/head 2025-12-04T08:53:09.1944187Z * [new branch] gh/wconstab/447/orig -> origin/gh/wconstab/447/orig 2025-12-04T08:53:09.1944256Z * [new branch] gh/wconstab/448/base -> origin/gh/wconstab/448/base 2025-12-04T08:53:09.1944368Z * [new branch] gh/wconstab/448/head -> origin/gh/wconstab/448/head 2025-12-04T08:53:09.1944473Z * [new branch] gh/wconstab/448/orig -> origin/gh/wconstab/448/orig 2025-12-04T08:53:09.1944544Z * [new branch] gh/wconstab/449/base -> origin/gh/wconstab/449/base 2025-12-04T08:53:09.1944615Z * [new branch] gh/wconstab/449/head -> origin/gh/wconstab/449/head 2025-12-04T08:53:09.1944685Z * [new branch] gh/wconstab/449/orig -> origin/gh/wconstab/449/orig 2025-12-04T08:53:09.1944755Z * [new branch] gh/wconstab/450/base -> origin/gh/wconstab/450/base 2025-12-04T08:53:09.1944826Z * [new branch] gh/wconstab/450/head -> origin/gh/wconstab/450/head 2025-12-04T08:53:09.1944896Z * [new branch] gh/wconstab/450/orig -> origin/gh/wconstab/450/orig 2025-12-04T08:53:09.1944967Z * [new branch] gh/wconstab/451/base -> origin/gh/wconstab/451/base 2025-12-04T08:53:09.1945039Z * [new branch] gh/wconstab/451/head -> origin/gh/wconstab/451/head 2025-12-04T08:53:09.1945111Z * [new branch] gh/wconstab/451/orig -> origin/gh/wconstab/451/orig 2025-12-04T08:53:09.1945182Z * [new branch] gh/wconstab/452/base -> origin/gh/wconstab/452/base 2025-12-04T08:53:09.1945252Z * [new branch] gh/wconstab/452/head -> origin/gh/wconstab/452/head 2025-12-04T08:53:09.1945323Z * [new branch] gh/wconstab/452/orig -> origin/gh/wconstab/452/orig 2025-12-04T08:53:09.1945394Z * [new branch] gh/wconstab/453/base -> origin/gh/wconstab/453/base 2025-12-04T08:53:09.1945465Z * [new branch] gh/wconstab/453/head -> origin/gh/wconstab/453/head 2025-12-04T08:53:09.1945534Z * [new branch] gh/wconstab/453/orig -> origin/gh/wconstab/453/orig 2025-12-04T08:53:09.1945605Z * [new branch] gh/wconstab/454/base -> origin/gh/wconstab/454/base 2025-12-04T08:53:09.1945677Z * [new branch] gh/wconstab/454/head -> origin/gh/wconstab/454/head 2025-12-04T08:53:09.1945749Z * [new branch] gh/wconstab/454/orig -> origin/gh/wconstab/454/orig 2025-12-04T08:53:09.1945822Z * [new branch] gh/wconstab/455/base -> origin/gh/wconstab/455/base 2025-12-04T08:53:09.1945892Z * [new branch] gh/wconstab/455/head -> origin/gh/wconstab/455/head 2025-12-04T08:53:09.1945962Z * [new branch] gh/wconstab/455/orig -> origin/gh/wconstab/455/orig 2025-12-04T08:53:09.1946033Z * [new branch] gh/wconstab/456/base -> origin/gh/wconstab/456/base 2025-12-04T08:53:09.1946102Z * [new branch] gh/wconstab/456/head -> origin/gh/wconstab/456/head 2025-12-04T08:53:09.1946173Z * [new branch] gh/wconstab/456/orig -> origin/gh/wconstab/456/orig 2025-12-04T08:53:09.1946245Z * [new branch] gh/wconstab/457/base -> origin/gh/wconstab/457/base 2025-12-04T08:53:09.1946317Z * [new branch] gh/wconstab/457/head -> origin/gh/wconstab/457/head 2025-12-04T08:53:09.1946388Z * [new branch] gh/wconstab/457/orig -> origin/gh/wconstab/457/orig 2025-12-04T08:53:09.1946458Z * [new branch] gh/wconstab/458/base -> origin/gh/wconstab/458/base 2025-12-04T08:53:09.1946527Z * [new branch] gh/wconstab/458/head -> origin/gh/wconstab/458/head 2025-12-04T08:53:09.1946598Z * [new branch] gh/wconstab/458/orig -> origin/gh/wconstab/458/orig 2025-12-04T08:53:09.1946668Z * [new branch] gh/wconstab/459/base -> origin/gh/wconstab/459/base 2025-12-04T08:53:09.1946737Z * [new branch] gh/wconstab/459/head -> origin/gh/wconstab/459/head 2025-12-04T08:53:09.1946809Z * [new branch] gh/wconstab/459/orig -> origin/gh/wconstab/459/orig 2025-12-04T08:53:09.1946878Z * [new branch] gh/wconstab/460/base -> origin/gh/wconstab/460/base 2025-12-04T08:53:09.1946977Z * [new branch] gh/wconstab/460/head -> origin/gh/wconstab/460/head 2025-12-04T08:53:09.1947082Z * [new branch] gh/wconstab/460/orig -> origin/gh/wconstab/460/orig 2025-12-04T08:53:09.1947154Z * [new branch] gh/wconstab/461/base -> origin/gh/wconstab/461/base 2025-12-04T08:53:09.1947223Z * [new branch] gh/wconstab/461/head -> origin/gh/wconstab/461/head 2025-12-04T08:53:09.1947294Z * [new branch] gh/wconstab/461/orig -> origin/gh/wconstab/461/orig 2025-12-04T08:53:09.1947363Z * [new branch] gh/wconstab/462/base -> origin/gh/wconstab/462/base 2025-12-04T08:53:09.1947433Z * [new branch] gh/wconstab/462/head -> origin/gh/wconstab/462/head 2025-12-04T08:53:09.1947504Z * [new branch] gh/wconstab/462/orig -> origin/gh/wconstab/462/orig 2025-12-04T08:53:09.1947574Z * [new branch] gh/wconstab/463/base -> origin/gh/wconstab/463/base 2025-12-04T08:53:09.1947645Z * [new branch] gh/wconstab/463/head -> origin/gh/wconstab/463/head 2025-12-04T08:53:09.1947718Z * [new branch] gh/wconstab/463/orig -> origin/gh/wconstab/463/orig 2025-12-04T08:53:09.1947789Z * [new branch] gh/wconstab/464/base -> origin/gh/wconstab/464/base 2025-12-04T08:53:09.1947860Z * [new branch] gh/wconstab/464/head -> origin/gh/wconstab/464/head 2025-12-04T08:53:09.1947929Z * [new branch] gh/wconstab/464/orig -> origin/gh/wconstab/464/orig 2025-12-04T08:53:09.1947998Z * [new branch] gh/wconstab/465/base -> origin/gh/wconstab/465/base 2025-12-04T08:53:09.1948069Z * [new branch] gh/wconstab/465/head -> origin/gh/wconstab/465/head 2025-12-04T08:53:09.1948138Z * [new branch] gh/wconstab/465/orig -> origin/gh/wconstab/465/orig 2025-12-04T08:53:09.1948209Z * [new branch] gh/wconstab/466/base -> origin/gh/wconstab/466/base 2025-12-04T08:53:09.1948281Z * [new branch] gh/wconstab/466/head -> origin/gh/wconstab/466/head 2025-12-04T08:53:09.1948350Z * [new branch] gh/wconstab/466/orig -> origin/gh/wconstab/466/orig 2025-12-04T08:53:09.1948420Z * [new branch] gh/wconstab/467/base -> origin/gh/wconstab/467/base 2025-12-04T08:53:09.1948491Z * [new branch] gh/wconstab/467/head -> origin/gh/wconstab/467/head 2025-12-04T08:53:09.1948561Z * [new branch] gh/wconstab/467/orig -> origin/gh/wconstab/467/orig 2025-12-04T08:53:09.1948630Z * [new branch] gh/wconstab/468/base -> origin/gh/wconstab/468/base 2025-12-04T08:53:09.1948708Z * [new branch] gh/wconstab/468/head -> origin/gh/wconstab/468/head 2025-12-04T08:53:09.1948777Z * [new branch] gh/wconstab/468/orig -> origin/gh/wconstab/468/orig 2025-12-04T08:53:09.1948851Z * [new branch] gh/weifengpy/39/base -> origin/gh/weifengpy/39/base 2025-12-04T08:53:09.1948924Z * [new branch] gh/weifengpy/39/head -> origin/gh/weifengpy/39/head 2025-12-04T08:53:09.1948996Z * [new branch] gh/weifengpy/39/orig -> origin/gh/weifengpy/39/orig 2025-12-04T08:53:09.1949067Z * [new branch] gh/weifengpy/40/base -> origin/gh/weifengpy/40/base 2025-12-04T08:53:09.1949139Z * [new branch] gh/weifengpy/40/head -> origin/gh/weifengpy/40/head 2025-12-04T08:53:09.1949210Z * [new branch] gh/weifengpy/40/orig -> origin/gh/weifengpy/40/orig 2025-12-04T08:53:09.1949280Z * [new branch] gh/weifengpy/41/base -> origin/gh/weifengpy/41/base 2025-12-04T08:53:09.1949352Z * [new branch] gh/weifengpy/41/head -> origin/gh/weifengpy/41/head 2025-12-04T08:53:09.1949423Z * [new branch] gh/weifengpy/41/orig -> origin/gh/weifengpy/41/orig 2025-12-04T08:53:09.1949534Z * [new branch] gh/williamwen42/250/base -> origin/gh/williamwen42/250/base 2025-12-04T08:53:09.1949615Z * [new branch] gh/williamwen42/250/head -> origin/gh/williamwen42/250/head 2025-12-04T08:53:09.1949723Z * [new branch] gh/williamwen42/250/orig -> origin/gh/williamwen42/250/orig 2025-12-04T08:53:09.1949802Z * [new branch] gh/williamwen42/279/base -> origin/gh/williamwen42/279/base 2025-12-04T08:53:09.1949879Z * [new branch] gh/williamwen42/279/head -> origin/gh/williamwen42/279/head 2025-12-04T08:53:09.1949956Z * [new branch] gh/williamwen42/279/orig -> origin/gh/williamwen42/279/orig 2025-12-04T08:53:09.1950034Z * [new branch] gh/williamwen42/282/base -> origin/gh/williamwen42/282/base 2025-12-04T08:53:09.1950111Z * [new branch] gh/williamwen42/282/head -> origin/gh/williamwen42/282/head 2025-12-04T08:53:09.1950187Z * [new branch] gh/williamwen42/282/orig -> origin/gh/williamwen42/282/orig 2025-12-04T08:53:09.1950266Z * [new branch] gh/williamwen42/287/base -> origin/gh/williamwen42/287/base 2025-12-04T08:53:09.1950343Z * [new branch] gh/williamwen42/287/head -> origin/gh/williamwen42/287/head 2025-12-04T08:53:09.1950420Z * [new branch] gh/williamwen42/287/orig -> origin/gh/williamwen42/287/orig 2025-12-04T08:53:09.1950497Z * [new branch] gh/williamwen42/288/base -> origin/gh/williamwen42/288/base 2025-12-04T08:53:09.1950573Z * [new branch] gh/williamwen42/288/head -> origin/gh/williamwen42/288/head 2025-12-04T08:53:09.1950650Z * [new branch] gh/williamwen42/288/orig -> origin/gh/williamwen42/288/orig 2025-12-04T08:53:09.1950727Z * [new branch] gh/williamwen42/296/base -> origin/gh/williamwen42/296/base 2025-12-04T08:53:09.1950804Z * [new branch] gh/williamwen42/296/head -> origin/gh/williamwen42/296/head 2025-12-04T08:53:09.1950882Z * [new branch] gh/williamwen42/296/orig -> origin/gh/williamwen42/296/orig 2025-12-04T08:53:09.1950959Z * [new branch] gh/williamwen42/297/base -> origin/gh/williamwen42/297/base 2025-12-04T08:53:09.1951036Z * [new branch] gh/williamwen42/297/head -> origin/gh/williamwen42/297/head 2025-12-04T08:53:09.1951114Z * [new branch] gh/williamwen42/297/orig -> origin/gh/williamwen42/297/orig 2025-12-04T08:53:09.1951190Z * [new branch] gh/williamwen42/306/base -> origin/gh/williamwen42/306/base 2025-12-04T08:53:09.1951266Z * [new branch] gh/williamwen42/306/head -> origin/gh/williamwen42/306/head 2025-12-04T08:53:09.1951345Z * [new branch] gh/williamwen42/306/orig -> origin/gh/williamwen42/306/orig 2025-12-04T08:53:09.1951422Z * [new branch] gh/williamwen42/309/base -> origin/gh/williamwen42/309/base 2025-12-04T08:53:09.1951499Z * [new branch] gh/williamwen42/309/head -> origin/gh/williamwen42/309/head 2025-12-04T08:53:09.1951579Z * [new branch] gh/williamwen42/309/orig -> origin/gh/williamwen42/309/orig 2025-12-04T08:53:09.1951657Z * [new branch] gh/williamwen42/310/base -> origin/gh/williamwen42/310/base 2025-12-04T08:53:09.1951734Z * [new branch] gh/williamwen42/310/head -> origin/gh/williamwen42/310/head 2025-12-04T08:53:09.1951812Z * [new branch] gh/williamwen42/310/orig -> origin/gh/williamwen42/310/orig 2025-12-04T08:53:09.1951887Z * [new branch] gh/williamwen42/311/base -> origin/gh/williamwen42/311/base 2025-12-04T08:53:09.1951963Z * [new branch] gh/williamwen42/311/head -> origin/gh/williamwen42/311/head 2025-12-04T08:53:09.1952041Z * [new branch] gh/williamwen42/311/orig -> origin/gh/williamwen42/311/orig 2025-12-04T08:53:09.1952118Z * [new branch] gh/williamwen42/319/base -> origin/gh/williamwen42/319/base 2025-12-04T08:53:09.1952224Z * [new branch] gh/williamwen42/319/head -> origin/gh/williamwen42/319/head 2025-12-04T08:53:09.1952302Z * [new branch] gh/williamwen42/319/orig -> origin/gh/williamwen42/319/orig 2025-12-04T08:53:09.1952404Z * [new branch] gh/williamwen42/325/base -> origin/gh/williamwen42/325/base 2025-12-04T08:53:09.1952484Z * [new branch] gh/williamwen42/325/head -> origin/gh/williamwen42/325/head 2025-12-04T08:53:09.1952560Z * [new branch] gh/williamwen42/325/orig -> origin/gh/williamwen42/325/orig 2025-12-04T08:53:09.1952637Z * [new branch] gh/williamwen42/326/base -> origin/gh/williamwen42/326/base 2025-12-04T08:53:09.1952715Z * [new branch] gh/williamwen42/326/head -> origin/gh/williamwen42/326/head 2025-12-04T08:53:09.1952791Z * [new branch] gh/williamwen42/326/orig -> origin/gh/williamwen42/326/orig 2025-12-04T08:53:09.1952867Z * [new branch] gh/williamwen42/327/base -> origin/gh/williamwen42/327/base 2025-12-04T08:53:09.1952984Z * [new branch] gh/williamwen42/327/head -> origin/gh/williamwen42/327/head 2025-12-04T08:53:09.1953066Z * [new branch] gh/williamwen42/327/orig -> origin/gh/williamwen42/327/orig 2025-12-04T08:53:09.1953143Z * [new branch] gh/williamwen42/328/base -> origin/gh/williamwen42/328/base 2025-12-04T08:53:09.1953221Z * [new branch] gh/williamwen42/328/head -> origin/gh/williamwen42/328/head 2025-12-04T08:53:09.1953298Z * [new branch] gh/williamwen42/328/orig -> origin/gh/williamwen42/328/orig 2025-12-04T08:53:09.1953374Z * [new branch] gh/williamwen42/329/base -> origin/gh/williamwen42/329/base 2025-12-04T08:53:09.1953452Z * [new branch] gh/williamwen42/329/head -> origin/gh/williamwen42/329/head 2025-12-04T08:53:09.1953530Z * [new branch] gh/williamwen42/329/orig -> origin/gh/williamwen42/329/orig 2025-12-04T08:53:09.1953608Z * [new branch] gh/williamwen42/330/base -> origin/gh/williamwen42/330/base 2025-12-04T08:53:09.1953686Z * [new branch] gh/williamwen42/330/head -> origin/gh/williamwen42/330/head 2025-12-04T08:53:09.1953765Z * [new branch] gh/williamwen42/330/orig -> origin/gh/williamwen42/330/orig 2025-12-04T08:53:09.1953843Z * [new branch] gh/williamwen42/331/base -> origin/gh/williamwen42/331/base 2025-12-04T08:53:09.1953919Z * [new branch] gh/williamwen42/331/head -> origin/gh/williamwen42/331/head 2025-12-04T08:53:09.1953997Z * [new branch] gh/williamwen42/331/orig -> origin/gh/williamwen42/331/orig 2025-12-04T08:53:09.1954074Z * [new branch] gh/williamwen42/332/base -> origin/gh/williamwen42/332/base 2025-12-04T08:53:09.1954151Z * [new branch] gh/williamwen42/332/head -> origin/gh/williamwen42/332/head 2025-12-04T08:53:09.1954227Z * [new branch] gh/williamwen42/332/orig -> origin/gh/williamwen42/332/orig 2025-12-04T08:53:09.1954307Z * [new branch] gh/williamwen42/333/base -> origin/gh/williamwen42/333/base 2025-12-04T08:53:09.1954385Z * [new branch] gh/williamwen42/333/head -> origin/gh/williamwen42/333/head 2025-12-04T08:53:09.1954462Z * [new branch] gh/williamwen42/333/orig -> origin/gh/williamwen42/333/orig 2025-12-04T08:53:09.1954538Z * [new branch] gh/williamwen42/334/base -> origin/gh/williamwen42/334/base 2025-12-04T08:53:09.1954614Z * [new branch] gh/williamwen42/334/head -> origin/gh/williamwen42/334/head 2025-12-04T08:53:09.1954690Z * [new branch] gh/williamwen42/334/orig -> origin/gh/williamwen42/334/orig 2025-12-04T08:53:09.1954767Z * [new branch] gh/williamwen42/335/base -> origin/gh/williamwen42/335/base 2025-12-04T08:53:09.1954845Z * [new branch] gh/williamwen42/335/head -> origin/gh/williamwen42/335/head 2025-12-04T08:53:09.1954959Z * [new branch] gh/williamwen42/335/orig -> origin/gh/williamwen42/335/orig 2025-12-04T08:53:09.1955038Z * [new branch] gh/williamwen42/336/base -> origin/gh/williamwen42/336/base 2025-12-04T08:53:09.1955150Z * [new branch] gh/williamwen42/336/head -> origin/gh/williamwen42/336/head 2025-12-04T08:53:09.1955227Z * [new branch] gh/williamwen42/336/orig -> origin/gh/williamwen42/336/orig 2025-12-04T08:53:09.1955306Z * [new branch] gh/williamwen42/337/base -> origin/gh/williamwen42/337/base 2025-12-04T08:53:09.1955384Z * [new branch] gh/williamwen42/337/head -> origin/gh/williamwen42/337/head 2025-12-04T08:53:09.1955461Z * [new branch] gh/williamwen42/337/orig -> origin/gh/williamwen42/337/orig 2025-12-04T08:53:09.1955538Z * [new branch] gh/williamwen42/338/base -> origin/gh/williamwen42/338/base 2025-12-04T08:53:09.1955615Z * [new branch] gh/williamwen42/338/head -> origin/gh/williamwen42/338/head 2025-12-04T08:53:09.1955694Z * [new branch] gh/williamwen42/338/orig -> origin/gh/williamwen42/338/orig 2025-12-04T08:53:09.1955772Z * [new branch] gh/williamwen42/339/base -> origin/gh/williamwen42/339/base 2025-12-04T08:53:09.1955848Z * [new branch] gh/williamwen42/339/head -> origin/gh/williamwen42/339/head 2025-12-04T08:53:09.1955925Z * [new branch] gh/williamwen42/339/orig -> origin/gh/williamwen42/339/orig 2025-12-04T08:53:09.1956003Z * [new branch] gh/williamwen42/340/base -> origin/gh/williamwen42/340/base 2025-12-04T08:53:09.1956081Z * [new branch] gh/williamwen42/340/head -> origin/gh/williamwen42/340/head 2025-12-04T08:53:09.1956158Z * [new branch] gh/williamwen42/340/orig -> origin/gh/williamwen42/340/orig 2025-12-04T08:53:09.1956235Z * [new branch] gh/williamwen42/341/base -> origin/gh/williamwen42/341/base 2025-12-04T08:53:09.1956311Z * [new branch] gh/williamwen42/341/head -> origin/gh/williamwen42/341/head 2025-12-04T08:53:09.1956389Z * [new branch] gh/williamwen42/341/orig -> origin/gh/williamwen42/341/orig 2025-12-04T08:53:09.1956467Z * [new branch] gh/williamwen42/342/base -> origin/gh/williamwen42/342/base 2025-12-04T08:53:09.1956543Z * [new branch] gh/williamwen42/342/head -> origin/gh/williamwen42/342/head 2025-12-04T08:53:09.1956621Z * [new branch] gh/williamwen42/342/orig -> origin/gh/williamwen42/342/orig 2025-12-04T08:53:09.1956697Z * [new branch] gh/williamwen42/343/base -> origin/gh/williamwen42/343/base 2025-12-04T08:53:09.1956775Z * [new branch] gh/williamwen42/343/head -> origin/gh/williamwen42/343/head 2025-12-04T08:53:09.1956853Z * [new branch] gh/williamwen42/343/orig -> origin/gh/williamwen42/343/orig 2025-12-04T08:53:09.1956929Z * [new branch] gh/williamwen42/344/base -> origin/gh/williamwen42/344/base 2025-12-04T08:53:09.1957008Z * [new branch] gh/williamwen42/344/head -> origin/gh/williamwen42/344/head 2025-12-04T08:53:09.1957086Z * [new branch] gh/williamwen42/344/orig -> origin/gh/williamwen42/344/orig 2025-12-04T08:53:09.1957162Z * [new branch] gh/williamwen42/345/base -> origin/gh/williamwen42/345/base 2025-12-04T08:53:09.1957239Z * [new branch] gh/williamwen42/345/head -> origin/gh/williamwen42/345/head 2025-12-04T08:53:09.1957315Z * [new branch] gh/williamwen42/345/orig -> origin/gh/williamwen42/345/orig 2025-12-04T08:53:09.1957391Z * [new branch] gh/williamwen42/346/base -> origin/gh/williamwen42/346/base 2025-12-04T08:53:09.1957468Z * [new branch] gh/williamwen42/346/head -> origin/gh/williamwen42/346/head 2025-12-04T08:53:09.1957545Z * [new branch] gh/williamwen42/346/orig -> origin/gh/williamwen42/346/orig 2025-12-04T08:53:09.1957621Z * [new branch] gh/williamwen42/347/base -> origin/gh/williamwen42/347/base 2025-12-04T08:53:09.1957739Z * [new branch] gh/williamwen42/347/head -> origin/gh/williamwen42/347/head 2025-12-04T08:53:09.1957841Z * [new branch] gh/williamwen42/347/orig -> origin/gh/williamwen42/347/orig 2025-12-04T08:53:09.1957918Z * [new branch] gh/williamwen42/348/base -> origin/gh/williamwen42/348/base 2025-12-04T08:53:09.1957995Z * [new branch] gh/williamwen42/348/head -> origin/gh/williamwen42/348/head 2025-12-04T08:53:09.1958073Z * [new branch] gh/williamwen42/348/orig -> origin/gh/williamwen42/348/orig 2025-12-04T08:53:09.1958149Z * [new branch] gh/williamwen42/349/base -> origin/gh/williamwen42/349/base 2025-12-04T08:53:09.1958228Z * [new branch] gh/williamwen42/349/head -> origin/gh/williamwen42/349/head 2025-12-04T08:53:09.1958305Z * [new branch] gh/williamwen42/349/orig -> origin/gh/williamwen42/349/orig 2025-12-04T08:53:09.1958386Z * [new branch] gh/williamwen42/350/base -> origin/gh/williamwen42/350/base 2025-12-04T08:53:09.1958463Z * [new branch] gh/williamwen42/350/head -> origin/gh/williamwen42/350/head 2025-12-04T08:53:09.1958541Z * [new branch] gh/williamwen42/350/orig -> origin/gh/williamwen42/350/orig 2025-12-04T08:53:09.1958620Z * [new branch] gh/williamwen42/351/base -> origin/gh/williamwen42/351/base 2025-12-04T08:53:09.1958697Z * [new branch] gh/williamwen42/351/head -> origin/gh/williamwen42/351/head 2025-12-04T08:53:09.1958773Z * [new branch] gh/williamwen42/351/orig -> origin/gh/williamwen42/351/orig 2025-12-04T08:53:09.1958854Z * [new branch] gh/williamwen42/352/base -> origin/gh/williamwen42/352/base 2025-12-04T08:53:09.1958930Z * [new branch] gh/williamwen42/352/head -> origin/gh/williamwen42/352/head 2025-12-04T08:53:09.1959009Z * [new branch] gh/williamwen42/352/orig -> origin/gh/williamwen42/352/orig 2025-12-04T08:53:09.1959088Z * [new branch] gh/williamwen42/353/base -> origin/gh/williamwen42/353/base 2025-12-04T08:53:09.1959167Z * [new branch] gh/williamwen42/353/head -> origin/gh/williamwen42/353/head 2025-12-04T08:53:09.1959245Z * [new branch] gh/williamwen42/353/orig -> origin/gh/williamwen42/353/orig 2025-12-04T08:53:09.1959322Z * [new branch] gh/williamwen42/354/base -> origin/gh/williamwen42/354/base 2025-12-04T08:53:09.1959400Z * [new branch] gh/williamwen42/354/head -> origin/gh/williamwen42/354/head 2025-12-04T08:53:09.1959477Z * [new branch] gh/williamwen42/354/orig -> origin/gh/williamwen42/354/orig 2025-12-04T08:53:09.1959556Z * [new branch] gh/williamwen42/355/base -> origin/gh/williamwen42/355/base 2025-12-04T08:53:09.1959633Z * [new branch] gh/williamwen42/355/head -> origin/gh/williamwen42/355/head 2025-12-04T08:53:09.1959711Z * [new branch] gh/williamwen42/355/orig -> origin/gh/williamwen42/355/orig 2025-12-04T08:53:09.1959788Z * [new branch] gh/williamwen42/356/base -> origin/gh/williamwen42/356/base 2025-12-04T08:53:09.1959867Z * [new branch] gh/williamwen42/356/head -> origin/gh/williamwen42/356/head 2025-12-04T08:53:09.1959946Z * [new branch] gh/williamwen42/356/orig -> origin/gh/williamwen42/356/orig 2025-12-04T08:53:09.1960022Z * [new branch] gh/williamwen42/357/base -> origin/gh/williamwen42/357/base 2025-12-04T08:53:09.1960099Z * [new branch] gh/williamwen42/357/head -> origin/gh/williamwen42/357/head 2025-12-04T08:53:09.1960177Z * [new branch] gh/williamwen42/357/orig -> origin/gh/williamwen42/357/orig 2025-12-04T08:53:09.1960254Z * [new branch] gh/williamwen42/358/base -> origin/gh/williamwen42/358/base 2025-12-04T08:53:09.1960332Z * [new branch] gh/williamwen42/358/head -> origin/gh/williamwen42/358/head 2025-12-04T08:53:09.1960438Z * [new branch] gh/williamwen42/358/orig -> origin/gh/williamwen42/358/orig 2025-12-04T08:53:09.1960533Z * [new branch] gh/xmfan/169/base -> origin/gh/xmfan/169/base 2025-12-04T08:53:09.1960602Z * [new branch] gh/xmfan/169/head -> origin/gh/xmfan/169/head 2025-12-04T08:53:09.1960670Z * [new branch] gh/xmfan/170/base -> origin/gh/xmfan/170/base 2025-12-04T08:53:09.1960735Z * [new branch] gh/xmfan/170/head -> origin/gh/xmfan/170/head 2025-12-04T08:53:09.1960800Z * [new branch] gh/xmfan/274/base -> origin/gh/xmfan/274/base 2025-12-04T08:53:09.1960867Z * [new branch] gh/xmfan/274/head -> origin/gh/xmfan/274/head 2025-12-04T08:53:09.1960932Z * [new branch] gh/xmfan/274/orig -> origin/gh/xmfan/274/orig 2025-12-04T08:53:09.1960996Z * [new branch] gh/xmfan/277/base -> origin/gh/xmfan/277/base 2025-12-04T08:53:09.1961063Z * [new branch] gh/xmfan/277/head -> origin/gh/xmfan/277/head 2025-12-04T08:53:09.1961129Z * [new branch] gh/xmfan/277/orig -> origin/gh/xmfan/277/orig 2025-12-04T08:53:09.1961194Z * [new branch] gh/xmfan/301/base -> origin/gh/xmfan/301/base 2025-12-04T08:53:09.1961262Z * [new branch] gh/xmfan/301/head -> origin/gh/xmfan/301/head 2025-12-04T08:53:09.1961327Z * [new branch] gh/xmfan/301/orig -> origin/gh/xmfan/301/orig 2025-12-04T08:53:09.1961392Z * [new branch] gh/xmfan/304/base -> origin/gh/xmfan/304/base 2025-12-04T08:53:09.1961457Z * [new branch] gh/xmfan/304/head -> origin/gh/xmfan/304/head 2025-12-04T08:53:09.1961522Z * [new branch] gh/xmfan/304/orig -> origin/gh/xmfan/304/orig 2025-12-04T08:53:09.1961587Z * [new branch] gh/xmfan/309/base -> origin/gh/xmfan/309/base 2025-12-04T08:53:09.1961654Z * [new branch] gh/xmfan/309/head -> origin/gh/xmfan/309/head 2025-12-04T08:53:09.1961721Z * [new branch] gh/xmfan/309/orig -> origin/gh/xmfan/309/orig 2025-12-04T08:53:09.1961786Z * [new branch] gh/xmfan/310/base -> origin/gh/xmfan/310/base 2025-12-04T08:53:09.1961851Z * [new branch] gh/xmfan/310/head -> origin/gh/xmfan/310/head 2025-12-04T08:53:09.1961915Z * [new branch] gh/xmfan/310/orig -> origin/gh/xmfan/310/orig 2025-12-04T08:53:09.1961982Z * [new branch] gh/xmfan/311/base -> origin/gh/xmfan/311/base 2025-12-04T08:53:09.1962048Z * [new branch] gh/xmfan/311/head -> origin/gh/xmfan/311/head 2025-12-04T08:53:09.1962112Z * [new branch] gh/xmfan/311/orig -> origin/gh/xmfan/311/orig 2025-12-04T08:53:09.1962177Z * [new branch] gh/xmfan/312/base -> origin/gh/xmfan/312/base 2025-12-04T08:53:09.1962243Z * [new branch] gh/xmfan/312/head -> origin/gh/xmfan/312/head 2025-12-04T08:53:09.1962308Z * [new branch] gh/xmfan/312/orig -> origin/gh/xmfan/312/orig 2025-12-04T08:53:09.1962376Z * [new branch] gh/xmfan/313/base -> origin/gh/xmfan/313/base 2025-12-04T08:53:09.1962440Z * [new branch] gh/xmfan/313/head -> origin/gh/xmfan/313/head 2025-12-04T08:53:09.1962505Z * [new branch] gh/xmfan/313/orig -> origin/gh/xmfan/313/orig 2025-12-04T08:53:09.1962583Z * [new branch] gh/xuanzhang816/27/base -> origin/gh/xuanzhang816/27/base 2025-12-04T08:53:09.1962659Z * [new branch] gh/xuanzhang816/27/head -> origin/gh/xuanzhang816/27/head 2025-12-04T08:53:09.1962735Z * [new branch] gh/xuanzhang816/27/orig -> origin/gh/xuanzhang816/27/orig 2025-12-04T08:53:09.1962811Z * [new branch] gh/xuanzhang816/32/base -> origin/gh/xuanzhang816/32/base 2025-12-04T08:53:09.1962917Z * [new branch] gh/xuanzhang816/32/head -> origin/gh/xuanzhang816/32/head 2025-12-04T08:53:09.1963097Z * [new branch] gh/xuanzhang816/32/orig -> origin/gh/xuanzhang816/32/orig 2025-12-04T08:53:09.1963175Z * [new branch] gh/xuanzhang816/33/base -> origin/gh/xuanzhang816/33/base 2025-12-04T08:53:09.1963251Z * [new branch] gh/xuanzhang816/33/head -> origin/gh/xuanzhang816/33/head 2025-12-04T08:53:09.1963327Z * [new branch] gh/xuanzhang816/33/orig -> origin/gh/xuanzhang816/33/orig 2025-12-04T08:53:09.1963401Z * [new branch] gh/xuanzhang816/34/base -> origin/gh/xuanzhang816/34/base 2025-12-04T08:53:09.1963476Z * [new branch] gh/xuanzhang816/34/head -> origin/gh/xuanzhang816/34/head 2025-12-04T08:53:09.1963552Z * [new branch] gh/xuanzhang816/34/orig -> origin/gh/xuanzhang816/34/orig 2025-12-04T08:53:09.1963626Z * [new branch] gh/xuanzhang816/35/base -> origin/gh/xuanzhang816/35/base 2025-12-04T08:53:09.1963703Z * [new branch] gh/xuanzhang816/35/head -> origin/gh/xuanzhang816/35/head 2025-12-04T08:53:09.1963780Z * [new branch] gh/xuanzhang816/35/orig -> origin/gh/xuanzhang816/35/orig 2025-12-04T08:53:09.1963853Z * [new branch] gh/yanbing-j/11/base -> origin/gh/yanbing-j/11/base 2025-12-04T08:53:09.1963924Z * [new branch] gh/yanbing-j/11/head -> origin/gh/yanbing-j/11/head 2025-12-04T08:53:09.1963996Z * [new branch] gh/yanbing-j/11/orig -> origin/gh/yanbing-j/11/orig 2025-12-04T08:53:09.1964067Z * [new branch] gh/yanbing-j/12/base -> origin/gh/yanbing-j/12/base 2025-12-04T08:53:09.1964137Z * [new branch] gh/yanbing-j/12/head -> origin/gh/yanbing-j/12/head 2025-12-04T08:53:09.1964208Z * [new branch] gh/yanbing-j/12/orig -> origin/gh/yanbing-j/12/orig 2025-12-04T08:53:09.1964277Z * [new branch] gh/yanbing-j/13/base -> origin/gh/yanbing-j/13/base 2025-12-04T08:53:09.1964348Z * [new branch] gh/yanbing-j/13/head -> origin/gh/yanbing-j/13/head 2025-12-04T08:53:09.1964421Z * [new branch] gh/yanbing-j/13/orig -> origin/gh/yanbing-j/13/orig 2025-12-04T08:53:09.1964491Z * [new branch] gh/yanbing-j/14/base -> origin/gh/yanbing-j/14/base 2025-12-04T08:53:09.1964560Z * [new branch] gh/yanbing-j/14/head -> origin/gh/yanbing-j/14/head 2025-12-04T08:53:09.1964629Z * [new branch] gh/yanbing-j/14/orig -> origin/gh/yanbing-j/14/orig 2025-12-04T08:53:09.1964699Z * [new branch] gh/yanbing-j/15/base -> origin/gh/yanbing-j/15/base 2025-12-04T08:53:09.1964769Z * [new branch] gh/yanbing-j/15/head -> origin/gh/yanbing-j/15/head 2025-12-04T08:53:09.1964838Z * [new branch] gh/yanbing-j/15/orig -> origin/gh/yanbing-j/15/orig 2025-12-04T08:53:09.1964909Z * [new branch] gh/yanbing-j/18/base -> origin/gh/yanbing-j/18/base 2025-12-04T08:53:09.1964980Z * [new branch] gh/yanbing-j/18/head -> origin/gh/yanbing-j/18/head 2025-12-04T08:53:09.1965051Z * [new branch] gh/yanbing-j/18/orig -> origin/gh/yanbing-j/18/orig 2025-12-04T08:53:09.1965120Z * [new branch] gh/yanbing-j/19/base -> origin/gh/yanbing-j/19/base 2025-12-04T08:53:09.1965191Z * [new branch] gh/yanbing-j/19/head -> origin/gh/yanbing-j/19/head 2025-12-04T08:53:09.1965261Z * [new branch] gh/yanbing-j/19/orig -> origin/gh/yanbing-j/19/orig 2025-12-04T08:53:09.1965330Z * [new branch] gh/yanbing-j/20/base -> origin/gh/yanbing-j/20/base 2025-12-04T08:53:09.1965401Z * [new branch] gh/yanbing-j/20/head -> origin/gh/yanbing-j/20/head 2025-12-04T08:53:09.1965471Z * [new branch] gh/yanbing-j/20/orig -> origin/gh/yanbing-j/20/orig 2025-12-04T08:53:09.1965604Z * [new branch] gh/yanbing-j/21/base -> origin/gh/yanbing-j/21/base 2025-12-04T08:53:09.1965677Z * [new branch] gh/yanbing-j/21/head -> origin/gh/yanbing-j/21/head 2025-12-04T08:53:09.1965772Z * [new branch] gh/yanbing-j/22/base -> origin/gh/yanbing-j/22/base 2025-12-04T08:53:09.1965843Z * [new branch] gh/yanbing-j/22/head -> origin/gh/yanbing-j/22/head 2025-12-04T08:53:09.1965913Z * [new branch] gh/yanbing-j/22/orig -> origin/gh/yanbing-j/22/orig 2025-12-04T08:53:09.1965982Z * [new branch] gh/yanbing-j/23/base -> origin/gh/yanbing-j/23/base 2025-12-04T08:53:09.1966050Z * [new branch] gh/yanbing-j/23/head -> origin/gh/yanbing-j/23/head 2025-12-04T08:53:09.1966120Z * [new branch] gh/yanbing-j/23/orig -> origin/gh/yanbing-j/23/orig 2025-12-04T08:53:09.1966189Z * [new branch] gh/yanbing-j/24/base -> origin/gh/yanbing-j/24/base 2025-12-04T08:53:09.1966260Z * [new branch] gh/yanbing-j/24/head -> origin/gh/yanbing-j/24/head 2025-12-04T08:53:09.1966329Z * [new branch] gh/yanbing-j/24/orig -> origin/gh/yanbing-j/24/orig 2025-12-04T08:53:09.1966400Z * [new branch] gh/yanbing-j/25/base -> origin/gh/yanbing-j/25/base 2025-12-04T08:53:09.1966471Z * [new branch] gh/yanbing-j/25/head -> origin/gh/yanbing-j/25/head 2025-12-04T08:53:09.1966540Z * [new branch] gh/yanbing-j/25/orig -> origin/gh/yanbing-j/25/orig 2025-12-04T08:53:09.1966610Z * [new branch] gh/yanbing-j/26/base -> origin/gh/yanbing-j/26/base 2025-12-04T08:53:09.1966679Z * [new branch] gh/yanbing-j/26/head -> origin/gh/yanbing-j/26/head 2025-12-04T08:53:09.1966748Z * [new branch] gh/yanbing-j/26/orig -> origin/gh/yanbing-j/26/orig 2025-12-04T08:53:09.1966825Z * [new branch] gh/yang-yu-hang/1/base -> origin/gh/yang-yu-hang/1/base 2025-12-04T08:53:09.1966903Z * [new branch] gh/yang-yu-hang/1/head -> origin/gh/yang-yu-hang/1/head 2025-12-04T08:53:09.1966976Z * [new branch] gh/yang-yu-hang/1/orig -> origin/gh/yang-yu-hang/1/orig 2025-12-04T08:53:09.1967050Z * [new branch] gh/yang-yu-hang/2/base -> origin/gh/yang-yu-hang/2/base 2025-12-04T08:53:09.1967123Z * [new branch] gh/yang-yu-hang/2/head -> origin/gh/yang-yu-hang/2/head 2025-12-04T08:53:09.1967195Z * [new branch] gh/yang-yu-hang/2/orig -> origin/gh/yang-yu-hang/2/orig 2025-12-04T08:53:09.1967267Z * [new branch] gh/yang-yu-hang/3/base -> origin/gh/yang-yu-hang/3/base 2025-12-04T08:53:09.1967341Z * [new branch] gh/yang-yu-hang/3/head -> origin/gh/yang-yu-hang/3/head 2025-12-04T08:53:09.1967412Z * [new branch] gh/yang-yu-hang/3/orig -> origin/gh/yang-yu-hang/3/orig 2025-12-04T08:53:09.1967484Z * [new branch] gh/yangw-dev/12/base -> origin/gh/yangw-dev/12/base 2025-12-04T08:53:09.1967558Z * [new branch] gh/yangw-dev/12/head -> origin/gh/yangw-dev/12/head 2025-12-04T08:53:09.1967630Z * [new branch] gh/yangw-dev/12/orig -> origin/gh/yangw-dev/12/orig 2025-12-04T08:53:09.1967703Z * [new branch] gh/yangw-dev/13/base -> origin/gh/yangw-dev/13/base 2025-12-04T08:53:09.1967774Z * [new branch] gh/yangw-dev/13/head -> origin/gh/yangw-dev/13/head 2025-12-04T08:53:09.1967843Z * [new branch] gh/yangw-dev/13/orig -> origin/gh/yangw-dev/13/orig 2025-12-04T08:53:09.1967913Z * [new branch] gh/yangw-dev/14/base -> origin/gh/yangw-dev/14/base 2025-12-04T08:53:09.1967983Z * [new branch] gh/yangw-dev/14/head -> origin/gh/yangw-dev/14/head 2025-12-04T08:53:09.1968053Z * [new branch] gh/yangw-dev/14/orig -> origin/gh/yangw-dev/14/orig 2025-12-04T08:53:09.1968125Z * [new branch] gh/yangw-dev/15/base -> origin/gh/yangw-dev/15/base 2025-12-04T08:53:09.1968233Z * [new branch] gh/yangw-dev/15/head -> origin/gh/yangw-dev/15/head 2025-12-04T08:53:09.1968338Z * [new branch] gh/yangw-dev/15/orig -> origin/gh/yangw-dev/15/orig 2025-12-04T08:53:09.1968409Z * [new branch] gh/yangw-dev/19/base -> origin/gh/yangw-dev/19/base 2025-12-04T08:53:09.1968479Z * [new branch] gh/yangw-dev/19/head -> origin/gh/yangw-dev/19/head 2025-12-04T08:53:09.1968549Z * [new branch] gh/yangw-dev/19/orig -> origin/gh/yangw-dev/19/orig 2025-12-04T08:53:09.1968619Z * [new branch] gh/yangw-dev/26/base -> origin/gh/yangw-dev/26/base 2025-12-04T08:53:09.1968688Z * [new branch] gh/yangw-dev/26/head -> origin/gh/yangw-dev/26/head 2025-12-04T08:53:09.1968757Z * [new branch] gh/yangw-dev/26/orig -> origin/gh/yangw-dev/26/orig 2025-12-04T08:53:09.1968828Z * [new branch] gh/yangw-dev/27/base -> origin/gh/yangw-dev/27/base 2025-12-04T08:53:09.1968899Z * [new branch] gh/yangw-dev/27/head -> origin/gh/yangw-dev/27/head 2025-12-04T08:53:09.1968970Z * [new branch] gh/yangw-dev/27/orig -> origin/gh/yangw-dev/27/orig 2025-12-04T08:53:09.1969041Z * [new branch] gh/ydwu4/292/base -> origin/gh/ydwu4/292/base 2025-12-04T08:53:09.1969109Z * [new branch] gh/ydwu4/292/head -> origin/gh/ydwu4/292/head 2025-12-04T08:53:09.1969175Z * [new branch] gh/ydwu4/292/orig -> origin/gh/ydwu4/292/orig 2025-12-04T08:53:09.1969240Z * [new branch] gh/ydwu4/294/base -> origin/gh/ydwu4/294/base 2025-12-04T08:53:09.1969305Z * [new branch] gh/ydwu4/294/head -> origin/gh/ydwu4/294/head 2025-12-04T08:53:09.1969370Z * [new branch] gh/ydwu4/294/orig -> origin/gh/ydwu4/294/orig 2025-12-04T08:53:09.1969435Z * [new branch] gh/ydwu4/295/base -> origin/gh/ydwu4/295/base 2025-12-04T08:53:09.1969502Z * [new branch] gh/ydwu4/295/head -> origin/gh/ydwu4/295/head 2025-12-04T08:53:09.1969573Z * [new branch] gh/ydwu4/295/orig -> origin/gh/ydwu4/295/orig 2025-12-04T08:53:09.1969637Z * [new branch] gh/ydwu4/296/base -> origin/gh/ydwu4/296/base 2025-12-04T08:53:09.1969702Z * [new branch] gh/ydwu4/296/head -> origin/gh/ydwu4/296/head 2025-12-04T08:53:09.1969768Z * [new branch] gh/ydwu4/296/orig -> origin/gh/ydwu4/296/orig 2025-12-04T08:53:09.1969832Z * [new branch] gh/ydwu4/306/base -> origin/gh/ydwu4/306/base 2025-12-04T08:53:09.1969896Z * [new branch] gh/ydwu4/306/head -> origin/gh/ydwu4/306/head 2025-12-04T08:53:09.1969963Z * [new branch] gh/ydwu4/306/orig -> origin/gh/ydwu4/306/orig 2025-12-04T08:53:09.1970029Z * [new branch] gh/ydwu4/312/base -> origin/gh/ydwu4/312/base 2025-12-04T08:53:09.1970095Z * [new branch] gh/ydwu4/312/head -> origin/gh/ydwu4/312/head 2025-12-04T08:53:09.1970163Z * [new branch] gh/ydwu4/312/orig -> origin/gh/ydwu4/312/orig 2025-12-04T08:53:09.1970227Z * [new branch] gh/ydwu4/322/base -> origin/gh/ydwu4/322/base 2025-12-04T08:53:09.1970291Z * [new branch] gh/ydwu4/322/head -> origin/gh/ydwu4/322/head 2025-12-04T08:53:09.1970356Z * [new branch] gh/ydwu4/322/orig -> origin/gh/ydwu4/322/orig 2025-12-04T08:53:09.1970421Z * [new branch] gh/ydwu4/327/base -> origin/gh/ydwu4/327/base 2025-12-04T08:53:09.1970485Z * [new branch] gh/ydwu4/327/head -> origin/gh/ydwu4/327/head 2025-12-04T08:53:09.1970554Z * [new branch] gh/ydwu4/327/orig -> origin/gh/ydwu4/327/orig 2025-12-04T08:53:09.1970618Z * [new branch] gh/ydwu4/328/base -> origin/gh/ydwu4/328/base 2025-12-04T08:53:09.1970715Z * [new branch] gh/ydwu4/328/head -> origin/gh/ydwu4/328/head 2025-12-04T08:53:09.1970781Z * [new branch] gh/ydwu4/328/orig -> origin/gh/ydwu4/328/orig 2025-12-04T08:53:09.1970871Z * [new branch] gh/ydwu4/329/base -> origin/gh/ydwu4/329/base 2025-12-04T08:53:09.1970938Z * [new branch] gh/ydwu4/329/head -> origin/gh/ydwu4/329/head 2025-12-04T08:53:09.1971005Z * [new branch] gh/ydwu4/329/orig -> origin/gh/ydwu4/329/orig 2025-12-04T08:53:09.1971070Z * [new branch] gh/ydwu4/330/base -> origin/gh/ydwu4/330/base 2025-12-04T08:53:09.1971136Z * [new branch] gh/ydwu4/330/head -> origin/gh/ydwu4/330/head 2025-12-04T08:53:09.1971201Z * [new branch] gh/ydwu4/330/orig -> origin/gh/ydwu4/330/orig 2025-12-04T08:53:09.1971265Z * [new branch] gh/ydwu4/331/base -> origin/gh/ydwu4/331/base 2025-12-04T08:53:09.1971333Z * [new branch] gh/ydwu4/331/head -> origin/gh/ydwu4/331/head 2025-12-04T08:53:09.1971398Z * [new branch] gh/ydwu4/331/orig -> origin/gh/ydwu4/331/orig 2025-12-04T08:53:09.1971466Z * [new branch] gh/ydwu4/332/base -> origin/gh/ydwu4/332/base 2025-12-04T08:53:09.1971534Z * [new branch] gh/ydwu4/332/head -> origin/gh/ydwu4/332/head 2025-12-04T08:53:09.1971598Z * [new branch] gh/ydwu4/332/orig -> origin/gh/ydwu4/332/orig 2025-12-04T08:53:09.1971662Z * [new branch] gh/ydwu4/333/base -> origin/gh/ydwu4/333/base 2025-12-04T08:53:09.1971729Z * [new branch] gh/ydwu4/333/head -> origin/gh/ydwu4/333/head 2025-12-04T08:53:09.1971793Z * [new branch] gh/ydwu4/333/orig -> origin/gh/ydwu4/333/orig 2025-12-04T08:53:09.1971857Z * [new branch] gh/ydwu4/334/base -> origin/gh/ydwu4/334/base 2025-12-04T08:53:09.1971925Z * [new branch] gh/ydwu4/334/head -> origin/gh/ydwu4/334/head 2025-12-04T08:53:09.1971990Z * [new branch] gh/ydwu4/334/orig -> origin/gh/ydwu4/334/orig 2025-12-04T08:53:09.1972055Z * [new branch] gh/ydwu4/335/base -> origin/gh/ydwu4/335/base 2025-12-04T08:53:09.1972121Z * [new branch] gh/ydwu4/335/head -> origin/gh/ydwu4/335/head 2025-12-04T08:53:09.1972186Z * [new branch] gh/ydwu4/335/orig -> origin/gh/ydwu4/335/orig 2025-12-04T08:53:09.1972250Z * [new branch] gh/ydwu4/337/base -> origin/gh/ydwu4/337/base 2025-12-04T08:53:09.1972317Z * [new branch] gh/ydwu4/337/head -> origin/gh/ydwu4/337/head 2025-12-04T08:53:09.1972383Z * [new branch] gh/ydwu4/337/orig -> origin/gh/ydwu4/337/orig 2025-12-04T08:53:09.1972452Z * [new branch] gh/ydwu4/339/base -> origin/gh/ydwu4/339/base 2025-12-04T08:53:09.1972518Z * [new branch] gh/ydwu4/339/head -> origin/gh/ydwu4/339/head 2025-12-04T08:53:09.1972583Z * [new branch] gh/ydwu4/339/orig -> origin/gh/ydwu4/339/orig 2025-12-04T08:53:09.1972650Z * [new branch] gh/yf225/133/base -> origin/gh/yf225/133/base 2025-12-04T08:53:09.1972713Z * [new branch] gh/yf225/133/head -> origin/gh/yf225/133/head 2025-12-04T08:53:09.1972780Z * [new branch] gh/yf225/93/base -> origin/gh/yf225/93/base 2025-12-04T08:53:09.1972847Z * [new branch] gh/yf225/93/head -> origin/gh/yf225/93/head 2025-12-04T08:53:09.1972920Z * [new branch] gh/yifuwang/152/base -> origin/gh/yifuwang/152/base 2025-12-04T08:53:09.1973040Z * [new branch] gh/yifuwang/152/head -> origin/gh/yifuwang/152/head 2025-12-04T08:53:09.1973115Z * [new branch] gh/yifuwang/152/orig -> origin/gh/yifuwang/152/orig 2025-12-04T08:53:09.1973185Z * [new branch] gh/yifuwang/195/base -> origin/gh/yifuwang/195/base 2025-12-04T08:53:09.1973298Z * [new branch] gh/yifuwang/195/head -> origin/gh/yifuwang/195/head 2025-12-04T08:53:09.1973405Z * [new branch] gh/yifuwang/195/orig -> origin/gh/yifuwang/195/orig 2025-12-04T08:53:09.1973477Z * [new branch] gh/yiming0416/1/base -> origin/gh/yiming0416/1/base 2025-12-04T08:53:09.1973548Z * [new branch] gh/yiming0416/1/head -> origin/gh/yiming0416/1/head 2025-12-04T08:53:09.1973619Z * [new branch] gh/yiming0416/2/base -> origin/gh/yiming0416/2/base 2025-12-04T08:53:09.1973688Z * [new branch] gh/yiming0416/2/head -> origin/gh/yiming0416/2/head 2025-12-04T08:53:09.1973761Z * [new branch] gh/yushangdi/1/base -> origin/gh/yushangdi/1/base 2025-12-04T08:53:09.1973834Z * [new branch] gh/yushangdi/1/head -> origin/gh/yushangdi/1/head 2025-12-04T08:53:09.1973906Z * [new branch] gh/yushangdi/10/base -> origin/gh/yushangdi/10/base 2025-12-04T08:53:09.1973977Z * [new branch] gh/yushangdi/10/head -> origin/gh/yushangdi/10/head 2025-12-04T08:53:09.1974049Z * [new branch] gh/yushangdi/10/orig -> origin/gh/yushangdi/10/orig 2025-12-04T08:53:09.1974120Z * [new branch] gh/yushangdi/11/base -> origin/gh/yushangdi/11/base 2025-12-04T08:53:09.1974191Z * [new branch] gh/yushangdi/11/head -> origin/gh/yushangdi/11/head 2025-12-04T08:53:09.1974261Z * [new branch] gh/yushangdi/11/orig -> origin/gh/yushangdi/11/orig 2025-12-04T08:53:09.1974332Z * [new branch] gh/yushangdi/2/base -> origin/gh/yushangdi/2/base 2025-12-04T08:53:09.1974404Z * [new branch] gh/yushangdi/2/head -> origin/gh/yushangdi/2/head 2025-12-04T08:53:09.1974474Z * [new branch] gh/yushangdi/7/base -> origin/gh/yushangdi/7/base 2025-12-04T08:53:09.1974546Z * [new branch] gh/yushangdi/7/head -> origin/gh/yushangdi/7/head 2025-12-04T08:53:09.1974616Z * [new branch] gh/yushangdi/7/orig -> origin/gh/yushangdi/7/orig 2025-12-04T08:53:09.1974687Z * [new branch] gh/yushangdi/8/base -> origin/gh/yushangdi/8/base 2025-12-04T08:53:09.1974757Z * [new branch] gh/yushangdi/8/head -> origin/gh/yushangdi/8/head 2025-12-04T08:53:09.1974827Z * [new branch] gh/yushangdi/8/orig -> origin/gh/yushangdi/8/orig 2025-12-04T08:53:09.1974895Z * [new branch] gh/yushangdi/9/base -> origin/gh/yushangdi/9/base 2025-12-04T08:53:09.1974964Z * [new branch] gh/yushangdi/9/head -> origin/gh/yushangdi/9/head 2025-12-04T08:53:09.1975034Z * [new branch] gh/yushangdi/9/orig -> origin/gh/yushangdi/9/orig 2025-12-04T08:53:09.1975101Z * [new branch] gh/zklaus/19/base -> origin/gh/zklaus/19/base 2025-12-04T08:53:09.1975169Z * [new branch] gh/zklaus/19/head -> origin/gh/zklaus/19/head 2025-12-04T08:53:09.1975237Z * [new branch] gh/zklaus/19/orig -> origin/gh/zklaus/19/orig 2025-12-04T08:53:09.1975304Z * [new branch] gh/zklaus/20/base -> origin/gh/zklaus/20/base 2025-12-04T08:53:09.1975370Z * [new branch] gh/zklaus/20/head -> origin/gh/zklaus/20/head 2025-12-04T08:53:09.1975436Z * [new branch] gh/zklaus/20/orig -> origin/gh/zklaus/20/orig 2025-12-04T08:53:09.1975501Z * [new branch] gh/zklaus/21/base -> origin/gh/zklaus/21/base 2025-12-04T08:53:09.1975566Z * [new branch] gh/zklaus/21/head -> origin/gh/zklaus/21/head 2025-12-04T08:53:09.1975632Z * [new branch] gh/zklaus/21/orig -> origin/gh/zklaus/21/orig 2025-12-04T08:53:09.1975697Z * [new branch] gh/zklaus/22/base -> origin/gh/zklaus/22/base 2025-12-04T08:53:09.1975765Z * [new branch] gh/zklaus/22/head -> origin/gh/zklaus/22/head 2025-12-04T08:53:09.1975857Z * [new branch] gh/zklaus/22/orig -> origin/gh/zklaus/22/orig 2025-12-04T08:53:09.1975961Z * [new branch] gh/zklaus/23/base -> origin/gh/zklaus/23/base 2025-12-04T08:53:09.1976028Z * [new branch] gh/zklaus/23/head -> origin/gh/zklaus/23/head 2025-12-04T08:53:09.1976096Z * [new branch] gh/zklaus/23/orig -> origin/gh/zklaus/23/orig 2025-12-04T08:53:09.1976161Z * [new branch] gh/zklaus/24/base -> origin/gh/zklaus/24/base 2025-12-04T08:53:09.1976229Z * [new branch] gh/zklaus/24/head -> origin/gh/zklaus/24/head 2025-12-04T08:53:09.1976294Z * [new branch] gh/zklaus/24/orig -> origin/gh/zklaus/24/orig 2025-12-04T08:53:09.1976364Z * [new branch] gh/zou3519/1197/base -> origin/gh/zou3519/1197/base 2025-12-04T08:53:09.1976434Z * [new branch] gh/zou3519/1197/head -> origin/gh/zou3519/1197/head 2025-12-04T08:53:09.1976505Z * [new branch] gh/zou3519/1197/orig -> origin/gh/zou3519/1197/orig 2025-12-04T08:53:09.1976574Z * [new branch] gh/zou3519/1199/base -> origin/gh/zou3519/1199/base 2025-12-04T08:53:09.1976643Z * [new branch] gh/zou3519/1199/head -> origin/gh/zou3519/1199/head 2025-12-04T08:53:09.1976711Z * [new branch] gh/zou3519/1199/orig -> origin/gh/zou3519/1199/orig 2025-12-04T08:53:09.1976777Z * [new branch] gh/zou3519/1200/base -> origin/gh/zou3519/1200/base 2025-12-04T08:53:09.1976844Z * [new branch] gh/zou3519/1200/head -> origin/gh/zou3519/1200/head 2025-12-04T08:53:09.1976911Z * [new branch] gh/zou3519/1200/orig -> origin/gh/zou3519/1200/orig 2025-12-04T08:53:09.1976978Z * [new branch] gh/zou3519/1201/base -> origin/gh/zou3519/1201/base 2025-12-04T08:53:09.1977045Z * [new branch] gh/zou3519/1201/head -> origin/gh/zou3519/1201/head 2025-12-04T08:53:09.1977113Z * [new branch] gh/zou3519/1201/orig -> origin/gh/zou3519/1201/orig 2025-12-04T08:53:09.1977182Z * [new branch] gh/zou3519/1202/base -> origin/gh/zou3519/1202/base 2025-12-04T08:53:09.1977250Z * [new branch] gh/zou3519/1202/head -> origin/gh/zou3519/1202/head 2025-12-04T08:53:09.1977318Z * [new branch] gh/zou3519/1202/orig -> origin/gh/zou3519/1202/orig 2025-12-04T08:53:09.1977390Z * [new branch] gh/zpcore/1/base -> origin/gh/zpcore/1/base 2025-12-04T08:53:09.1977457Z * [new branch] gh/zpcore/1/head -> origin/gh/zpcore/1/head 2025-12-04T08:53:09.1977524Z * [new branch] gh/zpcore/11/base -> origin/gh/zpcore/11/base 2025-12-04T08:53:09.1977591Z * [new branch] gh/zpcore/11/head -> origin/gh/zpcore/11/head 2025-12-04T08:53:09.1977657Z * [new branch] gh/zpcore/11/orig -> origin/gh/zpcore/11/orig 2025-12-04T08:53:09.1977725Z * [new branch] gh/zpcore/12/base -> origin/gh/zpcore/12/base 2025-12-04T08:53:09.1977792Z * [new branch] gh/zpcore/12/head -> origin/gh/zpcore/12/head 2025-12-04T08:53:09.1977857Z * [new branch] gh/zpcore/12/orig -> origin/gh/zpcore/12/orig 2025-12-04T08:53:09.1977922Z * [new branch] gh/zpcore/13/base -> origin/gh/zpcore/13/base 2025-12-04T08:53:09.1977989Z * [new branch] gh/zpcore/13/head -> origin/gh/zpcore/13/head 2025-12-04T08:53:09.1978055Z * [new branch] gh/zpcore/13/orig -> origin/gh/zpcore/13/orig 2025-12-04T08:53:09.1978120Z * [new branch] gh/zpcore/14/base -> origin/gh/zpcore/14/base 2025-12-04T08:53:09.1978187Z * [new branch] gh/zpcore/14/head -> origin/gh/zpcore/14/head 2025-12-04T08:53:09.1978253Z * [new branch] gh/zpcore/14/orig -> origin/gh/zpcore/14/orig 2025-12-04T08:53:09.1978346Z * [new branch] gh/zpcore/15/base -> origin/gh/zpcore/15/base 2025-12-04T08:53:09.1978438Z * [new branch] gh/zpcore/15/head -> origin/gh/zpcore/15/head 2025-12-04T08:53:09.1978504Z * [new branch] gh/zpcore/15/orig -> origin/gh/zpcore/15/orig 2025-12-04T08:53:09.1978570Z * [new branch] gh/zpcore/2/base -> origin/gh/zpcore/2/base 2025-12-04T08:53:09.1978638Z * [new branch] gh/zpcore/2/head -> origin/gh/zpcore/2/head 2025-12-04T08:53:09.1978705Z * [new branch] gh/zpcore/21/base -> origin/gh/zpcore/21/base 2025-12-04T08:53:09.1978770Z * [new branch] gh/zpcore/21/head -> origin/gh/zpcore/21/head 2025-12-04T08:53:09.1978838Z * [new branch] gh/zpcore/21/orig -> origin/gh/zpcore/21/orig 2025-12-04T08:53:09.1978904Z * [new branch] gh/zpcore/22/base -> origin/gh/zpcore/22/base 2025-12-04T08:53:09.1978973Z * [new branch] gh/zpcore/22/head -> origin/gh/zpcore/22/head 2025-12-04T08:53:09.1979040Z * [new branch] gh/zpcore/22/orig -> origin/gh/zpcore/22/orig 2025-12-04T08:53:09.1979106Z * [new branch] gh/zpcore/23/base -> origin/gh/zpcore/23/base 2025-12-04T08:53:09.1979173Z * [new branch] gh/zpcore/23/head -> origin/gh/zpcore/23/head 2025-12-04T08:53:09.1979239Z * [new branch] gh/zpcore/23/orig -> origin/gh/zpcore/23/orig 2025-12-04T08:53:09.1979303Z * [new branch] gh/zpcore/24/base -> origin/gh/zpcore/24/base 2025-12-04T08:53:09.1979369Z * [new branch] gh/zpcore/24/head -> origin/gh/zpcore/24/head 2025-12-04T08:53:09.1979435Z * [new branch] gh/zpcore/24/orig -> origin/gh/zpcore/24/orig 2025-12-04T08:53:09.1979500Z * [new branch] gh/zpcore/25/base -> origin/gh/zpcore/25/base 2025-12-04T08:53:09.1979568Z * [new branch] gh/zpcore/25/head -> origin/gh/zpcore/25/head 2025-12-04T08:53:09.1979634Z * [new branch] gh/zpcore/25/orig -> origin/gh/zpcore/25/orig 2025-12-04T08:53:09.1979700Z * [new branch] gh/zpcore/26/base -> origin/gh/zpcore/26/base 2025-12-04T08:53:09.1979768Z * [new branch] gh/zpcore/26/head -> origin/gh/zpcore/26/head 2025-12-04T08:53:09.1979833Z * [new branch] gh/zpcore/26/orig -> origin/gh/zpcore/26/orig 2025-12-04T08:53:09.1979898Z * [new branch] gh/zpcore/27/base -> origin/gh/zpcore/27/base 2025-12-04T08:53:09.1979966Z * [new branch] gh/zpcore/27/head -> origin/gh/zpcore/27/head 2025-12-04T08:53:09.1980031Z * [new branch] gh/zpcore/27/orig -> origin/gh/zpcore/27/orig 2025-12-04T08:53:09.1980097Z * [new branch] gh/zpcore/28/base -> origin/gh/zpcore/28/base 2025-12-04T08:53:09.1980166Z * [new branch] gh/zpcore/28/head -> origin/gh/zpcore/28/head 2025-12-04T08:53:09.1980231Z * [new branch] gh/zpcore/28/orig -> origin/gh/zpcore/28/orig 2025-12-04T08:53:09.1980298Z * [new branch] gh/zpcore/3/base -> origin/gh/zpcore/3/base 2025-12-04T08:53:09.1980366Z * [new branch] gh/zpcore/3/head -> origin/gh/zpcore/3/head 2025-12-04T08:53:09.1980432Z * [new branch] gh/zpcore/4/base -> origin/gh/zpcore/4/base 2025-12-04T08:53:09.1980498Z * [new branch] gh/zpcore/4/head -> origin/gh/zpcore/4/head 2025-12-04T08:53:09.1980564Z * [new branch] gh/zpcore/5/base -> origin/gh/zpcore/5/base 2025-12-04T08:53:09.1980629Z * [new branch] gh/zpcore/5/head -> origin/gh/zpcore/5/head 2025-12-04T08:53:09.1980695Z * [new branch] gh/zpcore/6/base -> origin/gh/zpcore/6/base 2025-12-04T08:53:09.1980785Z * [new branch] gh/zpcore/6/head -> origin/gh/zpcore/6/head 2025-12-04T08:53:09.1980851Z * [new branch] gh/zpcore/7/base -> origin/gh/zpcore/7/base 2025-12-04T08:53:09.1980943Z * [new branch] gh/zpcore/7/head -> origin/gh/zpcore/7/head 2025-12-04T08:53:09.1981010Z * [new branch] gh/zpcore/8/base -> origin/gh/zpcore/8/base 2025-12-04T08:53:09.1981075Z * [new branch] gh/zpcore/8/head -> origin/gh/zpcore/8/head 2025-12-04T08:53:09.1981145Z * [new branch] google-main -> origin/google-main 2025-12-04T08:53:09.1981230Z * [new branch] guangyey/external_stream -> origin/guangyey/external_stream 2025-12-04T08:53:09.1981301Z * [new branch] guangyey/test_2025 -> origin/guangyey/test_2025 2025-12-04T08:53:09.1981443Z * [new branch] guilhermeleobas/cherry-pick-55d87d9dfd9 -> origin/guilhermeleobas/cherry-pick-55d87d9dfd9 2025-12-04T08:53:09.1981561Z * [new branch] hameerabbasi/complex_tensor_subclass -> origin/hameerabbasi/complex_tensor_subclass 2025-12-04T08:53:09.1981703Z * [new branch] hameerabbasi/fix-ctensor-gradcheck-tests -> origin/hameerabbasi/fix-ctensor-gradcheck-tests 2025-12-04T08:53:09.1981812Z * [new branch] hameerabbasi/gradcheck-allclose -> origin/hameerabbasi/gradcheck-allclose 2025-12-04T08:53:09.1981877Z * [new branch] hc_baseline -> origin/hc_baseline 2025-12-04T08:53:09.1981939Z * [new branch] hhh_rand -> origin/hhh_rand 2025-12-04T08:53:09.1982002Z * [new branch] huba/f1 -> origin/huba/f1 2025-12-04T08:53:09.1982188Z * [new branch] increase-timeout-linux-jammy-cuda12_8-py3_10-gcc11-test -> origin/increase-timeout-linux-jammy-cuda12_8-py3_10-gcc11-test 2025-12-04T08:53:09.1982250Z * [new branch] inlining -> origin/inlining 2025-12-04T08:53:09.1982323Z * [new branch] inlining-ezyang -> origin/inlining-ezyang 2025-12-04T08:53:09.1982405Z * [new branch] install-torchao-0.13.0 -> origin/install-torchao-0.13.0 2025-12-04T08:53:09.1982585Z * [new branch] instrument-trunk-pull-linux-with-job-test-filters -> origin/instrument-trunk-pull-linux-with-job-test-filters 2025-12-04T08:53:09.1982656Z * [new branch] invoke-subgraph -> origin/invoke-subgraph 2025-12-04T08:53:09.1982721Z * [new branch] issue#58739 -> origin/issue#58739 2025-12-04T08:53:09.1982803Z * [new branch] jainapurva-patch-1 -> origin/jainapurva-patch-1 2025-12-04T08:53:09.1982863Z * [new branch] jathu/o3 -> origin/jathu/o3 2025-12-04T08:53:09.1982924Z * [new branch] jathu/sve -> origin/jathu/sve 2025-12-04T08:53:09.1983088Z * [new branch] jcaip/test-cusparselt-version-0.6.2 -> origin/jcaip/test-cusparselt-version-0.6.2 2025-12-04T08:53:09.1983193Z * [new branch] jcaip/update-cusparselt-0.6.2 -> origin/jcaip/update-cusparselt-0.6.2 2025-12-04T08:53:09.1983305Z * [new branch] jiannanWang/memorysnapshot_filter -> origin/jiannanWang/memorysnapshot_filter 2025-12-04T08:53:09.1983416Z * [new branch] jiannanWang/profilerstepwarning -> origin/jiannanWang/profilerstepwarning 2025-12-04T08:53:09.1983501Z * [new branch] jithunnair-amd-patch-1 -> origin/jithunnair-amd-patch-1 2025-12-04T08:53:09.1983585Z * [new branch] jithunnair-amd-patch-10 -> origin/jithunnair-amd-patch-10 2025-12-04T08:53:09.1983666Z * [new branch] jithunnair-amd-patch-2 -> origin/jithunnair-amd-patch-2 2025-12-04T08:53:09.1983745Z * [new branch] jithunnair-amd-patch-3 -> origin/jithunnair-amd-patch-3 2025-12-04T08:53:09.1983825Z * [new branch] jithunnair-amd-patch-4 -> origin/jithunnair-amd-patch-4 2025-12-04T08:53:09.1983950Z * [new branch] jithunnair-amd-patch-5 -> origin/jithunnair-amd-patch-5 2025-12-04T08:53:09.1984062Z * [new branch] jithunnair-amd-patch-6 -> origin/jithunnair-amd-patch-6 2025-12-04T08:53:09.1984141Z * [new branch] jithunnair-amd-patch-7 -> origin/jithunnair-amd-patch-7 2025-12-04T08:53:09.1984218Z * [new branch] jithunnair-amd-patch-8 -> origin/jithunnair-amd-patch-8 2025-12-04T08:53:09.1984300Z * [new branch] jithunnair-amd-patch-9 -> origin/jithunnair-amd-patch-9 2025-12-04T08:53:09.1984381Z * [new branch] justinchu/native-qdq -> origin/justinchu/native-qdq 2025-12-04T08:53:09.1984455Z * [new branch] kainan666/xlf_debug -> origin/kainan666/xlf_debug 2025-12-04T08:53:09.1984519Z * [new branch] kainan_test -> origin/kainan_test 2025-12-04T08:53:09.1984597Z * [new branch] larryliu0820-patch-1 -> origin/larryliu0820-patch-1 2025-12-04T08:53:09.1984706Z * [new branch] leslie/test_group_gemm_epilogues -> origin/leslie/test_group_gemm_epilogues 2025-12-04T08:53:09.1984813Z * [new branch] lessw2020/fix_cutlass_cache_error -> origin/lessw2020/fix_cutlass_cache_error 2025-12-04T08:53:09.1984894Z * [new branch] liaoxuan/shm_all_reduce -> origin/liaoxuan/shm_all_reduce 2025-12-04T08:53:09.1984995Z * [new branch] liaoxuan/test_fa_disable_softmax -> origin/liaoxuan/test_fa_disable_softmax 2025-12-04T08:53:09.1985074Z * [new branch] liaoxuan/test_int8_sdpa -> origin/liaoxuan/test_int8_sdpa 2025-12-04T08:53:09.1985146Z * [new branch] llama4-stable -> origin/llama4-stable 2025-12-04T08:53:09.1985213Z * [new branch] lts/release/1.8 -> origin/lts/release/1.8 2025-12-04T08:53:09.1985286Z * [new branch] lucaskabela/#94773 -> origin/lucaskabela/#94773 2025-12-04T08:53:09.1985367Z * [new branch] lucaskabela/fix_164876 -> origin/lucaskabela/fix_164876 2025-12-04T08:53:09.1985448Z * [new branch] lucaskabela/flop_counter -> origin/lucaskabela/flop_counter 2025-12-04T08:53:09.1985548Z * [new branch] lucaskabela/func_under_decomp -> origin/lucaskabela/func_under_decomp 2025-12-04T08:53:09.1985654Z * [new branch] lucaskabela/functional_in_dynamo -> origin/lucaskabela/functional_in_dynamo 2025-12-04T08:53:09.1985781Z * [new branch] lucaskabela/install_params_as_graph_attr -> origin/lucaskabela/install_params_as_graph_attr 2025-12-04T08:53:09.1985895Z * [new branch] lucaskabela/parameters_as_graph_attr -> origin/lucaskabela/parameters_as_graph_attr 2025-12-04T08:53:09.1986026Z * [new branch] lucaskabela/remove_aot_dispatcher_metadata -> origin/lucaskabela/remove_aot_dispatcher_metadata 2025-12-04T08:53:09.1986106Z * [new branch] lucaskabela/rnn_decomp -> origin/lucaskabela/rnn_decomp 2025-12-04T08:53:09.1986201Z * [new branch] lucaskabela/typing_backends -> origin/lucaskabela/typing_backends 2025-12-04T08:53:09.1986301Z * [new branch] lucaskabela/typing_ctx_manager -> origin/lucaskabela/typing_ctx_manager 2025-12-04T08:53:09.1986395Z * [new branch] lucaskabela/typing_nn_module -> origin/lucaskabela/typing_nn_module 2025-12-04T08:53:09.1986496Z * [new branch] lucaskabela/typing_user_defined -> origin/lucaskabela/typing_user_defined 2025-12-04T08:53:09.1986590Z * [new branch] lucaskabela/typing_variables -> origin/lucaskabela/typing_variables 2025-12-04T08:53:09.1986698Z * [new branch] lucaskabela/typing_variables_dicts -> origin/lucaskabela/typing_variables_dicts 2025-12-04T08:53:09.1986820Z * [new branch] lucaskabela/typing_variables_functions -> origin/lucaskabela/typing_variables_functions 2025-12-04T08:53:09.1986929Z * [new branch] lucaskabela/typing_variables_lists -> origin/lucaskabela/typing_variables_lists 2025-12-04T08:53:09.1987030Z * [new branch] lw/torch_box_by_ref -> origin/lw/torch_box_by_ref 2025-12-04T08:53:09.1987129Z * [new branch] main -> origin/main 2025-12-04T08:53:09.1987201Z * [new branch] malfet-patch-1 -> origin/malfet-patch-1 2025-12-04T08:53:09.1987272Z * [new branch] malfet-patch-2 -> origin/malfet-patch-2 2025-12-04T08:53:09.1987339Z * [new branch] malfet-patch-3 -> origin/malfet-patch-3 2025-12-04T08:53:09.1987404Z * [new branch] malfet-patch-4 -> origin/malfet-patch-4 2025-12-04T08:53:09.1987471Z * [new branch] malfet-patch-5 -> origin/malfet-patch-5 2025-12-04T08:53:09.1987535Z * [new branch] malfet-patch-6 -> origin/malfet-patch-6 2025-12-04T08:53:09.1987600Z * [new branch] malfet-patch-7 -> origin/malfet-patch-7 2025-12-04T08:53:09.1987669Z * [new branch] malfet-patch-8 -> origin/malfet-patch-8 2025-12-04T08:53:09.1987744Z * [new branch] malfet/add-3.14-ci -> origin/malfet/add-3.14-ci 2025-12-04T08:53:09.1987904Z * [new branch] malfet/be-do-not-make-typos-in-build-artifacts -> origin/malfet/be-do-not-make-typos-in-build-artifacts 2025-12-04T08:53:09.1988072Z * [new branch] malfet/be-move-more-settings-to-checkout-pytorch -> origin/malfet/be-move-more-settings-to-checkout-pytorch 2025-12-04T08:53:09.1988197Z * [new branch] malfet/be-remove-misisng-neon-headers -> origin/malfet/be-remove-misisng-neon-headers 2025-12-04T08:53:09.1988294Z * [new branch] malfet/mps-implement-col2im -> origin/malfet/mps-implement-col2im 2025-12-04T08:53:09.1988411Z * [new branch] manuel/aoti_metal_shimify-thread_safe -> origin/manuel/aoti_metal_shimify-thread_safe 2025-12-04T08:53:09.1988503Z * [new branch] manuel/inductor_link_openmp -> origin/manuel/inductor_link_openmp 2025-12-04T08:53:09.1988580Z * [new branch] masnesral/metaconda -> origin/masnesral/metaconda 2025-12-04T08:53:09.1988657Z * [new branch] mem_profiler_flaky_fix -> origin/mem_profiler_flaky_fix 2025-12-04T08:53:09.1988736Z * [new branch] mem_profiler_stack_trace -> origin/mem_profiler_stack_trace 2025-12-04T08:53:09.1988813Z * [new branch] memory_profiler_stack -> origin/memory_profiler_stack 2025-12-04T08:53:09.1988887Z * [new branch] metascroy-patch-1 -> origin/metascroy-patch-1 2025-12-04T08:53:09.1988952Z * [new branch] mingw_posix -> origin/mingw_posix 2025-12-04T08:53:09.1989027Z * [new branch] mlazos/S429861-debug -> origin/mlazos/S429861-debug 2025-12-04T08:53:09.1989089Z * [new branch] mlazos/aa -> origin/mlazos/aa 2025-12-04T08:53:09.1989152Z * [new branch] mlazos/acts -> origin/mlazos/acts 2025-12-04T08:53:09.1989224Z * [new branch] mlazos/arg-renames -> origin/mlazos/arg-renames 2025-12-04T08:53:09.1989303Z * [new branch] mlazos/bad-cudagraphs -> origin/mlazos/bad-cudagraphs 2025-12-04T08:53:09.1989403Z * [new branch] mlazos/baseline-graph-breaks -> origin/mlazos/baseline-graph-breaks 2025-12-04T08:53:09.1989479Z * [new branch] mlazos/beta-tensor -> origin/mlazos/beta-tensor 2025-12-04T08:53:09.1989545Z * [new branch] mlazos/buffers -> origin/mlazos/buffers 2025-12-04T08:53:09.1989610Z * [new branch] mlazos/buffers2 -> origin/mlazos/buffers2 2025-12-04T08:53:09.1989678Z * [new branch] mlazos/buffers3 -> origin/mlazos/buffers3 2025-12-04T08:53:09.1989740Z * [new branch] mlazos/bwd -> origin/mlazos/bwd 2025-12-04T08:53:09.1989839Z * [new branch] mlazos/combo-test -> origin/mlazos/combo-test 2025-12-04T08:53:09.1989911Z * [new branch] mlazos/ctx-cleanup -> origin/mlazos/ctx-cleanup 2025-12-04T08:53:09.1990010Z * [new branch] mlazos/cuda-cmd-log -> origin/mlazos/cuda-cmd-log 2025-12-04T08:53:09.1990091Z * [new branch] mlazos/cudagraph-tests -> origin/mlazos/cudagraph-tests 2025-12-04T08:53:09.1990193Z * [new branch] mlazos/cudagraphs-measurement -> origin/mlazos/cudagraphs-measurement 2025-12-04T08:53:09.1990266Z * [new branch] mlazos/cutlass-test -> origin/mlazos/cutlass-test 2025-12-04T08:53:09.1990351Z * [new branch] mlazos/cutlass-topo-bug -> origin/mlazos/cutlass-topo-bug 2025-12-04T08:53:09.1990429Z * [new branch] mlazos/dataclass-proxy -> origin/mlazos/dataclass-proxy 2025-12-04T08:53:09.1990495Z * [new branch] mlazos/dc-attrs -> origin/mlazos/dc-attrs 2025-12-04T08:53:09.1990566Z * [new branch] mlazos/dc-helion -> origin/mlazos/dc-helion 2025-12-04T08:53:09.1990632Z * [new branch] mlazos/dict-fix -> origin/mlazos/dict-fix 2025-12-04T08:53:09.1990703Z * [new branch] mlazos/disable-tf -> origin/mlazos/disable-tf 2025-12-04T08:53:09.1990772Z * [new branch] mlazos/dupe-fix -> origin/mlazos/dupe-fix 2025-12-04T08:53:09.1990840Z * [new branch] mlazos/dyn-batch -> origin/mlazos/dyn-batch 2025-12-04T08:53:09.1990901Z * [new branch] mlazos/evt -> origin/mlazos/evt 2025-12-04T08:53:09.1990984Z * [new branch] mlazos/extract-examples -> origin/mlazos/extract-examples 2025-12-04T08:53:09.1991053Z * [new branch] mlazos/foreach-op -> origin/mlazos/foreach-op 2025-12-04T08:53:09.1991115Z * [new branch] mlazos/fp8 -> origin/mlazos/fp8 2025-12-04T08:53:09.1991182Z * [new branch] mlazos/fp8-bias -> origin/mlazos/fp8-bias 2025-12-04T08:53:09.1991261Z * [new branch] mlazos/fp8-bias-fusion -> origin/mlazos/fp8-bias-fusion 2025-12-04T08:53:09.1991331Z * [new branch] mlazos/fp8-fixes -> origin/mlazos/fp8-fixes 2025-12-04T08:53:09.1991397Z * [new branch] mlazos/freezing -> origin/mlazos/freezing 2025-12-04T08:53:09.1991463Z * [new branch] mlazos/h-comp -> origin/mlazos/h-comp 2025-12-04T08:53:09.1991529Z * [new branch] mlazos/h-comp2 -> origin/mlazos/h-comp2 2025-12-04T08:53:09.1991596Z * [new branch] mlazos/hash-hop -> origin/mlazos/hash-hop 2025-12-04T08:53:09.1991657Z * [new branch] mlazos/hc -> origin/mlazos/hc 2025-12-04T08:53:09.1991725Z * [new branch] mlazos/hc-cycles -> origin/mlazos/hc-cycles 2025-12-04T08:53:09.1991792Z * [new branch] mlazos/hc-fixes -> origin/mlazos/hc-fixes 2025-12-04T08:53:09.1991861Z * [new branch] mlazos/hc-fixes3 -> origin/mlazos/hc-fixes3 2025-12-04T08:53:09.1991929Z * [new branch] mlazos/hc-fixes4 -> origin/mlazos/hc-fixes4 2025-12-04T08:53:09.1991994Z * [new branch] mlazos/hc-hf -> origin/mlazos/hc-hf 2025-12-04T08:53:09.1992059Z * [new branch] mlazos/hc-mut -> origin/mlazos/hc-mut 2025-12-04T08:53:09.1992122Z * [new branch] mlazos/hc10 -> origin/mlazos/hc10 2025-12-04T08:53:09.1992183Z * [new branch] mlazos/hc11 -> origin/mlazos/hc11 2025-12-04T08:53:09.1992244Z * [new branch] mlazos/hc12 -> origin/mlazos/hc12 2025-12-04T08:53:09.1992305Z * [new branch] mlazos/hc13 -> origin/mlazos/hc13 2025-12-04T08:53:09.1992365Z * [new branch] mlazos/hc14 -> origin/mlazos/hc14 2025-12-04T08:53:09.1992452Z * [new branch] mlazos/hc15 -> origin/mlazos/hc15 2025-12-04T08:53:09.1992514Z * [new branch] mlazos/hc2 -> origin/mlazos/hc2 2025-12-04T08:53:09.1992603Z * [new branch] mlazos/hc4 -> origin/mlazos/hc4 2025-12-04T08:53:09.1992664Z * [new branch] mlazos/hc5 -> origin/mlazos/hc5 2025-12-04T08:53:09.1992725Z * [new branch] mlazos/hc6 -> origin/mlazos/hc6 2025-12-04T08:53:09.1992784Z * [new branch] mlazos/hc7 -> origin/mlazos/hc7 2025-12-04T08:53:09.1992842Z * [new branch] mlazos/hc8 -> origin/mlazos/hc8 2025-12-04T08:53:09.1992901Z * [new branch] mlazos/hc9 -> origin/mlazos/hc9 2025-12-04T08:53:09.1993018Z * [new branch] mlazos/hc_baseline2 -> origin/mlazos/hc_baseline2 2025-12-04T08:53:09.1993101Z * [new branch] mlazos/inductor-streams -> origin/mlazos/inductor-streams 2025-12-04T08:53:09.1993167Z * [new branch] mlazos/main -> origin/mlazos/main 2025-12-04T08:53:09.1993228Z * [new branch] mlazos/mcg2 -> origin/mlazos/mcg2 2025-12-04T08:53:09.1993302Z * [new branch] mlazos/meta-guards -> origin/mlazos/meta-guards 2025-12-04T08:53:09.1993405Z * [new branch] mlazos/mlazos/foreach-map-adam -> origin/mlazos/mlazos/foreach-map-adam 2025-12-04T08:53:09.1993501Z * [new branch] mlazos/mlazos/tf-mode-backup -> origin/mlazos/mlazos/tf-mode-backup 2025-12-04T08:53:09.1993569Z * [new branch] mlazos/mod-fix -> origin/mlazos/mod-fix 2025-12-04T08:53:09.1993636Z * [new branch] mlazos/mode-fix -> origin/mlazos/mode-fix 2025-12-04T08:53:09.1993701Z * [new branch] mlazos/offsets -> origin/mlazos/offsets 2025-12-04T08:53:09.1993774Z * [new branch] mlazos/overguarding -> origin/mlazos/overguarding 2025-12-04T08:53:09.1993850Z * [new branch] mlazos/proxy-ctors -> origin/mlazos/proxy-ctors 2025-12-04T08:53:09.1993919Z * [new branch] mlazos/quant-fix -> origin/mlazos/quant-fix 2025-12-04T08:53:09.1993992Z * [new branch] mlazos/resnet-fix -> origin/mlazos/resnet-fix 2025-12-04T08:53:09.1994066Z * [new branch] mlazos/rm-buf-names -> origin/mlazos/rm-buf-names 2025-12-04T08:53:09.1994131Z * [new branch] mlazos/rm-code -> origin/mlazos/rm-code 2025-12-04T08:53:09.1994199Z * [new branch] mlazos/rm-spam -> origin/mlazos/rm-spam 2025-12-04T08:53:09.1994261Z * [new branch] mlazos/rtp -> origin/mlazos/rtp 2025-12-04T08:53:09.1994338Z * [new branch] mlazos/static-idx-dbg -> origin/mlazos/static-idx-dbg 2025-12-04T08:53:09.1994426Z * [new branch] mlazos/static-inputs-log -> origin/mlazos/static-inputs-log 2025-12-04T08:53:09.1994491Z * [new branch] mlazos/stests -> origin/mlazos/stests 2025-12-04T08:53:09.1994561Z * [new branch] mlazos/stream-ops -> origin/mlazos/stream-ops 2025-12-04T08:53:09.1994630Z * [new branch] mlazos/td-fix2 -> origin/mlazos/td-fix2 2025-12-04T08:53:09.1994708Z * [new branch] mlazos/tensor-hasattr2 -> origin/mlazos/tensor-hasattr2 2025-12-04T08:53:09.1994769Z * [new branch] mlazos/test -> origin/mlazos/test 2025-12-04T08:53:09.1994838Z * [new branch] mlazos/tf-mode -> origin/mlazos/tf-mode 2025-12-04T08:53:09.1994915Z * [new branch] mlazos/tf-mode-backup2 -> origin/mlazos/tf-mode-backup2 2025-12-04T08:53:09.1994992Z * [new branch] mlazos/tf-mode-reland -> origin/mlazos/tf-mode-reland 2025-12-04T08:53:09.1995073Z * [new branch] mlazos/tf-mode-reland2 -> origin/mlazos/tf-mode-reland2 2025-12-04T08:53:09.1995190Z * [new branch] mlazos/tf-mode-reland3 -> origin/mlazos/tf-mode-reland3 2025-12-04T08:53:09.1995266Z * [new branch] mlazos/triton-no-epi -> origin/mlazos/triton-no-epi 2025-12-04T08:53:09.1995379Z * [new branch] mlazos/tune-proto -> origin/mlazos/tune-proto 2025-12-04T08:53:09.1995454Z * [new branch] mlazos/tuple-fixes -> origin/mlazos/tuple-fixes 2025-12-04T08:53:09.1995526Z * [new branch] mlazos/tuple-fixes2 -> origin/mlazos/tuple-fixes2 2025-12-04T08:53:09.1995604Z * [new branch] mlazos/tuple-handling -> origin/mlazos/tuple-handling 2025-12-04T08:53:09.1995684Z * [new branch] mlazos/user-stream-base -> origin/mlazos/user-stream-base 2025-12-04T08:53:09.1995758Z * [new branch] mlazos/user-streams -> origin/mlazos/user-streams 2025-12-04T08:53:09.1995849Z * [new branch] mlazos/user-streams-backup -> origin/mlazos/user-streams-backup 2025-12-04T08:53:09.1995943Z * [new branch] mlazos/user-streams-backup2 -> origin/mlazos/user-streams-backup2 2025-12-04T08:53:09.1996014Z * [new branch] mlazos/vary-beta -> origin/mlazos/vary-beta 2025-12-04T08:53:09.1996084Z * [new branch] mlazos/vary-beta2 -> origin/mlazos/vary-beta2 2025-12-04T08:53:09.1996155Z * [new branch] mlazos/weird-perf1 -> origin/mlazos/weird-perf1 2025-12-04T08:53:09.1996229Z * [new branch] mm_out_dtype_compile -> origin/mm_out_dtype_compile 2025-12-04T08:53:09.1996292Z * [new branch] module-shim -> origin/module-shim 2025-12-04T08:53:09.1996354Z * [new branch] move_config -> origin/move_config 2025-12-04T08:53:09.1996423Z * [new branch] msaroufim/reduce -> origin/msaroufim/reduce 2025-12-04T08:53:09.1996491Z * [new branch] mtia/basic-cmake -> origin/mtia/basic-cmake 2025-12-04T08:53:09.1996593Z * [new branch] mwizak/fix-triton-block-shape -> origin/mwizak/fix-triton-block-shape 2025-12-04T08:53:09.1996662Z * [new branch] my_varlen_backup -> origin/my_varlen_backup 2025-12-04T08:53:09.1996736Z * [new branch] nativert_num_outputs -> origin/nativert_num_outputs 2025-12-04T08:53:09.1996799Z * [new branch] new-codegen -> origin/new-codegen 2025-12-04T08:53:09.1996866Z * [new branch] newtest-base -> origin/newtest-base 2025-12-04T08:53:09.1996937Z * [new branch] ngimel/addmm_dtype -> origin/ngimel/addmm_dtype 2025-12-04T08:53:09.1997001Z * [new branch] ngimel/div_inv -> origin/ngimel/div_inv 2025-12-04T08:53:09.1997078Z * [new branch] ngimel/error_index_list -> origin/ngimel/error_index_list 2025-12-04T08:53:09.1997149Z * [new branch] ngimel/gather_grid -> origin/ngimel/gather_grid 2025-12-04T08:53:09.1997238Z * [new branch] ngimel/gather_grid_release -> origin/ngimel/gather_grid_release 2025-12-04T08:53:09.1997303Z * [new branch] ngimel/gg_new -> origin/ngimel/gg_new 2025-12-04T08:53:09.1997372Z * [new branch] ngimel/hostalloc -> origin/ngimel/hostalloc 2025-12-04T08:53:09.1997441Z * [new branch] ngimel/storage_id -> origin/ngimel/storage_id 2025-12-04T08:53:09.1997503Z * [new branch] nightly -> origin/nightly 2025-12-04T08:53:09.1997619Z * [new branch] nikitaved/addmm_1_rowcol_lt_path_check -> origin/nikitaved/addmm_1_rowcol_lt_path_check 2025-12-04T08:53:09.1997742Z * [new branch] nikitaved/addmm_epilogue_fusions_2d_bias -> origin/nikitaved/addmm_epilogue_fusions_2d_bias 2025-12-04T08:53:09.1997869Z * [new branch] nikitaved/addmm_epilogue_fusions_inductor -> origin/nikitaved/addmm_epilogue_fusions_inductor 2025-12-04T08:53:09.1998029Z * [new branch] nikitaved/addmm_epilogue_fusions_scratch -> origin/nikitaved/addmm_epilogue_fusions_scratch 2025-12-04T08:53:09.1998171Z * [new branch] nikitaved/grad_addmm_epilogue_fusions -> origin/nikitaved/grad_addmm_epilogue_fusions 2025-12-04T08:53:09.1998283Z * [new branch] nikitaved/simpler_can_use_32bit_index -> origin/nikitaved/simpler_can_use_32bit_index 2025-12-04T08:53:09.1998349Z * [new branch] nikitaved/test -> origin/nikitaved/test 2025-12-04T08:53:09.1998474Z * [new branch] nmacchioni-perf-test-async-autotune -> origin/nmacchioni-perf-test-async-autotune 2025-12-04T08:53:09.1998550Z * [new branch] no_distributed_log_spew -> origin/no_distributed_log_spew 2025-12-04T08:53:09.1998614Z * [new branch] nofun-hack -> origin/nofun-hack 2025-12-04T08:53:09.1998678Z * [new branch] norm_bench -> origin/norm_bench 2025-12-04T08:53:09.1998755Z * [new branch] nullplay/fuse_matmul -> origin/nullplay/fuse_matmul 2025-12-04T08:53:09.1998829Z * [new branch] nullplay_fuse_matmul -> origin/nullplay_fuse_matmul 2025-12-04T08:53:09.1998898Z * [new branch] optimizer_test -> origin/optimizer_test 2025-12-04T08:53:09.1998966Z * [new branch] orig/release/1.10 -> origin/orig/release/1.10 2025-12-04T08:53:09.1999035Z * [new branch] orig/release/1.11 -> origin/orig/release/1.11 2025-12-04T08:53:09.1999102Z * [new branch] orig/release/1.12 -> origin/orig/release/1.12 2025-12-04T08:53:09.1999168Z * [new branch] orig/release/1.13 -> origin/orig/release/1.13 2025-12-04T08:53:09.1999235Z * [new branch] orig/release/1.6 -> origin/orig/release/1.6 2025-12-04T08:53:09.1999301Z * [new branch] orig/release/1.7 -> origin/orig/release/1.7 2025-12-04T08:53:09.1999370Z * [new branch] orig/release/1.8 -> origin/orig/release/1.8 2025-12-04T08:53:09.1999436Z * [new branch] orig/release/1.9 -> origin/orig/release/1.9 2025-12-04T08:53:09.1999502Z * [new branch] orig/release/2.0 -> origin/orig/release/2.0 2025-12-04T08:53:09.1999566Z * [new branch] orig/release/2.1 -> origin/orig/release/2.1 2025-12-04T08:53:09.1999631Z * [new branch] orig/release/2.2 -> origin/orig/release/2.2 2025-12-04T08:53:09.1999695Z * [new branch] orig/release/2.3 -> origin/orig/release/2.3 2025-12-04T08:53:09.1999759Z * [new branch] orig/release/2.4 -> origin/orig/release/2.4 2025-12-04T08:53:09.1999824Z * [new branch] orig/release/2.5 -> origin/orig/release/2.5 2025-12-04T08:53:09.1999888Z * [new branch] orig/release/2.6 -> origin/orig/release/2.6 2025-12-04T08:53:09.1999952Z * [new branch] orig/release/2.7 -> origin/orig/release/2.7 2025-12-04T08:53:09.2000019Z * [new branch] orig/release/2.8 -> origin/orig/release/2.8 2025-12-04T08:53:09.2000083Z * [new branch] orig/release/2.9 -> origin/orig/release/2.9 2025-12-04T08:53:09.2000168Z * [new branch] origin/gh/fxdawnn/1/base -> origin/origin/gh/fxdawnn/1/base 2025-12-04T08:53:09.2000253Z * [new branch] origin/gh/fxdawnn/1/orig -> origin/origin/gh/fxdawnn/1/orig 2025-12-04T08:53:09.2000335Z * [new branch] origin/gh/zpcore/14/orig -> origin/origin/gh/zpcore/14/orig 2025-12-04T08:53:09.2000403Z * [new branch] oulgen-patch-1 -> origin/oulgen-patch-1 2025-12-04T08:53:09.2000471Z * [new branch] oulgen-patch-2 -> origin/oulgen-patch-2 2025-12-04T08:53:09.2000537Z * [new branch] oulgen-patch-3 -> origin/oulgen-patch-3 2025-12-04T08:53:09.2000603Z * [new branch] oulgen-patch-4 -> origin/oulgen-patch-4 2025-12-04T08:53:09.2000696Z * [new branch] padded-tensor -> origin/padded-tensor 2025-12-04T08:53:09.2000782Z * [new branch] pca2 -> origin/pca2 2025-12-04T08:53:09.2000858Z * [new branch] per_channel_backup -> origin/per_channel_backup 2025-12-04T08:53:09.2000921Z * [new branch] perf_ops -> origin/perf_ops 2025-12-04T08:53:09.2000984Z * [new branch] perf_ops_2_9 -> origin/perf_ops_2_9 2025-12-04T08:53:09.2001056Z * [new branch] pianpwk-patch-1 -> origin/pianpwk-patch-1 2025-12-04T08:53:09.2001142Z * [new branch] pianpwk/__draft_debug_mode -> origin/pianpwk/__draft_debug_mode 2025-12-04T08:53:09.2001251Z * [new branch] pianpwk/_debug_mode_for_triton_draft -> origin/pianpwk/_debug_mode_for_triton_draft 2025-12-04T08:53:09.2001354Z * [new branch] pianpwk/_debug_nn_module_compile -> origin/pianpwk/_debug_nn_module_compile 2025-12-04T08:53:09.2001442Z * [new branch] pianpwk/_draft_triton_11_3 -> origin/pianpwk/_draft_triton_11_3 2025-12-04T08:53:09.2001535Z * [new branch] pianpwk/_manual_bucket_draft -> origin/pianpwk/_manual_bucket_draft 2025-12-04T08:53:09.2001637Z * [new branch] pianpwk/_profile_w_dispatch_keys -> origin/pianpwk/_profile_w_dispatch_keys 2025-12-04T08:53:09.2001733Z * [new branch] pianpwk/_super_draft_debug_mode -> origin/pianpwk/_super_draft_debug_mode 2025-12-04T08:53:09.2001838Z * [new branch] pianpwk/_unbacked_local_shard_size -> origin/pianpwk/_unbacked_local_shard_size 2025-12-04T08:53:09.2001914Z * [new branch] pianpwk/anomaly_tb -> origin/pianpwk/anomaly_tb 2025-12-04T08:53:09.2001995Z * [new branch] pianpwk/auto_fx_annotate -> origin/pianpwk/auto_fx_annotate 2025-12-04T08:53:09.2002106Z * [new branch] pianpwk/backed_size_oblivious_export -> origin/pianpwk/backed_size_oblivious_export 2025-12-04T08:53:09.2002195Z * [new branch] pianpwk/bert_dynamic_perf -> origin/pianpwk/bert_dynamic_perf 2025-12-04T08:53:09.2002292Z * [new branch] pianpwk/debug_fwd_stack_traces -> origin/pianpwk/debug_fwd_stack_traces 2025-12-04T08:53:09.2002380Z * [new branch] pianpwk/debug_hash_tensor -> origin/pianpwk/debug_hash_tensor 2025-12-04T08:53:09.2002469Z * [new branch] pianpwk/debug_mode_annotate -> origin/pianpwk/debug_mode_annotate 2025-12-04T08:53:09.2002557Z * [new branch] pianpwk/debug_mode_defaults -> origin/pianpwk/debug_mode_defaults 2025-12-04T08:53:09.2002638Z * [new branch] pianpwk/debug_mode_hacks -> origin/pianpwk/debug_mode_hacks 2025-12-04T08:53:09.2002742Z * [new branch] pianpwk/debug_mode_opcall_refactor -> origin/pianpwk/debug_mode_opcall_refactor 2025-12-04T08:53:09.2002829Z * [new branch] pianpwk/debug_mode_show_ids -> origin/pianpwk/debug_mode_show_ids 2025-12-04T08:53:09.2002916Z * [new branch] pianpwk/debug_mode_triton -> origin/pianpwk/debug_mode_triton 2025-12-04T08:53:09.2003059Z * [new branch] pianpwk/debug_show_stack_trace -> origin/pianpwk/debug_show_stack_trace 2025-12-04T08:53:09.2003161Z * [new branch] pianpwk/debug_wait_on_collective -> origin/pianpwk/debug_wait_on_collective 2025-12-04T08:53:09.2003259Z * [new branch] pianpwk/debugmode_compile_tf -> origin/pianpwk/debugmode_compile_tf 2025-12-04T08:53:09.2003383Z * [new branch] pianpwk/dispatch_key_debugging_for_debug -> origin/pianpwk/dispatch_key_debugging_for_debug 2025-12-04T08:53:09.2003488Z * [new branch] pianpwk/draft_debug_mode_tfcompile -> origin/pianpwk/draft_debug_mode_tfcompile 2025-12-04T08:53:09.2003583Z * [new branch] pianpwk/draft_multikernel_nn -> origin/pianpwk/draft_multikernel_nn 2025-12-04T08:53:09.2003736Z * [new branch] pianpwk/draft_multikernel_status_10_5 -> origin/pianpwk/draft_multikernel_status_10_5 2025-12-04T08:53:09.2003861Z * [new branch] pianpwk/dtensor_custom_chunk -> origin/pianpwk/dtensor_custom_chunk 2025-12-04T08:53:09.2003964Z * [new branch] pianpwk/dtensor_unbacked_keypath -> origin/pianpwk/dtensor_unbacked_keypath 2025-12-04T08:53:09.2004043Z * [new branch] pianpwk/event_list_tree -> origin/pianpwk/event_list_tree 2025-12-04T08:53:09.2004124Z * [new branch] pianpwk/false_numel_refs -> origin/pianpwk/false_numel_refs 2025-12-04T08:53:09.2004201Z * [new branch] pianpwk/maybe_guard_rel -> origin/pianpwk/maybe_guard_rel 2025-12-04T08:53:09.2004305Z * [new branch] pianpwk/multikernel_hints_draft -> origin/pianpwk/multikernel_hints_draft 2025-12-04T08:53:09.2004413Z * [new branch] pianpwk/no_size_oblivious_slice_scat -> origin/pianpwk/no_size_oblivious_slice_scat 2025-12-04T08:53:09.2004531Z * [new branch] pianpwk/oblivious_reshape_view_better -> origin/pianpwk/oblivious_reshape_view_better 2025-12-04T08:53:09.2004614Z * [new branch] pianpwk/pre_forward_hook -> origin/pianpwk/pre_forward_hook 2025-12-04T08:53:09.2004720Z * [new branch] pianpwk/skip_python_keys_alternate -> origin/pianpwk/skip_python_keys_alternate 2025-12-04T08:53:09.2004823Z * [new branch] pianpwk/skip_python_keys_in_guards -> origin/pianpwk/skip_python_keys_in_guards 2025-12-04T08:53:09.2004904Z * [new branch] pianpwk/sym_tokens_draft -> origin/pianpwk/sym_tokens_draft 2025-12-04T08:53:09.2004983Z * [new branch] pianpwk/symint_one_hot -> origin/pianpwk/symint_one_hot 2025-12-04T08:53:09.2005095Z * [new branch] pianpwk/test_pointwise_guard_or_false -> origin/pianpwk/test_pointwise_guard_or_false 2025-12-04T08:53:09.2005193Z * [new branch] pianpwk/totally_draft_sym_wrap -> origin/pianpwk/totally_draft_sym_wrap 2025-12-04T08:53:09.2005281Z * [new branch] pianpwk/try_dumb_stuff -> origin/pianpwk/try_dumb_stuff 2025-12-04T08:53:09.2005361Z * [new branch] pianpwk/try_dumb_stuff_2 -> origin/pianpwk/try_dumb_stuff_2 2025-12-04T08:53:09.2005453Z * [new branch] pianpwk/unbacked_dtensor_mm -> origin/pianpwk/unbacked_dtensor_mm 2025-12-04T08:53:09.2005547Z * [new branch] pianpwk/unbacked_tracing_12_2 -> origin/pianpwk/unbacked_tracing_12_2 2025-12-04T08:53:09.2005623Z * [new branch] pianpwk/user_symints -> origin/pianpwk/user_symints 2025-12-04T08:53:09.2005701Z * [new branch] pianpwk/wan21_reshape -> origin/pianpwk/wan21_reshape 2025-12-04T08:53:09.2005793Z * [new branch] piz/fix_partial_backward_1112 -> origin/piz/fix_partial_backward_1112 2025-12-04T08:53:09.2005869Z * [new branch] piz/prop_cache_clean -> origin/piz/prop_cache_clean 2025-12-04T08:53:09.2005939Z * [new branch] pool-separate -> origin/pool-separate 2025-12-04T08:53:09.2006001Z * [new branch] pr-156087 -> origin/pr-156087 2025-12-04T08:53:09.2006061Z * [new branch] pr/131860 -> origin/pr/131860 2025-12-04T08:53:09.2006133Z * [new branch] predispatch_to -> origin/predispatch_to 2025-12-04T08:53:09.2006196Z * [new branch] protect-c17 -> origin/protect-c17 2025-12-04T08:53:09.2006261Z * [new branch] pt-opt-cuda3 -> origin/pt-opt-cuda3 2025-12-04T08:53:09.2006342Z * [new branch] python_compiled_autograd -> origin/python_compiled_autograd 2025-12-04T08:53:09.2006470Z * [new branch] q1l1/fix_device_moved_constant_type_unknown -> origin/q1l1/fix_device_moved_constant_type_unknown 2025-12-04T08:53:09.2006609Z * [new branch] q1l1/fix_wrong_default_type_for_kernel_call_args -> origin/q1l1/fix_wrong_default_type_for_kernel_call_args 2025-12-04T08:53:09.2006717Z * [new branch] qchip/export-D54134695 -> origin/qchip/export-D54134695 2025-12-04T08:53:09.2006816Z * [new branch] quote-pytest_cache -> origin/quote-pytest_cache 2025-12-04T08:53:09.2006914Z * [new branch] reland-accgrad-stream-warn -> origin/reland-accgrad-stream-warn 2025-12-04T08:53:09.2006978Z * [new branch] release/1.10 -> origin/release/1.10 2025-12-04T08:53:09.2007041Z * [new branch] release/1.11 -> origin/release/1.11 2025-12-04T08:53:09.2007106Z * [new branch] release/1.12 -> origin/release/1.12 2025-12-04T08:53:09.2007167Z * [new branch] release/1.13 -> origin/release/1.13 2025-12-04T08:53:09.2007228Z * [new branch] release/1.4 -> origin/release/1.4 2025-12-04T08:53:09.2007292Z * [new branch] release/1.4.1 -> origin/release/1.4.1 2025-12-04T08:53:09.2007354Z * [new branch] release/1.5 -> origin/release/1.5 2025-12-04T08:53:09.2007416Z * [new branch] release/1.6 -> origin/release/1.6 2025-12-04T08:53:09.2007476Z * [new branch] release/1.7 -> origin/release/1.7 2025-12-04T08:53:09.2007536Z * [new branch] release/1.8 -> origin/release/1.8 2025-12-04T08:53:09.2007595Z * [new branch] release/1.9 -> origin/release/1.9 2025-12-04T08:53:09.2007655Z * [new branch] release/2.0 -> origin/release/2.0 2025-12-04T08:53:09.2007714Z * [new branch] release/2.1 -> origin/release/2.1 2025-12-04T08:53:09.2007773Z * [new branch] release/2.2 -> origin/release/2.2 2025-12-04T08:53:09.2007832Z * [new branch] release/2.3 -> origin/release/2.3 2025-12-04T08:53:09.2007891Z * [new branch] release/2.4 -> origin/release/2.4 2025-12-04T08:53:09.2007952Z * [new branch] release/2.5 -> origin/release/2.5 2025-12-04T08:53:09.2008014Z * [new branch] release/2.6 -> origin/release/2.6 2025-12-04T08:53:09.2008074Z * [new branch] release/2.7 -> origin/release/2.7 2025-12-04T08:53:09.2008132Z * [new branch] release/2.8 -> origin/release/2.8 2025-12-04T08:53:09.2008193Z * [new branch] release/2.9 -> origin/release/2.9 2025-12-04T08:53:09.2008257Z * [new branch] release_notes -> origin/release_notes 2025-12-04T08:53:09.2008332Z * [new branch] remove_pyinterpreter -> origin/remove_pyinterpreter 2025-12-04T08:53:09.2008456Z * [new branch] replace-pytorch-labs-20250812-195836 -> origin/replace-pytorch-labs-20250812-195836 2025-12-04T08:53:09.2008576Z * [new branch] replace-pytorch-labs-20250812-200248 -> origin/replace-pytorch-labs-20250812-200248 2025-12-04T08:53:09.2008696Z * [new branch] replace-pytorch-labs-20250812-200324 -> origin/replace-pytorch-labs-20250812-200324 2025-12-04T08:53:09.2008815Z * [new branch] replace-pytorch-labs-20250812-204020 -> origin/replace-pytorch-labs-20250812-204020 2025-12-04T08:53:09.2008944Z * [new branch] revert-131069-gh/krzysztofjordan/1/head -> origin/revert-131069-gh/krzysztofjordan/1/head 2025-12-04T08:53:09.2009055Z * [new branch] revert-131469-gh/andrewor14/51/head -> origin/revert-131469-gh/andrewor14/51/head 2025-12-04T08:53:09.2009156Z * [new branch] revert-152361-gh/fadara01/1/head -> origin/revert-152361-gh/fadara01/1/head 2025-12-04T08:53:09.2009256Z * [new branch] revert-156870-gh/skarjala/3/head -> origin/revert-156870-gh/skarjala/3/head 2025-12-04T08:53:09.2009431Z * [new branch] revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ -> origin/revert-157914-cherry-pick-157503-by-pytorch_bot_bot_ 2025-12-04T08:53:09.2009567Z * [new branch] revert-hoo-invoke-subgraph -> origin/revert-hoo-invoke-subgraph 2025-12-04T08:53:09.2009695Z * [new branch] revert_always_build_distributed -> origin/revert_always_build_distributed 2025-12-04T08:53:09.2009764Z * [new branch] rms_norm_patch -> origin/rms_norm_patch 2025-12-04T08:53:09.2009860Z * [new branch] ruisi/fix_all_to_all_estimation -> origin/ruisi/fix_all_to_all_estimation 2025-12-04T08:53:09.2009943Z * [new branch] ruisi/fix_comm_estimation -> origin/ruisi/fix_comm_estimation 2025-12-04T08:53:09.2010048Z * [new branch] ruisi/fix_dynamic_shape_estimation -> origin/ruisi/fix_dynamic_shape_estimation 2025-12-04T08:53:09.2010144Z * [new branch] ruisi/fix_llama3_autobucketing -> origin/ruisi/fix_llama3_autobucketing 2025-12-04T08:53:09.2010248Z * [new branch] ruisi/fix_manual_bucketing_ep_pass -> origin/ruisi/fix_manual_bucketing_ep_pass 2025-12-04T08:53:09.2010332Z * [new branch] ruisi/manual_bucket_pass -> origin/ruisi/manual_bucket_pass 2025-12-04T08:53:09.2010478Z * [new branch] ryanguo99/cleanup-dynamo-expected-failures -> origin/ryanguo99/cleanup-dynamo-expected-failures 2025-12-04T08:53:09.2010566Z * [new branch] ryanguo99/fix-closure-var -> origin/ryanguo99/fix-closure-var 2025-12-04T08:53:09.2010642Z * [new branch] rzou/faketensor_bench -> origin/rzou/faketensor_bench 2025-12-04T08:53:09.2010704Z * [new branch] rzou/njt -> origin/rzou/njt 2025-12-04T08:53:09.2010766Z * [new branch] rzou/pca -> origin/rzou/pca 2025-12-04T08:53:09.2010833Z * [new branch] rzou/realprop -> origin/rzou/realprop 2025-12-04T08:53:09.2010896Z * [new branch] samplevllm -> origin/samplevllm 2025-12-04T08:53:09.2011066Z * [new branch] sanchitintel/weird_thing_with_test_cpu_select_algorithm -> origin/sanchitintel/weird_thing_with_test_cpu_select_algorithm 2025-12-04T08:53:09.2011160Z * [new branch] sapling-pr-archive-SS-JIA -> origin/sapling-pr-archive-SS-JIA 2025-12-04T08:53:09.2011272Z * [new branch] sapling-pr-archive-tushar00jain -> origin/sapling-pr-archive-tushar00jain 2025-12-04T08:53:09.2011333Z * [new branch] save -> origin/save 2025-12-04T08:53:09.2011393Z * [new branch] scaled_mm -> origin/scaled_mm 2025-12-04T08:53:09.2011457Z * [new branch] scan_attempt -> origin/scan_attempt 2025-12-04T08:53:09.2011518Z * [new branch] sdym/2.5.1 -> origin/sdym/2.5.1 2025-12-04T08:53:09.2011623Z * [new branch] sekyondaMeta-dynamoconfig-fix -> origin/sekyondaMeta-dynamoconfig-fix 2025-12-04T08:53:09.2011701Z * [new branch] shengf/fx-xform-perf -> origin/shengf/fx-xform-perf 2025-12-04T08:53:09.2011777Z * [new branch] shoumikhin-patch-1 -> origin/shoumikhin-patch-1 2025-12-04T08:53:09.2011852Z * [new branch] solve-accuracy-fix -> origin/solve-accuracy-fix 2025-12-04T08:53:09.2011933Z * [new branch] some_rocm_inductor_skips -> origin/some_rocm_inductor_skips 2025-12-04T08:53:09.2012013Z * [new branch] soulitzer/stash-tls-ac -> origin/soulitzer/stash-tls-ac 2025-12-04T08:53:09.2012095Z * [new branch] sparse-mm-bf16-support -> origin/sparse-mm-bf16-support 2025-12-04T08:53:09.2012168Z * [new branch] starterTaskUpdate -> origin/starterTaskUpdate 2025-12-04T08:53:09.2012226Z * [new branch] suo -> origin/suo 2025-12-04T08:53:09.2012288Z * [new branch] sve-poc -> origin/sve-poc 2025-12-04T08:53:09.2012351Z * [new branch] switch-bn -> origin/switch-bn 2025-12-04T08:53:09.2012469Z * [new branch] sy_annotation_in_autograd_hop -> origin/sy_annotation_in_autograd_hop 2025-12-04T08:53:09.2014560Z * [new branch] sy_aot_eager_record -> origin/sy_aot_eager_record 2025-12-04T08:53:09.2014641Z * [new branch] sy_custom_bucketing -> origin/sy_custom_bucketing 2025-12-04T08:53:09.2014714Z * [new branch] sy_debug_mode_test -> origin/sy_debug_mode_test 2025-12-04T08:53:09.2014783Z * [new branch] sy_deserialize -> origin/sy_deserialize 2025-12-04T08:53:09.2014852Z * [new branch] sy_dump_gm_code -> origin/sy_dump_gm_code 2025-12-04T08:53:09.2014915Z * [new branch] sy_exp -> origin/sy_exp 2025-12-04T08:53:09.2014986Z * [new branch] sy_export_annotation -> origin/sy_export_annotation 2025-12-04T08:53:09.2015054Z * [new branch] sy_invoke_subgraph -> origin/sy_invoke_subgraph 2025-12-04T08:53:09.2015128Z * [new branch] sy_kernel_bw_name -> origin/sy_kernel_bw_name 2025-12-04T08:53:09.2015194Z * [new branch] sy_multi_arch -> origin/sy_multi_arch 2025-12-04T08:53:09.2015261Z * [new branch] sy_nn_module_stack -> origin/sy_nn_module_stack 2025-12-04T08:53:09.2015333Z * [new branch] sy_original_dtensor -> origin/sy_original_dtensor 2025-12-04T08:53:09.2015398Z * [new branch] sy_profiler_cia -> origin/sy_profiler_cia 2025-12-04T08:53:09.2015463Z * [new branch] symm_mem_sync -> origin/symm_mem_sync 2025-12-04T08:53:09.2015548Z * [new branch] sympy-bottleneck-repro -> origin/sympy-bottleneck-repro 2025-12-04T08:53:09.2015624Z * [new branch] tensordict_integration -> origin/tensordict_integration 2025-12-04T08:53:09.2015704Z * [new branch] test-move-conda-builds -> origin/test-move-conda-builds 2025-12-04T08:53:09.2015769Z * [new branch] test-old -> origin/test-old 2025-12-04T08:53:09.2015836Z * [new branch] test/bmm_heur -> origin/test/bmm_heur 2025-12-04T08:53:09.2015932Z * [new branch] tianren/customOp_autotune_fix -> origin/tianren/customOp_autotune_fix 2025-12-04T08:53:09.2016045Z * [new branch] tianren/customOp_enable_max_autotune -> origin/tianren/customOp_enable_max_autotune 2025-12-04T08:53:09.2016127Z * [new branch] tianren/customOp_fusion -> origin/tianren/customOp_fusion 2025-12-04T08:53:09.2016254Z * [new branch] tianren/customop_collectiveop_benchmark -> origin/tianren/customop_collectiveop_benchmark 2025-12-04T08:53:09.2016388Z * [new branch] tianren/customop_collectiveop_benchmark_fix -> origin/tianren/customop_collectiveop_benchmark_fix 2025-12-04T08:53:09.2016489Z * [new branch] tianren/customop_dynamic_config -> origin/tianren/customop_dynamic_config 2025-12-04T08:53:09.2016584Z * [new branch] tianren/dynamic_range_input -> origin/tianren/dynamic_range_input 2025-12-04T08:53:09.2016687Z * [new branch] tianren/dynamic_range_input_fix -> origin/tianren/dynamic_range_input_fix 2025-12-04T08:53:09.2016791Z * [new branch] tianren/dynamic_range_input_merge -> origin/tianren/dynamic_range_input_merge 2025-12-04T08:53:09.2016895Z * [new branch] tianren/flex_paged_attn_fix_temp -> origin/tianren/flex_paged_attn_fix_temp 2025-12-04T08:53:09.2016975Z * [new branch] tianren/fx_codegen_dump -> origin/tianren/fx_codegen_dump 2025-12-04T08:53:09.2017058Z * [new branch] tianren/symmetric_memory -> origin/tianren/symmetric_memory 2025-12-04T08:53:09.2017127Z * [new branch] tianren/test -> origin/tianren/test 2025-12-04T08:53:09.2017204Z * [new branch] tidy_performance_cyy -> origin/tidy_performance_cyy 2025-12-04T08:53:09.2017310Z * [new branch] tmp -> origin/tmp 2025-12-04T08:53:09.2017378Z * [new branch] torchtitan_ep -> origin/torchtitan_ep 2025-12-04T08:53:09.2017487Z * [new branch] torchtitan_integration -> origin/torchtitan_integration 2025-12-04T08:53:09.2017571Z * [new branch] trace_fsdp_torchtune_lora -> origin/trace_fsdp_torchtune_lora 2025-12-04T08:53:09.2017656Z * [new branch] traceable_fsdp_unit_tests -> origin/traceable_fsdp_unit_tests 2025-12-04T08:53:09.2017727Z * [new branch] tree_loop_vec_base -> origin/tree_loop_vec_base 2025-12-04T08:53:09.2017793Z * [new branch] triton_kernel -> origin/triton_kernel 2025-12-04T08:53:09.2017857Z * [new branch] tt_pkg_1908 -> origin/tt_pkg_1908 2025-12-04T08:53:09.2017919Z * [new branch] type_dec -> origin/type_dec 2025-12-04T08:53:09.2018013Z * [new branch] udate-sphinx-dependancies -> origin/udate-sphinx-dependancies 2025-12-04T08:53:09.2018152Z * [new branch] update-audio-commit-hash/17630256502-1803-1 -> origin/update-audio-commit-hash/17630256502-1803-1 2025-12-04T08:53:09.2018284Z * [new branch] update-audio-commit-hash/19087141161-1916-1 -> origin/update-audio-commit-hash/19087141161-1916-1 2025-12-04T08:53:09.2018414Z * [new branch] update-audio-commit-hash/19250643381-1929-1 -> origin/update-audio-commit-hash/19250643381-1929-1 2025-12-04T08:53:09.2018542Z * [new branch] update-audio-commit-hash/19397724337-1935-1 -> origin/update-audio-commit-hash/19397724337-1935-1 2025-12-04T08:53:09.2018672Z * [new branch] update-audio-commit-hash/19555670148-1941-1 -> origin/update-audio-commit-hash/19555670148-1941-1 2025-12-04T08:53:09.2018802Z * [new branch] update-audio-commit-hash/19750627930-1946-1 -> origin/update-audio-commit-hash/19750627930-1946-1 2025-12-04T08:53:09.2018939Z * [new branch] update-triton-commit-hash/13663274526-1487-2 -> origin/update-triton-commit-hash/13663274526-1487-2 2025-12-04T08:53:09.2019072Z * [new branch] update-vision-commit-hash/19087141161-1916-1 -> origin/update-vision-commit-hash/19087141161-1916-1 2025-12-04T08:53:09.2019205Z * [new branch] update-vision-commit-hash/19184897099-1925-1 -> origin/update-vision-commit-hash/19184897099-1925-1 2025-12-04T08:53:09.2019336Z * [new branch] update-vision-commit-hash/19250643381-1929-1 -> origin/update-vision-commit-hash/19250643381-1929-1 2025-12-04T08:53:09.2019470Z * [new branch] update-vision-commit-hash/19381328640-1934-1 -> origin/update-vision-commit-hash/19381328640-1934-1 2025-12-04T08:53:09.2019600Z * [new branch] update-vision-commit-hash/19485237164-1938-1 -> origin/update-vision-commit-hash/19485237164-1938-1 2025-12-04T08:53:09.2019731Z * [new branch] update-vllm-commit-hash/18451675449-1879-1 -> origin/update-vllm-commit-hash/18451675449-1879-1 2025-12-04T08:53:09.2019819Z * [new branch] update-vllm-dockerfile -> origin/update-vllm-dockerfile 2025-12-04T08:53:09.2019944Z * [new branch] update-xla-commit-hash/19224287370-211-1 -> origin/update-xla-commit-hash/19224287370-211-1 2025-12-04T08:53:09.2020066Z * [new branch] update-xla-commit-hash/19422028566-212-1 -> origin/update-xla-commit-hash/19422028566-212-1 2025-12-04T08:53:09.2020189Z * [new branch] update-xla-commit-hash/19626841311-213-1 -> origin/update-xla-commit-hash/19626841311-213-1 2025-12-04T08:53:09.2020315Z * [new branch] update_docs_torch_multinomial_issue#125388 -> origin/update_docs_torch_multinomial_issue#125388 2025-12-04T08:53:09.2020395Z * [new branch] update_operator_readme -> origin/update_operator_readme 2025-12-04T08:53:09.2020509Z * [new branch] update_slow_tests_1722488736 -> origin/update_slow_tests_1722488736 2025-12-04T08:53:09.2020597Z * [new branch] update_slow_tests_1722879173 -> origin/update_slow_tests_1722879173 2025-12-04T08:53:09.2020723Z * [new branch] update_slow_tests_1762155677 -> origin/update_slow_tests_1762155677 2025-12-04T08:53:09.2020809Z * [new branch] update_slow_tests_1763365283 -> origin/update_slow_tests_1763365283 2025-12-04T08:53:09.2020898Z * [new branch] update_submodule_FBGEMM -> origin/update_submodule_FBGEMM 2025-12-04T08:53:09.2020977Z * [new branch] update_submodule_kineto -> origin/update_submodule_kineto 2025-12-04T08:53:09.2021068Z * [new branch] update_submodule_tensorpipe -> origin/update_submodule_tensorpipe 2025-12-04T08:53:09.2021167Z * [new branch] upload-tests-for-autorevert -> origin/upload-tests-for-autorevert 2025-12-04T08:53:09.2021229Z * [new branch] v0.1.2 -> origin/v0.1.2 2025-12-04T08:53:09.2021292Z * [new branch] v1.0.1 -> origin/v1.0.1 2025-12-04T08:53:09.2021351Z * [new branch] v1.0.3 -> origin/v1.0.3 2025-12-04T08:53:09.2021408Z * [new branch] v1.1.0 -> origin/v1.1.0 2025-12-04T08:53:09.2021466Z * [new branch] v1.2.0 -> origin/v1.2.0 2025-12-04T08:53:09.2021521Z * [new branch] v1.3.0 -> origin/v1.3.0 2025-12-04T08:53:09.2021576Z * [new branch] v1.3.1 -> origin/v1.3.1 2025-12-04T08:53:09.2021641Z * [new branch] validate_fn -> origin/validate_fn 2025-12-04T08:53:09.2021708Z * [new branch] validations_2.6 -> origin/validations_2.6 2025-12-04T08:53:09.2021775Z * [new branch] validations_2.8 -> origin/validations_2.8 2025-12-04T08:53:09.2021840Z * [new branch] varlen-api -> origin/varlen-api 2025-12-04T08:53:09.2021916Z * [new branch] varlen-api-backup -> origin/varlen-api-backup 2025-12-04T08:53:09.2021996Z * [new branch] varlen_batch_invariance -> origin/varlen_batch_invariance 2025-12-04T08:53:09.2022062Z * [new branch] viable/strict -> origin/viable/strict 2025-12-04T08:53:09.2022180Z * [new branch] vishal9-team/dtensor_parallelism_toy -> origin/vishal9-team/dtensor_parallelism_toy 2025-12-04T08:53:09.2022245Z * [new branch] vllmbuildci -> origin/vllmbuildci 2025-12-04T08:53:09.2022309Z * [new branch] vllmpin -> origin/vllmpin 2025-12-04T08:53:09.2022397Z * [new branch] vscode-recommend-pyrefly -> origin/vscode-recommend-pyrefly 2025-12-04T08:53:09.2022463Z * [new branch] wdvr-patch-1 -> origin/wdvr-patch-1 2025-12-04T08:53:09.2022528Z * [new branch] wdvr/iss_145259 -> origin/wdvr/iss_145259 2025-12-04T08:53:09.2022590Z * [new branch] whc/pei -> origin/whc/pei 2025-12-04T08:53:09.2022655Z * [new branch] whc/pp_fix -> origin/whc/pp_fix 2025-12-04T08:53:09.2022720Z * [new branch] whc/sharding -> origin/whc/sharding 2025-12-04T08:53:09.2022785Z * [new branch] whc/sharding2 -> origin/whc/sharding2 2025-12-04T08:53:09.2022846Z * [new branch] whc/uneven -> origin/whc/uneven 2025-12-04T08:53:09.2022916Z * [new branch] whc/uneven-merge -> origin/whc/uneven-merge 2025-12-04T08:53:09.2023025Z * [new branch] win_warnings -> origin/win_warnings 2025-12-04T08:53:09.2023104Z * [new branch] windows_libtorch_free -> origin/windows_libtorch_free 2025-12-04T08:53:09.2023166Z * [new branch] xmfan-war -> origin/xmfan-war 2025-12-04T08:53:09.2023267Z * [new branch] xmfan/ca_0516 -> origin/xmfan/ca_0516 2025-12-04T08:53:09.2023337Z * [new branch] xmfan/ca_1051b93192 -> origin/xmfan/ca_1051b93192 2025-12-04T08:53:09.2023527Z * [new branch] xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 -> origin/xmfan/ca_1a722f62c248391fc4a542e8851a5559aa356ae8 2025-12-04T08:53:09.2023597Z * [new branch] xmfan/ca_5a2be192d1 -> origin/xmfan/ca_5a2be192d1 2025-12-04T08:53:09.2023666Z * [new branch] xmfan/ca_9d59b516e9 -> origin/xmfan/ca_9d59b516e9 2025-12-04T08:53:09.2023730Z * [new branch] xmfan/ca_apr8 -> origin/xmfan/ca_apr8 2025-12-04T08:53:09.2023794Z * [new branch] xmfan/ca_base -> origin/xmfan/ca_base 2025-12-04T08:53:09.2023863Z * [new branch] xmfan/ca_dynamic -> origin/xmfan/ca_dynamic 2025-12-04T08:53:09.2023929Z * [new branch] xmfan/ca_fix_dyn -> origin/xmfan/ca_fix_dyn 2025-12-04T08:53:09.2024003Z * [new branch] xmfan/ca_fix_lowering -> origin/xmfan/ca_fix_lowering 2025-12-04T08:53:09.2024081Z * [new branch] xmfan/ca_fix_polyfills -> origin/xmfan/ca_fix_polyfills 2025-12-04T08:53:09.2024144Z * [new branch] xmfan/ca_jan3 -> origin/xmfan/ca_jan3 2025-12-04T08:53:09.2024209Z * [new branch] xmfan/ca_jun18 -> origin/xmfan/ca_jun18 2025-12-04T08:53:09.2024275Z * [new branch] xmfan/ca_jun24 -> origin/xmfan/ca_jun24 2025-12-04T08:53:09.2024340Z * [new branch] xmfan/ca_nested -> origin/xmfan/ca_nested 2025-12-04T08:53:09.2024406Z * [new branch] xmfan/ca_overhead -> origin/xmfan/ca_overhead 2025-12-04T08:53:09.2024498Z * [new branch] xmfan/ca_overhead_0eba7e5451 -> origin/xmfan/ca_overhead_0eba7e5451 2025-12-04T08:53:09.2024565Z * [new branch] xmfan/cacu_jun18 -> origin/xmfan/cacu_jun18 2025-12-04T08:53:09.2024633Z * [new branch] xmfan/cacu_jun19 -> origin/xmfan/cacu_jun19 2025-12-04T08:53:09.2024700Z * [new branch] xmfan/cacu_jun4 -> origin/xmfan/cacu_jun4 2025-12-04T08:53:09.2024782Z * [new branch] xmfan/disable_duck_shape -> origin/xmfan/disable_duck_shape 2025-12-04T08:53:09.2024880Z * [new branch] xmfan/fca_cpp_node_passthrough -> origin/xmfan/fca_cpp_node_passthrough 2025-12-04T08:53:09.2025031Z * [new branch] xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/post_3945954741e2d37023c5d6954f9483008e0892f9 2025-12-04T08:53:09.2025176Z * [new branch] xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 -> origin/xmfan/pre_3945954741e2d37023c5d6954f9483008e0892f9 2025-12-04T08:53:09.2025248Z * [new branch] xmfan/single_step -> origin/xmfan/single_step 2025-12-04T08:53:09.2025314Z * [new branch] xmfan/sth_0829 -> origin/xmfan/sth_0829 2025-12-04T08:53:09.2025377Z * [new branch] xmfan/test -> origin/xmfan/test 2025-12-04T08:53:09.2025468Z * [new branch] yguo/debug-0226-constexpr -> origin/yguo/debug-0226-constexpr 2025-12-04T08:53:09.2025546Z * [new branch] yguo/new_latest_changes -> origin/yguo/new_latest_changes 2025-12-04T08:53:09.2025640Z * [new branch] yguo/patch_constexpr_changes -> origin/yguo/patch_constexpr_changes 2025-12-04T08:53:09.2025709Z * [new branch] yiming/bootcamp -> origin/yiming/bootcamp 2025-12-04T08:53:09.2025811Z * [new branch] yiming/run_with_start_end_rng_hop -> origin/yiming/run_with_start_end_rng_hop 2025-12-04T08:53:09.2025875Z * [new branch] yolo-llama3 -> origin/yolo-llama3 2025-12-04T08:53:09.2025946Z * [new branch] zainr/canary-test -> origin/zainr/canary-test 2025-12-04T08:53:09.2026032Z * [new branch] zainr/cleanup-gh-runners -> origin/zainr/cleanup-gh-runners 2025-12-04T08:53:09.2026142Z * [new branch] zainr/pull-migration-c -> origin/zainr/pull-migration-c 2025-12-04T08:53:09.2026234Z * [new branch] zainr/test2 -> origin/zainr/test2 2025-12-04T08:53:09.2026306Z * [new branch] zasdfgbnm-patch-3 -> origin/zasdfgbnm-patch-3 2025-12-04T08:53:09.2026365Z * [new branch] zb2p -> origin/zb2p 2025-12-04T08:53:09.2026450Z * [new branch] zeros-and-scatter-part2 -> origin/zeros-and-scatter-part2 2025-12-04T08:53:09.2026537Z * [new branch] zhxchen17/ci/vllm_lora_oom -> origin/zhxchen17/ci/vllm_lora_oom 2025-12-04T08:53:09.2026641Z * [new branch] zhxchen17/ci/vllm_multimodal_oom -> origin/zhxchen17/ci/vllm_multimodal_oom 2025-12-04T08:53:09.2026716Z * [new branch] zhxchen17/ci/vllm_pin -> origin/zhxchen17/ci/vllm_pin 2025-12-04T08:53:09.2026840Z * [new branch] zhxchen17/dynamo/unsafe_drop_all_guards -> origin/zhxchen17/dynamo/unsafe_drop_all_guards 2025-12-04T08:53:09.2026943Z * [new branch] zhxchen17/export/call_override -> origin/zhxchen17/export/call_override 2025-12-04T08:53:09.2027028Z * [new branch] zhxchen17/export/codemod1 -> origin/zhxchen17/export/codemod1 2025-12-04T08:53:09.2027117Z * [new branch] zhxchen17/export/ctx_return -> origin/zhxchen17/export/ctx_return 2025-12-04T08:53:09.2027246Z * [new branch] zhxchen17/export/disable_side_effect_warn -> origin/zhxchen17/export/disable_side_effect_warn 2025-12-04T08:53:09.2027343Z * [new branch] zhxchen17/export/pytree_check -> origin/zhxchen17/export/pytree_check 2025-12-04T08:53:09.2027429Z * [new branch] zhxchen17/precompile/aoti -> origin/zhxchen17/precompile/aoti 2025-12-04T08:53:09.2027526Z * [new branch] zhxchen17/precompile/globals -> origin/zhxchen17/precompile/globals 2025-12-04T08:53:09.2027645Z * [new branch] zhxchen17/precompile/inductor_guards -> origin/zhxchen17/precompile/inductor_guards 2025-12-04T08:53:09.2027724Z * [new branch] zhxchen17/scratch/0 -> origin/zhxchen17/scratch/0 2025-12-04T08:53:09.2027830Z * [new branch] zhxchen17/torch_export_api_update -> origin/zhxchen17/torch_export_api_update 2025-12-04T08:53:09.2027906Z * [new branch] zhxhcen17/moodycamel -> origin/zhxhcen17/moodycamel 2025-12-04T08:53:09.2027981Z * [new branch] zxiiro/build-times -> origin/zxiiro/build-times 2025-12-04T08:53:09.2028052Z * [new branch] zxiiro/c7i.2xlarge -> origin/zxiiro/c7i.2xlarge 2025-12-04T08:53:09.2028130Z * [new branch] zxiiro/c7i.2xlarge.h100 -> origin/zxiiro/c7i.2xlarge.h100 2025-12-04T08:53:09.2028194Z * [new branch] zxiiro/main -> origin/zxiiro/main 2025-12-04T08:53:09.2028257Z * [new branch] zxiiro/risc64 -> origin/zxiiro/risc64 2025-12-04T08:53:09.2028348Z * [new branch] zxiiro/test-multicloud-arc -> origin/zxiiro/test-multicloud-arc 2025-12-04T08:53:09.2028414Z t [tag update] ciflow/b200/168195 -> ciflow/b200/168195 2025-12-04T08:53:09.2028475Z * [new tag] ciflow/dynamo/169525 -> ciflow/dynamo/169525 2025-12-04T08:53:09.2028537Z t [tag update] ciflow/h100/168195 -> ciflow/h100/168195 2025-12-04T08:53:09.2028601Z * [new tag] ciflow/inductor/163245 -> ciflow/inductor/163245 2025-12-04T08:53:09.2028668Z t [tag update] ciflow/inductor/167647 -> ciflow/inductor/167647 2025-12-04T08:53:09.2028735Z t [tag update] ciflow/inductor/167781 -> ciflow/inductor/167781 2025-12-04T08:53:09.2028801Z t [tag update] ciflow/inductor/168050 -> ciflow/inductor/168050 2025-12-04T08:53:09.2028865Z t [tag update] ciflow/inductor/168127 -> ciflow/inductor/168127 2025-12-04T08:53:09.2028956Z t [tag update] ciflow/inductor/168195 -> ciflow/inductor/168195 2025-12-04T08:53:09.2029045Z t [tag update] ciflow/inductor/168266 -> ciflow/inductor/168266 2025-12-04T08:53:09.2029109Z t [tag update] ciflow/inductor/168939 -> ciflow/inductor/168939 2025-12-04T08:53:09.2029175Z t [tag update] ciflow/inductor/168946 -> ciflow/inductor/168946 2025-12-04T08:53:09.2029240Z t [tag update] ciflow/inductor/169282 -> ciflow/inductor/169282 2025-12-04T08:53:09.2029305Z t [tag update] ciflow/inductor/169326 -> ciflow/inductor/169326 2025-12-04T08:53:09.2029369Z t [tag update] ciflow/inductor/169509 -> ciflow/inductor/169509 2025-12-04T08:53:09.2029435Z t [tag update] ciflow/inductor/169513 -> ciflow/inductor/169513 2025-12-04T08:53:09.2029500Z t [tag update] ciflow/inductor/169535 -> ciflow/inductor/169535 2025-12-04T08:53:09.2029562Z * [new tag] ciflow/inductor/169553 -> ciflow/inductor/169553 2025-12-04T08:53:09.2029625Z t [tag update] ciflow/rocm/167781 -> ciflow/rocm/167781 2025-12-04T08:53:09.2029688Z t [tag update] ciflow/rocm/168195 -> ciflow/rocm/168195 2025-12-04T08:53:09.2029750Z t [tag update] ciflow/rocm/168939 -> ciflow/rocm/168939 2025-12-04T08:53:09.2029810Z t [tag update] ciflow/slow/168050 -> ciflow/slow/168050 2025-12-04T08:53:09.2029870Z * [new tag] ciflow/trunk/163245 -> ciflow/trunk/163245 2025-12-04T08:53:09.2029929Z * [new tag] ciflow/trunk/165728 -> ciflow/trunk/165728 2025-12-04T08:53:09.2029987Z * [new tag] ciflow/trunk/166843 -> ciflow/trunk/166843 2025-12-04T08:53:09.2030050Z t [tag update] ciflow/trunk/167781 -> ciflow/trunk/167781 2025-12-04T08:53:09.2030113Z t [tag update] ciflow/trunk/168050 -> ciflow/trunk/168050 2025-12-04T08:53:09.2030177Z t [tag update] ciflow/trunk/168127 -> ciflow/trunk/168127 2025-12-04T08:53:09.2030240Z t [tag update] ciflow/trunk/168262 -> ciflow/trunk/168262 2025-12-04T08:53:09.2030299Z * [new tag] ciflow/trunk/169048 -> ciflow/trunk/169048 2025-12-04T08:53:09.2030356Z * [new tag] ciflow/trunk/169125 -> ciflow/trunk/169125 2025-12-04T08:53:09.2030418Z t [tag update] ciflow/trunk/169229 -> ciflow/trunk/169229 2025-12-04T08:53:09.2030480Z t [tag update] ciflow/trunk/169280 -> ciflow/trunk/169280 2025-12-04T08:53:09.2030541Z t [tag update] ciflow/trunk/169296 -> ciflow/trunk/169296 2025-12-04T08:53:09.2030603Z t [tag update] ciflow/trunk/169442 -> ciflow/trunk/169442 2025-12-04T08:53:09.2030660Z * [new tag] ciflow/trunk/169555 -> ciflow/trunk/169555 2025-12-04T08:53:09.2030721Z * [new tag] ciflow/xpu/166843 -> ciflow/xpu/166843 2025-12-04T08:53:09.2030783Z t [tag update] ciflow/xpu/168262 -> ciflow/xpu/168262 2025-12-04T08:53:09.2030849Z t [tag update] ciflow/xpu/169203 -> ciflow/xpu/169203 2025-12-04T08:53:09.2030909Z t [tag update] ciflow/xpu/169229 -> ciflow/xpu/169229 2025-12-04T08:53:09.2030969Z t [tag update] ciflow/xpu/169280 -> ciflow/xpu/169280 2025-12-04T08:53:09.2031031Z t [tag update] ciflow/xpu/169296 -> ciflow/xpu/169296 2025-12-04T08:53:09.2031090Z t [tag update] ciflow/xpu/169442 -> ciflow/xpu/169442 2025-12-04T08:53:09.2031145Z * [new tag] ciflow/xpu/169555 -> ciflow/xpu/169555 2025-12-04T08:53:09.2031289Z * [new tag] trunk/35b7a9a26c5923d98aebaa41a031dae21788a9ee -> trunk/35b7a9a26c5923d98aebaa41a031dae21788a9ee 2025-12-04T08:53:09.2031425Z * [new tag] trunk/4fefb8e7e942386ffac764a41b232241f82bea3a -> trunk/4fefb8e7e942386ffac764a41b232241f82bea3a 2025-12-04T08:53:09.2031618Z * [new tag] trunk/5634469fda9e5d98869c82c7d03bb08914245f96 -> trunk/5634469fda9e5d98869c82c7d03bb08914245f96 2025-12-04T08:53:09.2031750Z * [new tag] trunk/ae3a2395bf66151078e2d201716f7d63ce1c6f3e -> trunk/ae3a2395bf66151078e2d201716f7d63ce1c6f3e 2025-12-04T08:53:09.2031886Z * [new tag] trunk/ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 -> trunk/ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:09.3977181Z [command]/usr/bin/git rev-parse --verify --quiet ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32^{object} 2025-12-04T08:53:09.4112894Z ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:09.4117850Z ##[endgroup] 2025-12-04T08:53:09.4118094Z ##[group]Determining the checkout info 2025-12-04T08:53:09.4119685Z ##[endgroup] 2025-12-04T08:53:09.4125002Z [command]/usr/bin/git sparse-checkout disable 2025-12-04T08:53:09.4211920Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-12-04T08:53:09.4235806Z ##[group]Checking out the ref 2025-12-04T08:53:09.4237507Z [command]/usr/bin/git checkout --progress --force ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:09.4929519Z Previous HEAD position was 76aeb8c7e0f7 [DebugMode] default values for outputs, stack trace (#169499) 2025-12-04T08:53:09.4932361Z HEAD is now at ffd9b0fb4355 Resolve collective autotuning test failure on arm (#168919) 2025-12-04T08:53:09.5005305Z ##[endgroup] 2025-12-04T08:53:09.5005535Z ##[group]Setting up auth for fetching submodules 2025-12-04T08:53:09.5011501Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-12-04T08:53:09.5049128Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-12-04T08:53:09.5068382Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-12-04T08:53:09.5092387Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-12-04T08:53:09.5115033Z ##[endgroup] 2025-12-04T08:53:09.5115219Z ##[group]Fetching submodules 2025-12-04T08:53:09.5116979Z [command]/usr/bin/git submodule sync --recursive 2025-12-04T08:53:09.5322703Z Synchronizing submodule url for 'android/libs/fbjni' 2025-12-04T08:53:09.5340929Z Synchronizing submodule url for 'third_party/FP16' 2025-12-04T08:53:09.5358255Z Synchronizing submodule url for 'third_party/FXdiv' 2025-12-04T08:53:09.5375857Z Synchronizing submodule url for 'third_party/NNPACK' 2025-12-04T08:53:09.5388637Z Synchronizing submodule url for 'third_party/NVTX' 2025-12-04T08:53:09.5399331Z Synchronizing submodule url for 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:09.5412211Z Synchronizing submodule url for 'third_party/XNNPACK' 2025-12-04T08:53:09.5428550Z Synchronizing submodule url for 'third_party/aiter' 2025-12-04T08:53:09.5441923Z Synchronizing submodule url for 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:09.5463041Z Synchronizing submodule url for 'third_party/benchmark' 2025-12-04T08:53:09.5474195Z Synchronizing submodule url for 'third_party/composable_kernel' 2025-12-04T08:53:09.5488572Z Synchronizing submodule url for 'third_party/cpp-httplib' 2025-12-04T08:53:09.5500065Z Synchronizing submodule url for 'third_party/cpuinfo' 2025-12-04T08:53:09.5510752Z Synchronizing submodule url for 'third_party/cudnn_frontend' 2025-12-04T08:53:09.5521680Z Synchronizing submodule url for 'third_party/cutlass' 2025-12-04T08:53:09.5534510Z Synchronizing submodule url for 'third_party/fbgemm' 2025-12-04T08:53:09.5563162Z Synchronizing submodule url for 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:09.5582025Z Synchronizing submodule url for 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:09.5605015Z Synchronizing submodule url for 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:09.5628933Z Synchronizing submodule url for 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:09.5644581Z Synchronizing submodule url for 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:09.5655790Z Synchronizing submodule url for 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:09.5676068Z Synchronizing submodule url for 'third_party/fbgemm/external/json' 2025-12-04T08:53:09.5702291Z Synchronizing submodule url for 'third_party/flash-attention' 2025-12-04T08:53:09.5714710Z Synchronizing submodule url for 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:09.5735513Z Synchronizing submodule url for 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:09.5750875Z Synchronizing submodule url for 'third_party/flatbuffers' 2025-12-04T08:53:09.5763027Z Synchronizing submodule url for 'third_party/fmt' 2025-12-04T08:53:09.5775706Z Synchronizing submodule url for 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:09.5787504Z Synchronizing submodule url for 'third_party/gloo' 2025-12-04T08:53:09.5798538Z Synchronizing submodule url for 'third_party/googletest' 2025-12-04T08:53:09.5810613Z Synchronizing submodule url for 'third_party/ideep' 2025-12-04T08:53:09.5823265Z Synchronizing submodule url for 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:09.5835410Z Synchronizing submodule url for 'third_party/ittapi' 2025-12-04T08:53:09.5845766Z Synchronizing submodule url for 'third_party/kineto' 2025-12-04T08:53:09.5858579Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:09.5872476Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:09.5885155Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:09.5895926Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:09.5910743Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:09.5927049Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:09.5939040Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:09.5949140Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:09.5958168Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:09.5967716Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:09.5979834Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:09.5992690Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:09.6003354Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:09.6022271Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:09.6032115Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:09.6051304Z Synchronizing submodule url for 'third_party/kleidiai' 2025-12-04T08:53:09.6061785Z Synchronizing submodule url for 'third_party/mimalloc' 2025-12-04T08:53:09.6079412Z Synchronizing submodule url for 'third_party/nlohmann' 2025-12-04T08:53:09.6094042Z Synchronizing submodule url for 'third_party/onnx' 2025-12-04T08:53:09.6124827Z Synchronizing submodule url for 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:09.6141332Z Synchronizing submodule url for 'third_party/opentelemetry-cpp' 2025-12-04T08:53:09.6152605Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:09.6165101Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:09.6175729Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:09.6187818Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:09.6200687Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:09.6212269Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:09.6233026Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:09.6246936Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:09.6257427Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:09.6271336Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:09.6294133Z Synchronizing submodule url for 'third_party/pocketfft' 2025-12-04T08:53:09.6306573Z Synchronizing submodule url for 'third_party/protobuf' 2025-12-04T08:53:09.6329085Z Synchronizing submodule url for 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:09.6340952Z Synchronizing submodule url for 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:09.6355102Z Synchronizing submodule url for 'third_party/psimd' 2025-12-04T08:53:09.6365186Z Synchronizing submodule url for 'third_party/pthreadpool' 2025-12-04T08:53:09.6377518Z Synchronizing submodule url for 'third_party/pybind11' 2025-12-04T08:53:09.6389432Z Synchronizing submodule url for 'third_party/python-peachpy' 2025-12-04T08:53:09.6399708Z Synchronizing submodule url for 'third_party/sleef' 2025-12-04T08:53:09.6410640Z Synchronizing submodule url for 'third_party/tensorpipe' 2025-12-04T08:53:09.6422169Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:09.6436257Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:09.6448512Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:09.6462645Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:09.6477431Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:09.6505252Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-12-04T08:53:09.6757551Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-12-04T08:53:09.6819616Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-12-04T08:53:09.6873540Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-12-04T08:53:09.6992572Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-12-04T08:53:09.7066243Z Submodule path 'third_party/NVTX': checked out '3ebbc93ded7285963bff932c678fa367eb393ba6' 2025-12-04T08:53:09.7124628Z Submodule path 'third_party/VulkanMemoryAllocator': checked out '1d8f600fd424278486eade7ed3e877c99f0846b1' 2025-12-04T08:53:10.1962279Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-12-04T08:53:10.2149238Z Submodule path 'third_party/aiter': checked out '01aae101b9e5e94d6c16a9514c9fb8df99c93150' 2025-12-04T08:53:10.2348033Z Submodule path 'third_party/aiter/3rdparty/composable_kernel': checked out 'cffe8fa2a442ac8e80dd236a1a5d24fe3d7e0cbf' 2025-12-04T08:53:10.2472357Z Submodule path 'third_party/benchmark': checked out '299e5928955cc62af9968370293b916f5130916f' 2025-12-04T08:53:10.2661024Z Submodule path 'third_party/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-12-04T08:53:10.2728867Z Submodule path 'third_party/cpp-httplib': checked out '89c932f313c6437c38f2982869beacc89c2f2246' 2025-12-04T08:53:10.3350192Z Submodule path 'third_party/cpuinfo': checked out 'f858c30bcb16f8effd5ff46996f0514539e17abc' 2025-12-04T08:53:10.3440554Z Submodule path 'third_party/cudnn_frontend': checked out '0b1577c8c83401237d601d0d0db5210506705396' 2025-12-04T08:53:10.3571402Z Submodule path 'third_party/cutlass': checked out 'f88806b1e31dfa579842638740216dd41fc6c588' 2025-12-04T08:53:10.4263933Z Submodule path 'third_party/fbgemm': checked out 'c0b988d39a9e47c794d699f29930ed4d7c7e13a4' 2025-12-04T08:53:10.4609471Z Submodule path 'third_party/fbgemm/external/asmjit': checked out 'a3199e8857792cd10b7589ff5d58343d2c9008ea' 2025-12-04T08:53:10.6432197Z Submodule path 'third_party/fbgemm/external/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-12-04T08:53:10.7104221Z Submodule path 'third_party/fbgemm/external/cpuinfo': checked out '6543fec09b2f04ac4a666882998b534afc9c1349' 2025-12-04T08:53:11.1603127Z Submodule path 'third_party/fbgemm/external/cutlass': checked out '98125ce499b0fdf7ffbe0e3052f5b8709f4840f8' 2025-12-04T08:53:11.1829541Z Submodule path 'third_party/fbgemm/external/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:11.1905346Z Submodule path 'third_party/fbgemm/external/hipify_torch': checked out '63b6a7b541fa7f08f8475ca7d74054db36ff2691' 2025-12-04T08:53:11.2482052Z Submodule path 'third_party/fbgemm/external/json': checked out '9cca280a4d0ccf0c08f47a99aa71d1b0e52f8d03' 2025-12-04T08:53:11.2601427Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-12-04T08:53:11.2791884Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-12-04T08:53:11.2914816Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-12-04T08:53:11.3015742Z Submodule path 'third_party/flatbuffers': checked out 'a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757' 2025-12-04T08:53:11.3180249Z Submodule path 'third_party/fmt': checked out '407c905e45ad75fc29bf0f9bb7c5c2fd3475976f' 2025-12-04T08:53:11.3393042Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-12-04T08:53:11.3511185Z Submodule path 'third_party/gloo': checked out '54cbae0d3a67fa890b4c3d9ee162b7860315e341' 2025-12-04T08:53:11.3708981Z Submodule path 'third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:11.3788594Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-12-04T08:53:11.7798482Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-12-04T08:53:11.7914657Z Submodule path 'third_party/ittapi': checked out 'dec1d23ca65ab069d225dfe40dea14f455170959' 2025-12-04T08:53:11.8019720Z Submodule path 'third_party/kineto': checked out '31f85df8fbd89c188f14ef10f1ec65379786b943' 2025-12-04T08:53:11.8124605Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out 'd2ffe0a4e3acace628db49974246b66fc3e85fb1' 2025-12-04T08:53:11.8210297Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-12-04T08:53:11.8298851Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-12-04T08:53:11.8372725Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-12-04T08:53:11.8442622Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-12-04T08:53:11.8502636Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-12-04T08:53:11.8557304Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-12-04T08:53:11.8634351Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:11.8731237Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-12-04T08:53:11.8793515Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-12-04T08:53:11.8863373Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp': checked out 'b1234816facfdda29845c46696a02998a4af115a' 2025-12-04T08:53:11.8971549Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'd7ba35bbb649209c66e582d5a0244ba988a15159' 2025-12-04T08:53:11.9024890Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-12-04T08:53:11.9095099Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '40626af88bd7df9a5fb80be7b25ac85b122d6c21' 2025-12-04T08:53:11.9155609Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:11.9252336Z Submodule path 'third_party/kleidiai': checked out 'd7770c89632329a9914ef1a90289917597639cbe' 2025-12-04T08:53:11.9331313Z Submodule path 'third_party/mimalloc': checked out 'fbd8b99c2b828428947d70fdc046bb55609be93e' 2025-12-04T08:53:11.9412382Z Submodule path 'third_party/nlohmann': checked out '55f93686c01528224f448c19128836e7df245f72' 2025-12-04T08:53:12.1145811Z Submodule path 'third_party/onnx': checked out 'e709452ef2bbc1d113faf678c24e6d3467696e83' 2025-12-04T08:53:12.1333979Z Submodule path 'third_party/onnx/third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-12-04T08:53:12.1445991Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-12-04T08:53:12.1519406Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-12-04T08:53:12.1590307Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-12-04T08:53:12.1666477Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-12-04T08:53:12.1751743Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-12-04T08:53:12.1806894Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-12-04T08:53:12.1860625Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-12-04T08:53:12.1932424Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-12-04T08:53:12.2000737Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-12-04T08:53:12.2062371Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-12-04T08:53:12.2205703Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-12-04T08:53:12.2277017Z Submodule path 'third_party/pocketfft': checked out '0fa0ef591e38c2758e3184c6c23e497b9f732ffa' 2025-12-04T08:53:12.3588171Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-12-04T08:53:12.3700967Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-12-04T08:53:12.3926149Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-12-04T08:53:12.4009677Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-12-04T08:53:12.4106025Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-12-04T08:53:12.4305807Z Submodule path 'third_party/pybind11': checked out 'f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8' 2025-12-04T08:53:12.4544406Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-12-04T08:53:12.4792114Z Submodule path 'third_party/sleef': checked out '5a1d179df9cf652951b59010a2d2075372d67f68' 2025-12-04T08:53:12.4897263Z Submodule path 'third_party/tensorpipe': checked out '2b4cd91092d335a697416b2a3cb398283246849d' 2025-12-04T08:53:12.5091331Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-12-04T08:53:12.5180711Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-12-04T08:53:12.5471356Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '5152db2cbfeb5582e9c27c5ea1dba2cd9e10759b' 2025-12-04T08:53:12.5601768Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-12-04T08:53:12.5684466Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-12-04T08:53:12.5718037Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-12-04T08:53:12.5925418Z Entering 'android/libs/fbjni' 2025-12-04T08:53:12.5948119Z Entering 'third_party/FP16' 2025-12-04T08:53:12.5971793Z Entering 'third_party/FXdiv' 2025-12-04T08:53:12.6004492Z Entering 'third_party/NNPACK' 2025-12-04T08:53:12.6024734Z Entering 'third_party/NVTX' 2025-12-04T08:53:12.6068557Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:12.6097967Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:12.6131893Z Entering 'third_party/aiter' 2025-12-04T08:53:12.6161044Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:12.6195707Z Entering 'third_party/benchmark' 2025-12-04T08:53:12.6216647Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:12.6239836Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:12.6268740Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:12.6292350Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:12.6317001Z Entering 'third_party/cutlass' 2025-12-04T08:53:12.6343046Z Entering 'third_party/fbgemm' 2025-12-04T08:53:12.6367548Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:12.6400750Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:12.6423964Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:12.6448741Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:12.6477053Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:12.6503587Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:12.6527572Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:12.6557289Z Entering 'third_party/flash-attention' 2025-12-04T08:53:12.6588631Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:12.6608823Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:12.6641150Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:12.6668512Z Entering 'third_party/fmt' 2025-12-04T08:53:12.6689781Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:12.6710661Z Entering 'third_party/gloo' 2025-12-04T08:53:12.6730884Z Entering 'third_party/googletest' 2025-12-04T08:53:12.6755256Z Entering 'third_party/ideep' 2025-12-04T08:53:12.6776317Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:12.6797654Z Entering 'third_party/ittapi' 2025-12-04T08:53:12.6818072Z Entering 'third_party/kineto' 2025-12-04T08:53:12.6840121Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:12.6858299Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:12.6877909Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:12.6896947Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:12.6915160Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:12.6940529Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:12.6963555Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:12.6982521Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:12.7012793Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:12.7037985Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:12.7061058Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:12.7081362Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:12.7104484Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:12.7128299Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:12.7149811Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:12.7172659Z Entering 'third_party/kleidiai' 2025-12-04T08:53:12.7192210Z Entering 'third_party/mimalloc' 2025-12-04T08:53:12.7212006Z Entering 'third_party/nlohmann' 2025-12-04T08:53:12.7231281Z Entering 'third_party/onnx' 2025-12-04T08:53:12.7261269Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:12.7283994Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:12.7303711Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:12.7322768Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:12.7348850Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:12.7372098Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:12.7392636Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:12.7417720Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:12.7436886Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:12.7458916Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:12.7477187Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:12.7500096Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:12.7528323Z Entering 'third_party/pocketfft' 2025-12-04T08:53:12.7555052Z Entering 'third_party/protobuf' 2025-12-04T08:53:12.7576591Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:12.7597227Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:12.7623666Z Entering 'third_party/psimd' 2025-12-04T08:53:12.7643337Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:12.7662745Z Entering 'third_party/pybind11' 2025-12-04T08:53:12.7684032Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:12.7702982Z Entering 'third_party/sleef' 2025-12-04T08:53:12.7722440Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:12.7742040Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:12.7760895Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:12.7779578Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:12.7798619Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:12.7819301Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:12.7849978Z ##[endgroup] 2025-12-04T08:53:12.7850226Z ##[group]Persisting credentials for submodules 2025-12-04T08:53:12.7856203Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-12-04T08:53:12.8014669Z Entering 'android/libs/fbjni' 2025-12-04T08:53:12.8042859Z Entering 'third_party/FP16' 2025-12-04T08:53:12.8067721Z Entering 'third_party/FXdiv' 2025-12-04T08:53:12.8087989Z Entering 'third_party/NNPACK' 2025-12-04T08:53:12.8110304Z Entering 'third_party/NVTX' 2025-12-04T08:53:12.8131968Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:12.8153547Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:12.8182747Z Entering 'third_party/aiter' 2025-12-04T08:53:12.8205820Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:12.8232433Z Entering 'third_party/benchmark' 2025-12-04T08:53:12.8278239Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:12.8306490Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:12.8334202Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:12.8371980Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:12.8406871Z Entering 'third_party/cutlass' 2025-12-04T08:53:12.8441655Z Entering 'third_party/fbgemm' 2025-12-04T08:53:12.8473390Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:12.8496381Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:12.8527705Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:12.8549100Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:12.8577370Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:12.8597521Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:12.8620594Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:12.8646308Z Entering 'third_party/flash-attention' 2025-12-04T08:53:12.8668917Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:12.8697392Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:12.8732355Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:12.8762099Z Entering 'third_party/fmt' 2025-12-04T08:53:12.8787569Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:12.8812253Z Entering 'third_party/gloo' 2025-12-04T08:53:12.8835374Z Entering 'third_party/googletest' 2025-12-04T08:53:12.8857023Z Entering 'third_party/ideep' 2025-12-04T08:53:12.8877846Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:12.8905256Z Entering 'third_party/ittapi' 2025-12-04T08:53:12.8931614Z Entering 'third_party/kineto' 2025-12-04T08:53:12.8957228Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:12.8978665Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:12.9002859Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:12.9036926Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:12.9070305Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:12.9095888Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:12.9120853Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:12.9154290Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:12.9176617Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:12.9198556Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:12.9219153Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:12.9241258Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:12.9263824Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:12.9287027Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:12.9309366Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:12.9341052Z Entering 'third_party/kleidiai' 2025-12-04T08:53:12.9363413Z Entering 'third_party/mimalloc' 2025-12-04T08:53:12.9390256Z Entering 'third_party/nlohmann' 2025-12-04T08:53:12.9417183Z Entering 'third_party/onnx' 2025-12-04T08:53:12.9460704Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:12.9494407Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:12.9518994Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:12.9545371Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:12.9567556Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:12.9594338Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:12.9617345Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:12.9636965Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:12.9656432Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:12.9677297Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:12.9701293Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:12.9731672Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:12.9767770Z Entering 'third_party/pocketfft' 2025-12-04T08:53:12.9790339Z Entering 'third_party/protobuf' 2025-12-04T08:53:12.9813900Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:12.9839695Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:12.9867510Z Entering 'third_party/psimd' 2025-12-04T08:53:12.9890730Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:12.9913108Z Entering 'third_party/pybind11' 2025-12-04T08:53:12.9938515Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:12.9960956Z Entering 'third_party/sleef' 2025-12-04T08:53:12.9982253Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:13.0006389Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:13.0028354Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:13.0062915Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:13.0095373Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:13.0130454Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:13.0179523Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-12-04T08:53:13.0355037Z Entering 'android/libs/fbjni' 2025-12-04T08:53:13.0378134Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T08:53:13.0386983Z Entering 'third_party/FP16' 2025-12-04T08:53:13.0412763Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T08:53:13.0422164Z Entering 'third_party/FXdiv' 2025-12-04T08:53:13.0441730Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T08:53:13.0456288Z Entering 'third_party/NNPACK' 2025-12-04T08:53:13.0479370Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T08:53:13.0489432Z Entering 'third_party/NVTX' 2025-12-04T08:53:13.0511297Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T08:53:13.0523277Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:13.0543300Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T08:53:13.0553590Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:13.0576053Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T08:53:13.0599282Z Entering 'third_party/aiter' 2025-12-04T08:53:13.0619005Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T08:53:13.0635775Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:13.0656490Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T08:53:13.0671032Z Entering 'third_party/benchmark' 2025-12-04T08:53:13.0696930Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:13.0706159Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:13.0727401Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T08:53:13.0740288Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:13.0760059Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T08:53:13.0773694Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:13.0794675Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T08:53:13.0806719Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:13.0829068Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T08:53:13.0838835Z Entering 'third_party/cutlass' 2025-12-04T08:53:13.0858606Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T08:53:13.0874046Z Entering 'third_party/fbgemm' 2025-12-04T08:53:13.0897767Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T08:53:13.0909236Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:13.0930685Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T08:53:13.0941206Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:13.0960981Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T08:53:13.0974696Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:13.0999131Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T08:53:13.1013945Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:13.1035284Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T08:53:13.1049594Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:13.1088571Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T08:53:13.1099505Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:13.1134865Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T08:53:13.1144379Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:13.1180523Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T08:53:13.1193763Z Entering 'third_party/flash-attention' 2025-12-04T08:53:13.1213872Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T08:53:13.1226954Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:13.1248122Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T08:53:13.1259063Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:13.1279243Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T08:53:13.1293197Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:13.1315878Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T08:53:13.1326778Z Entering 'third_party/fmt' 2025-12-04T08:53:13.1345421Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:13.1355542Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:13.1374584Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T08:53:13.1387905Z Entering 'third_party/gloo' 2025-12-04T08:53:13.1407819Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T08:53:13.1421543Z Entering 'third_party/googletest' 2025-12-04T08:53:13.1447674Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.1458017Z Entering 'third_party/ideep' 2025-12-04T08:53:13.1488339Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T08:53:13.1499750Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:13.1532423Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T08:53:13.1553215Z Entering 'third_party/ittapi' 2025-12-04T08:53:13.1573250Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T08:53:13.1582378Z Entering 'third_party/kineto' 2025-12-04T08:53:13.1603116Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T08:53:13.1614827Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:13.1637830Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T08:53:13.1647212Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:13.1674256Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T08:53:13.1684856Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:13.1707569Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T08:53:13.1718684Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:13.1738268Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:13.1753251Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:13.1781030Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T08:53:13.1795511Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:13.1815203Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T08:53:13.1830376Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:13.1852675Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T08:53:13.1862468Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:13.1882168Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.1891451Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:13.1909948Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T08:53:13.1919562Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:13.1945913Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T08:53:13.1959486Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:13.1989746Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:13.2003124Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.2029612Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:13.2047293Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.2068602Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:13.2081807Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:13.2107754Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T08:53:13.2120403Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:13.2149668Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.2162727Z Entering 'third_party/kleidiai' 2025-12-04T08:53:13.2184578Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T08:53:13.2201472Z Entering 'third_party/mimalloc' 2025-12-04T08:53:13.2224387Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T08:53:13.2234525Z Entering 'third_party/nlohmann' 2025-12-04T08:53:13.2266124Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T08:53:13.2278423Z Entering 'third_party/onnx' 2025-12-04T08:53:13.2301516Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T08:53:13.2323956Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:13.2350067Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:13.2366891Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:13.2389518Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T08:53:13.2399591Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:13.2433380Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:13.2444187Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:13.2478088Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.2488994Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:13.2516760Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T08:53:13.2527695Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:13.2552172Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T08:53:13.2563292Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:13.2590152Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T08:53:13.2600252Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:13.2628500Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T08:53:13.2639231Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:13.2662099Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:13.2672648Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.2711148Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:13.2727351Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.2754782Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:13.2768951Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:13.2792919Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T08:53:13.2815436Z Entering 'third_party/pocketfft' 2025-12-04T08:53:13.2835769Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T08:53:13.2846922Z Entering 'third_party/protobuf' 2025-12-04T08:53:13.2874319Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T08:53:13.2886158Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:13.2909089Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:13.2922843Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:13.2951014Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.2965519Z Entering 'third_party/psimd' 2025-12-04T08:53:13.2990107Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T08:53:13.3001968Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:13.3027027Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T08:53:13.3037635Z Entering 'third_party/pybind11' 2025-12-04T08:53:13.3059226Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:13.3071664Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:13.3100578Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T08:53:13.3110463Z Entering 'third_party/sleef' 2025-12-04T08:53:13.3139769Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T08:53:13.3152781Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:13.3176136Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T08:53:13.3186802Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:13.3209455Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:13.3221502Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:13.3244453Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T08:53:13.3256008Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:13.3285736Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T08:53:13.3297255Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:13.3318662Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:13.3325951Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:13.3350008Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T08:53:13.3553806Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-12-04T08:53:13.3752195Z Entering 'android/libs/fbjni' 2025-12-04T08:53:13.3779024Z Entering 'third_party/FP16' 2025-12-04T08:53:13.3826796Z Entering 'third_party/FXdiv' 2025-12-04T08:53:13.3853157Z Entering 'third_party/NNPACK' 2025-12-04T08:53:13.3891214Z Entering 'third_party/NVTX' 2025-12-04T08:53:13.3917977Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:13.3941236Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:13.3967659Z Entering 'third_party/aiter' 2025-12-04T08:53:13.3989083Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:13.4025918Z Entering 'third_party/benchmark' 2025-12-04T08:53:13.4062836Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:13.4092136Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:13.4115087Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:13.4139543Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:13.4164777Z Entering 'third_party/cutlass' 2025-12-04T08:53:13.4194829Z Entering 'third_party/fbgemm' 2025-12-04T08:53:13.4220134Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:13.4245772Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:13.4275157Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:13.4298484Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:13.4322263Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:13.4342840Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:13.4368403Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:13.4391585Z Entering 'third_party/flash-attention' 2025-12-04T08:53:13.4414769Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:13.4437254Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:13.4463412Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:13.4486645Z Entering 'third_party/fmt' 2025-12-04T08:53:13.4509154Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:13.4531218Z Entering 'third_party/gloo' 2025-12-04T08:53:13.4561427Z Entering 'third_party/googletest' 2025-12-04T08:53:13.4585944Z Entering 'third_party/ideep' 2025-12-04T08:53:13.4607136Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:13.4631511Z Entering 'third_party/ittapi' 2025-12-04T08:53:13.4661519Z Entering 'third_party/kineto' 2025-12-04T08:53:13.4683911Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:13.4714700Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:13.4735271Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:13.4756944Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:13.4778039Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:13.4797188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:13.4819665Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:13.4839373Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:13.4858611Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:13.4878078Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:13.4897251Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:13.4916000Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.4945157Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.4970003Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:13.4992331Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:13.5014886Z Entering 'third_party/kleidiai' 2025-12-04T08:53:13.5041531Z Entering 'third_party/mimalloc' 2025-12-04T08:53:13.5064846Z Entering 'third_party/nlohmann' 2025-12-04T08:53:13.5087389Z Entering 'third_party/onnx' 2025-12-04T08:53:13.5116736Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:13.5155572Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:13.5185228Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:13.5217141Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:13.5243461Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:13.5269273Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:13.5296082Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:13.5317391Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:13.5339975Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:13.5359239Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.5384519Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.5406489Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:13.5435482Z Entering 'third_party/pocketfft' 2025-12-04T08:53:13.5458108Z Entering 'third_party/protobuf' 2025-12-04T08:53:13.5481211Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:13.5504243Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:13.5535952Z Entering 'third_party/psimd' 2025-12-04T08:53:13.5559818Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:13.5580585Z Entering 'third_party/pybind11' 2025-12-04T08:53:13.5601515Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:13.5623402Z Entering 'third_party/sleef' 2025-12-04T08:53:13.5645261Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:13.5666892Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:13.5688528Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:13.5708542Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:13.5727312Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:13.5746118Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:13.5788282Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-12-04T08:53:13.5963643Z Entering 'android/libs/fbjni' 2025-12-04T08:53:13.5986771Z Entering 'third_party/FP16' 2025-12-04T08:53:13.6008708Z Entering 'third_party/FXdiv' 2025-12-04T08:53:13.6029270Z Entering 'third_party/NNPACK' 2025-12-04T08:53:13.6048574Z Entering 'third_party/NVTX' 2025-12-04T08:53:13.6069434Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:13.6094653Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:13.6130748Z Entering 'third_party/aiter' 2025-12-04T08:53:13.6152118Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:13.6188793Z Entering 'third_party/benchmark' 2025-12-04T08:53:13.6213038Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:13.6244924Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:13.6266005Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:13.6289408Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:13.6310440Z Entering 'third_party/cutlass' 2025-12-04T08:53:13.6336341Z Entering 'third_party/fbgemm' 2025-12-04T08:53:13.6357583Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:13.6381544Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:13.6404803Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:13.6429709Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:13.6452922Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:13.6480833Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:13.6499864Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:13.6522294Z Entering 'third_party/flash-attention' 2025-12-04T08:53:13.6541829Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:13.6568427Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:13.6593870Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:13.6616302Z Entering 'third_party/fmt' 2025-12-04T08:53:13.6636718Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:13.6657261Z Entering 'third_party/gloo' 2025-12-04T08:53:13.6679989Z Entering 'third_party/googletest' 2025-12-04T08:53:13.6700329Z Entering 'third_party/ideep' 2025-12-04T08:53:13.6719638Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:13.6759388Z Entering 'third_party/ittapi' 2025-12-04T08:53:13.6780619Z Entering 'third_party/kineto' 2025-12-04T08:53:13.6805045Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:13.6824843Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:13.6854493Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:13.6875912Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:13.6905315Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:13.6931609Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:13.6963658Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:13.6992795Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:13.7011499Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:13.7031985Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:13.7051987Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:13.7071452Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.7098245Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.7127538Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:13.7148997Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:13.7172375Z Entering 'third_party/kleidiai' 2025-12-04T08:53:13.7198729Z Entering 'third_party/mimalloc' 2025-12-04T08:53:13.7218958Z Entering 'third_party/nlohmann' 2025-12-04T08:53:13.7240517Z Entering 'third_party/onnx' 2025-12-04T08:53:13.7266173Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:13.7290823Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:13.7311340Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:13.7333678Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:13.7353236Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:13.7376272Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:13.7399015Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:13.7421899Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:13.7442195Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:13.7460775Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:13.7489254Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:13.7512754Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:13.7539709Z Entering 'third_party/pocketfft' 2025-12-04T08:53:13.7559726Z Entering 'third_party/protobuf' 2025-12-04T08:53:13.7581607Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:13.7603679Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:13.7626552Z Entering 'third_party/psimd' 2025-12-04T08:53:13.7646917Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:13.7677429Z Entering 'third_party/pybind11' 2025-12-04T08:53:13.7700381Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:13.7721233Z Entering 'third_party/sleef' 2025-12-04T08:53:13.7749085Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:13.7776683Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:13.7803236Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:13.7829732Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:13.7850659Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:13.7876208Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:13.7919170Z ##[endgroup] 2025-12-04T08:53:13.8079203Z [command]/usr/bin/git log -1 --format=%H 2025-12-04T08:53:13.8166519Z ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:13.8286029Z ##[group]Run actions/checkout@v4 2025-12-04T08:53:13.8286169Z with: 2025-12-04T08:53:13.8286278Z ref: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:13.8286418Z fetch-depth: 0 2025-12-04T08:53:13.8286521Z submodules: recursive 2025-12-04T08:53:13.8286627Z show-progress: false 2025-12-04T08:53:13.8286746Z repository: pytorch/pytorch 2025-12-04T08:53:13.8286905Z token: *** 2025-12-04T08:53:13.8286998Z ssh-strict: true 2025-12-04T08:53:13.8287097Z ssh-user: git 2025-12-04T08:53:13.8287195Z persist-credentials: true 2025-12-04T08:53:13.8287310Z clean: true 2025-12-04T08:53:13.8287415Z sparse-checkout-cone-mode: true 2025-12-04T08:53:13.8287553Z fetch-tags: false 2025-12-04T08:53:13.8287650Z lfs: false 2025-12-04T08:53:13.8287742Z set-safe-directory: true 2025-12-04T08:53:13.8287846Z env: 2025-12-04T08:53:13.8287937Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:13.8288054Z ##[endgroup] 2025-12-04T08:53:13.8773366Z Syncing repository: pytorch/pytorch 2025-12-04T08:53:13.8773709Z ##[group]Getting Git version info 2025-12-04T08:53:13.8773894Z Working directory is '/home/runner/_work/pytorch/pytorch' 2025-12-04T08:53:13.8787130Z [command]/usr/bin/git version 2025-12-04T08:53:13.8811988Z git version 2.52.0 2025-12-04T08:53:13.8830321Z ##[endgroup] 2025-12-04T08:53:13.8836199Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/741ee72b-4719-4f00-baea-5fd9c6b3f9af/.gitconfig' 2025-12-04T08:53:13.8842189Z Temporarily overriding HOME='/home/runner/_work/_temp/741ee72b-4719-4f00-baea-5fd9c6b3f9af' before making global git config changes 2025-12-04T08:53:13.8842508Z Adding repository directory to the temporary git global config as a safe directory 2025-12-04T08:53:13.8845128Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-12-04T08:53:13.8881408Z [command]/usr/bin/git config --local --get remote.origin.url 2025-12-04T08:53:13.8900138Z https://github.com/pytorch/pytorch 2025-12-04T08:53:13.8919117Z ##[group]Removing previously created refs, to avoid conflicts 2025-12-04T08:53:13.8923346Z [command]/usr/bin/git rev-parse --symbolic-full-name --verify --quiet HEAD 2025-12-04T08:53:13.8946578Z HEAD 2025-12-04T08:53:13.8986606Z ##[endgroup] 2025-12-04T08:53:13.8988795Z [command]/usr/bin/git submodule status 2025-12-04T08:53:13.9208830Z 7e1e1fe3858c63c251c637ae41a20de425dde96f android/libs/fbjni (v0.1.0-12-g7e1e1fe) 2025-12-04T08:53:13.9268297Z 4dfe081cf6bcd15db339cf2680b9281b8451eeb3 third_party/FP16 (4dfe081) 2025-12-04T08:53:13.9331688Z b408327ac2a15ec3e43352421954f5b1967701d1 third_party/FXdiv (b408327) 2025-12-04T08:53:13.9410062Z c07e3a0400713d546e0dea2d5466dd22ea389c73 third_party/NNPACK (c07e3a0) 2025-12-04T08:53:13.9457300Z 3ebbc93ded7285963bff932c678fa367eb393ba6 third_party/NVTX (v3.1.0-313-g3ebbc93) 2025-12-04T08:53:13.9509857Z 1d8f600fd424278486eade7ed3e877c99f0846b1 third_party/VulkanMemoryAllocator (v2.1.0-982-g1d8f600) 2025-12-04T08:53:13.9804514Z 51a0103656eff6fc9bfd39a4597923c4b542c883 third_party/XNNPACK (remotes/origin/ds/ndk-1243-g51a0103656) 2025-12-04T08:53:13.9838427Z 01aae101b9e5e94d6c16a9514c9fb8df99c93150 third_party/aiter (v0.1.1-92-g01aae101) 2025-12-04T08:53:13.9855713Z 299e5928955cc62af9968370293b916f5130916f third_party/benchmark (v1.9.3) 2025-12-04T08:53:13.9912544Z 7fe50dc3da2069d6645d9deb8c017a876472a977 third_party/composable_kernel (rocm-6.4.3-459-g7fe50dc3d) 2025-12-04T08:53:13.9999447Z 89c932f313c6437c38f2982869beacc89c2f2246 third_party/cpp-httplib (v0.26.0) 2025-12-04T08:53:14.0071740Z f858c30bcb16f8effd5ff46996f0514539e17abc third_party/cpuinfo (f858c30) 2025-12-04T08:53:14.0097066Z 0b1577c8c83401237d601d0d0db5210506705396 third_party/cudnn_frontend (v0.5-61-g0b1577c) 2025-12-04T08:53:14.0173197Z f88806b1e31dfa579842638740216dd41fc6c588 third_party/cutlass (v4.3.1) 2025-12-04T08:53:14.0196259Z c0b988d39a9e47c794d699f29930ed4d7c7e13a4 third_party/fbgemm (v1.4.0-rc1-2-gc0b988d39) 2025-12-04T08:53:14.0268796Z 979702c87a8713a8e0a5e9fee122b90d2ef13be5 third_party/flash-attention (v2.7.4) 2025-12-04T08:53:14.0281958Z a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757 third_party/flatbuffers (v24.12.23) 2025-12-04T08:53:14.0524099Z 407c905e45ad75fc29bf0f9bb7c5c2fd3475976f third_party/fmt (12.1.0) 2025-12-04T08:53:14.0586398Z 3fb5c176c17c765a3492cd2f0321b0dab712f350 third_party/gemmlowp/gemmlowp (remotes/origin/revert-87-master-135-g3fb5c17) 2025-12-04T08:53:14.0669137Z 54cbae0d3a67fa890b4c3d9ee162b7860315e341 third_party/gloo (remotes/origin/gh/c-p-i-o/1/base-37-g54cbae0) 2025-12-04T08:53:14.0803684Z 52eb8108c5bdec04579160ae17225d66034bd723 third_party/googletest (release-1.8.0-3544-g52eb8108) 2025-12-04T08:53:14.0855176Z 719d8e6cd7f7a0e01b155657526d693acf97c2b3 third_party/ideep (pytorch-rls-v3.7.1) 2025-12-04T08:53:14.0894221Z dec1d23ca65ab069d225dfe40dea14f455170959 third_party/ittapi (v3.25.5) 2025-12-04T08:53:14.1029336Z 31f85df8fbd89c188f14ef10f1ec65379786b943 third_party/kineto (heads/main) 2025-12-04T08:53:14.1050354Z d7770c89632329a9914ef1a90289917597639cbe third_party/kleidiai (v1.15.0) 2025-12-04T08:53:14.1072436Z fbd8b99c2b828428947d70fdc046bb55609be93e third_party/mimalloc (v2.2.4) 2025-12-04T08:53:14.1095274Z 55f93686c01528224f448c19128836e7df245f72 third_party/nlohmann (v3.12.0) 2025-12-04T08:53:14.1305426Z e709452ef2bbc1d113faf678c24e6d3467696e83 third_party/onnx (v1.18.0) 2025-12-04T08:53:14.1325507Z a799f4aed9c94b765dcdaabaeab7d5e7e2310878 third_party/opentelemetry-cpp (v1.14.2) 2025-12-04T08:53:14.1354604Z 0fa0ef591e38c2758e3184c6c23e497b9f732ffa third_party/pocketfft (release_for_eigen-40-g0fa0ef5) 2025-12-04T08:53:14.1583860Z d1eca4e4b421cd2997495c4b4e65cea6be4e9b8a third_party/protobuf (v3.7.0-rc.2-1279-gd1eca4e4b) 2025-12-04T08:53:14.1644979Z 072586a71b55b7f8c584153d223e95687148a900 third_party/psimd (heads/master) 2025-12-04T08:53:14.1695128Z 4fe0e1e183925bf8cfa6aae24237e724a96479b8 third_party/pthreadpool (0.1-144-g4fe0e1e) 2025-12-04T08:53:14.1716601Z f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8 third_party/pybind11 (v3.0.1) 2025-12-04T08:53:14.1769667Z f45429b087dd7d5bc78bb40dc7cf06425c252d67 third_party/python-peachpy (remotes/origin/pre-generated) 2025-12-04T08:53:14.1828970Z 5a1d179df9cf652951b59010a2d2075372d67f68 third_party/sleef (3.8) 2025-12-04T08:53:14.1873281Z 2b4cd91092d335a697416b2a3cb398283246849d third_party/tensorpipe (heads/main) 2025-12-04T08:53:14.1883464Z ##[group]Cleaning the repository 2025-12-04T08:53:14.1889535Z [command]/usr/bin/git clean -ffdx 2025-12-04T08:53:14.2003655Z [command]/usr/bin/git reset --hard HEAD 2025-12-04T08:53:14.2745695Z HEAD is now at ffd9b0fb4355 Resolve collective autotuning test failure on arm (#168919) 2025-12-04T08:53:14.2794932Z ##[endgroup] 2025-12-04T08:53:14.2797881Z ##[group]Disabling automatic garbage collection 2025-12-04T08:53:14.2804119Z [command]/usr/bin/git config --local gc.auto 0 2025-12-04T08:53:14.2827889Z ##[endgroup] 2025-12-04T08:53:14.2828134Z ##[group]Setting up auth 2025-12-04T08:53:14.2832323Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-12-04T08:53:14.2859789Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-12-04T08:53:14.3067136Z Entering 'android/libs/fbjni' 2025-12-04T08:53:14.3088518Z Entering 'third_party/FP16' 2025-12-04T08:53:14.3108157Z Entering 'third_party/FXdiv' 2025-12-04T08:53:14.3132317Z Entering 'third_party/NNPACK' 2025-12-04T08:53:14.3162366Z Entering 'third_party/NVTX' 2025-12-04T08:53:14.3190276Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:14.3225972Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:14.3267435Z Entering 'third_party/aiter' 2025-12-04T08:53:14.3301407Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:14.3343033Z Entering 'third_party/benchmark' 2025-12-04T08:53:14.3365957Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:14.3390129Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:14.3412307Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:14.3432268Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:14.3459529Z Entering 'third_party/cutlass' 2025-12-04T08:53:14.3498507Z Entering 'third_party/fbgemm' 2025-12-04T08:53:14.3531129Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:14.3552176Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:14.3585267Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:14.3614278Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:14.3643266Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:14.3671302Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:14.3697325Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:14.3725950Z Entering 'third_party/flash-attention' 2025-12-04T08:53:14.3749458Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:14.3773393Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:14.3803006Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:14.3829418Z Entering 'third_party/fmt' 2025-12-04T08:53:14.3857500Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:14.3879383Z Entering 'third_party/gloo' 2025-12-04T08:53:14.3912162Z Entering 'third_party/googletest' 2025-12-04T08:53:14.3936942Z Entering 'third_party/ideep' 2025-12-04T08:53:14.3963134Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:14.3992372Z Entering 'third_party/ittapi' 2025-12-04T08:53:14.4017141Z Entering 'third_party/kineto' 2025-12-04T08:53:14.4040929Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:14.4065917Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:14.4088123Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:14.4110796Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:14.4132110Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:14.4152826Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:14.4174115Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:14.4195469Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:14.4217910Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:14.4238679Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:14.4261646Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:14.4288865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:14.4313542Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:14.4345125Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:14.4371563Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:14.4394478Z Entering 'third_party/kleidiai' 2025-12-04T08:53:14.4417958Z Entering 'third_party/mimalloc' 2025-12-04T08:53:14.4442861Z Entering 'third_party/nlohmann' 2025-12-04T08:53:14.4469728Z Entering 'third_party/onnx' 2025-12-04T08:53:14.4503887Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:14.4535037Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:14.4561808Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:14.4587726Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:14.4612312Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:14.4640366Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:14.4667364Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:14.4689025Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:14.4713282Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:14.4744445Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:14.4769379Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:14.4799495Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:14.4829402Z Entering 'third_party/pocketfft' 2025-12-04T08:53:14.4850490Z Entering 'third_party/protobuf' 2025-12-04T08:53:14.4871571Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:14.4897996Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:14.4922907Z Entering 'third_party/psimd' 2025-12-04T08:53:14.4949506Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:14.4973798Z Entering 'third_party/pybind11' 2025-12-04T08:53:14.4995656Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:14.5016880Z Entering 'third_party/sleef' 2025-12-04T08:53:14.5036941Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:14.5066214Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:14.5088904Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:14.5112374Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:14.5134400Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:14.5154600Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:14.5201129Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-12-04T08:53:14.5224420Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5233891Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-12-04T08:53:14.5263192Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-12-04T08:53:14.5484396Z Entering 'android/libs/fbjni' 2025-12-04T08:53:14.5497409Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5519671Z Entering 'third_party/FP16' 2025-12-04T08:53:14.5533615Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5552301Z Entering 'third_party/FXdiv' 2025-12-04T08:53:14.5569218Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5590654Z Entering 'third_party/NNPACK' 2025-12-04T08:53:14.5605898Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5626576Z Entering 'third_party/NVTX' 2025-12-04T08:53:14.5640165Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5664527Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:14.5678559Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5696067Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:14.5709654Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5732366Z Entering 'third_party/aiter' 2025-12-04T08:53:14.5749462Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5770314Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:14.5784636Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5808689Z Entering 'third_party/benchmark' 2025-12-04T08:53:14.5825491Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5844451Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:14.5857689Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5878588Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:14.5893699Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5912058Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:14.5926193Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5943972Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:14.5960055Z http.https://github.com/.extraheader 2025-12-04T08:53:14.5979632Z Entering 'third_party/cutlass' 2025-12-04T08:53:14.5993179Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6014674Z Entering 'third_party/fbgemm' 2025-12-04T08:53:14.6028535Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6047657Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:14.6061442Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6078607Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:14.6104781Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6130826Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:14.6145264Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6161220Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:14.6187035Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6217520Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:14.6238807Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6257858Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:14.6277471Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6300403Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:14.6322278Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6341579Z Entering 'third_party/flash-attention' 2025-12-04T08:53:14.6360929Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6383966Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:14.6404341Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6431238Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:14.6445014Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6466264Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:14.6481682Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6503397Z Entering 'third_party/fmt' 2025-12-04T08:53:14.6520992Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6538290Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:14.6553114Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6579614Z Entering 'third_party/gloo' 2025-12-04T08:53:14.6592737Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6609722Z Entering 'third_party/googletest' 2025-12-04T08:53:14.6623703Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6638956Z Entering 'third_party/ideep' 2025-12-04T08:53:14.6655983Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6675568Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:14.6689860Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6712875Z Entering 'third_party/ittapi' 2025-12-04T08:53:14.6726856Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6748945Z Entering 'third_party/kineto' 2025-12-04T08:53:14.6762226Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6780510Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:14.6793539Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6808980Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:14.6822085Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6839938Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:14.6853040Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6876809Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:14.6892106Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6909054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:14.6921494Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6937700Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:14.6949871Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6971287Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:14.6983265Z http.https://github.com/.extraheader 2025-12-04T08:53:14.6999237Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:14.7010719Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7028762Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:14.7041625Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7058755Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:14.7075768Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7092916Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:14.7106120Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7125899Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:14.7143602Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7169390Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:14.7185251Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7209723Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:14.7231375Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7257127Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:14.7274720Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7295604Z Entering 'third_party/kleidiai' 2025-12-04T08:53:14.7308560Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7326366Z Entering 'third_party/mimalloc' 2025-12-04T08:53:14.7341442Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7361923Z Entering 'third_party/nlohmann' 2025-12-04T08:53:14.7376517Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7400433Z Entering 'third_party/onnx' 2025-12-04T08:53:14.7412781Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7438423Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:14.7458963Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7486011Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:14.7498259Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7517208Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:14.7531361Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7554406Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:14.7568173Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7585308Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:14.7598257Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7614960Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:14.7632246Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7650425Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:14.7662830Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7679272Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:14.7692116Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7710137Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:14.7722300Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7737125Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:14.7750011Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7766223Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:14.7780919Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7803732Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:14.7829814Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7860149Z Entering 'third_party/pocketfft' 2025-12-04T08:53:14.7872117Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7889180Z Entering 'third_party/protobuf' 2025-12-04T08:53:14.7902017Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7920131Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:14.7933889Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7950665Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:14.7965696Z http.https://github.com/.extraheader 2025-12-04T08:53:14.7982857Z Entering 'third_party/psimd' 2025-12-04T08:53:14.7995940Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8012135Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:14.8024048Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8039214Z Entering 'third_party/pybind11' 2025-12-04T08:53:14.8051188Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8068241Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:14.8081349Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8098018Z Entering 'third_party/sleef' 2025-12-04T08:53:14.8110868Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8135495Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:14.8148484Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8169746Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:14.8182710Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8202742Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:14.8215695Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8232135Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:14.8248101Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8265215Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:14.8278066Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8307689Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:14.8333339Z http.https://github.com/.extraheader 2025-12-04T08:53:14.8383055Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:14.8412588Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url 2025-12-04T08:53:14.8599305Z Entering 'android/libs/fbjni' 2025-12-04T08:53:14.8613644Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T08:53:14.8627574Z Entering 'third_party/FP16' 2025-12-04T08:53:14.8641131Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T08:53:14.8651016Z Entering 'third_party/FXdiv' 2025-12-04T08:53:14.8663537Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T08:53:14.8672023Z Entering 'third_party/NNPACK' 2025-12-04T08:53:14.8684078Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T08:53:14.8692847Z Entering 'third_party/NVTX' 2025-12-04T08:53:14.8703010Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T08:53:14.8712575Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:14.8724215Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T08:53:14.8733576Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:14.8743350Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T08:53:14.8757828Z Entering 'third_party/aiter' 2025-12-04T08:53:14.8771108Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T08:53:14.8788510Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:14.8809650Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T08:53:14.8830522Z Entering 'third_party/benchmark' 2025-12-04T08:53:14.8843903Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:14.8852187Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:14.8862242Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T08:53:14.8879893Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:14.8889885Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T08:53:14.8904905Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:14.8915196Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T08:53:14.8925163Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:14.8934908Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T08:53:14.8943345Z Entering 'third_party/cutlass' 2025-12-04T08:53:14.8958601Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T08:53:14.8976401Z Entering 'third_party/fbgemm' 2025-12-04T08:53:14.8986663Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T08:53:14.8997045Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:14.9016155Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T08:53:14.9026169Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:14.9038187Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T08:53:14.9054826Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:14.9068682Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T08:53:14.9077382Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:14.9086897Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T08:53:14.9101332Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:14.9113393Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T08:53:14.9121652Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:14.9131364Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T08:53:14.9139639Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:14.9152110Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T08:53:14.9172069Z Entering 'third_party/flash-attention' 2025-12-04T08:53:14.9178162Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T08:53:14.9186765Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:14.9195522Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T08:53:14.9205661Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:14.9214287Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T08:53:14.9227135Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:14.9237522Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T08:53:14.9247570Z Entering 'third_party/fmt' 2025-12-04T08:53:14.9257742Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:14.9267140Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:14.9277375Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T08:53:14.9286396Z Entering 'third_party/gloo' 2025-12-04T08:53:14.9296029Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T08:53:14.9304624Z Entering 'third_party/googletest' 2025-12-04T08:53:14.9314935Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:14.9325210Z Entering 'third_party/ideep' 2025-12-04T08:53:14.9335226Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T08:53:14.9345572Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:14.9355033Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T08:53:14.9366433Z Entering 'third_party/ittapi' 2025-12-04T08:53:14.9376515Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T08:53:14.9387991Z Entering 'third_party/kineto' 2025-12-04T08:53:14.9398083Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T08:53:14.9410583Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:14.9425329Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T08:53:14.9434549Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:14.9446617Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T08:53:14.9456379Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:14.9468671Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T08:53:14.9476799Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:14.9486846Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:14.9495509Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:14.9506216Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T08:53:14.9516852Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:14.9532260Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T08:53:14.9542137Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:14.9552621Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T08:53:14.9562066Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:14.9574676Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:14.9583252Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:14.9599386Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T08:53:14.9609971Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:14.9619760Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T08:53:14.9632492Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:14.9642606Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:14.9651987Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:14.9663279Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:14.9674184Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:14.9688675Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:14.9703607Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:14.9724304Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T08:53:14.9734050Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:14.9745486Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T08:53:14.9756802Z Entering 'third_party/kleidiai' 2025-12-04T08:53:14.9766566Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T08:53:14.9776104Z Entering 'third_party/mimalloc' 2025-12-04T08:53:14.9785503Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T08:53:14.9794908Z Entering 'third_party/nlohmann' 2025-12-04T08:53:14.9807616Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T08:53:14.9818809Z Entering 'third_party/onnx' 2025-12-04T08:53:14.9829256Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T08:53:14.9844083Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:14.9853528Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:14.9866845Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:14.9876697Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T08:53:14.9889113Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:14.9898503Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:14.9908476Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:14.9918726Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:14.9928168Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:14.9937212Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T08:53:14.9948359Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:14.9959798Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T08:53:14.9972608Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:14.9990225Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T08:53:15.0000281Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:15.0011905Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T08:53:15.0019710Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:15.0032449Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:15.0044670Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:15.0055181Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:15.0065493Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:15.0077638Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:15.0088220Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:15.0099251Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T08:53:15.0116212Z Entering 'third_party/pocketfft' 2025-12-04T08:53:15.0126999Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T08:53:15.0136779Z Entering 'third_party/protobuf' 2025-12-04T08:53:15.0149004Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T08:53:15.0160395Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:15.0171135Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:15.0182130Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:15.0198287Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:15.0213497Z Entering 'third_party/psimd' 2025-12-04T08:53:15.0223774Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T08:53:15.0234690Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:15.0248588Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T08:53:15.0263222Z Entering 'third_party/pybind11' 2025-12-04T08:53:15.0274155Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:15.0283315Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:15.0293537Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T08:53:15.0302373Z Entering 'third_party/sleef' 2025-12-04T08:53:15.0318507Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T08:53:15.0331096Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:15.0341966Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T08:53:15.0358267Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:15.0368521Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:15.0381526Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:15.0393792Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T08:53:15.0401972Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:15.0411517Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T08:53:15.0419611Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:15.0431978Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:15.0442071Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:15.0454183Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T08:53:15.0487012Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0509153Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0525646Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0543298Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0559832Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0575008Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0589062Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0603447Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0620215Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0635553Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0657310Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0675768Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0696496Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0712224Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0727254Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0741809Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0757486Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0772126Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0788311Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0804844Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0819904Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0835776Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0854913Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0874409Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0890986Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0906242Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0921490Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0937845Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0953510Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0968684Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0983689Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.0997600Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1012788Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1028797Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1052549Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1070250Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1090199Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1111761Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1134316Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1150240Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1167330Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1183393Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1202062Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1218130Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1233928Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1252018Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1267391Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1282518Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1297910Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1317787Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1334498Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1353316Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1370074Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1386164Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1402612Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1421435Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1449318Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1468318Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1486249Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1503556Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1524375Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1541223Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1563895Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1580683Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1597194Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1618846Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1641118Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1657446Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1673274Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1690103Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1707708Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1728758Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1747103Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1764414Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1781030Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1797521Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1819921Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1837030Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1854232Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1871993Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1888772Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T08:53:15.1910801Z [command]/usr/bin/git config --local http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-12-04T08:53:15.1935510Z ##[endgroup] 2025-12-04T08:53:15.1935719Z ##[group]Fetching the repository 2025-12-04T08:53:15.1939359Z [command]/usr/bin/git -c protocol.version=2 fetch --prune --no-recurse-submodules origin +refs/heads/*:refs/remotes/origin/* +refs/tags/*:refs/tags/* 2025-12-04T08:53:16.4348394Z [command]/usr/bin/git rev-parse --verify --quiet ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32^{object} 2025-12-04T08:53:16.4446321Z ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:16.4451659Z ##[endgroup] 2025-12-04T08:53:16.4452005Z ##[group]Determining the checkout info 2025-12-04T08:53:16.4453705Z ##[endgroup] 2025-12-04T08:53:16.4459953Z [command]/usr/bin/git sparse-checkout disable 2025-12-04T08:53:16.4553202Z [command]/usr/bin/git config --local --unset-all extensions.worktreeConfig 2025-12-04T08:53:16.4578666Z ##[group]Checking out the ref 2025-12-04T08:53:16.4580447Z [command]/usr/bin/git checkout --progress --force ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:16.4815680Z HEAD is now at ffd9b0fb4355 Resolve collective autotuning test failure on arm (#168919) 2025-12-04T08:53:16.4820607Z ##[endgroup] 2025-12-04T08:53:16.4820880Z ##[group]Setting up auth for fetching submodules 2025-12-04T08:53:16.4826282Z [command]/usr/bin/git config --global http.https://github.com/.extraheader AUTHORIZATION: basic *** 2025-12-04T08:53:16.4860757Z [command]/usr/bin/git config --global --unset-all url.https://github.com/.insteadOf 2025-12-04T08:53:16.4877514Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf git@github.com: 2025-12-04T08:53:16.4897086Z [command]/usr/bin/git config --global --add url.https://github.com/.insteadOf org-21003710@github.com: 2025-12-04T08:53:16.4927615Z ##[endgroup] 2025-12-04T08:53:16.4927831Z ##[group]Fetching submodules 2025-12-04T08:53:16.4929659Z [command]/usr/bin/git submodule sync --recursive 2025-12-04T08:53:16.5136703Z Synchronizing submodule url for 'android/libs/fbjni' 2025-12-04T08:53:16.5148512Z Synchronizing submodule url for 'third_party/FP16' 2025-12-04T08:53:16.5163440Z Synchronizing submodule url for 'third_party/FXdiv' 2025-12-04T08:53:16.5174604Z Synchronizing submodule url for 'third_party/NNPACK' 2025-12-04T08:53:16.5186511Z Synchronizing submodule url for 'third_party/NVTX' 2025-12-04T08:53:16.5196533Z Synchronizing submodule url for 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:16.5205635Z Synchronizing submodule url for 'third_party/XNNPACK' 2025-12-04T08:53:16.5220243Z Synchronizing submodule url for 'third_party/aiter' 2025-12-04T08:53:16.5240269Z Synchronizing submodule url for 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:16.5255308Z Synchronizing submodule url for 'third_party/benchmark' 2025-12-04T08:53:16.5272279Z Synchronizing submodule url for 'third_party/composable_kernel' 2025-12-04T08:53:16.5285638Z Synchronizing submodule url for 'third_party/cpp-httplib' 2025-12-04T08:53:16.5303277Z Synchronizing submodule url for 'third_party/cpuinfo' 2025-12-04T08:53:16.5315479Z Synchronizing submodule url for 'third_party/cudnn_frontend' 2025-12-04T08:53:16.5329207Z Synchronizing submodule url for 'third_party/cutlass' 2025-12-04T08:53:16.5351482Z Synchronizing submodule url for 'third_party/fbgemm' 2025-12-04T08:53:16.5364122Z Synchronizing submodule url for 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:16.5376963Z Synchronizing submodule url for 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:16.5389968Z Synchronizing submodule url for 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:16.5403537Z Synchronizing submodule url for 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:16.5419643Z Synchronizing submodule url for 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:16.5430349Z Synchronizing submodule url for 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:16.5446347Z Synchronizing submodule url for 'third_party/fbgemm/external/json' 2025-12-04T08:53:16.5460179Z Synchronizing submodule url for 'third_party/flash-attention' 2025-12-04T08:53:16.5473163Z Synchronizing submodule url for 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:16.5491769Z Synchronizing submodule url for 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:16.5507579Z Synchronizing submodule url for 'third_party/flatbuffers' 2025-12-04T08:53:16.5519974Z Synchronizing submodule url for 'third_party/fmt' 2025-12-04T08:53:16.5530857Z Synchronizing submodule url for 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:16.5541440Z Synchronizing submodule url for 'third_party/gloo' 2025-12-04T08:53:16.5554876Z Synchronizing submodule url for 'third_party/googletest' 2025-12-04T08:53:16.5564082Z Synchronizing submodule url for 'third_party/ideep' 2025-12-04T08:53:16.5576806Z Synchronizing submodule url for 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:16.5589925Z Synchronizing submodule url for 'third_party/ittapi' 2025-12-04T08:53:16.5601989Z Synchronizing submodule url for 'third_party/kineto' 2025-12-04T08:53:16.5616196Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:16.5642706Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:16.5659751Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:16.5671840Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:16.5691389Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:16.5703548Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:16.5715355Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:16.5727732Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:16.5745930Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:16.5757572Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:16.5775135Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:16.5789564Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:16.5800983Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:16.5816976Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:16.5827970Z Synchronizing submodule url for 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:16.5839335Z Synchronizing submodule url for 'third_party/kleidiai' 2025-12-04T08:53:16.5857541Z Synchronizing submodule url for 'third_party/mimalloc' 2025-12-04T08:53:16.5870387Z Synchronizing submodule url for 'third_party/nlohmann' 2025-12-04T08:53:16.5881466Z Synchronizing submodule url for 'third_party/onnx' 2025-12-04T08:53:16.5898428Z Synchronizing submodule url for 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:16.5913621Z Synchronizing submodule url for 'third_party/opentelemetry-cpp' 2025-12-04T08:53:16.5926397Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:16.5942564Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:16.5965275Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:16.5979959Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:16.5993828Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:16.6004083Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:16.6012527Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:16.6024579Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:16.6036854Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:16.6049249Z Synchronizing submodule url for 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:16.6069655Z Synchronizing submodule url for 'third_party/pocketfft' 2025-12-04T08:53:16.6080132Z Synchronizing submodule url for 'third_party/protobuf' 2025-12-04T08:53:16.6091962Z Synchronizing submodule url for 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:16.6106795Z Synchronizing submodule url for 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:16.6120019Z Synchronizing submodule url for 'third_party/psimd' 2025-12-04T08:53:16.6130642Z Synchronizing submodule url for 'third_party/pthreadpool' 2025-12-04T08:53:16.6144511Z Synchronizing submodule url for 'third_party/pybind11' 2025-12-04T08:53:16.6157301Z Synchronizing submodule url for 'third_party/python-peachpy' 2025-12-04T08:53:16.6177729Z Synchronizing submodule url for 'third_party/sleef' 2025-12-04T08:53:16.6186053Z Synchronizing submodule url for 'third_party/tensorpipe' 2025-12-04T08:53:16.6203270Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:16.6214530Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:16.6226190Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:16.6235171Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:16.6253936Z Synchronizing submodule url for 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:16.6279257Z [command]/usr/bin/git -c protocol.version=2 submodule update --init --force --recursive 2025-12-04T08:53:16.6492405Z Submodule path 'android/libs/fbjni': checked out '7e1e1fe3858c63c251c637ae41a20de425dde96f' 2025-12-04T08:53:16.6536685Z Submodule path 'third_party/FP16': checked out '4dfe081cf6bcd15db339cf2680b9281b8451eeb3' 2025-12-04T08:53:16.6586549Z Submodule path 'third_party/FXdiv': checked out 'b408327ac2a15ec3e43352421954f5b1967701d1' 2025-12-04T08:53:16.6638377Z Submodule path 'third_party/NNPACK': checked out 'c07e3a0400713d546e0dea2d5466dd22ea389c73' 2025-12-04T08:53:16.6712131Z Submodule path 'third_party/NVTX': checked out '3ebbc93ded7285963bff932c678fa367eb393ba6' 2025-12-04T08:53:16.6773572Z Submodule path 'third_party/VulkanMemoryAllocator': checked out '1d8f600fd424278486eade7ed3e877c99f0846b1' 2025-12-04T08:53:16.6914541Z Submodule path 'third_party/XNNPACK': checked out '51a0103656eff6fc9bfd39a4597923c4b542c883' 2025-12-04T08:53:16.7051457Z Submodule path 'third_party/aiter': checked out '01aae101b9e5e94d6c16a9514c9fb8df99c93150' 2025-12-04T08:53:16.7210860Z Submodule path 'third_party/aiter/3rdparty/composable_kernel': checked out 'cffe8fa2a442ac8e80dd236a1a5d24fe3d7e0cbf' 2025-12-04T08:53:16.7281423Z Submodule path 'third_party/benchmark': checked out '299e5928955cc62af9968370293b916f5130916f' 2025-12-04T08:53:16.7474514Z Submodule path 'third_party/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-12-04T08:53:16.7548783Z Submodule path 'third_party/cpp-httplib': checked out '89c932f313c6437c38f2982869beacc89c2f2246' 2025-12-04T08:53:16.7619632Z Submodule path 'third_party/cpuinfo': checked out 'f858c30bcb16f8effd5ff46996f0514539e17abc' 2025-12-04T08:53:16.7694607Z Submodule path 'third_party/cudnn_frontend': checked out '0b1577c8c83401237d601d0d0db5210506705396' 2025-12-04T08:53:16.7794957Z Submodule path 'third_party/cutlass': checked out 'f88806b1e31dfa579842638740216dd41fc6c588' 2025-12-04T08:53:16.7901964Z Submodule path 'third_party/fbgemm': checked out 'c0b988d39a9e47c794d699f29930ed4d7c7e13a4' 2025-12-04T08:53:16.7960096Z Submodule path 'third_party/fbgemm/external/asmjit': checked out 'a3199e8857792cd10b7589ff5d58343d2c9008ea' 2025-12-04T08:53:16.8134381Z Submodule path 'third_party/fbgemm/external/composable_kernel': checked out '7fe50dc3da2069d6645d9deb8c017a876472a977' 2025-12-04T08:53:16.8204124Z Submodule path 'third_party/fbgemm/external/cpuinfo': checked out '6543fec09b2f04ac4a666882998b534afc9c1349' 2025-12-04T08:53:16.8294844Z Submodule path 'third_party/fbgemm/external/cutlass': checked out '98125ce499b0fdf7ffbe0e3052f5b8709f4840f8' 2025-12-04T08:53:16.8362521Z Submodule path 'third_party/fbgemm/external/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:16.8417667Z Submodule path 'third_party/fbgemm/external/hipify_torch': checked out '63b6a7b541fa7f08f8475ca7d74054db36ff2691' 2025-12-04T08:53:16.8492183Z Submodule path 'third_party/fbgemm/external/json': checked out '9cca280a4d0ccf0c08f47a99aa71d1b0e52f8d03' 2025-12-04T08:53:16.8571497Z Submodule path 'third_party/flash-attention': checked out '979702c87a8713a8e0a5e9fee122b90d2ef13be5' 2025-12-04T08:53:16.8724402Z Submodule path 'third_party/flash-attention/csrc/composable_kernel': checked out '888317e698e9803c62bd38568abc9e05d7709f33' 2025-12-04T08:53:16.8823222Z Submodule path 'third_party/flash-attention/csrc/cutlass': checked out 'c506e16788cb08416a4a57e11a9067beeee29420' 2025-12-04T08:53:16.8908525Z Submodule path 'third_party/flatbuffers': checked out 'a2cd1ea3b6d3fee220106b5fed3f7ce8da9eb757' 2025-12-04T08:53:16.8971642Z Submodule path 'third_party/fmt': checked out '407c905e45ad75fc29bf0f9bb7c5c2fd3475976f' 2025-12-04T08:53:16.9030961Z Submodule path 'third_party/gemmlowp/gemmlowp': checked out '3fb5c176c17c765a3492cd2f0321b0dab712f350' 2025-12-04T08:53:16.9092785Z Submodule path 'third_party/gloo': checked out '54cbae0d3a67fa890b4c3d9ee162b7860315e341' 2025-12-04T08:53:16.9151891Z Submodule path 'third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:16.9206758Z Submodule path 'third_party/ideep': checked out '719d8e6cd7f7a0e01b155657526d693acf97c2b3' 2025-12-04T08:53:16.9363520Z Submodule path 'third_party/ideep/mkl-dnn': checked out '8d263e693366ef8db40acc569cc7d8edf644556d' 2025-12-04T08:53:16.9419569Z Submodule path 'third_party/ittapi': checked out 'dec1d23ca65ab069d225dfe40dea14f455170959' 2025-12-04T08:53:16.9484684Z Submodule path 'third_party/kineto': checked out '31f85df8fbd89c188f14ef10f1ec65379786b943' 2025-12-04T08:53:16.9572801Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog': checked out 'd2ffe0a4e3acace628db49974246b66fc3e85fb1' 2025-12-04T08:53:16.9650256Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM': checked out 'ffde4e54bc7249a6039a5e6b45b395141e1217f9' 2025-12-04T08:53:16.9706083Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr': checked out '871ed52d350214a034f6ef8a3b8f51c5ce1bd400' 2025-12-04T08:53:16.9766683Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt': checked out 'cd4af11efc9c622896a3e4cb599fa28668ca3d05' 2025-12-04T08:53:16.9817164Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags': checked out 'e171aa2d15ed9eb17054558e0b3a6a413bb01067' 2025-12-04T08:53:16.9867212Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc': checked out '8411df715cf522606e3b1aca386ddfc0b63d34b4' 2025-12-04T08:53:16.9919357Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog': checked out 'b33e3bad4c46c8a6345525fd822af355e5ef9446' 2025-12-04T08:53:16.9977760Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:17.0054949Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/json': checked out '4f8fba14066156b73f1189a2b8bd568bde5284c5' 2025-12-04T08:53:17.0106954Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs': checked out 'f68a2fa8ea36c783bdd760371411fcb495aa3150' 2025-12-04T08:53:17.0174590Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp': checked out 'b1234816facfdda29845c46696a02998a4af115a' 2025-12-04T08:53:17.0260095Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'd7ba35bbb649209c66e582d5a0244ba988a15159' 2025-12-04T08:53:17.0317915Z Submodule path 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-12-04T08:53:17.0373685Z Submodule path 'third_party/kineto/libkineto/third_party/fmt': checked out '40626af88bd7df9a5fb80be7b25ac85b122d6c21' 2025-12-04T08:53:17.0439388Z Submodule path 'third_party/kineto/libkineto/third_party/googletest': checked out '52eb8108c5bdec04579160ae17225d66034bd723' 2025-12-04T08:53:17.0527321Z Submodule path 'third_party/kleidiai': checked out 'd7770c89632329a9914ef1a90289917597639cbe' 2025-12-04T08:53:17.0598922Z Submodule path 'third_party/mimalloc': checked out 'fbd8b99c2b828428947d70fdc046bb55609be93e' 2025-12-04T08:53:17.0705661Z Submodule path 'third_party/nlohmann': checked out '55f93686c01528224f448c19128836e7df245f72' 2025-12-04T08:53:17.0853017Z Submodule path 'third_party/onnx': checked out 'e709452ef2bbc1d113faf678c24e6d3467696e83' 2025-12-04T08:53:17.0937756Z Submodule path 'third_party/onnx/third_party/pybind11': checked out 'a2e59f0e7065404b44dfe92a28aca47ba1378dc4' 2025-12-04T08:53:17.1035883Z Submodule path 'third_party/opentelemetry-cpp': checked out 'a799f4aed9c94b765dcdaabaeab7d5e7e2310878' 2025-12-04T08:53:17.1095738Z Submodule path 'third_party/opentelemetry-cpp/third_party/benchmark': checked out 'd572f4777349d43653b21d6c2fc63020ab326db2' 2025-12-04T08:53:17.1154455Z Submodule path 'third_party/opentelemetry-cpp/third_party/googletest': checked out 'b796f7d44681514f58a683a3a71ff17c94edb0c1' 2025-12-04T08:53:17.1204167Z Submodule path 'third_party/opentelemetry-cpp/third_party/ms-gsl': checked out '6f4529395c5b7c2d661812257cd6780c67e54afa' 2025-12-04T08:53:17.1289709Z Submodule path 'third_party/opentelemetry-cpp/third_party/nlohmann-json': checked out 'bc889afb4c5bf1c0d8ee29ef35eaaf4c8bef8a5d' 2025-12-04T08:53:17.1345924Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto': checked out '4ca4f0335c63cda7ab31ea7ed70d6553aee14dce' 2025-12-04T08:53:17.1389068Z Submodule path 'third_party/opentelemetry-cpp/third_party/opentracing-cpp': checked out '06b57f48ded1fa3bdd3d4346f6ef29e40e08eaf5' 2025-12-04T08:53:17.1454845Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp': checked out 'c9ffcdda9086ffd9e1283ea7a0276d831f3c8a8d' 2025-12-04T08:53:17.1521903Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb': checked out 'eefb26f82b233268fc98577d265352720d477ba4' 2025-12-04T08:53:17.1583519Z Submodule path 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest': checked out 'e2239ee6043f73722e7aa812a459f54a28552929' 2025-12-04T08:53:17.1713878Z Submodule path 'third_party/opentelemetry-cpp/tools/vcpkg': checked out '8eb57355a4ffb410a2e94c07b4dca2dffbee8e50' 2025-12-04T08:53:17.1770969Z Submodule path 'third_party/pocketfft': checked out '0fa0ef591e38c2758e3184c6c23e497b9f732ffa' 2025-12-04T08:53:17.1915392Z Submodule path 'third_party/protobuf': checked out 'd1eca4e4b421cd2997495c4b4e65cea6be4e9b8a' 2025-12-04T08:53:17.1969062Z Submodule path 'third_party/protobuf/third_party/benchmark': checked out '5b7683f49e1e9223cf9927b24f6fd3d6bd82e3f8' 2025-12-04T08:53:17.2023701Z Submodule path 'third_party/protobuf/third_party/googletest': checked out '5ec7f0c4a113e2f18ac2c6cc7df51ad6afc24081' 2025-12-04T08:53:17.2071520Z Submodule path 'third_party/psimd': checked out '072586a71b55b7f8c584153d223e95687148a900' 2025-12-04T08:53:17.2113641Z Submodule path 'third_party/pthreadpool': checked out '4fe0e1e183925bf8cfa6aae24237e724a96479b8' 2025-12-04T08:53:17.2183414Z Submodule path 'third_party/pybind11': checked out 'f5fbe867d2d26e4a0a9177a51f6e568868ad3dc8' 2025-12-04T08:53:17.2233380Z Submodule path 'third_party/python-peachpy': checked out 'f45429b087dd7d5bc78bb40dc7cf06425c252d67' 2025-12-04T08:53:17.2291809Z Submodule path 'third_party/sleef': checked out '5a1d179df9cf652951b59010a2d2075372d67f68' 2025-12-04T08:53:17.2357949Z Submodule path 'third_party/tensorpipe': checked out '2b4cd91092d335a697416b2a3cb398283246849d' 2025-12-04T08:53:17.2421348Z Submodule path 'third_party/tensorpipe/third_party/googletest': checked out 'aee0f9d9b5b87796ee8a0ab26b7587ec30e8858e' 2025-12-04T08:53:17.2470240Z Submodule path 'third_party/tensorpipe/third_party/libnop': checked out '910b55815be16109f04f4180e9adee14fb4ce281' 2025-12-04T08:53:17.2608836Z Submodule path 'third_party/tensorpipe/third_party/libuv': checked out '5152db2cbfeb5582e9c27c5ea1dba2cd9e10759b' 2025-12-04T08:53:17.2673769Z Submodule path 'third_party/tensorpipe/third_party/pybind11': checked out 'a23996fce38ff6ccfbcdc09f1e63f2c4be5ea2ef' 2025-12-04T08:53:17.2759414Z Submodule path 'third_party/tensorpipe/third_party/pybind11/tools/clang': checked out '6a00cbc4a9b8e68b71caf7f774b3f9c753ae84d5' 2025-12-04T08:53:17.2797778Z [command]/usr/bin/git submodule foreach --recursive git config --local gc.auto 0 2025-12-04T08:53:17.3011613Z Entering 'android/libs/fbjni' 2025-12-04T08:53:17.3032108Z Entering 'third_party/FP16' 2025-12-04T08:53:17.3052823Z Entering 'third_party/FXdiv' 2025-12-04T08:53:17.3078152Z Entering 'third_party/NNPACK' 2025-12-04T08:53:17.3111555Z Entering 'third_party/NVTX' 2025-12-04T08:53:17.3133099Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:17.3154526Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:17.3183769Z Entering 'third_party/aiter' 2025-12-04T08:53:17.3209309Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:17.3240492Z Entering 'third_party/benchmark' 2025-12-04T08:53:17.3268658Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:17.3295394Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:17.3324335Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:17.3347389Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:17.3379063Z Entering 'third_party/cutlass' 2025-12-04T08:53:17.3413722Z Entering 'third_party/fbgemm' 2025-12-04T08:53:17.3448479Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:17.3471792Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:17.3514444Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:17.3550230Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:17.3574356Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:17.3599280Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:17.3619446Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:17.3643723Z Entering 'third_party/flash-attention' 2025-12-04T08:53:17.3671125Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:17.3700311Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:17.3737974Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:17.3766180Z Entering 'third_party/fmt' 2025-12-04T08:53:17.3792169Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:17.3816107Z Entering 'third_party/gloo' 2025-12-04T08:53:17.3838529Z Entering 'third_party/googletest' 2025-12-04T08:53:17.3863519Z Entering 'third_party/ideep' 2025-12-04T08:53:17.3883973Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:17.3918158Z Entering 'third_party/ittapi' 2025-12-04T08:53:17.3944964Z Entering 'third_party/kineto' 2025-12-04T08:53:17.3978319Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:17.4001045Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:17.4027284Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:17.4059720Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:17.4085451Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:17.4107248Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:17.4131239Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:17.4157654Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:17.4181402Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:17.4215233Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:17.4236964Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:17.4271382Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:17.4304425Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:17.4334042Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:17.4357367Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:17.4383493Z Entering 'third_party/kleidiai' 2025-12-04T08:53:17.4411082Z Entering 'third_party/mimalloc' 2025-12-04T08:53:17.4434190Z Entering 'third_party/nlohmann' 2025-12-04T08:53:17.4458148Z Entering 'third_party/onnx' 2025-12-04T08:53:17.4493342Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:17.4515788Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:17.4542302Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:17.4564227Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:17.4589151Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:17.4610633Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:17.4639582Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:17.4668722Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:17.4694167Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:17.4715570Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:17.4743273Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:17.4765579Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:17.4794826Z Entering 'third_party/pocketfft' 2025-12-04T08:53:17.4816636Z Entering 'third_party/protobuf' 2025-12-04T08:53:17.4840722Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:17.4869408Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:17.4898281Z Entering 'third_party/psimd' 2025-12-04T08:53:17.4928748Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:17.4956762Z Entering 'third_party/pybind11' 2025-12-04T08:53:17.4980070Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:17.5005545Z Entering 'third_party/sleef' 2025-12-04T08:53:17.5028111Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:17.5055539Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:17.5078417Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:17.5103185Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:17.5124691Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:17.5146483Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:17.5184401Z ##[endgroup] 2025-12-04T08:53:17.5184589Z ##[group]Persisting credentials for submodules 2025-12-04T08:53:17.5190878Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'url\.https\:\/\/github\.com\/\.insteadOf' && git config --local --unset-all 'url.https://github.com/.insteadOf' || :" 2025-12-04T08:53:17.5379181Z Entering 'android/libs/fbjni' 2025-12-04T08:53:17.5397138Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5397375Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5414803Z Entering 'third_party/FP16' 2025-12-04T08:53:17.5435120Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5435311Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5455513Z Entering 'third_party/FXdiv' 2025-12-04T08:53:17.5471385Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5471510Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5497334Z Entering 'third_party/NNPACK' 2025-12-04T08:53:17.5513514Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5513639Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5531767Z Entering 'third_party/NVTX' 2025-12-04T08:53:17.5544977Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5545101Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5562842Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:17.5581602Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5581728Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5600025Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:17.5613935Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5614069Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5637423Z Entering 'third_party/aiter' 2025-12-04T08:53:17.5650627Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5650758Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5671138Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:17.5687517Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5687646Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5710526Z Entering 'third_party/benchmark' 2025-12-04T08:53:17.5723687Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5723823Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5746966Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:17.5762581Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5763723Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5782145Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:17.5802883Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5803109Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5819598Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:17.5835652Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5835784Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5855956Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:17.5869564Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5869700Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5897956Z Entering 'third_party/cutlass' 2025-12-04T08:53:17.5915070Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5915204Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5936399Z Entering 'third_party/fbgemm' 2025-12-04T08:53:17.5952450Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5952590Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5969658Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:17.5985444Z url.https://github.com/.insteadof 2025-12-04T08:53:17.5985587Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6007615Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:17.6026210Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6026459Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6047713Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:17.6064318Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6064550Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6082426Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:17.6103381Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6103601Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6125670Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:17.6143141Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6143330Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6166638Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:17.6185438Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6185638Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6202693Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:17.6219315Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6219507Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6243683Z Entering 'third_party/flash-attention' 2025-12-04T08:53:17.6261639Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6262006Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6280703Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:17.6299483Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6299753Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6320480Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:17.6338954Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6339186Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6361535Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:17.6375821Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6376045Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6393987Z Entering 'third_party/fmt' 2025-12-04T08:53:17.6406880Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6407095Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6427346Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:17.6440398Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6440580Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6459875Z Entering 'third_party/gloo' 2025-12-04T08:53:17.6480585Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6480738Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6500116Z Entering 'third_party/googletest' 2025-12-04T08:53:17.6514215Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6514379Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6531051Z Entering 'third_party/ideep' 2025-12-04T08:53:17.6544790Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6544942Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6561041Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:17.6577242Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6577385Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6598696Z Entering 'third_party/ittapi' 2025-12-04T08:53:17.6611903Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6612042Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6628366Z Entering 'third_party/kineto' 2025-12-04T08:53:17.6640723Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6640859Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6659313Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:17.6671957Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6672095Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6691363Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:17.6708014Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6708156Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6726706Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:17.6740774Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6740906Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6759630Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:17.6773846Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6793616Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6793800Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:17.6808144Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6808272Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6830426Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:17.6846254Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6846387Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6869457Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:17.6882625Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6882751Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6900618Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:17.6918277Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6918417Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6941787Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:17.6959591Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6959893Z url.https://github.com/.insteadof 2025-12-04T08:53:17.6983230Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:17.7002357Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7002811Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7021151Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:17.7041808Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7041976Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7072656Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:17.7086643Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7086988Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7116041Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:17.7131838Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7132006Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7156168Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:17.7172888Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7181028Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7193392Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:17.7209358Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7209502Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7230408Z Entering 'third_party/kleidiai' 2025-12-04T08:53:17.7245887Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7246031Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7272012Z Entering 'third_party/mimalloc' 2025-12-04T08:53:17.7288338Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7288476Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7309443Z Entering 'third_party/nlohmann' 2025-12-04T08:53:17.7324260Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7324421Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7344000Z Entering 'third_party/onnx' 2025-12-04T08:53:17.7358457Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7358599Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7382883Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:17.7396284Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7396441Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7417176Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:17.7432383Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7432534Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7452472Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:17.7465169Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7465487Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7481202Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:17.7496531Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7496811Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7514365Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:17.7532432Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7532690Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7549769Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:17.7563727Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7563976Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7582296Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:17.7595199Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7595413Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7611726Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:17.7623892Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7624093Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7640595Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:17.7653003Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7653208Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7671374Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:17.7686751Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7686949Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7710173Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:17.7726812Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7727287Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7746466Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:17.7758976Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7759130Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7786776Z Entering 'third_party/pocketfft' 2025-12-04T08:53:17.7801337Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7801478Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7819625Z Entering 'third_party/protobuf' 2025-12-04T08:53:17.7838968Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7839106Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7862387Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:17.7876872Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7877041Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7893122Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:17.7909190Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7909350Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7929855Z Entering 'third_party/psimd' 2025-12-04T08:53:17.7946030Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7946248Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7968902Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:17.7982999Z url.https://github.com/.insteadof 2025-12-04T08:53:17.7983159Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8000325Z Entering 'third_party/pybind11' 2025-12-04T08:53:17.8017007Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8017161Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8039606Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:17.8055438Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8055607Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8073833Z Entering 'third_party/sleef' 2025-12-04T08:53:17.8097448Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8097777Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8119074Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:17.8134773Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8134904Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8154674Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:17.8169294Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8169436Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8189338Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:17.8204635Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8222413Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8222551Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:17.8237819Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8256813Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8256999Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:17.8270494Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8270631Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8288190Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:17.8302862Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8303027Z url.https://github.com/.insteadof 2025-12-04T08:53:17.8340070Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local 'http.https://github.com/.extraheader' 'AUTHORIZATION: basic ***' && git config --local --show-origin --name-only --get-regexp remote.origin.url" 2025-12-04T08:53:17.8495182Z Entering 'android/libs/fbjni' 2025-12-04T08:53:17.8517759Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T08:53:17.8528106Z Entering 'third_party/FP16' 2025-12-04T08:53:17.8548930Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T08:53:17.8558896Z Entering 'third_party/FXdiv' 2025-12-04T08:53:17.8579977Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T08:53:17.8590822Z Entering 'third_party/NNPACK' 2025-12-04T08:53:17.8613164Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T08:53:17.8623429Z Entering 'third_party/NVTX' 2025-12-04T08:53:17.8643275Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T08:53:17.8653918Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:17.8673617Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T08:53:17.8684172Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:17.8705573Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T08:53:17.8721344Z Entering 'third_party/aiter' 2025-12-04T08:53:17.8742534Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T08:53:17.8753034Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:17.8777138Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T08:53:17.8795136Z Entering 'third_party/benchmark' 2025-12-04T08:53:17.8818597Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:17.8835456Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:17.8866213Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T08:53:17.8880584Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:17.8902655Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T08:53:17.8921707Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:17.8955198Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T08:53:17.8969110Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:17.9001819Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T08:53:17.9013325Z Entering 'third_party/cutlass' 2025-12-04T08:53:17.9038434Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T08:53:17.9053368Z Entering 'third_party/fbgemm' 2025-12-04T08:53:17.9077893Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T08:53:17.9087780Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:17.9111402Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T08:53:17.9122852Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:17.9145853Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T08:53:17.9159686Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:17.9179533Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T08:53:17.9188595Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:17.9212842Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T08:53:17.9225315Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:17.9247212Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T08:53:17.9256702Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:17.9279332Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T08:53:17.9287898Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:17.9308272Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T08:53:17.9321383Z Entering 'third_party/flash-attention' 2025-12-04T08:53:17.9343263Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T08:53:17.9355102Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:17.9378641Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T08:53:17.9392669Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:17.9418386Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T08:53:17.9434840Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:17.9459007Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T08:53:17.9470305Z Entering 'third_party/fmt' 2025-12-04T08:53:17.9491755Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:17.9503723Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:17.9524165Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T08:53:17.9534607Z Entering 'third_party/gloo' 2025-12-04T08:53:17.9561607Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T08:53:17.9572149Z Entering 'third_party/googletest' 2025-12-04T08:53:17.9594555Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:17.9604968Z Entering 'third_party/ideep' 2025-12-04T08:53:17.9625612Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T08:53:17.9635541Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:17.9657678Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T08:53:17.9671938Z Entering 'third_party/ittapi' 2025-12-04T08:53:17.9694174Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T08:53:17.9703950Z Entering 'third_party/kineto' 2025-12-04T08:53:17.9724862Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T08:53:17.9735815Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:17.9755656Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T08:53:17.9764782Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:17.9786324Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T08:53:17.9796359Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:17.9821242Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T08:53:17.9834043Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:17.9853654Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T08:53:17.9865043Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:17.9886613Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T08:53:17.9897204Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:17.9917690Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T08:53:17.9929084Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:17.9949567Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T08:53:17.9959170Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:17.9978266Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:17.9987527Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:18.0008094Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T08:53:18.0018258Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:18.0039051Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T08:53:18.0048692Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:18.0067979Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:18.0077312Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.0097892Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:18.0108513Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.0128480Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:18.0142809Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:18.0163596Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T08:53:18.0172863Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:18.0192471Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T08:53:18.0204063Z Entering 'third_party/kleidiai' 2025-12-04T08:53:18.0225191Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T08:53:18.0236622Z Entering 'third_party/mimalloc' 2025-12-04T08:53:18.0258322Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T08:53:18.0269280Z Entering 'third_party/nlohmann' 2025-12-04T08:53:18.0288901Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T08:53:18.0301613Z Entering 'third_party/onnx' 2025-12-04T08:53:18.0320024Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T08:53:18.0340205Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:18.0361561Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:18.0376731Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:18.0400277Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T08:53:18.0411819Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:18.0434654Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:18.0445830Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:18.0467421Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:18.0477226Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:18.0499198Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T08:53:18.0508136Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:18.0528599Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T08:53:18.0538542Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:18.0559699Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T08:53:18.0568379Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:18.0592008Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T08:53:18.0602616Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:18.0625913Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T08:53:18.0642374Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.0664032Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T08:53:18.0676293Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.0697704Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T08:53:18.0712129Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:18.0748051Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T08:53:18.0759014Z Entering 'third_party/pocketfft' 2025-12-04T08:53:18.0782661Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T08:53:18.0793073Z Entering 'third_party/protobuf' 2025-12-04T08:53:18.0815581Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T08:53:18.0829467Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:18.0850341Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T08:53:18.0859625Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:18.0881442Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:18.0896308Z Entering 'third_party/psimd' 2025-12-04T08:53:18.0917749Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T08:53:18.0928404Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:18.0950380Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T08:53:18.0961995Z Entering 'third_party/pybind11' 2025-12-04T08:53:18.0982762Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:18.0993936Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:18.1016042Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T08:53:18.1026144Z Entering 'third_party/sleef' 2025-12-04T08:53:18.1047786Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T08:53:18.1058378Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:18.1078756Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T08:53:18.1090748Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:18.1111780Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T08:53:18.1123253Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:18.1144992Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T08:53:18.1155586Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:18.1176772Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T08:53:18.1187265Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:18.1208037Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T08:53:18.1217321Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:18.1238731Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T08:53:18.1483465Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'git@github.com:' 2025-12-04T08:53:18.1663196Z Entering 'android/libs/fbjni' 2025-12-04T08:53:18.1683886Z Entering 'third_party/FP16' 2025-12-04T08:53:18.1704461Z Entering 'third_party/FXdiv' 2025-12-04T08:53:18.1727276Z Entering 'third_party/NNPACK' 2025-12-04T08:53:18.1747917Z Entering 'third_party/NVTX' 2025-12-04T08:53:18.1767877Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:18.1786926Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:18.1812247Z Entering 'third_party/aiter' 2025-12-04T08:53:18.1832208Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:18.1855829Z Entering 'third_party/benchmark' 2025-12-04T08:53:18.1875482Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:18.1899126Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:18.1919285Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:18.1938419Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:18.1957992Z Entering 'third_party/cutlass' 2025-12-04T08:53:18.1983023Z Entering 'third_party/fbgemm' 2025-12-04T08:53:18.2004378Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:18.2022085Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:18.2042843Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:18.2063776Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:18.2087145Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:18.2106983Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:18.2127169Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:18.2149691Z Entering 'third_party/flash-attention' 2025-12-04T08:53:18.2169425Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:18.2191490Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:18.2215163Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:18.2235899Z Entering 'third_party/fmt' 2025-12-04T08:53:18.2256418Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:18.2276960Z Entering 'third_party/gloo' 2025-12-04T08:53:18.2300259Z Entering 'third_party/googletest' 2025-12-04T08:53:18.2330257Z Entering 'third_party/ideep' 2025-12-04T08:53:18.2351971Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:18.2382089Z Entering 'third_party/ittapi' 2025-12-04T08:53:18.2406681Z Entering 'third_party/kineto' 2025-12-04T08:53:18.2427626Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:18.2451198Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:18.2473546Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:18.2496311Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:18.2523163Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:18.2543502Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:18.2568334Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:18.2593899Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:18.2615835Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:18.2639206Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:18.2660659Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:18.2682440Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.2705318Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.2732376Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:18.2754192Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:18.2781551Z Entering 'third_party/kleidiai' 2025-12-04T08:53:18.2802447Z Entering 'third_party/mimalloc' 2025-12-04T08:53:18.2823290Z Entering 'third_party/nlohmann' 2025-12-04T08:53:18.2843403Z Entering 'third_party/onnx' 2025-12-04T08:53:18.2870145Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:18.2896715Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:18.2918351Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:18.2942343Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:18.2964377Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:18.2987203Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:18.3013193Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:18.3033208Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:18.3052182Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:18.3068951Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.3100780Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.3125097Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:18.3159972Z Entering 'third_party/pocketfft' 2025-12-04T08:53:18.3187237Z Entering 'third_party/protobuf' 2025-12-04T08:53:18.3213841Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:18.3234906Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:18.3257845Z Entering 'third_party/psimd' 2025-12-04T08:53:18.3281055Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:18.3310527Z Entering 'third_party/pybind11' 2025-12-04T08:53:18.3334655Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:18.3355796Z Entering 'third_party/sleef' 2025-12-04T08:53:18.3381407Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:18.3407340Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:18.3428237Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:18.3446503Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:18.3467554Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:18.3489172Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:18.3529691Z [command]/usr/bin/git submodule foreach --recursive git config --local --add 'url.https://github.com/.insteadOf' 'org-21003710@github.com:' 2025-12-04T08:53:18.3690426Z Entering 'android/libs/fbjni' 2025-12-04T08:53:18.3714077Z Entering 'third_party/FP16' 2025-12-04T08:53:18.3735210Z Entering 'third_party/FXdiv' 2025-12-04T08:53:18.3755360Z Entering 'third_party/NNPACK' 2025-12-04T08:53:18.3780727Z Entering 'third_party/NVTX' 2025-12-04T08:53:18.3807357Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T08:53:18.3830855Z Entering 'third_party/XNNPACK' 2025-12-04T08:53:18.3860327Z Entering 'third_party/aiter' 2025-12-04T08:53:18.3881047Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T08:53:18.3905689Z Entering 'third_party/benchmark' 2025-12-04T08:53:18.3925422Z Entering 'third_party/composable_kernel' 2025-12-04T08:53:18.3947288Z Entering 'third_party/cpp-httplib' 2025-12-04T08:53:18.3965680Z Entering 'third_party/cpuinfo' 2025-12-04T08:53:18.3983990Z Entering 'third_party/cudnn_frontend' 2025-12-04T08:53:18.4004782Z Entering 'third_party/cutlass' 2025-12-04T08:53:18.4030108Z Entering 'third_party/fbgemm' 2025-12-04T08:53:18.4052551Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T08:53:18.4070714Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T08:53:18.4096839Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T08:53:18.4116422Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T08:53:18.4139976Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T08:53:18.4162480Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T08:53:18.4183773Z Entering 'third_party/fbgemm/external/json' 2025-12-04T08:53:18.4205497Z Entering 'third_party/flash-attention' 2025-12-04T08:53:18.4226214Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T08:53:18.4246980Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T08:53:18.4274148Z Entering 'third_party/flatbuffers' 2025-12-04T08:53:18.4295614Z Entering 'third_party/fmt' 2025-12-04T08:53:18.4314479Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T08:53:18.4334547Z Entering 'third_party/gloo' 2025-12-04T08:53:18.4353878Z Entering 'third_party/googletest' 2025-12-04T08:53:18.4373883Z Entering 'third_party/ideep' 2025-12-04T08:53:18.4396476Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T08:53:18.4423520Z Entering 'third_party/ittapi' 2025-12-04T08:53:18.4444516Z Entering 'third_party/kineto' 2025-12-04T08:53:18.4464905Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T08:53:18.4486172Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T08:53:18.4513076Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T08:53:18.4546065Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T08:53:18.4575824Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T08:53:18.4595582Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T08:53:18.4615638Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T08:53:18.4636751Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T08:53:18.4660852Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T08:53:18.4684712Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T08:53:18.4706863Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T08:53:18.4729759Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.4753934Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.4780395Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T08:53:18.4800908Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T08:53:18.4826648Z Entering 'third_party/kleidiai' 2025-12-04T08:53:18.4848344Z Entering 'third_party/mimalloc' 2025-12-04T08:53:18.4867892Z Entering 'third_party/nlohmann' 2025-12-04T08:53:18.4888311Z Entering 'third_party/onnx' 2025-12-04T08:53:18.4917453Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T08:53:18.4941286Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T08:53:18.4961860Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T08:53:18.4985142Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T08:53:18.5007989Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T08:53:18.5028094Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T08:53:18.5051358Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T08:53:18.5073243Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T08:53:18.5092665Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T08:53:18.5113470Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T08:53:18.5138874Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T08:53:18.5162179Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T08:53:18.5188791Z Entering 'third_party/pocketfft' 2025-12-04T08:53:18.5209711Z Entering 'third_party/protobuf' 2025-12-04T08:53:18.5230782Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T08:53:18.5251413Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T08:53:18.5295804Z Entering 'third_party/psimd' 2025-12-04T08:53:18.5318895Z Entering 'third_party/pthreadpool' 2025-12-04T08:53:18.5341499Z Entering 'third_party/pybind11' 2025-12-04T08:53:18.5364399Z Entering 'third_party/python-peachpy' 2025-12-04T08:53:18.5384939Z Entering 'third_party/sleef' 2025-12-04T08:53:18.5404111Z Entering 'third_party/tensorpipe' 2025-12-04T08:53:18.5425704Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T08:53:18.5447740Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T08:53:18.5469403Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T08:53:18.5489874Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T08:53:18.5511398Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T08:53:18.5543325Z ##[endgroup] 2025-12-04T08:53:18.5678805Z [command]/usr/bin/git log -1 --format=%H 2025-12-04T08:53:18.5750620Z ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:18.5876685Z Prepare all required actions 2025-12-04T08:53:18.5876961Z Getting action download info 2025-12-04T08:53:18.8694803Z Download action repository 'aws-actions/amazon-ecr-login@062b18b96a7aff071d4dc91bc00c4c1a7945b076' (SHA:062b18b96a7aff071d4dc91bc00c4c1a7945b076) 2025-12-04T08:53:19.6336184Z ##[group]Run ./.github/actions/setup-rocm 2025-12-04T08:53:19.6336317Z env: 2025-12-04T08:53:19.6336405Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6336507Z ##[endgroup] 2025-12-04T08:53:19.6349237Z ##[group]Run dpkg -l | grep -E " rocm" 2025-12-04T08:53:19.6349371Z dpkg -l | grep -E " rocm" 2025-12-04T08:53:19.6353702Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.6353840Z env: 2025-12-04T08:53:19.6353925Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6354027Z ##[endgroup] 2025-12-04T08:53:19.6417433Z ii rocm-cmake 0.14.0.60401-83~22.04 amd64 rocm-cmake built using CMake 2025-12-04T08:53:19.6417835Z ii rocm-core 6.4.1.60401-83~22.04 amd64 ROCm Runtime software stack 2025-12-04T08:53:19.6418069Z ii rocm-dbgapi 0.77.2.60401-83~22.04 amd64 Library to provide AMD GPU debugger API 2025-12-04T08:53:19.6418316Z ii rocm-debug-agent 2.0.4.60401-83~22.04 amd64 Radeon Open Compute Debug Agent (ROCdebug-agent) 2025-12-04T08:53:19.6418564Z ii rocm-dev 6.4.1.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime software stack 2025-12-04T08:53:19.6418797Z ii rocm-device-libs 1.0.0.60401-83~22.04 amd64 Radeon Open Compute - device libraries 2025-12-04T08:53:19.6419004Z ii rocm-gdb 15.2.60401-83~22.04 amd64 ROCgdb 2025-12-04T08:53:19.6419195Z ii rocm-llvm 19.0.0.25184.60401-83~22.04 amd64 ROCm core compiler 2025-12-04T08:53:19.6419404Z ii rocm-opencl 2.0.0.60401-83~22.04 amd64 clr built using CMake 2025-12-04T08:53:19.6419613Z ii rocm-opencl-dev 2.0.0.60401-83~22.04 amd64 clr built using CMake 2025-12-04T08:53:19.6419826Z ii rocm-smi-lib 7.5.0.60401-83~22.04 amd64 AMD System Management libraries 2025-12-04T08:53:19.6420049Z ii rocm-utils 6.4.1.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime software stack 2025-12-04T08:53:19.6420486Z ii rocminfo 1.0.0.60401-83~22.04 amd64 Radeon Open Compute (ROCm) Runtime rocminfo tool 2025-12-04T08:53:19.6436629Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-12-04T08:53:19.6436942Z # ignore expansion of "docker ps -q" since it could be empty 2025-12-04T08:53:19.6437127Z # shellcheck disable=SC2046 2025-12-04T08:53:19.6437279Z docker stop $(docker ps -q) || true 2025-12-04T08:53:19.6437414Z # Prune all stopped containers. 2025-12-04T08:53:19.6437548Z docker container prune -f 2025-12-04T08:53:19.6441913Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.6442057Z env: 2025-12-04T08:53:19.6442152Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6442257Z ##[endgroup] 2025-12-04T08:53:19.6646232Z docker: 'docker stop' requires at least 1 argument 2025-12-04T08:53:19.6646347Z 2025-12-04T08:53:19.6646423Z Usage: docker stop [OPTIONS] CONTAINER [CONTAINER...] 2025-12-04T08:53:19.6646522Z 2025-12-04T08:53:19.6646577Z See 'docker stop --help' for more information 2025-12-04T08:53:19.6749519Z Total reclaimed space: 0B 2025-12-04T08:53:19.6774985Z ##[group]Run cat /etc/os-release || true 2025-12-04T08:53:19.6775208Z cat /etc/os-release || true 2025-12-04T08:53:19.6775389Z cat /etc/apt/sources.list.d/rocm.list || true 2025-12-04T08:53:19.6775784Z cat /opt/rocm/.info/version || true 2025-12-04T08:53:19.6775942Z whoami 2025-12-04T08:53:19.6780286Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.6780438Z env: 2025-12-04T08:53:19.6780531Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6780637Z ##[endgroup] 2025-12-04T08:53:19.6799506Z PRETTY_NAME="Ubuntu 22.04.5 LTS" 2025-12-04T08:53:19.6799627Z NAME="Ubuntu" 2025-12-04T08:53:19.6799725Z VERSION_ID="22.04" 2025-12-04T08:53:19.6799843Z VERSION="22.04.5 LTS (Jammy Jellyfish)" 2025-12-04T08:53:19.6799966Z VERSION_CODENAME=jammy 2025-12-04T08:53:19.6800072Z ID=ubuntu 2025-12-04T08:53:19.6800162Z ID_LIKE=debian 2025-12-04T08:53:19.6800288Z HOME_URL="https://www.ubuntu.com/" 2025-12-04T08:53:19.6800425Z SUPPORT_URL="https://help.ubuntu.com/" 2025-12-04T08:53:19.6800573Z BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2025-12-04T08:53:19.6800788Z PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2025-12-04T08:53:19.6801186Z UBUNTU_CODENAME=jammy 2025-12-04T08:53:19.6805894Z deb [arch=amd64 signed-by=/etc/apt/keyrings/rocm.gpg] https://repo.radeon.com/rocm/apt/6.4.1 jammy main 2025-12-04T08:53:19.6811614Z 6.4.1-83 2025-12-04T08:53:19.6817478Z runner 2025-12-04T08:53:19.6835044Z ##[group]Run dpkg -l | grep -E " amdgpu" 2025-12-04T08:53:19.6835257Z dpkg -l | grep -E " amdgpu" 2025-12-04T08:53:19.6839425Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.6839577Z env: 2025-12-04T08:53:19.6839673Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6839781Z ##[endgroup] 2025-12-04T08:53:19.6887939Z ii amdgpu-core 1:6.4.60401-2164967.22.04 all Core meta package for unified amdgpu driver. 2025-12-04T08:53:19.6888192Z ii amdgpu-install 6.4.60401-2164967.22.04 all AMDGPU driver repository and installer 2025-12-04T08:53:19.6910592Z ##[group]Run rocm-smi 2025-12-04T08:53:19.6910780Z rocm-smi 2025-12-04T08:53:19.6915542Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.6915728Z env: 2025-12-04T08:53:19.6915839Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.6915976Z ##[endgroup] 2025-12-04T08:53:19.7468356Z 2025-12-04T08:53:19.7468467Z 2025-12-04T08:53:19.7468831Z ============================================ ROCm System Management Interface ============================================ 2025-12-04T08:53:19.7469402Z ====================================================== Concise Info ====================================================== 2025-12-04T08:53:19.7470026Z Device Node IDs Temp Power Partitions SCLK MCLK Fan Perf PwrCap VRAM% GPU% 2025-12-04T08:53:19.7471146Z  (DID, GUID) (Junction) (Socket) (Mem, Compute, ID)  2025-12-04T08:53:19.7471667Z ========================================================================================================================== 2025-12-04T08:53:19.7472720Z 0 5 0x74a5, 2987 27.0°C 119.0W NPS1, SPX, 0 N/A 900Mhz 0% manual 1000.0W 0% 0% 2025-12-04T08:53:19.7473436Z ========================================================================================================================== 2025-12-04T08:53:19.7473871Z ================================================== End of ROCm SMI Log =================================================== 2025-12-04T08:53:19.7533656Z ##[group]Run rocminfo 2025-12-04T08:53:19.7533838Z rocminfo 2025-12-04T08:53:19.7538438Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.7538605Z env: 2025-12-04T08:53:19.7538707Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.7538832Z ##[endgroup] 2025-12-04T08:53:19.8097327Z ROCk module version 6.12.12 is loaded 2025-12-04T08:53:19.8097489Z ===================== 2025-12-04T08:53:19.8097679Z HSA System Attributes 2025-12-04T08:53:19.8097794Z ===================== 2025-12-04T08:53:19.8098468Z Runtime Version: 1.15 2025-12-04T08:53:19.8098646Z Runtime Ext Version: 1.7 2025-12-04T08:53:19.8098843Z System Timestamp Freq.: 1000.000000MHz 2025-12-04T08:53:19.8099046Z Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) 2025-12-04T08:53:19.8099262Z Machine Model: LARGE 2025-12-04T08:53:19.8099437Z System Endianness: LITTLE 2025-12-04T08:53:19.8099592Z Mwaitx: DISABLED 2025-12-04T08:53:19.8099797Z XNACK enabled: NO 2025-12-04T08:53:19.8099917Z DMAbuf Support: YES 2025-12-04T08:53:19.8100098Z VMM Support: YES 2025-12-04T08:53:19.8100175Z 2025-12-04T08:53:19.8100215Z ========== 2025-12-04T08:53:19.8100322Z HSA Agents 2025-12-04T08:53:19.8100428Z ========== 2025-12-04T08:53:19.8100588Z ******* 2025-12-04T08:53:19.8100892Z Agent 1 2025-12-04T08:53:19.8101002Z ******* 2025-12-04T08:53:19.8101128Z Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T08:53:19.8101353Z Uuid: CPU-XX 2025-12-04T08:53:19.8101539Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T08:53:19.8101750Z Vendor Name: CPU 2025-12-04T08:53:19.8101916Z Feature: None specified 2025-12-04T08:53:19.8102079Z Profile: FULL_PROFILE 2025-12-04T08:53:19.8102387Z Float Round Mode: NEAR 2025-12-04T08:53:19.8102590Z Max Queue Number: 0(0x0) 2025-12-04T08:53:19.8102749Z Queue Min Size: 0(0x0) 2025-12-04T08:53:19.8102912Z Queue Max Size: 0(0x0) 2025-12-04T08:53:19.8103137Z Queue Type: MULTI 2025-12-04T08:53:19.8103294Z Node: 0 2025-12-04T08:53:19.8103452Z Device Type: CPU 2025-12-04T08:53:19.8103618Z Cache Info: 2025-12-04T08:53:19.8103741Z L1: 49152(0xc000) KB 2025-12-04T08:53:19.8103895Z Chip ID: 0(0x0) 2025-12-04T08:53:19.8104050Z ASIC Revision: 0(0x0) 2025-12-04T08:53:19.8104221Z Cacheline Size: 64(0x40) 2025-12-04T08:53:19.8104388Z Max Clock Freq. (MHz): 3300 2025-12-04T08:53:19.8104541Z BDFID: 0 2025-12-04T08:53:19.8104699Z Internal Node ID: 0 2025-12-04T08:53:19.8104868Z Compute Unit: 64 2025-12-04T08:53:19.8105031Z SIMDs per CU: 0 2025-12-04T08:53:19.8105196Z Shader Engines: 0 2025-12-04T08:53:19.8105361Z Shader Arrs. per Eng.: 0 2025-12-04T08:53:19.8105533Z WatchPts on Addr. Ranges:1 2025-12-04T08:53:19.8105687Z Memory Properties: 2025-12-04T08:53:19.8105807Z Features: None 2025-12-04T08:53:19.8105922Z Pool Info: 2025-12-04T08:53:19.8106034Z Pool 1 2025-12-04T08:53:19.8106176Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T08:53:19.8106344Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T08:53:19.8106504Z Allocatable: TRUE 2025-12-04T08:53:19.8106679Z Alloc Granule: 4KB 2025-12-04T08:53:19.8106923Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8107104Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8107279Z Accessible by all: TRUE 2025-12-04T08:53:19.8107432Z Pool 2 2025-12-04T08:53:19.8107575Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T08:53:19.8107739Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T08:53:19.8107902Z Allocatable: TRUE 2025-12-04T08:53:19.8108060Z Alloc Granule: 4KB 2025-12-04T08:53:19.8108217Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8108370Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8108522Z Accessible by all: TRUE 2025-12-04T08:53:19.8108697Z Pool 3 2025-12-04T08:53:19.8108818Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-12-04T08:53:19.8108960Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T08:53:19.8109100Z Allocatable: TRUE 2025-12-04T08:53:19.8109246Z Alloc Granule: 4KB 2025-12-04T08:53:19.8109401Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8109556Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8109708Z Accessible by all: TRUE 2025-12-04T08:53:19.8109840Z Pool 4 2025-12-04T08:53:19.8109959Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T08:53:19.8110099Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T08:53:19.8110252Z Allocatable: TRUE 2025-12-04T08:53:19.8110398Z Alloc Granule: 4KB 2025-12-04T08:53:19.8110552Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8110706Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8110858Z Accessible by all: TRUE 2025-12-04T08:53:19.8110989Z ISA Info: 2025-12-04T08:53:19.8111082Z ******* 2025-12-04T08:53:19.8111178Z Agent 2 2025-12-04T08:53:19.8111271Z ******* 2025-12-04T08:53:19.8111380Z Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T08:53:19.8111518Z Uuid: CPU-XX 2025-12-04T08:53:19.8111662Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T08:53:19.8111826Z Vendor Name: CPU 2025-12-04T08:53:19.8111977Z Feature: None specified 2025-12-04T08:53:19.8112119Z Profile: FULL_PROFILE 2025-12-04T08:53:19.8112270Z Float Round Mode: NEAR 2025-12-04T08:53:19.8112421Z Max Queue Number: 0(0x0) 2025-12-04T08:53:19.8112563Z Queue Min Size: 0(0x0) 2025-12-04T08:53:19.8112706Z Queue Max Size: 0(0x0) 2025-12-04T08:53:19.8112849Z Queue Type: MULTI 2025-12-04T08:53:19.8113031Z Node: 1 2025-12-04T08:53:19.8113167Z Device Type: CPU 2025-12-04T08:53:19.8113293Z Cache Info: 2025-12-04T08:53:19.8113402Z L1: 49152(0xc000) KB 2025-12-04T08:53:19.8113577Z Chip ID: 0(0x0) 2025-12-04T08:53:19.8113715Z ASIC Revision: 0(0x0) 2025-12-04T08:53:19.8113862Z Cacheline Size: 64(0x40) 2025-12-04T08:53:19.8114010Z Max Clock Freq. (MHz): 3300 2025-12-04T08:53:19.8114145Z BDFID: 0 2025-12-04T08:53:19.8114286Z Internal Node ID: 1 2025-12-04T08:53:19.8114434Z Compute Unit: 64 2025-12-04T08:53:19.8114574Z SIMDs per CU: 0 2025-12-04T08:53:19.8114718Z Shader Engines: 0 2025-12-04T08:53:19.8114866Z Shader Arrs. per Eng.: 0 2025-12-04T08:53:19.8115018Z WatchPts on Addr. Ranges:1 2025-12-04T08:53:19.8115187Z Memory Properties: 2025-12-04T08:53:19.8115296Z Features: None 2025-12-04T08:53:19.8115399Z Pool Info: 2025-12-04T08:53:19.8115495Z Pool 1 2025-12-04T08:53:19.8115619Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T08:53:19.8115763Z Size: 1585311844(0x5e7df064) KB 2025-12-04T08:53:19.8115906Z Allocatable: TRUE 2025-12-04T08:53:19.8116058Z Alloc Granule: 4KB 2025-12-04T08:53:19.8116217Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8116373Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8116528Z Accessible by all: TRUE 2025-12-04T08:53:19.8116659Z Pool 2 2025-12-04T08:53:19.8116782Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T08:53:19.8116939Z Size: 1585311844(0x5e7df064) KB 2025-12-04T08:53:19.8117081Z Allocatable: TRUE 2025-12-04T08:53:19.8117234Z Alloc Granule: 4KB 2025-12-04T08:53:19.8117395Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8117551Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8117707Z Accessible by all: TRUE 2025-12-04T08:53:19.8117842Z Pool 3 2025-12-04T08:53:19.8117965Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-12-04T08:53:19.8118110Z Size: 1585311844(0x5e7df064) KB 2025-12-04T08:53:19.8118249Z Allocatable: TRUE 2025-12-04T08:53:19.8118402Z Alloc Granule: 4KB 2025-12-04T08:53:19.8118575Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8118734Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8118890Z Accessible by all: TRUE 2025-12-04T08:53:19.8119027Z Pool 4 2025-12-04T08:53:19.8119149Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T08:53:19.8119296Z Size: 1585311844(0x5e7df064) KB 2025-12-04T08:53:19.8119437Z Allocatable: TRUE 2025-12-04T08:53:19.8119590Z Alloc Granule: 4KB 2025-12-04T08:53:19.8119749Z Alloc Recommended Granule:4KB 2025-12-04T08:53:19.8119906Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8120063Z Accessible by all: TRUE 2025-12-04T08:53:19.8120202Z ISA Info: 2025-12-04T08:53:19.8120352Z ******* 2025-12-04T08:53:19.8120453Z Agent 3 2025-12-04T08:53:19.8120547Z ******* 2025-12-04T08:53:19.8120661Z Name: gfx942 2025-12-04T08:53:19.8120804Z Uuid: GPU-f5e0b55322138365 2025-12-04T08:53:19.8120950Z Marketing Name: AMD Instinct MI325X 2025-12-04T08:53:19.8121105Z Vendor Name: AMD 2025-12-04T08:53:19.8121256Z Feature: KERNEL_DISPATCH 2025-12-04T08:53:19.8121404Z Profile: BASE_PROFILE 2025-12-04T08:53:19.8121557Z Float Round Mode: NEAR 2025-12-04T08:53:19.8121708Z Max Queue Number: 128(0x80) 2025-12-04T08:53:19.8121858Z Queue Min Size: 64(0x40) 2025-12-04T08:53:19.8122040Z Queue Max Size: 131072(0x20000) 2025-12-04T08:53:19.8122185Z Queue Type: MULTI 2025-12-04T08:53:19.8122329Z Node: 2 2025-12-04T08:53:19.8122474Z Device Type: GPU 2025-12-04T08:53:19.8122604Z Cache Info: 2025-12-04T08:53:19.8122718Z L1: 32(0x20) KB 2025-12-04T08:53:19.8122850Z L2: 4096(0x1000) KB 2025-12-04T08:53:19.8123015Z L3: 262144(0x40000) KB 2025-12-04T08:53:19.8123152Z Chip ID: 29861(0x74a5) 2025-12-04T08:53:19.8123294Z ASIC Revision: 1(0x1) 2025-12-04T08:53:19.8123446Z Cacheline Size: 128(0x80) 2025-12-04T08:53:19.8123607Z Max Clock Freq. (MHz): 2100 2025-12-04T08:53:19.8123747Z BDFID: 5376 2025-12-04T08:53:19.8123893Z Internal Node ID: 2 2025-12-04T08:53:19.8124046Z Compute Unit: 304 2025-12-04T08:53:19.8124188Z SIMDs per CU: 4 2025-12-04T08:53:19.8124339Z Shader Engines: 32 2025-12-04T08:53:19.8124488Z Shader Arrs. per Eng.: 1 2025-12-04T08:53:19.8124646Z WatchPts on Addr. Ranges:4 2025-12-04T08:53:19.8124804Z Coherent Host Access: FALSE 2025-12-04T08:53:19.8124939Z Memory Properties: 2025-12-04T08:53:19.8125055Z Features: KERNEL_DISPATCH 2025-12-04T08:53:19.8125196Z Fast F16 Operation: TRUE 2025-12-04T08:53:19.8125352Z Wavefront Size: 64(0x40) 2025-12-04T08:53:19.8125507Z Workgroup Max Size: 1024(0x400) 2025-12-04T08:53:19.8125646Z Workgroup Max Size per Dimension: 2025-12-04T08:53:19.8125775Z x 1024(0x400) 2025-12-04T08:53:19.8125905Z y 1024(0x400) 2025-12-04T08:53:19.8126027Z z 1024(0x400) 2025-12-04T08:53:19.8126167Z Max Waves Per CU: 32(0x20) 2025-12-04T08:53:19.8126323Z Max Work-item Per CU: 2048(0x800) 2025-12-04T08:53:19.8126473Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T08:53:19.8126610Z Grid Max Size per Dimension: 2025-12-04T08:53:19.8126726Z x 4294967295(0xffffffff) 2025-12-04T08:53:19.8126859Z y 4294967295(0xffffffff) 2025-12-04T08:53:19.8127029Z z 4294967295(0xffffffff) 2025-12-04T08:53:19.8127173Z Max fbarriers/Workgrp: 32 2025-12-04T08:53:19.8132117Z Packet Processor uCode:: 185 2025-12-04T08:53:19.8132294Z SDMA engine uCode:: 24 2025-12-04T08:53:19.8132449Z IOMMU Support:: None 2025-12-04T08:53:19.8132588Z Pool Info: 2025-12-04T08:53:19.8132698Z Pool 1 2025-12-04T08:53:19.8132825Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T08:53:19.8133024Z Size: 268419072(0xfffc000) KB 2025-12-04T08:53:19.8133170Z Allocatable: TRUE 2025-12-04T08:53:19.8133326Z Alloc Granule: 4KB 2025-12-04T08:53:19.8133575Z Alloc Recommended Granule:2048KB 2025-12-04T08:53:19.8133738Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8133896Z Accessible by all: FALSE 2025-12-04T08:53:19.8134034Z Pool 2 2025-12-04T08:53:19.8134162Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T08:53:19.8134313Z Size: 268419072(0xfffc000) KB 2025-12-04T08:53:19.8134459Z Allocatable: TRUE 2025-12-04T08:53:19.8134617Z Alloc Granule: 4KB 2025-12-04T08:53:19.8134778Z Alloc Recommended Granule:2048KB 2025-12-04T08:53:19.8134936Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8135117Z Accessible by all: FALSE 2025-12-04T08:53:19.8135260Z Pool 3 2025-12-04T08:53:19.8135384Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T08:53:19.8135531Z Size: 268419072(0xfffc000) KB 2025-12-04T08:53:19.8135678Z Allocatable: TRUE 2025-12-04T08:53:19.8135827Z Alloc Granule: 4KB 2025-12-04T08:53:19.8135988Z Alloc Recommended Granule:2048KB 2025-12-04T08:53:19.8136148Z Alloc Alignment: 4KB 2025-12-04T08:53:19.8136301Z Accessible by all: FALSE 2025-12-04T08:53:19.8136438Z Pool 4 2025-12-04T08:53:19.8136555Z Segment: GROUP 2025-12-04T08:53:19.8136695Z Size: 64(0x40) KB 2025-12-04T08:53:19.8136838Z Allocatable: FALSE 2025-12-04T08:53:19.8136993Z Alloc Granule: 0KB 2025-12-04T08:53:19.8137159Z Alloc Recommended Granule:0KB 2025-12-04T08:53:19.8137321Z Alloc Alignment: 0KB 2025-12-04T08:53:19.8137472Z Accessible by all: FALSE 2025-12-04T08:53:19.8137609Z ISA Info: 2025-12-04T08:53:19.8137708Z ISA 1 2025-12-04T08:53:19.8137842Z Name: amdgcn-amd-amdhsa--gfx942:sramecc+:xnack- 2025-12-04T08:53:19.8138007Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-12-04T08:53:19.8138163Z Profiles: HSA_PROFILE_BASE 2025-12-04T08:53:19.8138321Z Default Rounding Mode: NEAR 2025-12-04T08:53:19.8138486Z Default Rounding Mode: NEAR 2025-12-04T08:53:19.8138679Z Fast f16: TRUE 2025-12-04T08:53:19.8138832Z Workgroup Max Size: 1024(0x400) 2025-12-04T08:53:19.8138979Z Workgroup Max Size per Dimension: 2025-12-04T08:53:19.8139106Z x 1024(0x400) 2025-12-04T08:53:19.8139239Z y 1024(0x400) 2025-12-04T08:53:19.8139365Z z 1024(0x400) 2025-12-04T08:53:19.8139507Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T08:53:19.8139645Z Grid Max Size per Dimension: 2025-12-04T08:53:19.8139765Z x 4294967295(0xffffffff) 2025-12-04T08:53:19.8139897Z y 4294967295(0xffffffff) 2025-12-04T08:53:19.8140029Z z 4294967295(0xffffffff) 2025-12-04T08:53:19.8140200Z FBarrier Max Size: 32 2025-12-04T08:53:19.8140336Z ISA 2 2025-12-04T08:53:19.8140475Z Name: amdgcn-amd-amdhsa--gfx9-4-generic:sramecc+:xnack- 2025-12-04T08:53:19.8140649Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-12-04T08:53:19.8140810Z Profiles: HSA_PROFILE_BASE 2025-12-04T08:53:19.8140966Z Default Rounding Mode: NEAR 2025-12-04T08:53:19.8141130Z Default Rounding Mode: NEAR 2025-12-04T08:53:19.8141284Z Fast f16: TRUE 2025-12-04T08:53:19.8141431Z Workgroup Max Size: 1024(0x400) 2025-12-04T08:53:19.8141578Z Workgroup Max Size per Dimension: 2025-12-04T08:53:19.8141704Z x 1024(0x400) 2025-12-04T08:53:19.8141831Z y 1024(0x400) 2025-12-04T08:53:19.8141960Z z 1024(0x400) 2025-12-04T08:53:19.8142096Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T08:53:19.8142236Z Grid Max Size per Dimension: 2025-12-04T08:53:19.8142356Z x 4294967295(0xffffffff) 2025-12-04T08:53:19.8142483Z y 4294967295(0xffffffff) 2025-12-04T08:53:19.8142614Z z 4294967295(0xffffffff) 2025-12-04T08:53:19.8142758Z FBarrier Max Size: 32 2025-12-04T08:53:19.8142888Z *** Done *** 2025-12-04T08:53:19.8182135Z ##[group]Run ngpu=$(rocminfo | grep -c -E 'Name:.*\sgfx') 2025-12-04T08:53:19.8182322Z ngpu=$(rocminfo | grep -c -E 'Name:.*\sgfx') 2025-12-04T08:53:19.8182598Z msg="Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified" 2025-12-04T08:53:19.8182866Z if [[ $ngpu -eq 0 ]]; then 2025-12-04T08:53:19.8183060Z  echo "Error: Failed to detect any GPUs on the runner" 2025-12-04T08:53:19.8183201Z  echo "$msg" 2025-12-04T08:53:19.8183300Z  exit 1 2025-12-04T08:53:19.8183391Z fi 2025-12-04T08:53:19.8186239Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.8186377Z env: 2025-12-04T08:53:19.8186460Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.8186561Z ##[endgroup] 2025-12-04T08:53:19.8804718Z ##[group]Run pytorch/pytorch/.github/actions/diskspace-cleanup@main 2025-12-04T08:53:19.8804887Z with: 2025-12-04T08:53:19.8804976Z diskspace-cutoff: 70 2025-12-04T08:53:19.8805075Z env: 2025-12-04T08:53:19.8805165Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.8805268Z ##[endgroup] 2025-12-04T08:53:19.8822885Z ##[group]Run set -ex 2025-12-04T08:53:19.8823089Z set -ex 2025-12-04T08:53:19.8823281Z diskspace_cutoff=70 2025-12-04T08:53:19.8823430Z docker_root_dir=$(docker info -f '{{.DockerRootDir}}') 2025-12-04T08:53:19.8823594Z if [ ! -d "$docker_root_dir" ]; then 2025-12-04T08:53:19.8823789Z  echo "Docker root directory ($docker_root_dir) does not exist. Skipping disk space check." 2025-12-04T08:53:19.8823974Z  exit 0 2025-12-04T08:53:19.8824069Z fi 2025-12-04T08:53:19.8824232Z diskspace=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-12-04T08:53:19.8824556Z msg="Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified" 2025-12-04T08:53:19.8824839Z if [[ "$diskspace" -ge "$diskspace_cutoff" ]] ; then 2025-12-04T08:53:19.8824984Z  docker system prune -af 2025-12-04T08:53:19.8825182Z  diskspace_new=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-12-04T08:53:19.8825461Z  if [[ "$diskspace_new" -gt "$diskspace_cutoff" ]] ; then 2025-12-04T08:53:19.8825621Z  diskspace_cutoff_int=$((diskspace_cutoff + 0)) 2025-12-04T08:53:19.8825778Z  difference=$((100 - diskspace_cutoff_int)) 2025-12-04T08:53:19.8825982Z  echo "Error: Available diskspace is less than $difference percent. Not enough diskspace." 2025-12-04T08:53:19.8826166Z  echo "$msg" 2025-12-04T08:53:19.8826272Z  exit 1 2025-12-04T08:53:19.8826365Z  else 2025-12-04T08:53:19.8826478Z  difference=$((diskspace - diskspace_new)) 2025-12-04T08:53:19.8826631Z  echo "Diskspace saved: $difference percent" 2025-12-04T08:53:19.8826757Z  fi 2025-12-04T08:53:19.8826844Z fi 2025-12-04T08:53:19.8829877Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.8830022Z env: 2025-12-04T08:53:19.8830121Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.8830223Z ##[endgroup] 2025-12-04T08:53:19.8847078Z + diskspace_cutoff=70 2025-12-04T08:53:19.8851799Z ++ docker info -f '{{.DockerRootDir}}' 2025-12-04T08:53:19.9154182Z + docker_root_dir=/home/runner/docker-data 2025-12-04T08:53:19.9154465Z + '[' '!' -d /home/runner/docker-data ']' 2025-12-04T08:53:19.9161638Z ++ df -H --output=pcent /home/runner/docker-data 2025-12-04T08:53:19.9162167Z ++ sed -n 2p 2025-12-04T08:53:19.9163221Z ++ sed s/%// 2025-12-04T08:53:19.9163810Z ++ sed 's/ //' 2025-12-04T08:53:19.9175538Z + diskspace=' 5' 2025-12-04T08:53:19.9175928Z + msg='Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified' 2025-12-04T08:53:19.9176306Z + [[ 5 -ge 70 ]] 2025-12-04T08:53:19.9188830Z ##[group]Run RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2025-12-04T08:53:19.9189026Z RUNNER_ARTIFACT_DIR="${RUNNER_TEMP}/artifacts" 2025-12-04T08:53:19.9189190Z rm -rf "${RUNNER_ARTIFACT_DIR}" 2025-12-04T08:53:19.9189324Z mkdir -p "${RUNNER_ARTIFACT_DIR}" 2025-12-04T08:53:19.9189494Z echo "RUNNER_ARTIFACT_DIR=${RUNNER_ARTIFACT_DIR}" >> "${GITHUB_ENV}" 2025-12-04T08:53:19.9189647Z  2025-12-04T08:53:19.9189765Z RUNNER_TEST_RESULTS_DIR="${RUNNER_TEMP}/test-results" 2025-12-04T08:53:19.9189916Z rm -rf "${RUNNER_TEST_RESULTS_DIR}" 2025-12-04T08:53:19.9190058Z mkdir -p "${RUNNER_TEST_RESULTS_DIR}" 2025-12-04T08:53:19.9190236Z echo "RUNNER_TEST_RESULTS_DIR=${RUNNER_TEST_RESULTS_DIR}" >> "${GITHUB_ENV}" 2025-12-04T08:53:19.9190397Z  2025-12-04T08:53:19.9190494Z RUNNER_DOCS_DIR="${RUNNER_TEMP}/docs" 2025-12-04T08:53:19.9190628Z rm -rf "${RUNNER_DOCS_DIR}" 2025-12-04T08:53:19.9190746Z mkdir -p "${RUNNER_DOCS_DIR}" 2025-12-04T08:53:19.9190898Z echo "RUNNER_DOCS_DIR=${RUNNER_DOCS_DIR}" >> "${GITHUB_ENV}" 2025-12-04T08:53:19.9193503Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.9193645Z env: 2025-12-04T08:53:19.9193734Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.9193834Z ##[endgroup] 2025-12-04T08:53:19.9268513Z ##[group]Run env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:19.9268814Z env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:19.9269074Z env | grep '^CI' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:19.9272813Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.9273061Z env: 2025-12-04T08:53:19.9273184Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.9273372Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:19.9273608Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:19.9273833Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:19.9274091Z ##[endgroup] 2025-12-04T08:53:19.9329739Z ##[group]Run # All GPUs are visible to the runner; visibility, if needed, will be set by run_test.py. 2025-12-04T08:53:19.9330065Z # All GPUs are visible to the runner; visibility, if needed, will be set by run_test.py. 2025-12-04T08:53:19.9330262Z # Add render group for container creation. 2025-12-04T08:53:19.9330428Z render_gid=`cat /etc/group | grep render | cut -d: -f3` 2025-12-04T08:53:19.9330626Z # Ensure GPU isolation if pod is part of kubernetes setup with DEVICE_FLAG. 2025-12-04T08:53:19.9330825Z if [ -f "/etc/podinfo/gha-render-devices" ]; then 2025-12-04T08:53:19.9331012Z  DEVICE_FLAG=$(cat /etc/podinfo/gha-render-devices) 2025-12-04T08:53:19.9331149Z else 2025-12-04T08:53:19.9331256Z  DEVICE_FLAG="--device /dev/dri" 2025-12-04T08:53:19.9331381Z fi 2025-12-04T08:53:19.9331560Z # The --group-add daemon and --group-add bin are needed in the Ubuntu 24.04 and Almalinux OSs respectively. 2025-12-04T08:53:19.9331853Z # This is due to the device files (/dev/kfd & /dev/dri) being owned by video group on bare metal. 2025-12-04T08:53:19.9332112Z # This video group ID maps to subgid 1 inside the docker image due to the /etc/subgid entries. 2025-12-04T08:53:19.9332374Z # The group name corresponding to group ID 1 can change depending on the OS, so both are necessary. 2025-12-04T08:53:19.9332826Z echo "GPU_FLAG=--device=/dev/mem --device=/dev/kfd $DEVICE_FLAG --group-add video --group-add $render_gid --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host" >> "${GITHUB_ENV}" 2025-12-04T08:53:19.9337396Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:19.9337537Z env: 2025-12-04T08:53:19.9337635Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.9337772Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:19.9337945Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:19.9338116Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:19.9338245Z ##[endgroup] 2025-12-04T08:53:19.9397735Z ##[group]Run aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722 2025-12-04T08:53:19.9397934Z with: 2025-12-04T08:53:19.9398078Z role-to-assume: arn:aws:iam::308535385114:role/gha_workflow_s3_and_ecr_read_only 2025-12-04T08:53:19.9398248Z aws-region: us-east-1 2025-12-04T08:53:19.9398355Z role-duration-seconds: 18000 2025-12-04T08:53:19.9398474Z audience: sts.amazonaws.com 2025-12-04T08:53:19.9398581Z env: 2025-12-04T08:53:19.9398670Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:19.9398798Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:19.9398968Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:19.9399125Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:19.9399591Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:19.9399956Z ##[endgroup] 2025-12-04T08:53:20.2806547Z Assuming role with OIDC 2025-12-04T08:53:20.6278361Z Authenticated as assumedRoleId AROAUPVRELQNLLCOPFEJR:GitHubActions 2025-12-04T08:53:20.7246981Z ##[group]Run aws-actions/amazon-ecr-login@062b18b96a7aff071d4dc91bc00c4c1a7945b076 2025-12-04T08:53:20.7247206Z with: 2025-12-04T08:53:20.7247320Z mask-password: true 2025-12-04T08:53:20.7247446Z registry-type: private 2025-12-04T08:53:20.7247573Z skip-logout: false 2025-12-04T08:53:20.7247682Z env: 2025-12-04T08:53:20.7247791Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:20.7247947Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:20.7248146Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:20.7248338Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:20.7248949Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:20.7249375Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:20.7249514Z AWS_REGION: us-east-1 2025-12-04T08:53:20.7249966Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:20.7250134Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:20.7252273Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:20.7252388Z ##[endgroup] 2025-12-04T08:53:21.1332558Z Logging into registry 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.7802370Z ##[group]Run env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:21.7802688Z env | grep '^GITHUB' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:21.7803022Z env | grep '^CI' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:21.7803303Z env | grep '^RUNNER' >> "${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" 2025-12-04T08:53:21.7808209Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:21.7808370Z env: 2025-12-04T08:53:21.7808471Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:21.7808618Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:21.7808812Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:21.7808995Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:21.7809405Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:21.7809813Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:21.7809945Z AWS_REGION: us-east-1 2025-12-04T08:53:21.7810188Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:21.7810403Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:21.7812674Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:21.7812798Z ##[endgroup] 2025-12-04T08:53:21.7970494Z ##[group]Run pytorch/test-infra/.github/actions/calculate-docker-image@main 2025-12-04T08:53:21.7970688Z with: 2025-12-04T08:53:21.7970971Z docker-image-name: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.7971284Z use-custom-docker-registry: true 2025-12-04T08:53:21.7971418Z docker-build-dir: .ci/docker 2025-12-04T08:53:21.7971546Z docker-build-script: ./build.sh 2025-12-04T08:53:21.7971670Z working-directory: . 2025-12-04T08:53:21.7971818Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.7971979Z force-push: false 2025-12-04T08:53:21.7972079Z env: 2025-12-04T08:53:21.7972177Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:21.7972320Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:21.7972519Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:21.7972714Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:21.7973295Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:21.7973673Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:21.7973791Z AWS_REGION: us-east-1 2025-12-04T08:53:21.7974030Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:21.7974189Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:21.7976310Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:21.7976419Z ##[endgroup] 2025-12-04T08:53:21.7984807Z ##[group]Run set -ex 2025-12-04T08:53:21.7984943Z set -ex 2025-12-04T08:53:21.7985036Z  2025-12-04T08:53:21.7985190Z # If the docker build directory or the build script doesn't exist, the action will 2025-12-04T08:53:21.7985546Z # gracefully return the docker image name as it is. Pulling docker image in Linux 2025-12-04T08:53:21.7985760Z # job could then download the pre-built image as usual 2025-12-04T08:53:21.7986016Z if [[ -d "${DOCKER_BUILD_DIR}" ]] && [[ -f "${DOCKER_BUILD_DIR}/${DOCKER_BUILD_SCRIPT}" ]] && [[ "${USE_CUSTOM_DOCKER_REGISTRY}" == "true" ]]; then 2025-12-04T08:53:21.7986254Z  echo "skip=false" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7986382Z else 2025-12-04T08:53:21.7986490Z  echo "skip=true" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7986662Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7986816Z  2025-12-04T08:53:21.7987020Z  echo "Not using custom ECR registry. Either it was not requested or there is no Docker build script in the ${REPO_NAME} repo..." 2025-12-04T08:53:21.7987246Z  exit 0 2025-12-04T08:53:21.7987339Z fi 2025-12-04T08:53:21.7987432Z  2025-12-04T08:53:21.7987569Z if [[ "${DOCKER_IMAGE_NAME}" == *"${DOCKER_REGISTRY}/${REPO_NAME}"* ]]; then 2025-12-04T08:53:21.7987795Z  # The docker image name already includes the ECR prefix and tag, so we can just 2025-12-04T08:53:21.7987994Z  # use it as it is, but first let's extract the tag 2025-12-04T08:53:21.7988177Z  DOCKER_TAG=$(echo "${DOCKER_IMAGE_NAME}" | awk -F '[:,]' '{print $2}') 2025-12-04T08:53:21.7988368Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7988549Z  echo "docker-image=${DOCKER_IMAGE_NAME}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7988699Z else 2025-12-04T08:53:21.7988808Z  if [[ "${DOCKER_IMAGE_NAME}" == *:* ]]; then 2025-12-04T08:53:21.7988958Z  CUSTOM_TAG_PREFIX=${DOCKER_IMAGE_NAME#*:} 2025-12-04T08:53:21.7989110Z  DOCKER_IMAGE_NAME=${DOCKER_IMAGE_NAME%%:*} 2025-12-04T08:53:21.7989240Z  fi 2025-12-04T08:53:21.7989509Z  DOCKER_TAG=${CUSTOM_TAG_PREFIX:+${CUSTOM_TAG_PREFIX}-}$(git rev-parse HEAD:"${DOCKER_BUILD_DIR}") 2025-12-04T08:53:21.7989736Z  echo "docker-tag=${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7989972Z  echo "docker-image=${DOCKER_REGISTRY}/${REPO_NAME}/${DOCKER_IMAGE_NAME}:${DOCKER_TAG}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7990229Z  echo "custom-tag-prefix=${CUSTOM_TAG_PREFIX}" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.7990390Z fi 2025-12-04T08:53:21.7994479Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:21.7994627Z env: 2025-12-04T08:53:21.7994722Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:21.7994858Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:21.7995036Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:21.7995202Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:21.7995587Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:21.7995962Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:21.7996081Z AWS_REGION: us-east-1 2025-12-04T08:53:21.7996221Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:21.7996376Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:21.7998484Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:21.7998592Z REPO_NAME: pytorch 2025-12-04T08:53:21.7998866Z DOCKER_IMAGE_NAME: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.7999158Z DOCKER_BUILD_DIR: .ci/docker 2025-12-04T08:53:21.7999277Z DOCKER_BUILD_SCRIPT: ./build.sh 2025-12-04T08:53:21.7999428Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.7999585Z USE_CUSTOM_DOCKER_REGISTRY: true 2025-12-04T08:53:21.7999704Z CUSTOM_TAG_PREFIX: 2025-12-04T08:53:21.7999860Z ##[endgroup] 2025-12-04T08:53:21.8015066Z + [[ -d .ci/docker ]] 2025-12-04T08:53:21.8015191Z + [[ -f .ci/docker/./build.sh ]] 2025-12-04T08:53:21.8015315Z + [[ true == \t\r\u\e ]] 2025-12-04T08:53:21.8015416Z + echo skip=false 2025-12-04T08:53:21.8015867Z + [[ 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a == *\3\0\8\5\3\5\3\8\5\1\1\4\.\d\k\r\.\e\c\r\.\u\s\-\e\a\s\t\-\1\.\a\m\a\z\o\n\a\w\s\.\c\o\m\/\p\y\t\o\r\c\h* ]] 2025-12-04T08:53:21.8021936Z ++ echo 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8022223Z ++ awk -F '[:,]' '{print $2}' 2025-12-04T08:53:21.8030977Z + DOCKER_TAG=pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8031264Z + echo docker-tag=pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8031641Z + echo docker-image=308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8058957Z ##[group]Run set +e 2025-12-04T08:53:21.8059136Z set +e 2025-12-04T08:53:21.8059248Z set -x 2025-12-04T08:53:21.8059355Z  2025-12-04T08:53:21.8059461Z login() { 2025-12-04T08:53:21.8059674Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-12-04T08:53:21.8059886Z } 2025-12-04T08:53:21.8059981Z  2025-12-04T08:53:21.8060076Z retry () { 2025-12-04T08:53:21.8060198Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-12-04T08:53:21.8060330Z } 2025-12-04T08:53:21.8060422Z  2025-12-04T08:53:21.8060527Z retry login "${DOCKER_REGISTRY}" 2025-12-04T08:53:21.8060654Z  2025-12-04T08:53:21.8060757Z START_TIME=$(date +%s) 2025-12-04T08:53:21.8060910Z # Wait up to 120 minutes 2025-12-04T08:53:21.8061231Z while [[ $(( $(date +%s) - 7200 )) -lt $START_TIME ]]; do 2025-12-04T08:53:21.8061428Z  # Check if image already exists, if it does then skip building it 2025-12-04T08:53:21.8061623Z  if docker manifest inspect "${DOCKER_IMAGE}"; then 2025-12-04T08:53:21.8061772Z  exit 0 2025-12-04T08:53:21.8061879Z  fi 2025-12-04T08:53:21.8061979Z  2025-12-04T08:53:21.8062138Z  # NB: This flag is used by Docker build workflow to push the image to ECR, so we can 2025-12-04T08:53:21.8062390Z  # use this to differentiate between the Docker build and regular build jobs. For the 2025-12-04T08:53:21.8062640Z  # latter, it will wait for the Docker images to become available before continuing 2025-12-04T08:53:21.8062846Z  if [ "${DOCKER_PUSH:-false}" == "true" ]; then 2025-12-04T08:53:21.8063066Z  # It's a Docker build job, let's build the image 2025-12-04T08:53:21.8063216Z  break 2025-12-04T08:53:21.8063331Z  else 2025-12-04T08:53:21.8063475Z  # It's a regular build job, wait for the image to become available 2025-12-04T08:53:21.8063640Z  sleep 300 2025-12-04T08:53:21.8063751Z  fi 2025-12-04T08:53:21.8063876Z done 2025-12-04T08:53:21.8063972Z  2025-12-04T08:53:21.8064115Z # NB: This part requires a full checkout. Otherwise, the merge base will 2025-12-04T08:53:21.8064330Z # be empty. The default action would be to continue rebuild the image 2025-12-04T08:53:21.8064535Z if [[ "$BASE_REVISION" = "$(git rev-parse HEAD)" ]]; then 2025-12-04T08:53:21.8064714Z  # if we're on the base branch then use the parent commit 2025-12-04T08:53:21.8064876Z  MERGE_BASE=$(git rev-parse HEAD~) 2025-12-04T08:53:21.8065004Z else 2025-12-04T08:53:21.8065141Z  # otherwise we're on a PR, so use the most recent base commit 2025-12-04T08:53:21.8065465Z  MERGE_BASE=$(git merge-base HEAD "$BASE_REVISION") 2025-12-04T08:53:21.8065609Z fi 2025-12-04T08:53:21.8065703Z  2025-12-04T08:53:21.8065808Z if [[ -z "${MERGE_BASE}" ]]; then 2025-12-04T08:53:21.8065956Z  echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.8066090Z  2025-12-04T08:53:21.8066269Z  echo "Finding merge base only works with full checkout, please set fetch-depth to 0, continuing ..." 2025-12-04T08:53:21.8066472Z  exit 0 2025-12-04T08:53:21.8066570Z fi 2025-12-04T08:53:21.8066664Z  2025-12-04T08:53:21.8066796Z if ! git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}"; then 2025-12-04T08:53:21.8067056Z  echo "Directory '${DOCKER_BUILD_DIR}' not found in commit $MERGE_BASE, you should rebase onto a more recent commit" 2025-12-04T08:53:21.8067273Z  exit 1 2025-12-04T08:53:21.8067376Z fi 2025-12-04T08:53:21.8067470Z  2025-12-04T08:53:21.8067624Z PREVIOUS_DOCKER_TAG=$(git rev-parse "${MERGE_BASE}:${DOCKER_BUILD_DIR}") 2025-12-04T08:53:21.8067872Z # If no image exists but the hash is the same as the previous hash then we should error out here 2025-12-04T08:53:21.8068095Z if [[ "${PREVIOUS_DOCKER_TAG}" == "${DOCKER_TAG}" ]]; then 2025-12-04T08:53:21.8068350Z  echo "WARNING: Something has gone wrong and the previous image isn't available for the merge-base of your branch" 2025-12-04T08:53:21.8068632Z  echo " Will re-build docker image to store in local cache, TTS may be longer" 2025-12-04T08:53:21.8068809Z fi 2025-12-04T08:53:21.8068905Z  2025-12-04T08:53:21.8069021Z echo "rebuild=true" >> "${GITHUB_OUTPUT}" 2025-12-04T08:53:21.8073141Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:21.8073297Z env: 2025-12-04T08:53:21.8073399Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:21.8073546Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:21.8073779Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:21.8073953Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:21.8074341Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:21.8074716Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:21.8074839Z AWS_REGION: us-east-1 2025-12-04T08:53:21.8075071Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:21.8075233Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:21.8077351Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:21.8077468Z DOCKER_BUILD_DIR: .ci/docker 2025-12-04T08:53:21.8077615Z BASE_REVISION: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T08:53:21.8077934Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8078294Z DOCKER_TAG: pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:21.8078527Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.8078682Z DOCKER_PUSH: 2025-12-04T08:53:21.8078787Z ##[endgroup] 2025-12-04T08:53:21.8095341Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.8095541Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.8098250Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:21.8098546Z /home/runner/_work/_temp/c9da5613-0b32-4f26-abe7-820f5bdf3d37.sh: line 5: aws: command not found 2025-12-04T08:53:21.8099712Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:21.8190440Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:21.8200793Z + sleep 1 2025-12-04T08:53:22.8211388Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:22.8215836Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:22.8216166Z /home/runner/_work/_temp/c9da5613-0b32-4f26-abe7-820f5bdf3d37.sh: line 5: aws: command not found 2025-12-04T08:53:22.8216522Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:22.8307430Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:22.8320186Z + sleep 2 2025-12-04T08:53:24.8331309Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:24.8334619Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:24.8335003Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:24.8335444Z /home/runner/_work/_temp/c9da5613-0b32-4f26-abe7-820f5bdf3d37.sh: line 5: aws: command not found 2025-12-04T08:53:24.8404289Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:24.8416746Z ++ date +%s 2025-12-04T08:53:24.8425044Z + START_TIME=1764838404 2025-12-04T08:53:24.8428736Z ++ date +%s 2025-12-04T08:53:24.8436514Z + [[ 1764831204 -lt 1764838404 ]] 2025-12-04T08:53:24.8437188Z + docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:26.2427811Z { 2025-12-04T08:53:26.2428158Z "schemaVersion": 2, 2025-12-04T08:53:26.2428685Z "mediaType": "application/vnd.docker.distribution.manifest.v2+json", 2025-12-04T08:53:26.2429166Z "config": { 2025-12-04T08:53:26.2429540Z "mediaType": "application/vnd.docker.container.image.v1+json", 2025-12-04T08:53:26.2429967Z "size": 30522, 2025-12-04T08:53:26.2430422Z "digest": "sha256:79498ef00fdf8abfcde955fd685c3a7412c33ca80383b5905abfdc3c70621215" 2025-12-04T08:53:26.2430909Z }, 2025-12-04T08:53:26.2431142Z "layers": [ 2025-12-04T08:53:26.2431373Z { 2025-12-04T08:53:26.2431729Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2432187Z "size": 30594402, 2025-12-04T08:53:26.2433201Z "digest": "sha256:02de03a7213b62b792ec66a7efb8c86c4117ca00fb8651facf8ecfe33044b485" 2025-12-04T08:53:26.2433678Z }, 2025-12-04T08:53:26.2433890Z { 2025-12-04T08:53:26.2434238Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2434653Z "size": 1554, 2025-12-04T08:53:26.2435080Z "digest": "sha256:3a5718b5258e28918133dd74ea64bd506b2c15530a2fa8a72c45c5b0d8f7c7b0" 2025-12-04T08:53:26.2435544Z }, 2025-12-04T08:53:26.2435749Z { 2025-12-04T08:53:26.2436237Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2436656Z "size": 335779211, 2025-12-04T08:53:26.2437088Z "digest": "sha256:bf3aa22776924a41b55849f0f30cb22af45d41da1177a9d682cf94cde99d8f98" 2025-12-04T08:53:26.2437409Z }, 2025-12-04T08:53:26.2437549Z { 2025-12-04T08:53:26.2437769Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2438052Z "size": 704, 2025-12-04T08:53:26.2438336Z "digest": "sha256:9d58e5257cefd43e8226153d71d28a865253662146aa9fce9a9f95af67b497fa" 2025-12-04T08:53:26.2438639Z }, 2025-12-04T08:53:26.2438775Z { 2025-12-04T08:53:26.2438998Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2439274Z "size": 1770, 2025-12-04T08:53:26.2439552Z "digest": "sha256:fde80a64553533a56c032d4bc388837e7d4631a0424d1bfe135703165b67fd4d" 2025-12-04T08:53:26.2439855Z }, 2025-12-04T08:53:26.2439991Z { 2025-12-04T08:53:26.2440211Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2440482Z "size": 485, 2025-12-04T08:53:26.2440756Z "digest": "sha256:6931c5f20e80e481e4f484471ff3a02878b4f8c54a9a5a4717213fdaa35c0bff" 2025-12-04T08:53:26.2441061Z }, 2025-12-04T08:53:26.2441200Z { 2025-12-04T08:53:26.2441419Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2441838Z "size": 120663474, 2025-12-04T08:53:26.2442145Z "digest": "sha256:170ea6d3edd62991e37d2e6ebe53dfcd4601f5d42e8f9720af5f8db5fc267856" 2025-12-04T08:53:26.2442455Z }, 2025-12-04T08:53:26.2442589Z { 2025-12-04T08:53:26.2442811Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2443148Z "size": 4433, 2025-12-04T08:53:26.2443432Z "digest": "sha256:dc8487f6c81cac00fa33031f8d3481e2c3634c4f064a9c4c36b87b41e78bc9fb" 2025-12-04T08:53:26.2443739Z }, 2025-12-04T08:53:26.2443873Z { 2025-12-04T08:53:26.2444123Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2444403Z "size": 1755, 2025-12-04T08:53:26.2444682Z "digest": "sha256:9748c5348f39a11c960c49fd9219fdea1c23e612ed11a02d71501424defc80f5" 2025-12-04T08:53:26.2444989Z }, 2025-12-04T08:53:26.2445124Z { 2025-12-04T08:53:26.2445348Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2445622Z "size": 724, 2025-12-04T08:53:26.2445914Z "digest": "sha256:8539cc3f8d8a138501ed0255c0cd7ec491bc0add9e4a62095f1c0f9533daa1cc" 2025-12-04T08:53:26.2446234Z }, 2025-12-04T08:53:26.2446429Z { 2025-12-04T08:53:26.2446859Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2447132Z "size": 3378352584, 2025-12-04T08:53:26.2447356Z "digest": "sha256:af88f886884fe6f1a1992efb7ce8473901f795eef69caa199443f3e076fdfd5b" 2025-12-04T08:53:26.2447599Z }, 2025-12-04T08:53:26.2447705Z { 2025-12-04T08:53:26.2447869Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2448076Z "size": 396, 2025-12-04T08:53:26.2448286Z "digest": "sha256:32fbb88555c4195c45c7008cf92e389d67acc79a7e382503003ef93bcb886afe" 2025-12-04T08:53:26.2448523Z }, 2025-12-04T08:53:26.2448627Z { 2025-12-04T08:53:26.2448788Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2448996Z "size": 80171601, 2025-12-04T08:53:26.2449207Z "digest": "sha256:3231e1ab814b143b244037c540b637be259085834865ac43b1ed2b6f6ad631e1" 2025-12-04T08:53:26.2449442Z }, 2025-12-04T08:53:26.2449615Z { 2025-12-04T08:53:26.2449794Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2450004Z "size": 787, 2025-12-04T08:53:26.2450215Z "digest": "sha256:80061bf5dcbb9a4e38ac865a9cdc0a615bb294e3e6bfa357a6d515dcf3f54abc" 2025-12-04T08:53:26.2450445Z }, 2025-12-04T08:53:26.2450553Z { 2025-12-04T08:53:26.2450725Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2450944Z "size": 106, 2025-12-04T08:53:26.2451164Z "digest": "sha256:6e9524f4518ec02b47ff12c55b6b6afbc65b3f4be59072e2afe20c2c87522549" 2025-12-04T08:53:26.2451405Z }, 2025-12-04T08:53:26.2451513Z { 2025-12-04T08:53:26.2451694Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2451906Z "size": 1495, 2025-12-04T08:53:26.2452115Z "digest": "sha256:ce919d4bf5eeff71d49b160a16603117225530497c3905e02224227d11e2ff88" 2025-12-04T08:53:26.2452358Z }, 2025-12-04T08:53:26.2452469Z { 2025-12-04T08:53:26.2452643Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2452862Z "size": 548601195, 2025-12-04T08:53:26.2453158Z "digest": "sha256:47681e3e6f37423139a5c86549ffbb43e4f258344b0461208f5821263da152e9" 2025-12-04T08:53:26.2453398Z }, 2025-12-04T08:53:26.2453509Z { 2025-12-04T08:53:26.2453693Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2453904Z "size": 162, 2025-12-04T08:53:26.2454123Z "digest": "sha256:cb70fe22c9ebacebfe8402519059c8a66da6d5a77979e4c0ecdb3a762bebe357" 2025-12-04T08:53:26.2454369Z }, 2025-12-04T08:53:26.2454480Z { 2025-12-04T08:53:26.2454658Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2454874Z "size": 104, 2025-12-04T08:53:26.2455090Z "digest": "sha256:17858e829c8cfe9a7e22516e03ad5273d8cf5c50f58edb10ff60c74e15c8e1f6" 2025-12-04T08:53:26.2455393Z }, 2025-12-04T08:53:26.2455497Z { 2025-12-04T08:53:26.2455679Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2455893Z "size": 724, 2025-12-04T08:53:26.2456109Z "digest": "sha256:8539cc3f8d8a138501ed0255c0cd7ec491bc0add9e4a62095f1c0f9533daa1cc" 2025-12-04T08:53:26.2456349Z }, 2025-12-04T08:53:26.2456462Z { 2025-12-04T08:53:26.2456632Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2456843Z "size": 196, 2025-12-04T08:53:26.2457079Z "digest": "sha256:a63f3b4eed1157bcb3c51b64196e74e9f10d1f923652b02fd433c6ed993597ff" 2025-12-04T08:53:26.2457290Z }, 2025-12-04T08:53:26.2457382Z { 2025-12-04T08:53:26.2457522Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2457694Z "size": 2584, 2025-12-04T08:53:26.2457873Z "digest": "sha256:10ab3d1afbc4cb2d3ced8f3e0072c0b1dd124dcadcf68b95fadf8a7a9f663860" 2025-12-04T08:53:26.2458071Z }, 2025-12-04T08:53:26.2458169Z { 2025-12-04T08:53:26.2458308Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2458480Z "size": 7652105336, 2025-12-04T08:53:26.2458661Z "digest": "sha256:98ca88b5095b449a2f2d753a21217856271912fbe51c2d99f928a2196f4097d5" 2025-12-04T08:53:26.2458848Z }, 2025-12-04T08:53:26.2458941Z { 2025-12-04T08:53:26.2459080Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2459247Z "size": 135, 2025-12-04T08:53:26.2459417Z "digest": "sha256:025c90839a58c768b3cc444e48cae67c1a5b2c85320ad8827231f0ba390cf9aa" 2025-12-04T08:53:26.2459604Z }, 2025-12-04T08:53:26.2459695Z { 2025-12-04T08:53:26.2459835Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2460002Z "size": 104, 2025-12-04T08:53:26.2460171Z "digest": "sha256:9255df5942ae69fee24f8074314f451d5d2f1ca71b6c777274297fd43a0032d8" 2025-12-04T08:53:26.2460361Z }, 2025-12-04T08:53:26.2460450Z { 2025-12-04T08:53:26.2460592Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2460771Z "size": 612, 2025-12-04T08:53:26.2460984Z "digest": "sha256:f71ca9d4ed1c4ca8177602f3cb0db83d9787ea6c258a8ef203387b308ff3e0f0" 2025-12-04T08:53:26.2461178Z }, 2025-12-04T08:53:26.2461271Z { 2025-12-04T08:53:26.2461411Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2461584Z "size": 838191953, 2025-12-04T08:53:26.2461765Z "digest": "sha256:d02b47b56ca7f3598f5943d4fdc7139d5e3d3bc82d49185cedf9817dd55fc75c" 2025-12-04T08:53:26.2461958Z }, 2025-12-04T08:53:26.2462049Z { 2025-12-04T08:53:26.2462190Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2462357Z "size": 111, 2025-12-04T08:53:26.2462527Z "digest": "sha256:40279492aea7bc8fb650842b495912195621c21b14cef4c717a9e0a9fc535131" 2025-12-04T08:53:26.2462714Z }, 2025-12-04T08:53:26.2462808Z { 2025-12-04T08:53:26.2462994Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2463169Z "size": 1556, 2025-12-04T08:53:26.2463347Z "digest": "sha256:33a27ce74abd7e32a03a564fc45005bc75904b53ad516f18d47facbeb2f2794e" 2025-12-04T08:53:26.2463540Z }, 2025-12-04T08:53:26.2463631Z { 2025-12-04T08:53:26.2463771Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2463941Z "size": 107, 2025-12-04T08:53:26.2464115Z "digest": "sha256:6b66ed335d1d8df6140caba76d9c2babed83bb37962e1e638825d49e67184fa5" 2025-12-04T08:53:26.2464307Z }, 2025-12-04T08:53:26.2464398Z { 2025-12-04T08:53:26.2464535Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2464709Z "size": 166, 2025-12-04T08:53:26.2464884Z "digest": "sha256:9f010fa04118bfee2d7b4481e6badb714032bde0652b04151a6599e57e1bd91b" 2025-12-04T08:53:26.2465078Z }, 2025-12-04T08:53:26.2465167Z { 2025-12-04T08:53:26.2465305Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2465522Z "size": 3702493, 2025-12-04T08:53:26.2465708Z "digest": "sha256:6c64d5e8bb6ae6ef4e3f1d316429d8b14a6e8a1fb410fb83b96c8bbd4a0a095c" 2025-12-04T08:53:26.2465903Z }, 2025-12-04T08:53:26.2465993Z { 2025-12-04T08:53:26.2466128Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2466297Z "size": 107, 2025-12-04T08:53:26.2466471Z "digest": "sha256:c20ea058f549f5f5538c95c5e0da23afbbc9fb7ffc1987d126fe684eeed743f5" 2025-12-04T08:53:26.2466662Z }, 2025-12-04T08:53:26.2466752Z { 2025-12-04T08:53:26.2466890Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2467059Z "size": 829, 2025-12-04T08:53:26.2467221Z "digest": "sha256:3c4fd2d54638a1336d39769fe36041aa6d186a8dea0e7096b8d8a7068ba0d3c0" 2025-12-04T08:53:26.2467398Z }, 2025-12-04T08:53:26.2467484Z { 2025-12-04T08:53:26.2467617Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2467779Z "size": 26673844, 2025-12-04T08:53:26.2467957Z "digest": "sha256:964ebac3d7a95c64ea7f0d828cd58e6244cc955e9a099a2525079ecf64026e3f" 2025-12-04T08:53:26.2468139Z }, 2025-12-04T08:53:26.2468226Z { 2025-12-04T08:53:26.2468361Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2468522Z "size": 104, 2025-12-04T08:53:26.2468689Z "digest": "sha256:2aaa7210673fc5bd15d36e54ee5c3fb495d1eafa1cb8d686054ccedb1c37bfc8" 2025-12-04T08:53:26.2468871Z }, 2025-12-04T08:53:26.2468958Z { 2025-12-04T08:53:26.2469091Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2469251Z "size": 424, 2025-12-04T08:53:26.2469417Z "digest": "sha256:fa273daa00371a98ed668535e14b8cc3cb425feba0b601b3e3c72314d0234312" 2025-12-04T08:53:26.2469598Z }, 2025-12-04T08:53:26.2469684Z { 2025-12-04T08:53:26.2469817Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2469979Z "size": 19279582, 2025-12-04T08:53:26.2470151Z "digest": "sha256:d931a62fd2408369decfa0e6eac11768e35d0ffddee87d769c82aaf1ad7e2899" 2025-12-04T08:53:26.2470337Z }, 2025-12-04T08:53:26.2470470Z { 2025-12-04T08:53:26.2470606Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2470767Z "size": 826, 2025-12-04T08:53:26.2470933Z "digest": "sha256:d3573d61c28e1400840260d3c2c786c9e104f6558162beac799e55b6f5c1e747" 2025-12-04T08:53:26.2471109Z }, 2025-12-04T08:53:26.2471192Z { 2025-12-04T08:53:26.2471325Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2471485Z "size": 724, 2025-12-04T08:53:26.2471649Z "digest": "sha256:8539cc3f8d8a138501ed0255c0cd7ec491bc0add9e4a62095f1c0f9533daa1cc" 2025-12-04T08:53:26.2471826Z }, 2025-12-04T08:53:26.2471913Z { 2025-12-04T08:53:26.2472048Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2472207Z "size": 149, 2025-12-04T08:53:26.2472371Z "digest": "sha256:f9b32f08c49055dd61bd359d5f42f6adb9e5a183c2821d97d11572dd7ce1e91f" 2025-12-04T08:53:26.2472551Z }, 2025-12-04T08:53:26.2472636Z { 2025-12-04T08:53:26.2472772Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2472969Z "size": 136, 2025-12-04T08:53:26.2473128Z "digest": "sha256:3a0206399d60f6e8897f78c8e8f81b59d51969a329ef45485d28ae19607ca72c" 2025-12-04T08:53:26.2473303Z }, 2025-12-04T08:53:26.2473388Z { 2025-12-04T08:53:26.2473520Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2473687Z "size": 140, 2025-12-04T08:53:26.2473847Z "digest": "sha256:386f322edd1c1c275126bab065c22fcd3950916c1fb8491a21a7f5c358af599a" 2025-12-04T08:53:26.2474023Z }, 2025-12-04T08:53:26.2474102Z { 2025-12-04T08:53:26.2474229Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2474383Z "size": 32, 2025-12-04T08:53:26.2474542Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-12-04T08:53:26.2474774Z }, 2025-12-04T08:53:26.2474855Z { 2025-12-04T08:53:26.2474982Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2475138Z "size": 223, 2025-12-04T08:53:26.2475294Z "digest": "sha256:bbe49df30697f6959cd958299909d9255cd54663ce2e9e2c2d378f8f9dfe8345" 2025-12-04T08:53:26.2475466Z }, 2025-12-04T08:53:26.2475642Z { 2025-12-04T08:53:26.2475817Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2476025Z "size": 346, 2025-12-04T08:53:26.2476510Z "digest": "sha256:d6630aa6f375b12cb7471c5b60eb32e02ff8d70adf4497e061d6c15fead186c7" 2025-12-04T08:53:26.2476725Z }, 2025-12-04T08:53:26.2487835Z { 2025-12-04T08:53:26.2487982Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2488142Z "size": 88302, 2025-12-04T08:53:26.2488308Z "digest": "sha256:6d807afc1309592c99c7d77af3874afb54c1718377fe721ac0cc616f59d291b9" 2025-12-04T08:53:26.2488486Z }, 2025-12-04T08:53:26.2488569Z { 2025-12-04T08:53:26.2488708Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2488866Z "size": 106, 2025-12-04T08:53:26.2489023Z "digest": "sha256:60b679430e4e0b7690392dfe4f5dc417847f7a3ba2b761ce747b66d412e1d956" 2025-12-04T08:53:26.2489195Z }, 2025-12-04T08:53:26.2489274Z { 2025-12-04T08:53:26.2489401Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2489556Z "size": 1671, 2025-12-04T08:53:26.2489717Z "digest": "sha256:3992ae84f9eda1c5c52fa96b1f1d0fc3f93c661c5cf0b971a504a260c290da49" 2025-12-04T08:53:26.2489893Z }, 2025-12-04T08:53:26.2489971Z { 2025-12-04T08:53:26.2490097Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2490251Z "size": 724, 2025-12-04T08:53:26.2490408Z "digest": "sha256:8539cc3f8d8a138501ed0255c0cd7ec491bc0add9e4a62095f1c0f9533daa1cc" 2025-12-04T08:53:26.2490581Z }, 2025-12-04T08:53:26.2490660Z { 2025-12-04T08:53:26.2490784Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2490940Z "size": 138, 2025-12-04T08:53:26.2491163Z "digest": "sha256:62d400609f9c38fce4745f72372423072ba0f142b3c03775ccb317f6c5240966" 2025-12-04T08:53:26.2491336Z }, 2025-12-04T08:53:26.2491415Z { 2025-12-04T08:53:26.2491543Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2491700Z "size": 119, 2025-12-04T08:53:26.2491854Z "digest": "sha256:7e7b097490967d568331cc9f8afdd02422fe101c6364ec5e12dba2970991e533" 2025-12-04T08:53:26.2492030Z }, 2025-12-04T08:53:26.2492116Z { 2025-12-04T08:53:26.2492248Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2492412Z "size": 6231259865, 2025-12-04T08:53:26.2492589Z "digest": "sha256:7dcdbd8421cb17aaa5d0cb965ddf94e196cb364e762b12ab78024cb25e3b6bcd" 2025-12-04T08:53:26.2492770Z }, 2025-12-04T08:53:26.2492855Z { 2025-12-04T08:53:26.2493023Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2493184Z "size": 174, 2025-12-04T08:53:26.2493350Z "digest": "sha256:cbb12613719bab9f179968227f9fb8881251992804e460b9a9e1c00f3ac4a0c5" 2025-12-04T08:53:26.2493527Z }, 2025-12-04T08:53:26.2493613Z { 2025-12-04T08:53:26.2493746Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2493908Z "size": 1896, 2025-12-04T08:53:26.2494074Z "digest": "sha256:e87038dce9bc8e13bd64006847d30ddcaf77455256c4985fccfec83f82d4b925" 2025-12-04T08:53:26.2494256Z }, 2025-12-04T08:53:26.2494341Z { 2025-12-04T08:53:26.2494473Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2494636Z "size": 162783968, 2025-12-04T08:53:26.2494807Z "digest": "sha256:e4606b636f96f1c80f4be26aeb9d6f5f990f6149789c2de160451c5ac76a467d" 2025-12-04T08:53:26.2494989Z }, 2025-12-04T08:53:26.2495071Z { 2025-12-04T08:53:26.2495199Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2495397Z "size": 302, 2025-12-04T08:53:26.2495557Z "digest": "sha256:6f2a5d33b946e561219b9968769773e36ce1d28bee8c62eff652098b7825fc79" 2025-12-04T08:53:26.2495730Z }, 2025-12-04T08:53:26.2495810Z { 2025-12-04T08:53:26.2495937Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2496094Z "size": 32, 2025-12-04T08:53:26.2496254Z "digest": "sha256:4f4fb700ef54461cfa02571ae0db9a0dc1e0cdb5577484a6d75e68dc38e8acc1" 2025-12-04T08:53:26.2496430Z }, 2025-12-04T08:53:26.2496509Z { 2025-12-04T08:53:26.2496633Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2496787Z "size": 108, 2025-12-04T08:53:26.2496944Z "digest": "sha256:a4f2bf2f19e63b91d46f2d9cf11a25c657517a6835996404da1e79a09d918b0e" 2025-12-04T08:53:26.2497119Z }, 2025-12-04T08:53:26.2497201Z { 2025-12-04T08:53:26.2497334Z "mediaType": "application/vnd.docker.image.rootfs.diff.tar.gzip", 2025-12-04T08:53:26.2497495Z "size": 54145661, 2025-12-04T08:53:26.2497674Z "digest": "sha256:1ae00acdac56cbc6d3f81b3c5d854a2b77c30d458b0fbe18c5935145364484f0" 2025-12-04T08:53:26.2497860Z } 2025-12-04T08:53:26.2497945Z ] 2025-12-04T08:53:26.2498034Z } 2025-12-04T08:53:26.2498128Z + exit 0 2025-12-04T08:53:26.2514604Z ##[group]Run set -eux 2025-12-04T08:53:26.2514726Z set -eux 2025-12-04T08:53:26.2514895Z # It's ok if this steps fails, it would then be an anonymous user like what we used to have 2025-12-04T08:53:26.2516522Z aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token | jq --raw-output '.SecretString' | jq -r .docker_hub_readonly_token | docker login --username pytorchbot --password-stdin || true 2025-12-04T08:53:26.2524410Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:26.2524686Z env: 2025-12-04T08:53:26.2524885Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:26.2525142Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:26.2525497Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:26.2525817Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:26.2526819Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:26.2527405Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:26.2527574Z AWS_REGION: us-east-1 2025-12-04T08:53:26.2527908Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:26.2528132Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:26.2530965Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:26.2531113Z ##[endgroup] 2025-12-04T08:53:26.2557333Z + aws secretsmanager get-secret-value --secret-id docker_hub_readonly_token 2025-12-04T08:53:26.2557777Z + jq --raw-output .SecretString 2025-12-04T08:53:26.2558190Z /home/runner/_work/_temp/bb5b1222-223e-436d-9dcf-6796dc6970f5.sh: line 3: aws: command not found 2025-12-04T08:53:26.2558609Z + jq -r .docker_hub_readonly_token 2025-12-04T08:53:26.2559015Z + docker login --username pytorchbot --password-stdin 2025-12-04T08:53:26.2652296Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:26.2657861Z + true 2025-12-04T08:53:26.2721099Z ##[group]Run pytorch/test-infra/.github/actions/pull-docker-image@main 2025-12-04T08:53:26.2721308Z with: 2025-12-04T08:53:26.2721590Z docker-image: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:26.2721927Z docker-registry: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:26.2722097Z env: 2025-12-04T08:53:26.2722208Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:26.2722361Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:26.2722549Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:26.2722728Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:26.2723472Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:26.2723910Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:26.2724041Z AWS_REGION: us-east-1 2025-12-04T08:53:26.2724309Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:26.2724478Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:26.2726647Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:26.2726769Z ##[endgroup] 2025-12-04T08:53:26.2745675Z ##[group]Run set -x 2025-12-04T08:53:26.2745904Z set -x 2025-12-04T08:53:26.2746052Z set +e 2025-12-04T08:53:26.2746200Z  2025-12-04T08:53:26.2746344Z login() { 2025-12-04T08:53:26.2746652Z  aws ecr get-login-password --region us-east-1 | docker login -u AWS --password-stdin "$1" 2025-12-04T08:53:26.2746969Z } 2025-12-04T08:53:26.2747112Z  2025-12-04T08:53:26.2747270Z retry () { 2025-12-04T08:53:26.2747448Z  $* || (sleep 1 && $*) || (sleep 2 && $*) 2025-12-04T08:53:26.2747649Z } 2025-12-04T08:53:26.2747784Z  2025-12-04T08:53:26.2747952Z retry login "${DOCKER_REGISTRY}" 2025-12-04T08:53:26.2748140Z  2025-12-04T08:53:26.2748445Z IMAGE_SIZE=$(docker manifest inspect "${DOCKER_IMAGE}" | jq '[.layers[].size, .config.size] | add / 1024 / 1024') 2025-12-04T08:53:26.2748847Z echo "Compressed size of image in MB: ${IMAGE_SIZE}" 2025-12-04T08:53:26.2749074Z  2025-12-04T08:53:26.2749199Z set -e 2025-12-04T08:53:26.2749373Z # ignore output since only exit code is used for conditional 2025-12-04T08:53:26.2749603Z # only pull docker image if it's not available locally 2025-12-04T08:53:26.2749857Z if ! docker inspect --type=image "${DOCKER_IMAGE}" >/dev/null 2>/dev/null; then 2025-12-04T08:53:26.2750091Z  retry docker pull "${DOCKER_IMAGE}" 2025-12-04T08:53:26.2750256Z fi 2025-12-04T08:53:26.2755469Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T08:53:26.2755655Z env: 2025-12-04T08:53:26.2755786Z GIT_DEFAULT_BRANCH: main 2025-12-04T08:53:26.2755961Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T08:53:26.2756180Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T08:53:26.2756396Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T08:53:26.2756873Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T08:53:26.2757332Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T08:53:26.2757478Z AWS_REGION: us-east-1 2025-12-04T08:53:26.2757795Z AWS_ACCESS_KEY_ID: *** 2025-12-04T08:53:26.2757996Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T08:53:26.2760353Z AWS_SESSION_TOKEN: *** 2025-12-04T08:53:26.2760639Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:26.2761131Z DOCKER_REGISTRY: 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:26.2761301Z ##[endgroup] 2025-12-04T08:53:26.2780396Z + set +e 2025-12-04T08:53:26.2780664Z + retry login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:26.2780856Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:26.2784655Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:26.2785793Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:26.2786079Z /home/runner/_work/_temp/9e0b82db-6c1e-4132-9623-1cedf98a6ee2.sh: line 5: aws: command not found 2025-12-04T08:53:26.2870044Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:26.2881209Z + sleep 1 2025-12-04T08:53:27.2893507Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:27.2896596Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:27.2897037Z /home/runner/_work/_temp/9e0b82db-6c1e-4132-9623-1cedf98a6ee2.sh: line 5: aws: command not found 2025-12-04T08:53:27.2897819Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:27.2995942Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:27.3009680Z + sleep 2 2025-12-04T08:53:29.3026612Z + login 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:29.3030150Z + aws ecr get-login-password --region us-east-1 2025-12-04T08:53:29.3030634Z /home/runner/_work/_temp/9e0b82db-6c1e-4132-9623-1cedf98a6ee2.sh: line 5: aws: command not found 2025-12-04T08:53:29.3031202Z + docker login -u AWS --password-stdin 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T08:53:29.3117816Z Error: Cannot perform an interactive login from a non TTY device 2025-12-04T08:53:29.3135446Z ++ docker manifest inspect 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:29.3135820Z ++ jq '[.layers[].size, .config.size] | add / 1024 / 1024' 2025-12-04T08:53:30.6828166Z + IMAGE_SIZE=18579.916069984436 2025-12-04T08:53:30.6828566Z + echo 'Compressed size of image in MB: 18579.916069984436' 2025-12-04T08:53:30.6828848Z + set -e 2025-12-04T08:53:30.6829392Z + docker inspect --type=image 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:30.6829971Z Compressed size of image in MB: 18579.916069984436 2025-12-04T08:53:30.6938209Z + retry docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:30.6938957Z + docker pull 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T08:53:31.7644214Z pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a: Pulling from pytorch/ci-image 2025-12-04T08:53:31.7644793Z 02de03a7213b: Pulling fs layer 2025-12-04T08:53:31.7645082Z 3a5718b5258e: Pulling fs layer 2025-12-04T08:53:31.7645343Z bf3aa2277692: Pulling fs layer 2025-12-04T08:53:31.7645589Z 9d58e5257cef: Pulling fs layer 2025-12-04T08:53:31.7645828Z fde80a645535: Pulling fs layer 2025-12-04T08:53:31.7646072Z 6931c5f20e80: Pulling fs layer 2025-12-04T08:53:31.7646315Z 170ea6d3edd6: Pulling fs layer 2025-12-04T08:53:31.7646557Z dc8487f6c81c: Pulling fs layer 2025-12-04T08:53:31.7660496Z 9748c5348f39: Pulling fs layer 2025-12-04T08:53:31.7660783Z 8539cc3f8d8a: Pulling fs layer 2025-12-04T08:53:31.7661095Z af88f886884f: Pulling fs layer 2025-12-04T08:53:31.7661303Z fde80a645535: Waiting 2025-12-04T08:53:31.7661506Z 32fbb88555c4: Pulling fs layer 2025-12-04T08:53:31.7661719Z 3231e1ab814b: Pulling fs layer 2025-12-04T08:53:31.7661936Z 6931c5f20e80: Waiting 2025-12-04T08:53:31.7662130Z 80061bf5dcbb: Pulling fs layer 2025-12-04T08:53:31.7662339Z 6e9524f4518e: Pulling fs layer 2025-12-04T08:53:31.7662550Z ce919d4bf5ee: Pulling fs layer 2025-12-04T08:53:31.7663197Z 47681e3e6f37: Pulling fs layer 2025-12-04T08:53:31.7663413Z cb70fe22c9eb: Pulling fs layer 2025-12-04T08:53:31.7663641Z 17858e829c8c: Pulling fs layer 2025-12-04T08:53:31.7663847Z a63f3b4eed11: Pulling fs layer 2025-12-04T08:53:31.7664058Z 10ab3d1afbc4: Pulling fs layer 2025-12-04T08:53:31.7664270Z 98ca88b5095b: Pulling fs layer 2025-12-04T08:53:31.7664473Z 025c90839a58: Pulling fs layer 2025-12-04T08:53:31.7664678Z 9255df5942ae: Pulling fs layer 2025-12-04T08:53:31.7664887Z f71ca9d4ed1c: Pulling fs layer 2025-12-04T08:53:31.7665096Z d02b47b56ca7: Pulling fs layer 2025-12-04T08:53:31.7665304Z 40279492aea7: Pulling fs layer 2025-12-04T08:53:31.7665509Z 33a27ce74abd: Pulling fs layer 2025-12-04T08:53:31.7665715Z 6b66ed335d1d: Pulling fs layer 2025-12-04T08:53:31.7665965Z 9f010fa04118: Pulling fs layer 2025-12-04T08:53:31.7666318Z 6c64d5e8bb6a: Pulling fs layer 2025-12-04T08:53:31.7666519Z 170ea6d3edd6: Waiting 2025-12-04T08:53:31.7666700Z cb70fe22c9eb: Waiting 2025-12-04T08:53:31.7666864Z dc8487f6c81c: Waiting 2025-12-04T08:53:31.7667038Z c20ea058f549: Pulling fs layer 2025-12-04T08:53:31.7667219Z 3c4fd2d54638: Pulling fs layer 2025-12-04T08:53:31.7667402Z 17858e829c8c: Waiting 2025-12-04T08:53:31.7667568Z 964ebac3d7a9: Pulling fs layer 2025-12-04T08:53:31.7667751Z 9d58e5257cef: Waiting 2025-12-04T08:53:31.7667911Z 9255df5942ae: Waiting 2025-12-04T08:53:31.7668067Z d02b47b56ca7: Waiting 2025-12-04T08:53:31.7668222Z 40279492aea7: Waiting 2025-12-04T08:53:31.7668377Z f71ca9d4ed1c: Waiting 2025-12-04T08:53:31.7668534Z 33a27ce74abd: Waiting 2025-12-04T08:53:31.7668713Z 9f010fa04118: Waiting 2025-12-04T08:53:31.7668874Z 6b66ed335d1d: Waiting 2025-12-04T08:53:31.7669031Z 6c64d5e8bb6a: Waiting 2025-12-04T08:53:31.7669189Z a63f3b4eed11: Waiting 2025-12-04T08:53:31.7669345Z c20ea058f549: Waiting 2025-12-04T08:53:31.7669511Z 3c4fd2d54638: Waiting 2025-12-04T08:53:31.7669667Z 10ab3d1afbc4: Waiting 2025-12-04T08:53:31.7669824Z 025c90839a58: Waiting 2025-12-04T08:53:31.7669978Z 9748c5348f39: Waiting 2025-12-04T08:53:31.7670144Z 8539cc3f8d8a: Waiting 2025-12-04T08:53:31.7670300Z 6e9524f4518e: Waiting 2025-12-04T08:53:31.7670455Z 32fbb88555c4: Waiting 2025-12-04T08:53:31.7670609Z 3231e1ab814b: Waiting 2025-12-04T08:53:31.7670774Z 2aaa7210673f: Pulling fs layer 2025-12-04T08:53:31.7670951Z 47681e3e6f37: Waiting 2025-12-04T08:53:31.7671109Z af88f886884f: Waiting 2025-12-04T08:53:31.7671266Z 80061bf5dcbb: Waiting 2025-12-04T08:53:31.7671435Z fa273daa0037: Pulling fs layer 2025-12-04T08:53:31.7671614Z 964ebac3d7a9: Waiting 2025-12-04T08:53:31.7671775Z d931a62fd240: Pulling fs layer 2025-12-04T08:53:31.7671967Z d3573d61c28e: Pulling fs layer 2025-12-04T08:53:31.7672141Z 2aaa7210673f: Waiting 2025-12-04T08:53:31.7672301Z fa273daa0037: Waiting 2025-12-04T08:53:31.7672462Z d931a62fd240: Waiting 2025-12-04T08:53:31.7672636Z f9b32f08c490: Pulling fs layer 2025-12-04T08:53:31.7672826Z 3a0206399d60: Pulling fs layer 2025-12-04T08:53:31.7673050Z d3573d61c28e: Waiting 2025-12-04T08:53:31.7673216Z 386f322edd1c: Pulling fs layer 2025-12-04T08:53:31.7673407Z 4f4fb700ef54: Pulling fs layer 2025-12-04T08:53:31.7673586Z f9b32f08c490: Waiting 2025-12-04T08:53:31.7673744Z 3a0206399d60: Waiting 2025-12-04T08:53:31.7673909Z bbe49df30697: Pulling fs layer 2025-12-04T08:53:31.7674086Z 4f4fb700ef54: Waiting 2025-12-04T08:53:31.7674253Z d6630aa6f375: Pulling fs layer 2025-12-04T08:53:31.7674436Z 6d807afc1309: Pulling fs layer 2025-12-04T08:53:31.7674622Z 60b679430e4e: Pulling fs layer 2025-12-04T08:53:31.7674801Z 3992ae84f9ed: Pulling fs layer 2025-12-04T08:53:31.7674982Z 386f322edd1c: Waiting 2025-12-04T08:53:31.7675149Z 62d400609f9c: Pulling fs layer 2025-12-04T08:53:31.7675322Z 6d807afc1309: Waiting 2025-12-04T08:53:31.7675488Z 7e7b09749096: Pulling fs layer 2025-12-04T08:53:31.7675661Z d6630aa6f375: Waiting 2025-12-04T08:53:31.7675834Z 7dcdbd8421cb: Pulling fs layer 2025-12-04T08:53:31.7676019Z cbb12613719b: Pulling fs layer 2025-12-04T08:53:31.7676194Z 60b679430e4e: Waiting 2025-12-04T08:53:31.7676349Z 7e7b09749096: Waiting 2025-12-04T08:53:31.7676582Z e87038dce9bc: Pulling fs layer 2025-12-04T08:53:31.7676765Z e4606b636f96: Pulling fs layer 2025-12-04T08:53:31.7677011Z cbb12613719b: Waiting 2025-12-04T08:53:31.7677138Z 7dcdbd8421cb: Waiting 2025-12-04T08:53:31.7677262Z 6f2a5d33b946: Pulling fs layer 2025-12-04T08:53:31.7677401Z 3992ae84f9ed: Waiting 2025-12-04T08:53:31.7677518Z e87038dce9bc: Waiting 2025-12-04T08:53:31.7677642Z e4606b636f96: Waiting 2025-12-04T08:53:31.7677761Z bbe49df30697: Waiting 2025-12-04T08:53:31.7677877Z 6f2a5d33b946: Waiting 2025-12-04T08:53:31.7678009Z a4f2bf2f19e6: Pulling fs layer 2025-12-04T08:53:31.7678148Z 1ae00acdac56: Pulling fs layer 2025-12-04T08:53:31.7678286Z 1ae00acdac56: Waiting 2025-12-04T08:53:31.7678407Z a4f2bf2f19e6: Waiting 2025-12-04T08:53:32.3398435Z 3a5718b5258e: Verifying Checksum 2025-12-04T08:53:32.3399700Z 3a5718b5258e: Download complete 2025-12-04T08:53:32.9165944Z 9d58e5257cef: Verifying Checksum 2025-12-04T08:53:32.9166295Z 9d58e5257cef: Download complete 2025-12-04T08:53:33.4754682Z 02de03a7213b: Verifying Checksum 2025-12-04T08:53:33.4754960Z 02de03a7213b: Download complete 2025-12-04T08:53:33.5102660Z fde80a645535: Download complete 2025-12-04T08:53:33.9755170Z 02de03a7213b: Pull complete 2025-12-04T08:53:33.9817425Z 3a5718b5258e: Pull complete 2025-12-04T08:53:34.0564257Z 6931c5f20e80: Verifying Checksum 2025-12-04T08:53:34.0564507Z 6931c5f20e80: Download complete 2025-12-04T08:53:34.6524491Z dc8487f6c81c: Verifying Checksum 2025-12-04T08:53:34.6524819Z dc8487f6c81c: Download complete 2025-12-04T08:53:35.2423904Z 9748c5348f39: Verifying Checksum 2025-12-04T08:53:35.2424297Z 9748c5348f39: Download complete 2025-12-04T08:53:35.8576503Z 8539cc3f8d8a: Download complete 2025-12-04T08:53:41.1273171Z bf3aa2277692: Verifying Checksum 2025-12-04T08:53:41.1273532Z bf3aa2277692: Download complete 2025-12-04T08:53:41.1752922Z 170ea6d3edd6: Verifying Checksum 2025-12-04T08:53:41.1753223Z 170ea6d3edd6: Download complete 2025-12-04T08:53:41.7892019Z 32fbb88555c4: Verifying Checksum 2025-12-04T08:53:41.7892520Z 32fbb88555c4: Download complete 2025-12-04T08:53:42.4058149Z 80061bf5dcbb: Verifying Checksum 2025-12-04T08:53:42.4058363Z 80061bf5dcbb: Download complete 2025-12-04T08:53:43.0101390Z 6e9524f4518e: Verifying Checksum 2025-12-04T08:53:43.0101817Z 6e9524f4518e: Download complete 2025-12-04T08:53:43.6104017Z ce919d4bf5ee: Verifying Checksum 2025-12-04T08:53:43.6104324Z ce919d4bf5ee: Download complete 2025-12-04T08:53:44.6664301Z 3231e1ab814b: Verifying Checksum 2025-12-04T08:53:44.6664472Z 3231e1ab814b: Download complete 2025-12-04T08:53:45.2690255Z bf3aa2277692: Pull complete 2025-12-04T08:53:45.2723932Z 9d58e5257cef: Pull complete 2025-12-04T08:53:45.2780277Z fde80a645535: Pull complete 2025-12-04T08:53:45.2833682Z 6931c5f20e80: Pull complete 2025-12-04T08:53:45.3084046Z cb70fe22c9eb: Download complete 2025-12-04T08:53:45.9773413Z 17858e829c8c: Verifying Checksum 2025-12-04T08:53:45.9773771Z 17858e829c8c: Download complete 2025-12-04T08:53:46.4349347Z 170ea6d3edd6: Pull complete 2025-12-04T08:53:46.4413829Z dc8487f6c81c: Pull complete 2025-12-04T08:53:46.4451201Z 9748c5348f39: Pull complete 2025-12-04T08:53:46.4489740Z 8539cc3f8d8a: Pull complete 2025-12-04T08:53:46.6128287Z a63f3b4eed11: Verifying Checksum 2025-12-04T08:53:46.6128591Z a63f3b4eed11: Download complete 2025-12-04T08:53:47.2507420Z 10ab3d1afbc4: Verifying Checksum 2025-12-04T08:53:47.2507773Z 10ab3d1afbc4: Download complete 2025-12-04T08:53:58.3580590Z 47681e3e6f37: Verifying Checksum 2025-12-04T08:53:58.3580989Z 47681e3e6f37: Download complete 2025-12-04T08:53:58.9576853Z 025c90839a58: Download complete 2025-12-04T08:53:59.5355145Z 9255df5942ae: Verifying Checksum 2025-12-04T08:53:59.5355380Z 9255df5942ae: Download complete 2025-12-04T08:54:00.1571346Z f71ca9d4ed1c: Verifying Checksum 2025-12-04T08:54:00.1571582Z f71ca9d4ed1c: Download complete 2025-12-04T08:54:21.9109457Z d02b47b56ca7: Verifying Checksum 2025-12-04T08:54:21.9109932Z d02b47b56ca7: Download complete 2025-12-04T08:54:22.4769965Z 40279492aea7: Verifying Checksum 2025-12-04T08:54:22.4770585Z 40279492aea7: Download complete 2025-12-04T08:54:23.0620900Z 33a27ce74abd: Verifying Checksum 2025-12-04T08:54:23.0621450Z 33a27ce74abd: Download complete 2025-12-04T08:54:23.6376177Z 6b66ed335d1d: Download complete 2025-12-04T08:54:24.2085153Z 9f010fa04118: Verifying Checksum 2025-12-04T08:54:24.2085335Z 9f010fa04118: Download complete 2025-12-04T08:54:25.8446671Z 6c64d5e8bb6a: Verifying Checksum 2025-12-04T08:54:25.8447142Z 6c64d5e8bb6a: Download complete 2025-12-04T08:54:26.4379928Z c20ea058f549: Download complete 2025-12-04T08:54:27.0034334Z 3c4fd2d54638: Verifying Checksum 2025-12-04T08:54:27.0034565Z 3c4fd2d54638: Download complete 2025-12-04T08:54:33.1998545Z 964ebac3d7a9: Verifying Checksum 2025-12-04T08:54:33.1999008Z 964ebac3d7a9: Download complete 2025-12-04T08:54:33.8955952Z 2aaa7210673f: Download complete 2025-12-04T08:54:34.5123650Z fa273daa0037: Download complete 2025-12-04T08:54:35.9532491Z d931a62fd240: Verifying Checksum 2025-12-04T08:54:35.9533271Z d931a62fd240: Download complete 2025-12-04T08:54:36.5674045Z d3573d61c28e: Verifying Checksum 2025-12-04T08:54:36.5674383Z d3573d61c28e: Download complete 2025-12-04T08:54:37.2046411Z f9b32f08c490: Verifying Checksum 2025-12-04T08:54:37.2046787Z f9b32f08c490: Download complete 2025-12-04T08:54:37.8241092Z 3a0206399d60: Verifying Checksum 2025-12-04T08:54:37.8241421Z 3a0206399d60: Download complete 2025-12-04T08:54:38.4755290Z 386f322edd1c: Download complete 2025-12-04T08:54:38.8235575Z 4f4fb700ef54: Verifying Checksum 2025-12-04T08:54:38.8236142Z 4f4fb700ef54: Download complete 2025-12-04T08:54:39.5130840Z bbe49df30697: Verifying Checksum 2025-12-04T08:54:39.5131472Z bbe49df30697: Download complete 2025-12-04T08:54:40.1415629Z d6630aa6f375: Verifying Checksum 2025-12-04T08:54:40.1415803Z d6630aa6f375: Download complete 2025-12-04T08:54:40.8805150Z 6d807afc1309: Download complete 2025-12-04T08:54:41.4872539Z 60b679430e4e: Verifying Checksum 2025-12-04T08:54:41.4872825Z 60b679430e4e: Download complete 2025-12-04T08:54:42.1255883Z 3992ae84f9ed: Verifying Checksum 2025-12-04T08:54:42.1256304Z 3992ae84f9ed: Download complete 2025-12-04T08:54:42.7280664Z 62d400609f9c: Verifying Checksum 2025-12-04T08:54:42.7281031Z 62d400609f9c: Download complete 2025-12-04T08:54:43.3494030Z 7e7b09749096: Download complete 2025-12-04T09:15:42.2407535Z af88f886884f: Verifying Checksum 2025-12-04T09:15:42.2407748Z af88f886884f: Download complete 2025-12-04T09:15:42.8158873Z cbb12613719b: Download complete 2025-12-04T09:15:43.6181349Z e87038dce9bc: Verifying Checksum 2025-12-04T09:15:43.6181577Z e87038dce9bc: Download complete 2025-12-04T09:15:48.1817611Z e4606b636f96: Verifying Checksum 2025-12-04T09:15:48.1817966Z e4606b636f96: Download complete 2025-12-04T09:15:48.8175190Z 6f2a5d33b946: Verifying Checksum 2025-12-04T09:15:48.8175536Z 6f2a5d33b946: Download complete 2025-12-04T09:15:49.4058150Z a4f2bf2f19e6: Verifying Checksum 2025-12-04T09:15:49.4058367Z a4f2bf2f19e6: Download complete 2025-12-04T09:15:51.7696775Z 1ae00acdac56: Verifying Checksum 2025-12-04T09:15:51.7697290Z 1ae00acdac56: Download complete 2025-12-04T09:16:04.4987959Z af88f886884f: Pull complete 2025-12-04T09:16:04.5027213Z 32fbb88555c4: Pull complete 2025-12-04T09:16:05.1059456Z 3231e1ab814b: Pull complete 2025-12-04T09:16:05.1108369Z 80061bf5dcbb: Pull complete 2025-12-04T09:16:05.1162212Z 6e9524f4518e: Pull complete 2025-12-04T09:16:05.1204552Z ce919d4bf5ee: Pull complete 2025-12-04T09:16:08.3396939Z 47681e3e6f37: Pull complete 2025-12-04T09:16:08.3437886Z cb70fe22c9eb: Pull complete 2025-12-04T09:16:08.3478379Z 17858e829c8c: Pull complete 2025-12-04T09:16:08.3584594Z a63f3b4eed11: Pull complete 2025-12-04T09:16:08.3619977Z 10ab3d1afbc4: Pull complete 2025-12-04T09:18:50.0704725Z 7dcdbd8421cb: Verifying Checksum 2025-12-04T09:18:50.0704967Z 7dcdbd8421cb: Download complete 2025-12-04T09:23:11.0494252Z 98ca88b5095b: Verifying Checksum 2025-12-04T09:23:11.0494670Z 98ca88b5095b: Download complete 2025-12-04T09:23:55.3426500Z 98ca88b5095b: Pull complete 2025-12-04T09:23:55.3464738Z 025c90839a58: Pull complete 2025-12-04T09:23:55.3525267Z 9255df5942ae: Pull complete 2025-12-04T09:23:55.3566029Z f71ca9d4ed1c: Pull complete 2025-12-04T09:23:59.9432684Z d02b47b56ca7: Pull complete 2025-12-04T09:23:59.9478316Z 40279492aea7: Pull complete 2025-12-04T09:23:59.9525708Z 33a27ce74abd: Pull complete 2025-12-04T09:23:59.9566792Z 6b66ed335d1d: Pull complete 2025-12-04T09:23:59.9602635Z 9f010fa04118: Pull complete 2025-12-04T09:23:59.9922163Z 6c64d5e8bb6a: Pull complete 2025-12-04T09:23:59.9956677Z c20ea058f549: Pull complete 2025-12-04T09:23:59.9994386Z 3c4fd2d54638: Pull complete 2025-12-04T09:24:00.2026353Z 964ebac3d7a9: Pull complete 2025-12-04T09:24:00.2062536Z 2aaa7210673f: Pull complete 2025-12-04T09:24:00.2099640Z fa273daa0037: Pull complete 2025-12-04T09:24:00.3065135Z d931a62fd240: Pull complete 2025-12-04T09:24:00.3102159Z d3573d61c28e: Pull complete 2025-12-04T09:24:00.3184606Z f9b32f08c490: Pull complete 2025-12-04T09:24:00.3220574Z 3a0206399d60: Pull complete 2025-12-04T09:24:00.3252557Z 386f322edd1c: Pull complete 2025-12-04T09:24:00.3285201Z 4f4fb700ef54: Pull complete 2025-12-04T09:24:00.3340930Z bbe49df30697: Pull complete 2025-12-04T09:24:00.3380984Z d6630aa6f375: Pull complete 2025-12-04T09:24:00.3425599Z 6d807afc1309: Pull complete 2025-12-04T09:24:00.3455177Z 60b679430e4e: Pull complete 2025-12-04T09:24:00.3491274Z 3992ae84f9ed: Pull complete 2025-12-04T09:24:00.3581243Z 62d400609f9c: Pull complete 2025-12-04T09:24:00.3624492Z 7e7b09749096: Pull complete 2025-12-04T09:24:37.4951455Z 7dcdbd8421cb: Pull complete 2025-12-04T09:24:37.4993481Z cbb12613719b: Pull complete 2025-12-04T09:24:37.5044091Z e87038dce9bc: Pull complete 2025-12-04T09:24:39.8311078Z e4606b636f96: Pull complete 2025-12-04T09:24:39.8366092Z 6f2a5d33b946: Pull complete 2025-12-04T09:24:39.8447135Z a4f2bf2f19e6: Pull complete 2025-12-04T09:24:40.4146220Z 1ae00acdac56: Pull complete 2025-12-04T09:24:40.4168009Z Digest: sha256:f0728d30af94602d09207f794eb469a578a6cd97e72880fb3f401801d2f4acc6 2025-12-04T09:24:40.4171291Z Status: Downloaded newer image for 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T09:24:40.4178813Z 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T09:24:40.4228262Z Prepare all required actions 2025-12-04T09:24:40.4246699Z ##[group]Run ./.github/actions/get-workflow-job-id 2025-12-04T09:24:40.4246868Z with: 2025-12-04T09:24:40.4247184Z github-token: *** 2025-12-04T09:24:40.4247290Z env: 2025-12-04T09:24:40.4247394Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:24:40.4247543Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:24:40.4247733Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:24:40.4247955Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:24:40.4248350Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:24:40.4248739Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:24:40.4248860Z AWS_REGION: us-east-1 2025-12-04T09:24:40.4248989Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:24:40.4249179Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:24:40.4251300Z AWS_SESSION_TOKEN: *** 2025-12-04T09:24:40.4251411Z ##[endgroup] 2025-12-04T09:24:40.4271701Z ##[group]Run set -eux 2025-12-04T09:24:40.4271821Z set -eux 2025-12-04T09:24:40.4271998Z python3 .github/scripts/get_workflow_job_id.py "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-12-04T09:24:40.4276208Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:24:40.4276361Z env: 2025-12-04T09:24:40.4276472Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:24:40.4276614Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:24:40.4276797Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:24:40.4276971Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:24:40.4277360Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:24:40.4277742Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:24:40.4277868Z AWS_REGION: us-east-1 2025-12-04T09:24:40.4278011Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:24:40.4278184Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:24:40.4280311Z AWS_SESSION_TOKEN: *** 2025-12-04T09:24:40.4280470Z GITHUB_TOKEN: *** 2025-12-04T09:24:40.4280577Z ##[endgroup] 2025-12-04T09:24:40.4298741Z + python3 .github/scripts/get_workflow_job_id.py 19922812470 linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T09:24:41.5404117Z Setting output job-id=57116139360 2025-12-04T09:24:41.5404730Z Setting output job-name=linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:24:41.5500570Z Prepare all required actions 2025-12-04T09:24:41.5500783Z Getting action download info 2025-12-04T09:24:41.9824415Z Download action repository 'seemethere/download-artifact-s3@v4' (SHA:1da556a7aa0a088e3153970611f6c432d58e80e6) 2025-12-04T09:24:43.0983220Z Download action repository 'actions/download-artifact@v4' (SHA:d3f86a106a0bac45b974a628896c90dbdf5c8093) 2025-12-04T09:24:44.1389829Z ##[group]Run ./.github/actions/download-build-artifacts 2025-12-04T09:24:44.1390009Z with: 2025-12-04T09:24:44.1390164Z name: linux-noble-rocm-py3.12-mi300 2025-12-04T09:24:44.1390319Z s3-bucket: gha-artifacts 2025-12-04T09:24:44.1390465Z env: 2025-12-04T09:24:44.1390569Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:24:44.1390721Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:24:44.1390926Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:24:44.1391108Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:24:44.1391554Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:24:44.1391947Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:24:44.1392071Z AWS_REGION: us-east-1 2025-12-04T09:24:44.1392261Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:24:44.1392542Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:24:44.1394868Z AWS_SESSION_TOKEN: *** 2025-12-04T09:24:44.1394993Z ##[endgroup] 2025-12-04T09:24:44.1409291Z ##[group]Run seemethere/download-artifact-s3@v4 2025-12-04T09:24:44.1409439Z with: 2025-12-04T09:24:44.1409564Z name: linux-noble-rocm-py3.12-mi300 2025-12-04T09:24:44.1409715Z s3-bucket: gha-artifacts 2025-12-04T09:24:44.1409851Z region: us-east-1 2025-12-04T09:24:44.1409964Z env: 2025-12-04T09:24:44.1410078Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:24:44.1410237Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:24:44.1410442Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:24:44.1410623Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:24:44.1411030Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:24:44.1411418Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:24:44.1411564Z AWS_REGION: us-east-1 2025-12-04T09:24:44.1411716Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:24:44.1411903Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:24:44.1414074Z AWS_SESSION_TOKEN: *** 2025-12-04T09:24:44.1414203Z ##[endgroup] 2025-12-04T09:24:44.3691019Z (node:17257) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-12-04T09:24:44.3691257Z 2025-12-04T09:24:44.3691353Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-12-04T09:24:44.3691606Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-12-04T09:24:44.3691836Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-12-04T09:24:44.6312736Z Found 1 objects with prefix pytorch/pytorch/19922812470/linux-noble-rocm-py3.12-mi300/ 2025-12-04T09:24:44.6313736Z Starting download (1/1): /home/runner/_work/pytorch/pytorch/artifacts.zip 2025-12-04T09:26:03.4016554Z Finished download (1/1): /home/runner/_work/pytorch/pytorch/artifacts.zip 2025-12-04T09:26:03.4019214Z Artifact download has finished successfully 2025-12-04T09:26:03.4204247Z ##[group]Run unzip -o artifacts.zip 2025-12-04T09:26:03.4204501Z unzip -o artifacts.zip 2025-12-04T09:26:03.4209200Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:03.4209574Z env: 2025-12-04T09:26:03.4209695Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:03.4209868Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:03.4210262Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:03.4210467Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:03.4210919Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:03.4211367Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:03.4211509Z AWS_REGION: us-east-1 2025-12-04T09:26:03.4211723Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:03.4211906Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:03.4214401Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:03.4214516Z ##[endgroup] 2025-12-04T09:26:03.4247462Z Archive: artifacts.zip 2025-12-04T09:26:03.4248007Z creating: dist/ 2025-12-04T09:26:03.4327954Z inflating: dist/.ninja_log 2025-12-04T09:26:06.3491626Z inflating: dist/torch-2.10.0a0+gitffd9b0f-cp312-cp312-linux_x86_64.whl 2025-12-04T09:26:06.3492221Z creating: build/ 2025-12-04T09:26:06.3492573Z creating: build/custom_test_artifacts/ 2025-12-04T09:26:06.3493093Z creating: build/custom_test_artifacts/custom-op-build/ 2025-12-04T09:26:06.3493607Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/ 2025-12-04T09:26:06.3494222Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/pkgRedirects/ 2025-12-04T09:26:06.3494932Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeConfigureLog.yaml 2025-12-04T09:26:06.3495602Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/ 2025-12-04T09:26:06.3496278Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CMakeSystem.cmake 2025-12-04T09:26:06.3496985Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdC/ 2025-12-04T09:26:06.3497702Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdC/tmp/ 2025-12-04T09:26:06.3498505Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdC/CMakeCCompilerId.c 2025-12-04T09:26:06.3499299Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdC/a.out 2025-12-04T09:26:06.3500052Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CMakeCCompiler.cmake 2025-12-04T09:26:06.3500788Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdCXX/ 2025-12-04T09:26:06.3501494Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdCXX/tmp/ 2025-12-04T09:26:06.3502318Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-12-04T09:26:06.3502728Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CompilerIdCXX/a.out 2025-12-04T09:26:06.3503076Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CMakeCXXCompiler.cmake 2025-12-04T09:26:06.3503383Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_C.bin 2025-12-04T09:26:06.3503702Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_CXX.bin 2025-12-04T09:26:06.3503977Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeScratch/ 2025-12-04T09:26:06.3504201Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeTmp/ 2025-12-04T09:26:06.3504441Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/cmake.check_cache 2025-12-04T09:26:06.3504687Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/ 2025-12-04T09:26:06.3504953Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.ts 2025-12-04T09:26:06.3505802Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/compiler_depend.make 2025-12-04T09:26:06.3506275Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/depend.make 2025-12-04T09:26:06.3506548Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.txt 2025-12-04T09:26:06.3506827Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/cmake_clean.cmake 2025-12-04T09:26:06.3507108Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/build.make 2025-12-04T09:26:06.3507397Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/DependInfo.cmake 2025-12-04T09:26:06.3507677Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/flags.make 2025-12-04T09:26:06.3507954Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/progress.make 2025-12-04T09:26:06.3515004Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o.d 2025-12-04T09:26:06.3621236Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/op.cpp.o 2025-12-04T09:26:06.3621529Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/custom_ops.dir/link.d 2025-12-04T09:26:06.3621909Z creating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/ 2025-12-04T09:26:06.3622213Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.ts 2025-12-04T09:26:06.3622553Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/compiler_depend.make 2025-12-04T09:26:06.3622860Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/depend.make 2025-12-04T09:26:06.3623205Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.txt 2025-12-04T09:26:06.3623510Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/cmake_clean.cmake 2025-12-04T09:26:06.3623821Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/build.make 2025-12-04T09:26:06.3636119Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/DependInfo.cmake 2025-12-04T09:26:06.3636460Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/flags.make 2025-12-04T09:26:06.3636756Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/progress.make 2025-12-04T09:26:06.3637072Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o.d 2025-12-04T09:26:06.3679421Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/test_custom_ops.cpp.o 2025-12-04T09:26:06.3679750Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/test_custom_ops.dir/link.d 2025-12-04T09:26:06.3680055Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-12-04T09:26:06.3680356Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/TargetDirectories.txt 2025-12-04T09:26:06.3680622Z extracting: build/custom_test_artifacts/custom-op-build/CMakeFiles/progress.marks 2025-12-04T09:26:06.3680871Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile2 2025-12-04T09:26:06.3681590Z inflating: build/custom_test_artifacts/custom-op-build/CMakeFiles/Makefile.cmake 2025-12-04T09:26:06.3682184Z inflating: build/custom_test_artifacts/custom-op-build/hipblaslt_test_outer_vec.cc 2025-12-04T09:26:06.3682439Z inflating: build/custom_test_artifacts/custom-op-build/hipblaslt_test_vec_ext.cc 2025-12-04T09:26:06.3683284Z inflating: build/custom_test_artifacts/custom-op-build/CMakeCache.txt 2025-12-04T09:26:06.3683630Z inflating: build/custom_test_artifacts/custom-op-build/Makefile 2025-12-04T09:26:06.3683981Z inflating: build/custom_test_artifacts/custom-op-build/cmake_install.cmake 2025-12-04T09:26:06.3774569Z inflating: build/custom_test_artifacts/custom-op-build/libcustom_ops.so 2025-12-04T09:26:06.3804065Z inflating: build/custom_test_artifacts/custom-op-build/test_custom_ops 2025-12-04T09:26:06.3804512Z creating: build/custom_test_artifacts/jit-hook-build/ 2025-12-04T09:26:06.3804944Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/ 2025-12-04T09:26:06.3805165Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/pkgRedirects/ 2025-12-04T09:26:06.3807032Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeConfigureLog.yaml 2025-12-04T09:26:06.3807298Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/ 2025-12-04T09:26:06.3807542Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CMakeSystem.cmake 2025-12-04T09:26:06.3807811Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdC/ 2025-12-04T09:26:06.3808062Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdC/tmp/ 2025-12-04T09:26:06.3808484Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdC/CMakeCCompilerId.c 2025-12-04T09:26:06.3809359Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdC/a.out 2025-12-04T09:26:06.3809656Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CMakeCCompiler.cmake 2025-12-04T09:26:06.3809928Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdCXX/ 2025-12-04T09:26:06.3810188Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdCXX/tmp/ 2025-12-04T09:26:06.3811155Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-12-04T09:26:06.3811928Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CompilerIdCXX/a.out 2025-12-04T09:26:06.3812239Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CMakeCXXCompiler.cmake 2025-12-04T09:26:06.3813390Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_C.bin 2025-12-04T09:26:06.3814177Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_CXX.bin 2025-12-04T09:26:06.3814469Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeScratch/ 2025-12-04T09:26:06.3814697Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeTmp/ 2025-12-04T09:26:06.3814929Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/cmake.check_cache 2025-12-04T09:26:06.3815180Z creating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/ 2025-12-04T09:26:06.3815460Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.ts 2025-12-04T09:26:06.3815777Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/compiler_depend.make 2025-12-04T09:26:06.3816080Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/depend.make 2025-12-04T09:26:06.3816366Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.txt 2025-12-04T09:26:06.3816657Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/cmake_clean.cmake 2025-12-04T09:26:06.3816949Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/build.make 2025-12-04T09:26:06.3817241Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/DependInfo.cmake 2025-12-04T09:26:06.3817535Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/flags.make 2025-12-04T09:26:06.3817815Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/progress.make 2025-12-04T09:26:06.3828188Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o.d 2025-12-04T09:26:06.3862091Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/test_jit_hooks.cpp.o 2025-12-04T09:26:06.3862390Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/test_jit_hooks.dir/link.d 2025-12-04T09:26:06.3863050Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-12-04T09:26:06.3863339Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/TargetDirectories.txt 2025-12-04T09:26:06.3863603Z extracting: build/custom_test_artifacts/jit-hook-build/CMakeFiles/progress.marks 2025-12-04T09:26:06.3863846Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile2 2025-12-04T09:26:06.3864297Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeFiles/Makefile.cmake 2025-12-04T09:26:06.3864561Z inflating: build/custom_test_artifacts/jit-hook-build/hipblaslt_test_outer_vec.cc 2025-12-04T09:26:06.3864812Z inflating: build/custom_test_artifacts/jit-hook-build/hipblaslt_test_vec_ext.cc 2025-12-04T09:26:06.3865658Z inflating: build/custom_test_artifacts/jit-hook-build/CMakeCache.txt 2025-12-04T09:26:06.3865878Z inflating: build/custom_test_artifacts/jit-hook-build/Makefile 2025-12-04T09:26:06.3866125Z inflating: build/custom_test_artifacts/jit-hook-build/cmake_install.cmake 2025-12-04T09:26:06.3886814Z inflating: build/custom_test_artifacts/jit-hook-build/test_jit_hooks 2025-12-04T09:26:06.3887022Z creating: build/custom_test_artifacts/custom-backend-build/ 2025-12-04T09:26:06.3887229Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/ 2025-12-04T09:26:06.3887461Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/pkgRedirects/ 2025-12-04T09:26:06.3889545Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeConfigureLog.yaml 2025-12-04T09:26:06.3889815Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/ 2025-12-04T09:26:06.3890086Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CMakeSystem.cmake 2025-12-04T09:26:06.3890365Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdC/ 2025-12-04T09:26:06.3890637Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdC/tmp/ 2025-12-04T09:26:06.3891379Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdC/CMakeCCompilerId.c 2025-12-04T09:26:06.3892139Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdC/a.out 2025-12-04T09:26:06.3892453Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CMakeCCompiler.cmake 2025-12-04T09:26:06.3892749Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdCXX/ 2025-12-04T09:26:06.3893075Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdCXX/tmp/ 2025-12-04T09:26:06.3894073Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdCXX/CMakeCXXCompilerId.cpp 2025-12-04T09:26:06.3894767Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CompilerIdCXX/a.out 2025-12-04T09:26:06.3895088Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CMakeCXXCompiler.cmake 2025-12-04T09:26:06.3896220Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_C.bin 2025-12-04T09:26:06.3896927Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/3.31.6/CMakeDetermineCompilerABI_CXX.bin 2025-12-04T09:26:06.3897242Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeScratch/ 2025-12-04T09:26:06.3897554Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeTmp/ 2025-12-04T09:26:06.3897812Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/cmake.check_cache 2025-12-04T09:26:06.3898131Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/ 2025-12-04T09:26:06.3898427Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.ts 2025-12-04T09:26:06.3898758Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/compiler_depend.make 2025-12-04T09:26:06.3899081Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/depend.make 2025-12-04T09:26:06.3899529Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.txt 2025-12-04T09:26:06.3899835Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/cmake_clean.cmake 2025-12-04T09:26:06.3900150Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/build.make 2025-12-04T09:26:06.3900468Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/DependInfo.cmake 2025-12-04T09:26:06.3900779Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/flags.make 2025-12-04T09:26:06.3901093Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/progress.make 2025-12-04T09:26:06.3901990Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o.d 2025-12-04T09:26:06.3965785Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/custom_backend.cpp.o 2025-12-04T09:26:06.3966168Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/custom_backend.dir/link.d 2025-12-04T09:26:06.3966468Z creating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/ 2025-12-04T09:26:06.3966795Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.ts 2025-12-04T09:26:06.3967143Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/compiler_depend.make 2025-12-04T09:26:06.3967483Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/depend.make 2025-12-04T09:26:06.3967799Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.txt 2025-12-04T09:26:06.3968124Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/cmake_clean.cmake 2025-12-04T09:26:06.3968453Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/build.make 2025-12-04T09:26:06.3968787Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/DependInfo.cmake 2025-12-04T09:26:06.3969119Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/flags.make 2025-12-04T09:26:06.3969445Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/progress.make 2025-12-04T09:26:06.3979921Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o.d 2025-12-04T09:26:06.4009403Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/test_custom_backend.cpp.o 2025-12-04T09:26:06.4009749Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/test_custom_backend.dir/link.d 2025-12-04T09:26:06.4010063Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/CMakeDirectoryInformation.cmake 2025-12-04T09:26:06.4010374Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/TargetDirectories.txt 2025-12-04T09:26:06.4010724Z extracting: build/custom_test_artifacts/custom-backend-build/CMakeFiles/progress.marks 2025-12-04T09:26:06.4011033Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile2 2025-12-04T09:26:06.4011293Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeFiles/Makefile.cmake 2025-12-04T09:26:06.4011574Z inflating: build/custom_test_artifacts/custom-backend-build/hipblaslt_test_outer_vec.cc 2025-12-04T09:26:06.4011902Z inflating: build/custom_test_artifacts/custom-backend-build/hipblaslt_test_vec_ext.cc 2025-12-04T09:26:06.4012957Z inflating: build/custom_test_artifacts/custom-backend-build/CMakeCache.txt 2025-12-04T09:26:06.4013245Z inflating: build/custom_test_artifacts/custom-backend-build/Makefile 2025-12-04T09:26:06.4013482Z inflating: build/custom_test_artifacts/custom-backend-build/cmake_install.cmake 2025-12-04T09:26:06.4067423Z inflating: build/custom_test_artifacts/custom-backend-build/libcustom_backend.so 2025-12-04T09:26:06.4088317Z inflating: build/custom_test_artifacts/custom-backend-build/test_custom_backend 2025-12-04T09:26:06.4088511Z creating: build/lib/ 2025-12-04T09:26:06.4133736Z inflating: build/lib/libprotobuf-lite.a 2025-12-04T09:26:06.4377302Z inflating: build/lib/libprotobuf.a 2025-12-04T09:26:06.4650548Z inflating: build/lib/libprotoc.a 2025-12-04T09:26:06.4655348Z inflating: build/lib/libpthreadpool.a 2025-12-04T09:26:06.4659729Z inflating: build/lib/libcpuinfo.a 2025-12-04T09:26:06.4663895Z inflating: build/lib/libcpuinfo_internals.a 2025-12-04T09:26:06.4664561Z inflating: build/lib/libclog.a 2025-12-04T09:26:06.4674765Z inflating: build/lib/libpytorch_qnnpack.a 2025-12-04T09:26:06.4675752Z inflating: build/lib/libnnpack_reference_layers.a 2025-12-04T09:26:06.4776889Z inflating: build/lib/libmicrokernels-prod.a 2025-12-04T09:26:06.4786560Z inflating: build/lib/libnnpack.a 2025-12-04T09:26:06.5254990Z inflating: build/lib/libmicrokernels-all.a 2025-12-04T09:26:06.5293241Z inflating: build/lib/libgtest.a 2025-12-04T09:26:06.5302218Z inflating: build/lib/libgmock.a 2025-12-04T09:26:06.5302403Z inflating: build/lib/libgtest_main.a 2025-12-04T09:26:06.5302569Z inflating: build/lib/libgmock_main.a 2025-12-04T09:26:06.5352444Z inflating: build/lib/libXNNPACK.a 2025-12-04T09:26:06.5393878Z inflating: build/lib/libbenchmark.a 2025-12-04T09:26:06.5394096Z inflating: build/lib/libbenchmark_main.a 2025-12-04T09:26:06.5430649Z inflating: build/lib/libasmjit.a 2025-12-04T09:26:06.5430838Z inflating: build/lib/libjitprofiling.a 2025-12-04T09:26:06.6054412Z inflating: build/lib/libfbgemm.a 2025-12-04T09:26:06.6058586Z inflating: build/lib/libittnotify.a 2025-12-04T09:26:06.6075250Z inflating: build/lib/libtensorpipe_uv.a 2025-12-04T09:26:06.6370941Z inflating: build/lib/libtensorpipe.a 2025-12-04T09:26:06.6436629Z inflating: build/lib/libgloo.a 2025-12-04T09:26:06.6462197Z inflating: build/lib/libonnx_proto.a 2025-12-04T09:26:06.6681335Z inflating: build/lib/libgloo_hip.a 2025-12-04T09:26:06.7074347Z inflating: build/lib/libonnx.a 2025-12-04T09:26:06.7085125Z inflating: build/lib/libfmt.a 2025-12-04T09:26:07.2615829Z inflating: build/lib/libdnnl.a 2025-12-04T09:26:07.2785018Z inflating: build/lib/libkineto.a 2025-12-04T09:26:07.2850188Z inflating: build/lib/libc10.so 2025-12-04T09:26:07.2850693Z inflating: build/lib/libcaffe2_nvrtc.so 2025-12-04T09:26:07.2851421Z inflating: build/lib/libtorch_global_deps.so 2025-12-04T09:26:07.2876791Z inflating: build/lib/libc10_hip.so 2025-12-04T09:26:07.3143449Z inflating: build/lib/libfbgemm_genai.a 2025-12-04T09:26:09.0073999Z inflating: build/lib/libtorch_cpu.so 2025-12-04T09:26:09.0075996Z inflating: build/lib/libshm.so 2025-12-04T09:26:09.8328532Z inflating: build/lib/libtorch_hip.so 2025-12-04T09:26:09.8328994Z inflating: build/lib/libtorch.so 2025-12-04T09:26:09.8340052Z inflating: build/lib/libjitbackend_test.so 2025-12-04T09:26:09.8379241Z inflating: build/lib/libtorchbind_test.so 2025-12-04T09:26:09.8393124Z inflating: build/lib/libbackend_with_compiler.so 2025-12-04T09:26:09.8407356Z inflating: build/lib/libaoti_custom_ops.so 2025-12-04T09:26:09.9717338Z inflating: build/lib/libtorch_python.so 2025-12-04T09:26:09.9737529Z inflating: build/lib/libnnapi_backend.so 2025-12-04T09:26:09.9737853Z creating: build/bin/ 2025-12-04T09:26:09.9738106Z creating: build/bin/CMakeFiles/ 2025-12-04T09:26:09.9738389Z inflating: build/bin/cmake_install.cmake 2025-12-04T09:26:09.9738687Z inflating: build/bin/CTestTestfile.cmake 2025-12-04T09:26:09.9990765Z inflating: build/bin/protoc-3.13.0.0 2025-12-04T09:26:10.0243266Z inflating: build/bin/protoc 2025-12-04T09:26:10.0275716Z inflating: build/bin/c10_AllocatorConfig_test 2025-12-04T09:26:10.0306441Z inflating: build/bin/c10_CompileTimeFunctionPointer_test 2025-12-04T09:26:10.0337922Z inflating: build/bin/c10_DeviceGuard_test 2025-12-04T09:26:10.0369513Z inflating: build/bin/c10_Device_test 2025-12-04T09:26:10.0405636Z inflating: build/bin/c10_DispatchKeySet_test 2025-12-04T09:26:10.0438277Z inflating: build/bin/c10_Scalar_test 2025-12-04T09:26:10.0468351Z inflating: build/bin/c10_StreamGuard_test 2025-12-04T09:26:10.0502842Z inflating: build/bin/c10_SymInt_test 2025-12-04T09:26:10.0536025Z inflating: build/bin/c10_InlineDeviceGuard_test 2025-12-04T09:26:10.0569971Z inflating: build/bin/c10_SizesAndStrides_test 2025-12-04T09:26:10.0600102Z inflating: build/bin/c10_ConstexprCrc_test 2025-12-04T09:26:10.0641957Z inflating: build/bin/c10_cow_test 2025-12-04T09:26:10.0675825Z inflating: build/bin/c10_InlineStreamGuard_test 2025-12-04T09:26:10.0706091Z inflating: build/bin/c10_ArrayRef_test 2025-12-04T09:26:10.0738381Z inflating: build/bin/c10_Bitset_test 2025-12-04T09:26:10.0768792Z inflating: build/bin/c10_DeadlockDetection_test 2025-12-04T09:26:10.0803269Z inflating: build/bin/c10_Enumerate_test 2025-12-04T09:26:10.0834393Z inflating: build/bin/c10_Half_test 2025-12-04T09:26:10.0868372Z inflating: build/bin/c10_LeftRight_test 2025-12-04T09:26:10.0900863Z inflating: build/bin/c10_NetworkFlow_test 2025-12-04T09:26:10.0933033Z inflating: build/bin/c10_IntrusiveList_test 2025-12-04T09:26:10.0963640Z inflating: build/bin/c10_Synchronized_test 2025-12-04T09:26:10.0993894Z inflating: build/bin/c10_Semaphore_test 2025-12-04T09:26:10.1025545Z inflating: build/bin/c10_TypeIndex_test 2025-12-04T09:26:10.1059186Z inflating: build/bin/c10_ThreadLocal_test 2025-12-04T09:26:10.1090811Z inflating: build/bin/c10_accumulate_test 2025-12-04T09:26:10.1124561Z inflating: build/bin/c10_bfloat16_test 2025-12-04T09:26:10.1155300Z inflating: build/bin/c10_bit_cast_test 2025-12-04T09:26:10.1190316Z inflating: build/bin/c10_complex_math_test 2025-12-04T09:26:10.1222258Z inflating: build/bin/c10_exception_test 2025-12-04T09:26:10.1252723Z inflating: build/bin/c10_error_test 2025-12-04T09:26:10.1286312Z inflating: build/bin/c10_complex_test 2025-12-04T09:26:10.1317158Z inflating: build/bin/c10_flags_test 2025-12-04T09:26:10.1348144Z inflating: build/bin/c10_generic_math_test 2025-12-04T09:26:10.1382741Z inflating: build/bin/c10_logging_test 2025-12-04T09:26:10.1413253Z inflating: build/bin/c10_nofatal_test 2025-12-04T09:26:10.1444391Z inflating: build/bin/c10_irange_test 2025-12-04T09:26:10.1533853Z inflating: build/bin/c10_intrusive_ptr_test 2025-12-04T09:26:10.1566490Z inflating: build/bin/c10_lazy_test 2025-12-04T09:26:10.1611046Z inflating: build/bin/c10_optional_test 2025-12-04T09:26:10.1643605Z inflating: build/bin/c10_registry_test 2025-12-04T09:26:10.1677756Z inflating: build/bin/c10_string_util_test 2025-12-04T09:26:10.1709229Z inflating: build/bin/c10_ssize_test 2025-12-04T09:26:10.1796543Z inflating: build/bin/c10_small_vector_test 2025-12-04T09:26:10.1833944Z inflating: build/bin/c10_ordered_preserving_dict_test 2025-12-04T09:26:10.1864103Z inflating: build/bin/c10_string_view_test 2025-12-04T09:26:10.1894699Z inflating: build/bin/c10_tempfile_test 2025-12-04T09:26:10.1921484Z inflating: build/bin/c10_intrusive_ptr_benchmark 2025-12-04T09:26:10.1955400Z inflating: build/bin/c10_typeid_test 2025-12-04T09:26:10.1985471Z inflating: build/bin/c10_hip_HIPAssertionsTest_1_var_test 2025-12-04T09:26:10.2015480Z inflating: build/bin/c10_hip_HIPAssertionsTest_catches_stream 2025-12-04T09:26:10.2045494Z inflating: build/bin/c10_hip_HIPAssertionsTest_catches_thread_and_block_and_device 2025-12-04T09:26:10.2075337Z inflating: build/bin/c10_hip_HIPAssertionsTest_from_2_processes 2025-12-04T09:26:10.2105423Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_blocks_and_threads 2025-12-04T09:26:10.2135373Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_multiple_blocks 2025-12-04T09:26:10.2165324Z inflating: build/bin/c10_hip_HIPAssertionsTest_multiple_writes_from_same_block 2025-12-04T09:26:10.2195371Z inflating: build/bin/c10_hip_HIPTest 2025-12-04T09:26:10.2521569Z inflating: build/bin/vec_test_all_types_DEFAULT 2025-12-04T09:26:10.2855729Z inflating: build/bin/vec_test_all_types_AVX512 2025-12-04T09:26:10.3199066Z inflating: build/bin/vec_test_all_types_AVX2 2025-12-04T09:26:10.3256707Z inflating: build/bin/test_aoti_abi_check 2025-12-04T09:26:10.3287038Z inflating: build/bin/test_vec_half_DEFAULT 2025-12-04T09:26:10.3317738Z inflating: build/bin/test_vec_half_AVX512 2025-12-04T09:26:10.3348487Z inflating: build/bin/test_vec_half_AVX2 2025-12-04T09:26:10.3380632Z inflating: build/bin/BackoffTest 2025-12-04T09:26:10.3413222Z inflating: build/bin/FileStoreTest 2025-12-04T09:26:10.3447721Z inflating: build/bin/TCPStoreTest 2025-12-04T09:26:10.3480479Z inflating: build/bin/HashStoreTest 2025-12-04T09:26:10.3520567Z inflating: build/bin/ProcessGroupGlooTest 2025-12-04T09:26:10.3522055Z inflating: build/bin/example_allreduce 2025-12-04T09:26:10.3523989Z inflating: build/bin/torch_shm_manager 2025-12-04T09:26:10.3557045Z inflating: build/bin/static_runtime_bench 2025-12-04T09:26:10.3699698Z inflating: build/bin/static_runtime_test 2025-12-04T09:26:10.3744337Z inflating: build/bin/Dict_test 2025-12-04T09:26:10.3775547Z inflating: build/bin/Dimname_test 2025-12-04T09:26:10.3814535Z inflating: build/bin/MaybeOwned_test 2025-12-04T09:26:10.3849101Z inflating: build/bin/NamedTensor_test 2025-12-04T09:26:10.3884897Z inflating: build/bin/apply_utils_test 2025-12-04T09:26:10.3920564Z inflating: build/bin/atest 2025-12-04T09:26:10.3959183Z inflating: build/bin/basic 2025-12-04T09:26:10.3992058Z inflating: build/bin/broadcast_test 2025-12-04T09:26:10.4023172Z inflating: build/bin/cpu_allocator_test 2025-12-04T09:26:10.4058120Z inflating: build/bin/cpu_generator_test 2025-12-04T09:26:10.4090281Z inflating: build/bin/cpu_profiling_allocator_test 2025-12-04T09:26:10.4145062Z inflating: build/bin/cpu_rng_test 2025-12-04T09:26:10.4176698Z inflating: build/bin/dlconvertor_test 2025-12-04T09:26:10.4211764Z inflating: build/bin/extension_backend_test 2025-12-04T09:26:10.4245659Z inflating: build/bin/half_test 2025-12-04T09:26:10.4303143Z inflating: build/bin/ivalue_test 2025-12-04T09:26:10.4333737Z inflating: build/bin/lazy_tensor_test 2025-12-04T09:26:10.4366014Z inflating: build/bin/math_kernel_test 2025-12-04T09:26:10.4398122Z inflating: build/bin/memory_format_test 2025-12-04T09:26:10.4431083Z inflating: build/bin/memory_overlapping_test 2025-12-04T09:26:10.4463513Z inflating: build/bin/mobile_memory_cleanup 2025-12-04T09:26:10.4497182Z inflating: build/bin/native_test 2025-12-04T09:26:10.4528343Z inflating: build/bin/operator_name_test 2025-12-04T09:26:10.4559415Z inflating: build/bin/operators_test 2025-12-04T09:26:10.4591271Z inflating: build/bin/packedtensoraccessor_test 2025-12-04T09:26:10.4631678Z inflating: build/bin/pow_test 2025-12-04T09:26:10.4666092Z inflating: build/bin/quantized_test 2025-12-04T09:26:10.4696843Z inflating: build/bin/reduce_ops_test 2025-12-04T09:26:10.4727968Z inflating: build/bin/reportMemoryUsage_test 2025-12-04T09:26:10.4761824Z inflating: build/bin/scalar_tensor_test 2025-12-04T09:26:10.4793538Z inflating: build/bin/stride_properties_test 2025-12-04T09:26:10.4828188Z inflating: build/bin/scalar_test 2025-12-04T09:26:10.4859688Z inflating: build/bin/StorageUtils_test 2025-12-04T09:26:10.4893149Z inflating: build/bin/type_ptr_test 2025-12-04T09:26:10.4923923Z inflating: build/bin/thread_init_test 2025-12-04T09:26:10.4971312Z inflating: build/bin/tensor_iterator_test 2025-12-04T09:26:10.5004188Z inflating: build/bin/test_parallel 2025-12-04T09:26:10.5040088Z inflating: build/bin/type_test 2025-12-04T09:26:10.5072068Z inflating: build/bin/undefined_tensor_test 2025-12-04T09:26:10.5102426Z inflating: build/bin/verify_api_visibility 2025-12-04T09:26:10.5133723Z inflating: build/bin/weakref_test 2025-12-04T09:26:10.5176001Z inflating: build/bin/legacy_vmap_test 2025-12-04T09:26:10.5207435Z inflating: build/bin/wrapdim_test 2025-12-04T09:26:10.5239041Z inflating: build/bin/xla_tensor_test 2025-12-04T09:26:10.5274788Z inflating: build/bin/IListRef_test 2025-12-04T09:26:10.5336215Z inflating: build/bin/List_test 2025-12-04T09:26:10.5405785Z inflating: build/bin/kernel_function_legacy_test 2025-12-04T09:26:10.5445512Z inflating: build/bin/KernelFunction_test 2025-12-04T09:26:10.5501870Z inflating: build/bin/kernel_function_test 2025-12-04T09:26:10.5561790Z inflating: build/bin/kernel_lambda_test 2025-12-04T09:26:10.5635119Z inflating: build/bin/kernel_lambda_legacy_test 2025-12-04T09:26:10.5671724Z inflating: build/bin/kernel_stackbased_test 2025-12-04T09:26:10.5703093Z inflating: build/bin/CppSignature_test 2025-12-04T09:26:10.5759215Z inflating: build/bin/make_boxed_from_unboxed_functor_test 2025-12-04T09:26:10.5789232Z inflating: build/bin/op_allowlist_test 2025-12-04T09:26:10.5965605Z inflating: build/bin/op_registration_test 2025-12-04T09:26:10.5999314Z inflating: build/bin/backend_fallback_test 2025-12-04T09:26:10.6029392Z inflating: build/bin/hip_complex_math_test 2025-12-04T09:26:10.6069703Z inflating: build/bin/inline_container_test 2025-12-04T09:26:10.6100000Z inflating: build/bin/hip_complex_test 2025-12-04T09:26:10.6132618Z inflating: build/bin/hip_apply_test 2025-12-04T09:26:10.6162391Z inflating: build/bin/hip_distributions_test 2025-12-04T09:26:10.6192402Z inflating: build/bin/hip_generator_test 2025-12-04T09:26:10.6222534Z inflating: build/bin/hip_half_test 2025-12-04T09:26:10.6252603Z inflating: build/bin/hip_integer_divider_test 2025-12-04T09:26:10.6282538Z inflating: build/bin/hip_optional_test 2025-12-04T09:26:10.6312534Z inflating: build/bin/hip_packedtensoraccessor_test 2025-12-04T09:26:10.6344243Z inflating: build/bin/hip_dlconvertor_test 2025-12-04T09:26:10.6374256Z inflating: build/bin/hip_vectorized_test 2025-12-04T09:26:10.6993018Z inflating: build/bin/test_jit 2025-12-04T09:26:10.7191983Z inflating: build/bin/test_lazy 2025-12-04T09:26:10.7225491Z inflating: build/bin/test_dist_autograd 2025-12-04T09:26:10.7266686Z inflating: build/bin/test_cpp_rpc 2025-12-04T09:26:10.7921732Z inflating: build/bin/test_api 2025-12-04T09:26:10.7922916Z inflating: build/bin/parallel_benchmark 2025-12-04T09:26:10.7923259Z creating: .additional_ci_files/ 2025-12-04T09:26:10.7959260Z inflating: .additional_ci_files/test-times.json 2025-12-04T09:26:10.8090711Z inflating: .additional_ci_files/test-class-times.json 2025-12-04T09:26:10.8118682Z ##[group]Run rm artifacts.zip 2025-12-04T09:26:10.8118894Z rm artifacts.zip 2025-12-04T09:26:10.8124125Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:10.8124335Z env: 2025-12-04T09:26:10.8124472Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:10.8124821Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:10.8125050Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:10.8125232Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:10.8125695Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:10.8126097Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:10.8126222Z AWS_REGION: us-east-1 2025-12-04T09:26:10.8126433Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:10.8126604Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:10.8128911Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:10.8129028Z ##[endgroup] 2025-12-04T09:26:10.8962506Z ##[group]Run df -H 2025-12-04T09:26:10.8962703Z df -H 2025-12-04T09:26:10.8967824Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:10.8968017Z env: 2025-12-04T09:26:10.8968159Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:10.8968339Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:10.8968569Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:10.8968783Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:10.8969274Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:10.8969746Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:10.8969898Z AWS_REGION: us-east-1 2025-12-04T09:26:10.8970118Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:10.8970327Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:10.8973074Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:10.8973218Z ##[endgroup] 2025-12-04T09:26:10.9021496Z Filesystem Size Used Avail Use% Mounted on 2025-12-04T09:26:10.9021836Z overlay 16T 820G 15T 6% / 2025-12-04T09:26:10.9022130Z tmpfs 68M 0 68M 0% /dev 2025-12-04T09:26:10.9022491Z /dev/md0 16T 820G 15T 6% /run 2025-12-04T09:26:10.9022766Z shm 68M 4.1k 68M 1% /dev/shm 2025-12-04T09:26:10.9023120Z amdprj2-k8s_2 5.5T 120G 5.4T 3% /home/runner/pytorch-data 2025-12-04T09:26:10.9023457Z tmpfs 3.3T 13k 3.3T 1% /run/secrets/kubernetes.io/serviceaccount 2025-12-04T09:26:10.9023758Z tmpfs 1.7T 0 1.7T 0% /proc/acpi 2025-12-04T09:26:10.9024012Z tmpfs 1.7T 0 1.7T 0% /proc/scsi 2025-12-04T09:26:10.9024254Z tmpfs 1.7T 0 1.7T 0% /sys/firmware 2025-12-04T09:26:10.9024524Z tmpfs 1.7T 0 1.7T 0% /sys/devices/virtual/powercap 2025-12-04T09:26:10.9050699Z Prepare all required actions 2025-12-04T09:26:10.9050951Z Getting action download info 2025-12-04T09:26:11.3345894Z ##[group]Run ./.github/actions/download-td-artifacts 2025-12-04T09:26:11.3346050Z with: 2025-12-04T09:26:11.3346141Z env: 2025-12-04T09:26:11.3346236Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:11.3346375Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:11.3346554Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:11.3346721Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:11.3347110Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:11.3347484Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:11.3347605Z AWS_REGION: us-east-1 2025-12-04T09:26:11.3347770Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:11.3347957Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:11.3350249Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:11.3350359Z ##[endgroup] 2025-12-04T09:26:11.3374132Z ##[group]Run seemethere/download-artifact-s3@v4 2025-12-04T09:26:11.3374280Z with: 2025-12-04T09:26:11.3374382Z name: td_results 2025-12-04T09:26:11.3374492Z s3-bucket: gha-artifacts 2025-12-04T09:26:11.3374611Z region: us-east-1 2025-12-04T09:26:11.3374714Z env: 2025-12-04T09:26:11.3374815Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:11.3374954Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:11.3375129Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:11.3375294Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:11.3375679Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:11.3376050Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:11.3376171Z AWS_REGION: us-east-1 2025-12-04T09:26:11.3376302Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:11.3376453Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:11.3378559Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:11.3378660Z ##[endgroup] 2025-12-04T09:26:11.5580578Z (node:17288) NOTE: We are formalizing our plans to enter AWS SDK for JavaScript (v2) into maintenance mode in 2023. 2025-12-04T09:26:11.5580915Z 2025-12-04T09:26:11.5581046Z Please migrate your code to use AWS SDK for JavaScript (v3). 2025-12-04T09:26:11.5581401Z For more information, check the migration guide at https://a.co/7PzMCcy 2025-12-04T09:26:11.5581744Z (Use `node --trace-warnings ...` to show where the warning was created) 2025-12-04T09:26:11.8692730Z Found 1 objects with prefix pytorch/pytorch/19922812470/td_results/ 2025-12-04T09:26:11.8693125Z Starting download (1/1): /home/runner/_work/pytorch/pytorch/td_results.json 2025-12-04T09:26:12.2452523Z Finished download (1/1): /home/runner/_work/pytorch/pytorch/td_results.json 2025-12-04T09:26:12.2456896Z Artifact download has finished successfully 2025-12-04T09:26:12.2587246Z ##[group]Run mkdir -p .additional_ci_files 2025-12-04T09:26:12.2587479Z mkdir -p .additional_ci_files 2025-12-04T09:26:12.2587732Z mv td_results.json .additional_ci_files/td_results.json || true 2025-12-04T09:26:12.2592999Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:12.2593171Z env: 2025-12-04T09:26:12.2593285Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:12.2593449Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:12.2593656Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:12.2593851Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:12.2594492Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:12.2594931Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:12.2595067Z AWS_REGION: us-east-1 2025-12-04T09:26:12.2595277Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:12.2595461Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:12.2597877Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:12.2597998Z ##[endgroup] 2025-12-04T09:26:12.2670680Z ##[group]Run .github/scripts/parse_ref.py 2025-12-04T09:26:12.2670927Z .github/scripts/parse_ref.py 2025-12-04T09:26:12.2676993Z shell: /usr/bin/bash -e {0} 2025-12-04T09:26:12.2677140Z env: 2025-12-04T09:26:12.2677265Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:12.2677444Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:12.2677677Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:12.2677908Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:12.2678394Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:12.2679003Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:12.2679162Z AWS_REGION: us-east-1 2025-12-04T09:26:12.2679344Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:12.2679566Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:12.2682213Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:12.2682328Z ##[endgroup] 2025-12-04T09:26:12.2786514Z Setting output branch=main 2025-12-04T09:26:12.2902339Z Prepare all required actions 2025-12-04T09:26:12.2902584Z Getting action download info 2025-12-04T09:26:12.4940573Z ##[group]Run ./.github/actions/filter-test-configs 2025-12-04T09:26:12.4940719Z with: 2025-12-04T09:26:12.4940937Z github-token: *** 2025-12-04T09:26:12.4942630Z test-matrix: {"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}]} 2025-12-04T09:26:12.4944726Z job-name: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:12.4944940Z env: 2025-12-04T09:26:12.4945035Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:12.4945175Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:12.4945359Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:12.4945526Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:12.4945907Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:12.4946276Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:12.4946398Z AWS_REGION: us-east-1 2025-12-04T09:26:12.4946531Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:12.4946687Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:12.4948847Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:12.4948961Z ##[endgroup] 2025-12-04T09:26:12.4964537Z ##[group]Run nick-fields/retry@v3.0.0 2025-12-04T09:26:12.4964669Z with: 2025-12-04T09:26:12.4964763Z shell: bash 2025-12-04T09:26:12.4964867Z timeout_minutes: 10 2025-12-04T09:26:12.4964971Z max_attempts: 5 2025-12-04T09:26:12.4965071Z retry_wait_seconds: 30 2025-12-04T09:26:12.4965362Z command: set -eux # PyYAML 6.0 doesn't work with MacOS x86 anymore # This must run on Python-3.7 (AmazonLinux2) so can't use request=3.32.2 python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-12-04T09:26:12.4965670Z polling_interval_seconds: 1 2025-12-04T09:26:12.4965890Z warning_on_retry: true 2025-12-04T09:26:12.4965999Z continue_on_error: false 2025-12-04T09:26:12.4966106Z env: 2025-12-04T09:26:12.4966200Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:12.4966335Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:12.4966513Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:12.4966684Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:12.4967142Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:12.4967520Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:12.4967645Z AWS_REGION: us-east-1 2025-12-04T09:26:12.4967785Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:12.4967943Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:12.4970083Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:12.4970254Z GITHUB_TOKEN: *** 2025-12-04T09:26:12.4970364Z ##[endgroup] 2025-12-04T09:26:12.5356077Z + python3 -m pip install requests==2.27.1 pyyaml==6.0.2 2025-12-04T09:26:12.6790304Z Defaulting to user installation because normal site-packages is not writeable 2025-12-04T09:26:12.7885773Z Collecting requests==2.27.1 2025-12-04T09:26:12.8365043Z Downloading requests-2.27.1-py2.py3-none-any.whl (63 kB) 2025-12-04T09:26:12.8494535Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 63.1/63.1 KB 4.7 MB/s eta 0:00:00 2025-12-04T09:26:12.8961432Z Collecting pyyaml==6.0.2 2025-12-04T09:26:12.9036700Z Downloading PyYAML-6.0.2-cp310-cp310-manylinux_2_17_x86_64.manylinux2014_x86_64.whl (751 kB) 2025-12-04T09:26:12.9407317Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 751.2/751.2 KB 20.7 MB/s eta 0:00:00 2025-12-04T09:26:12.9660577Z Collecting idna<4,>=2.5 2025-12-04T09:26:12.9790413Z Downloading idna-3.11-py3-none-any.whl (71 kB) 2025-12-04T09:26:12.9806361Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 71.0/71.0 KB 103.0 MB/s eta 0:00:00 2025-12-04T09:26:13.0055628Z Collecting certifi>=2017.4.17 2025-12-04T09:26:13.0177957Z Downloading certifi-2025.11.12-py3-none-any.whl (159 kB) 2025-12-04T09:26:13.0194300Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 159.4/159.4 KB 217.6 MB/s eta 0:00:00 2025-12-04T09:26:13.0506278Z Collecting urllib3<1.27,>=1.21.1 2025-12-04T09:26:13.0632456Z Downloading urllib3-1.26.20-py2.py3-none-any.whl (144 kB) 2025-12-04T09:26:13.0650338Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 144.2/144.2 KB 157.2 MB/s eta 0:00:00 2025-12-04T09:26:13.1588675Z Collecting charset-normalizer~=2.0.0 2025-12-04T09:26:13.1676054Z Downloading charset_normalizer-2.0.12-py3-none-any.whl (39 kB) 2025-12-04T09:26:13.2240430Z Installing collected packages: urllib3, pyyaml, idna, charset-normalizer, certifi, requests 2025-12-04T09:26:13.3169775Z WARNING: The script normalizer is installed in '/home/runner/.local/bin' which is not on PATH. 2025-12-04T09:26:13.3170669Z Consider adding this directory to PATH or, if you prefer to suppress this warning, use --no-warn-script-location. 2025-12-04T09:26:13.3338408Z Successfully installed certifi-2025.11.12 charset-normalizer-2.0.12 idna-3.11 pyyaml-6.0.2 requests-2.27.1 urllib3-1.26.20 2025-12-04T09:26:13.5358320Z Command completed after 1 attempt(s). 2025-12-04T09:26:13.5409148Z ##[group]Run set -x 2025-12-04T09:26:13.5409336Z set -x 2025-12-04T09:26:13.5409465Z  2025-12-04T09:26:13.5409709Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-12-04T09:26:13.5409972Z # in runner workspace 2025-12-04T09:26:13.5410193Z python3 "${GITHUB_ACTION_PATH}/../../scripts/parse_ref.py" 2025-12-04T09:26:13.5415561Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:13.5415727Z env: 2025-12-04T09:26:13.5415842Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:13.5415997Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:13.5416192Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:13.5416537Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:13.5416974Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:13.5417393Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:13.5417524Z AWS_REGION: us-east-1 2025-12-04T09:26:13.5417860Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:13.5418030Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:13.5420435Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:13.5420560Z ##[endgroup] 2025-12-04T09:26:13.5453171Z + python3 /home/runner/_work/pytorch/pytorch/./.github/actions/filter-test-configs/../../scripts/parse_ref.py 2025-12-04T09:26:13.5542422Z Setting output branch=main 2025-12-04T09:26:13.5580003Z ##[group]Run echo "Workflow: ${GITHUB_WORKFLOW}" 2025-12-04T09:26:13.5580246Z echo "Workflow: ${GITHUB_WORKFLOW}" 2025-12-04T09:26:13.5580437Z echo "Job name: ${JOB_NAME}" 2025-12-04T09:26:13.5580601Z  2025-12-04T09:26:13.5580800Z # Use relative path here as this could be checked out anywhere, not necessarily 2025-12-04T09:26:13.5581058Z # in runner workspace 2025-12-04T09:26:13.5581302Z python3 "${GITHUB_ACTION_PATH}/../../scripts/filter_test_configs.py" \ 2025-12-04T09:26:13.5581553Z  --workflow "${GITHUB_WORKFLOW}" \ 2025-12-04T09:26:13.5581747Z  --job-name "${JOB_NAME}" \ 2025-12-04T09:26:13.5584096Z  --test-matrix "{"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}]}" \ 2025-12-04T09:26:13.5585982Z  --selected-test-configs "" \ 2025-12-04T09:26:13.5586127Z  --pr-number "${PR_NUMBER}" \ 2025-12-04T09:26:13.5586262Z  --tag "${TAG}" \ 2025-12-04T09:26:13.5586388Z  --event-name "${EVENT_NAME}" \ 2025-12-04T09:26:13.5586529Z  --schedule "${SCHEDULE}" \ 2025-12-04T09:26:13.5586661Z  --branch "${HEAD_BRANCH}" 2025-12-04T09:26:13.5590764Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:13.5590914Z env: 2025-12-04T09:26:13.5591022Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:13.5591172Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:13.5591362Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:13.5591541Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:13.5592081Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:13.5592470Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:13.5592600Z AWS_REGION: us-east-1 2025-12-04T09:26:13.5592788Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:13.5593120Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:13.5595367Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:13.5595603Z GITHUB_TOKEN: *** 2025-12-04T09:26:13.5595814Z JOB_NAME: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:13.5596038Z PR_NUMBER: 2025-12-04T09:26:13.5596143Z TAG: 2025-12-04T09:26:13.5596242Z EVENT_NAME: schedule 2025-12-04T09:26:13.5596352Z SCHEDULE: 29 8 * * * 2025-12-04T09:26:13.5596463Z HEAD_BRANCH: main 2025-12-04T09:26:13.5596577Z ##[endgroup] 2025-12-04T09:26:13.5618532Z Workflow: rocm-mi300 2025-12-04T09:26:13.5618867Z Job name: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:14.1346412Z Setting output keep-going=True 2025-12-04T09:26:14.1346875Z Setting output ci-verbose-test-logs=False 2025-12-04T09:26:14.1347281Z Setting output ci-test-showlocals=False 2025-12-04T09:26:14.1347660Z Setting output ci-no-test-timeout=False 2025-12-04T09:26:14.1348046Z Setting output ci-no-td=False 2025-12-04T09:26:14.1348391Z Setting output ci-td-distributed=False 2025-12-04T09:26:14.1348757Z Setting output is-unstable=False 2025-12-04T09:26:14.1349108Z Setting output reenabled-issues= 2025-12-04T09:26:14.1359113Z Setting output test-matrix={"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}]} 2025-12-04T09:26:14.1366716Z Setting output is-test-matrix-empty=False 2025-12-04T09:26:14.1447039Z ##[group]Run echo "Filtered matrix:" 2025-12-04T09:26:14.1447294Z echo "Filtered matrix:" 2025-12-04T09:26:14.1452703Z echo "{"include": [{"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 1, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 2, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 3, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 4, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 5, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "mem_leak_check": "mem_leak_check", "rerun_disabled_tests": "rerun_disabled_tests"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests", "mem_leak_check": "mem_leak_check"}, {"config": "default", "shard": 6, "num_shards": 6, "runner": "linux.rocm.gpu.gfx942.1.b", "rerun_disabled_tests": "rerun_disabled_tests"}]}" 2025-12-04T09:26:14.1457505Z  2025-12-04T09:26:14.1457610Z echo 2025-12-04T09:26:14.1457749Z echo "Is the current job unstable? False" 2025-12-04T09:26:14.1457905Z  2025-12-04T09:26:14.1458010Z echo 2025-12-04T09:26:14.1458141Z echo "Is keep-going label set? True" 2025-12-04T09:26:14.1458287Z  2025-12-04T09:26:14.1458392Z echo 2025-12-04T09:26:14.1458518Z echo "Reenabled issues? " 2025-12-04T09:26:14.1463204Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:14.1463377Z env: 2025-12-04T09:26:14.1463491Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:14.1463649Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:14.1463851Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:14.1464043Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:14.1464442Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:14.1464820Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:14.1464947Z AWS_REGION: us-east-1 2025-12-04T09:26:14.1465139Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:14.1465301Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:14.1467424Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:14.1467545Z ##[endgroup] 2025-12-04T09:26:14.1487060Z Filtered matrix: 2025-12-04T09:26:14.1496212Z {include: [{config: default, shard: 1, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 1, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 1, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 1, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 2, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 2, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 2, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 2, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 3, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 3, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 3, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 3, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 4, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 4, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 4, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 4, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 5, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 5, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 5, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 5, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 6, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check}, {config: default, shard: 6, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, mem_leak_check: mem_leak_check, rerun_disabled_tests: rerun_disabled_tests}, {config: default, shard: 6, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests, mem_leak_check: mem_leak_check}, {config: default, shard: 6, num_shards: 6, runner: linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests: rerun_disabled_tests}]} 2025-12-04T09:26:14.1503661Z 2025-12-04T09:26:14.1503783Z Is the current job unstable? False 2025-12-04T09:26:14.1503943Z 2025-12-04T09:26:14.1504046Z Is keep-going label set? True 2025-12-04T09:26:14.1504195Z 2025-12-04T09:26:14.1504280Z Reenabled issues? 2025-12-04T09:26:14.1530505Z ##[group]Run echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-12-04T09:26:14.1530729Z echo "timeout=$((JOB_TIMEOUT-30))" >> "${GITHUB_OUTPUT}" 2025-12-04T09:26:14.1533759Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:14.1533915Z env: 2025-12-04T09:26:14.1534019Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:14.1534166Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:14.1534348Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:14.1534520Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:14.1534905Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:14.1535290Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:14.1535414Z AWS_REGION: us-east-1 2025-12-04T09:26:14.1535593Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:14.1535804Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:14.1537948Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:14.1538063Z JOB_TIMEOUT: 300 2025-12-04T09:26:14.1538333Z ##[endgroup] 2025-12-04T09:26:14.1578234Z ##[group]Run env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-12-04T09:26:14.1578520Z env | grep '^GITHUB' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-12-04T09:26:14.1578755Z env | grep '^CI' >> "/tmp/github_env_${GITHUB_RUN_ID}" 2025-12-04T09:26:14.1583337Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T09:26:14.1583536Z env: 2025-12-04T09:26:14.1583668Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:14.1583849Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:14.1584228Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:14.1584448Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:14.1584932Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:14.1585369Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:14.1585502Z AWS_REGION: us-east-1 2025-12-04T09:26:14.1585691Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:14.1585863Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:14.1588055Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:14.1588180Z ##[endgroup] 2025-12-04T09:26:14.1664555Z ##[group]Run set -x 2025-12-04T09:26:14.1664724Z set -x 2025-12-04T09:26:14.1664827Z  2025-12-04T09:26:14.1664945Z if [[ $TEST_CONFIG == 'multigpu' ]]; then 2025-12-04T09:26:14.1665112Z  TEST_COMMAND=.ci/pytorch/multigpu-test.sh 2025-12-04T09:26:14.1665287Z elif [[ $BUILD_ENVIRONMENT == *onnx* ]]; then 2025-12-04T09:26:14.1665438Z  TEST_COMMAND=.ci/caffe2/test.sh 2025-12-04T09:26:14.1665565Z else 2025-12-04T09:26:14.1665677Z  TEST_COMMAND=.ci/pytorch/test.sh 2025-12-04T09:26:14.1665803Z fi 2025-12-04T09:26:14.1665895Z  2025-12-04T09:26:14.1666034Z # detached container should get cleaned up by teardown_ec2_linux 2025-12-04T09:26:14.1666244Z # TODO: Stop building test binaries as part of the build phase 2025-12-04T09:26:14.1666438Z # Used for GPU_FLAG since that doesn't play nice 2025-12-04T09:26:14.1666633Z # shellcheck disable=SC2086,SC2090 2025-12-04T09:26:14.1666778Z container_name=$(docker run \ 2025-12-04T09:26:14.1666915Z  ${GPU_FLAG:-} \ 2025-12-04T09:26:14.1667041Z  -e BUILD_ENVIRONMENT \ 2025-12-04T09:26:14.1667172Z  -e PR_NUMBER \ 2025-12-04T09:26:14.1667300Z  -e GITHUB_ACTIONS \ 2025-12-04T09:26:14.1667427Z  -e GITHUB_REPOSITORY \ 2025-12-04T09:26:14.1667563Z  -e GITHUB_WORKFLOW \ 2025-12-04T09:26:14.1667684Z  -e GITHUB_JOB \ 2025-12-04T09:26:14.1667805Z  -e GITHUB_RUN_ID \ 2025-12-04T09:26:14.1667928Z  -e GITHUB_RUN_NUMBER \ 2025-12-04T09:26:14.1668060Z  -e GITHUB_RUN_ATTEMPT \ 2025-12-04T09:26:14.1668188Z  -e JOB_ID \ 2025-12-04T09:26:14.1668305Z  -e JOB_NAME \ 2025-12-04T09:26:14.1668423Z  -e BASE_SHA \ 2025-12-04T09:26:14.1668540Z  -e BRANCH \ 2025-12-04T09:26:14.1668652Z  -e SHA1 \ 2025-12-04T09:26:14.1668771Z  -e AWS_DEFAULT_REGION \ 2025-12-04T09:26:14.1668898Z  -e IN_WHEEL_TEST \ 2025-12-04T09:26:14.1669021Z  -e SHARD_NUMBER \ 2025-12-04T09:26:14.1669143Z  -e TEST_CONFIG \ 2025-12-04T09:26:14.1669267Z  -e NUM_TEST_SHARDS \ 2025-12-04T09:26:14.1669395Z  -e REENABLED_ISSUES \ 2025-12-04T09:26:14.1669534Z  -e CONTINUE_THROUGH_ERROR \ 2025-12-04T09:26:14.1669669Z  -e VERBOSE_TEST_LOGS \ 2025-12-04T09:26:14.1669797Z  -e TEST_SHOWLOCALS \ 2025-12-04T09:26:14.1669922Z  -e NO_TEST_TIMEOUT \ 2025-12-04T09:26:14.1670045Z  -e NO_TD \ 2025-12-04T09:26:14.1670174Z  -e MAX_JOBS="$(nproc --ignore=2)" \ 2025-12-04T09:26:14.1670326Z  -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK \ 2025-12-04T09:26:14.1670478Z  -e PYTORCH_TEST_RERUN_DISABLED_TESTS \ 2025-12-04T09:26:14.1670623Z  -e TESTS_TO_INCLUDE \ 2025-12-04T09:26:14.1670752Z  -e HUGGING_FACE_HUB_TOKEN \ 2025-12-04T09:26:14.1670885Z  -e DASHBOARD_TAG \ 2025-12-04T09:26:14.1671039Z  --env-file="${RUNNER_TEMP}/github_env_${GITHUB_RUN_ID}" \ 2025-12-04T09:26:14.1671210Z  --ulimit stack=10485760:83886080 \ 2025-12-04T09:26:14.1671344Z  --ulimit core=0 \ 2025-12-04T09:26:14.1671599Z  --env-file="/tmp/github_env_${GITHUB_RUN_ID}" \ 2025-12-04T09:26:14.1671761Z  --security-opt seccomp=unconfined \ 2025-12-04T09:26:14.1671909Z  --cap-add=SYS_PTRACE \ 2025-12-04T09:26:14.1672036Z  --shm-size="8g" \ 2025-12-04T09:26:14.1672151Z  --tty \ 2025-12-04T09:26:14.1672260Z  --detach \ 2025-12-04T09:26:14.1672384Z  --name="${container_name}" \ 2025-12-04T09:26:14.1672521Z  --user jenkins \ 2025-12-04T09:26:14.1672671Z  -v "${GITHUB_WORKSPACE}:/var/lib/jenkins/workspace" \ 2025-12-04T09:26:14.1672837Z  -w /var/lib/jenkins/workspace \ 2025-12-04T09:26:14.1673065Z  "${DOCKER_IMAGE}" 2025-12-04T09:26:14.1673182Z ) 2025-12-04T09:26:14.1673297Z # save container name for later step 2025-12-04T09:26:14.1673467Z echo "CONTAINER_NAME=${container_name}" >> "$GITHUB_ENV" 2025-12-04T09:26:14.1673748Z # jenkins user does not have write permission to mounted workspace; work-around by copying within container to jenkins home 2025-12-04T09:26:14.1674102Z docker exec -t "${container_name}" sh -c "cd .. && cp -R workspace pytorch && cd pytorch && pip install dist/*.whl && ${TEST_COMMAND}" 2025-12-04T09:26:14.1678146Z shell: /usr/bin/bash -e {0} 2025-12-04T09:26:14.1678268Z env: 2025-12-04T09:26:14.1678374Z GIT_DEFAULT_BRANCH: main 2025-12-04T09:26:14.1678522Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T09:26:14.1678710Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T09:26:14.1678886Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T09:26:14.1679284Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T09:26:14.1679672Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T09:26:14.1679803Z AWS_REGION: us-east-1 2025-12-04T09:26:14.1680009Z AWS_ACCESS_KEY_ID: *** 2025-12-04T09:26:14.1680177Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T09:26:14.1682308Z AWS_SESSION_TOKEN: *** 2025-12-04T09:26:14.1682446Z BUILD_ENVIRONMENT: linux-noble-rocm-py3.12-mi300 2025-12-04T09:26:14.1682590Z PR_NUMBER: 2025-12-04T09:26:14.1682702Z GITHUB_REPOSITORY: pytorch/pytorch 2025-12-04T09:26:14.1682837Z GITHUB_WORKFLOW: rocm-mi300 2025-12-04T09:26:14.1683001Z GITHUB_JOB: test 2025-12-04T09:26:14.1683110Z GITHUB_RUN_ID: 19922812470 2025-12-04T09:26:14.1683233Z GITHUB_RUN_NUMBER: 14122 2025-12-04T09:26:14.1683352Z GITHUB_RUN_ATTEMPT: 1 2025-12-04T09:26:14.1683463Z JOB_ID: 57116139360 2025-12-04T09:26:14.1683672Z JOB_NAME: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:14.1683891Z BRANCH: main 2025-12-04T09:26:14.1684014Z SHA1: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:14.1684176Z BASE_SHA: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:14.1684319Z TEST_CONFIG: default 2025-12-04T09:26:14.1684429Z SHARD_NUMBER: 6 2025-12-04T09:26:14.1684529Z NUM_TEST_SHARDS: 6 2025-12-04T09:26:14.1684633Z REENABLED_ISSUES: 2025-12-04T09:26:14.1684743Z CONTINUE_THROUGH_ERROR: True 2025-12-04T09:26:14.1684865Z VERBOSE_TEST_LOGS: False 2025-12-04T09:26:14.1684980Z TEST_SHOWLOCALS: False 2025-12-04T09:26:14.1685093Z NO_TEST_TIMEOUT: False 2025-12-04T09:26:14.1685200Z NO_TD: False 2025-12-04T09:26:14.1685469Z DOCKER_IMAGE: 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T09:26:14.1685769Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK: 0 2025-12-04T09:26:14.1685907Z PYTORCH_TEST_RERUN_DISABLED_TESTS: 1 2025-12-04T09:26:14.1686035Z TESTS_TO_INCLUDE: 2025-12-04T09:26:14.1686140Z DASHBOARD_TAG: 2025-12-04T09:26:14.1686291Z HUGGING_FACE_HUB_TOKEN: *** 2025-12-04T09:26:14.1686459Z ##[endgroup] 2025-12-04T09:26:14.1702545Z + [[ default == \m\u\l\t\i\g\p\u ]] 2025-12-04T09:26:14.1702697Z + [[ linux-noble-rocm-py3.12-mi300 == *onnx* ]] 2025-12-04T09:26:14.1702846Z + TEST_COMMAND=.ci/pytorch/test.sh 2025-12-04T09:26:14.1708091Z +++ nproc --ignore=2 2025-12-04T09:26:14.1715549Z ++ docker run --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host -e BUILD_ENVIRONMENT -e PR_NUMBER -e GITHUB_ACTIONS -e GITHUB_REPOSITORY -e GITHUB_WORKFLOW -e GITHUB_JOB -e GITHUB_RUN_ID -e GITHUB_RUN_NUMBER -e GITHUB_RUN_ATTEMPT -e JOB_ID -e JOB_NAME -e BASE_SHA -e BRANCH -e SHA1 -e AWS_DEFAULT_REGION -e IN_WHEEL_TEST -e SHARD_NUMBER -e TEST_CONFIG -e NUM_TEST_SHARDS -e REENABLED_ISSUES -e CONTINUE_THROUGH_ERROR -e VERBOSE_TEST_LOGS -e TEST_SHOWLOCALS -e NO_TEST_TIMEOUT -e NO_TD -e MAX_JOBS=126 -e PYTORCH_TEST_CUDA_MEM_LEAK_CHECK -e PYTORCH_TEST_RERUN_DISABLED_TESTS -e TESTS_TO_INCLUDE -e HUGGING_FACE_HUB_TOKEN -e DASHBOARD_TAG --env-file=/home/runner/_work/_temp/github_env_19922812470 --ulimit stack=10485760:83886080 --ulimit core=0 --env-file=/tmp/github_env_19922812470 --security-opt seccomp=unconfined --cap-add=SYS_PTRACE --shm-size=8g --tty --detach --name= --user jenkins -v /home/runner/_work/pytorch/pytorch:/var/lib/jenkins/workspace -w /var/lib/jenkins/workspace 308535385114.dkr.ecr.us-east-1.amazonaws.com/pytorch/ci-image:pytorch-linux-noble-rocm-n-py3-f0cd68561080d537ef3d3d6f81b25a6416ad600a 2025-12-04T09:26:14.4208269Z + container_name=ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T09:26:14.4208687Z + echo CONTAINER_NAME=ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T09:26:14.4209237Z + docker exec -t ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 sh -c 'cd .. && cp -R workspace pytorch && cd pytorch && pip install dist/*.whl && .ci/pytorch/test.sh' 2025-12-04T09:26:17.7154166Z Processing ./dist/torch-2.10.0a0+gitffd9b0f-cp312-cp312-linux_x86_64.whl 2025-12-04T09:26:18.2574223Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (3.18.0) 2025-12-04T09:26:18.2575136Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (4.12.2) 2025-12-04T09:26:18.2578647Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (78.1.1) 2025-12-04T09:26:18.2579467Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (1.13.3) 2025-12-04T09:26:18.2580234Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (2.8.8) 2025-12-04T09:26:18.2581033Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (3.1.6) 2025-12-04T09:26:18.2581829Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch==2.10.0a0+gitffd9b0f) (2025.10.0) 2025-12-04T09:26:18.2628969Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch==2.10.0a0+gitffd9b0f) (1.3.0) 2025-12-04T09:26:18.2648101Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch==2.10.0a0+gitffd9b0f) (3.0.3) 2025-12-04T09:26:18.4037827Z Installing collected packages: torch 2025-12-04T09:26:24.3034101Z Successfully installed torch-2.10.0a0+gitffd9b0f 2025-12-04T09:26:24.3545375Z + export TERM=vt100 2025-12-04T09:26:24.3548599Z + TERM=vt100 2025-12-04T09:26:24.3549175Z ++ dirname .ci/pytorch/test.sh 2025-12-04T09:26:24.3556624Z + source .ci/pytorch/common.sh 2025-12-04T09:26:24.3559307Z +++ dirname .ci/pytorch/common.sh 2025-12-04T09:26:24.3567127Z ++ source .ci/pytorch/common_utils.sh 2025-12-04T09:26:24.3568869Z +++ declare -f -t trap_add 2025-12-04T09:26:24.3573182Z ++ set -ex -o pipefail 2025-12-04T09:26:24.3573442Z ++ [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-12-04T09:26:24.3573678Z ++ unset HIP_PLATFORM 2025-12-04T09:26:24.3573859Z ++ export PYTORCH_TEST_WITH_ROCM=1 2025-12-04T09:26:24.3574074Z ++ PYTORCH_TEST_WITH_ROCM=1 2025-12-04T09:26:24.3574264Z ++ BUILD_TEST_LIBTORCH=0 2025-12-04T09:26:24.3577235Z ++ dirname .ci/pytorch/test.sh 2025-12-04T09:26:24.3586318Z + source .ci/pytorch/common-build.sh 2025-12-04T09:26:24.3586718Z ++ [[ linux-noble-rocm-py3.12-mi300 != *win-* ]] 2025-12-04T09:26:24.3594234Z ++++ dirname .ci/pytorch/common-build.sh 2025-12-04T09:26:24.3605576Z +++ cd .ci/pytorch 2025-12-04T09:26:24.3605797Z +++ pwd -P 2025-12-04T09:26:24.3607731Z ++ script_dir=/var/lib/jenkins/pytorch/.ci/pytorch 2025-12-04T09:26:24.3609274Z ++ [[ linux-noble-rocm-py3.12-mi300 == *-pch* ]] 2025-12-04T09:26:24.3609798Z ++ which sccache 2025-12-04T09:26:24.3619008Z ++ [[ -z '' ]] 2025-12-04T09:26:24.3619218Z ++ unset SCCACHE_BUCKET 2025-12-04T09:26:24.3619431Z ++ unset SCCACHE_REGION 2025-12-04T09:26:24.3619639Z ++ sccache --stop-server 2025-12-04T09:26:24.3634505Z ++ true 2025-12-04T09:26:24.3634695Z ++ rm -f /var/lib/jenkins/sccache_error.log 2025-12-04T09:26:24.3642888Z ++ trap_add sccache_epilogue EXIT 2025-12-04T09:26:24.3643181Z ++ trap_add_cmd=sccache_epilogue 2025-12-04T09:26:24.3643386Z ++ shift 2025-12-04T09:26:24.3643567Z ++ for trap_add_name in "$@" 2025-12-04T09:26:24.3648085Z ++++ trap -p EXIT 2025-12-04T09:26:24.3649269Z +++ eval 'extract_trap_cmd ' 2025-12-04T09:26:24.3649490Z ++++ extract_trap_cmd 2025-12-04T09:26:24.3649677Z ++++ printf '%s\n' '' 2025-12-04T09:26:24.3649876Z +++ printf '%s\n' sccache_epilogue 2025-12-04T09:26:24.3651623Z ++ trap -- ' 2025-12-04T09:26:24.3651792Z sccache_epilogue' EXIT 2025-12-04T09:26:24.3651974Z ++ [[ -n '' ]] 2025-12-04T09:26:24.3652173Z ++ [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-12-04T09:26:24.3652449Z ++ SCCACHE_ERROR_LOG=/var/lib/jenkins/sccache_error.log 2025-12-04T09:26:24.3652702Z ++ SCCACHE_IDLE_TIMEOUT=0 2025-12-04T09:26:24.3652901Z ++ sccache --start-server 2025-12-04T09:26:24.3662738Z sccache: Starting the server... 2025-12-04T09:26:24.3857176Z sccache: Listening on address 127.0.0.1:4226 2025-12-04T09:26:24.3866479Z ++ sccache --zero-stats 2025-12-04T09:26:24.3880948Z Statistics zeroed. 2025-12-04T09:26:24.3886665Z ++ which ccache 2025-12-04T09:26:24.3899180Z + [[ linux-noble-rocm-py3.12-mi300 != *rocm* ]] 2025-12-04T09:26:24.3899422Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-12-04T09:26:24.3910486Z + echo 'Environment variables:' 2025-12-04T09:26:24.3910704Z Environment variables: 2025-12-04T09:26:24.3910852Z + env 2025-12-04T09:26:24.3911144Z GITHUB_WORKSPACE=/home/runner/_work/pytorch/pytorch 2025-12-04T09:26:24.3911369Z CONTINUE_THROUGH_ERROR=True 2025-12-04T09:26:24.3911560Z BUILD_ENVIRONMENT=linux-noble-rocm-py3.12-mi300 2025-12-04T09:26:24.3911790Z HOSTNAME=linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T09:26:24.3912117Z GITHUB_PATH=/home/runner/_work/_temp/_runner_file_commands/add_path_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3912395Z GITHUB_ACTION=__run_2 2025-12-04T09:26:24.3912554Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-12-04T09:26:24.3912733Z GITHUB_RUN_NUMBER=14122 2025-12-04T09:26:24.3912875Z TEST_CONFIG=default 2025-12-04T09:26:24.3913110Z RUNNER_NAME=linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T09:26:24.3913334Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-12-04T09:26:24.3913528Z AWS_DEFAULT_REGION=us-east-1 2025-12-04T09:26:24.3913683Z RUNNER_ARTIFACT_DIR=/home/runner/_work/_temp/artifacts 2025-12-04T09:26:24.3913853Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-12-04T09:26:24.3913995Z GITHUB_REF_TYPE=branch 2025-12-04T09:26:24.3914132Z BASE_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3914463Z HUGGING_FACE_HUB_TOKEN=*** 2025-12-04T09:26:24.3915273Z *** 2025-12-04T09:26:24.3915386Z GITHUB_REPOSITORY_ID=65600975 2025-12-04T09:26:24.3915516Z GITHUB_ACTIONS=true 2025-12-04T09:26:24.3915649Z SHA1=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3915817Z GITHUB_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3916034Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/rocm-mi300.yml@refs/heads/main 2025-12-04T09:26:24.3916235Z UCC_HOME=/usr 2025-12-04T09:26:24.3916351Z RUNNER_ENVIRONMENT=self-hosted 2025-12-04T09:26:24.3916485Z VERBOSE_TEST_LOGS=False 2025-12-04T09:26:24.3916606Z GITHUB_REF=refs/heads/main 2025-12-04T09:26:24.3916729Z RUNNER_OS=Linux 2025-12-04T09:26:24.3916838Z SHARD_NUMBER=6 2025-12-04T09:26:24.3917012Z GITHUB_REF_PROTECTED=true 2025-12-04T09:26:24.3917139Z RUNNER_MANUALLY_TRAP_SIG=1 2025-12-04T09:26:24.3917259Z HOME=/var/lib/jenkins 2025-12-04T09:26:24.3917394Z GITHUB_API_URL=https://api.github.com 2025-12-04T09:26:24.3917545Z PYTORCH_TEST_RERUN_DISABLED_TESTS=1 2025-12-04T09:26:24.3917702Z RUNNER_DOCS_DIR=/home/runner/_work/_temp/docs 2025-12-04T09:26:24.3917843Z LANG=C.UTF-8 2025-12-04T09:26:24.3917973Z UCX_COMMIT=29831d319e6be55cb8c768ca61de335c934ca39e 2025-12-04T09:26:24.3918128Z PYTORCH_TEST_WITH_ROCM=1 2025-12-04T09:26:24.3918286Z RUNNER_TRACKING_ID=github_0ef10b1a-56ca-4445-a225-c9f88dce693c 2025-12-04T09:26:24.3918451Z RUNNER_ARCH=X64 2025-12-04T09:26:24.3918566Z RUNNER_TEMP=/home/runner/_work/_temp 2025-12-04T09:26:24.3918698Z NUM_TEST_SHARDS=6 2025-12-04T09:26:24.3918807Z UCX_HOME=/usr 2025-12-04T09:26:24.3919009Z GITHUB_STATE=/home/runner/_work/_temp/_runner_file_commands/save_state_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3919342Z JOB_NAME=linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:24.3919573Z MAGMA_HOME=/opt/rocm/magma 2025-12-04T09:26:24.3919777Z GITHUB_ENV=/home/runner/_work/_temp/_runner_file_commands/set_env_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3920036Z GITHUB_EVENT_PATH=/home/runner/_work/_temp/_github_workflow/event.json 2025-12-04T09:26:24.3920218Z GITHUB_EVENT_NAME=schedule 2025-12-04T09:26:24.3920384Z GITHUB_ACTIONS_RUNNER_EXTRA_USER_AGENT=actions-runner-controller/0.12.1 2025-12-04T09:26:24.3920558Z DASHBOARD_TAG= 2025-12-04T09:26:24.3920660Z GITHUB_RUN_ID=19922812470 2025-12-04T09:26:24.3920885Z GITHUB_STEP_SUMMARY=/home/runner/_work/_temp/_runner_file_commands/step_summary_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3921122Z GITHUB_ACTOR=pytorchmergebot 2025-12-04T09:26:24.3921241Z PR_NUMBER= 2025-12-04T09:26:24.3921342Z GITHUB_RUN_ATTEMPT=1 2025-12-04T09:26:24.3921460Z ANACONDA_PYTHON_VERSION=3.12 2025-12-04T09:26:24.3921606Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-12-04T09:26:24.3921757Z TERM=vt100 2025-12-04T09:26:24.3921858Z INSTALLED_VISION=yes 2025-12-04T09:26:24.3921970Z BRANCH=main 2025-12-04T09:26:24.3922080Z OPENSSL_ROOT_DIR=/opt/openssl 2025-12-04T09:26:24.3922204Z TESTS_TO_INCLUDE= 2025-12-04T09:26:24.3922378Z GITHUB_ACTION_PATH=/home/runner/_work/pytorch/pytorch/./.github/actions/setup-rocm 2025-12-04T09:26:24.3922587Z GITHUB_SERVER_URL=https://github.com 2025-12-04T09:26:24.3922741Z PYTORCH_ROCM_ARCH=gfx90a;gfx942;gfx950;gfx1100 2025-12-04T09:26:24.3922905Z UCC_COMMIT=9f4b242cbbd8b1462cbc732eb29316cdfa124b77 2025-12-04T09:26:24.3923126Z REENABLED_ISSUES= 2025-12-04T09:26:24.3923230Z SHLVL=1 2025-12-04T09:26:24.3923324Z MAX_JOBS=126 2025-12-04T09:26:24.3923464Z RUNNER_TEST_RESULTS_DIR=/home/runner/_work/_temp/test-results 2025-12-04T09:26:24.3923628Z GITHUB_ACTOR_ID=97764156 2025-12-04T09:26:24.3923754Z RUNNER_TOOL_CACHE=/home/runner/_work/_tool 2025-12-04T09:26:24.3923920Z GITHUB_WORKFLOW_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3924079Z GITHUB_REF_NAME=main 2025-12-04T09:26:24.3924185Z ROCM_PATH=/opt/rocm 2025-12-04T09:26:24.3924290Z GITHUB_JOB=test 2025-12-04T09:26:24.3924392Z NO_TEST_TIMEOUT=False 2025-12-04T09:26:24.3924508Z GITHUB_REPOSITORY=pytorch/pytorch 2025-12-04T09:26:24.3924632Z LC_ALL=C.UTF-8 2025-12-04T09:26:24.3924786Z GITHUB_RETENTION_DAYS=90 2025-12-04T09:26:24.3924907Z RUNNER_WORKSPACE=/home/runner/_work/pytorch 2025-12-04T09:26:24.3925040Z OPENSSL_DIR=/opt/openssl 2025-12-04T09:26:24.3925154Z GITHUB_ACTION_REPOSITORY= 2025-12-04T09:26:24.3925515Z PATH=/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-12-04T09:26:24.3925865Z GITHUB_BASE_REF= 2025-12-04T09:26:24.3925964Z CI=true 2025-12-04T09:26:24.3926065Z GITHUB_REPOSITORY_OWNER=pytorch 2025-12-04T09:26:24.3926185Z JOB_ID=57116139360 2025-12-04T09:26:24.3926284Z GITHUB_HEAD_REF= 2025-12-04T09:26:24.3926419Z GITHUB_ACTION_REF= 2025-12-04T09:26:24.3926523Z TEST_SHOWLOCALS=False 2025-12-04T09:26:24.3926636Z GITHUB_WORKFLOW=rocm-mi300 2025-12-04T09:26:24.3926753Z DEBIAN_FRONTEND=noninteractive 2025-12-04T09:26:24.3926955Z GITHUB_OUTPUT=/home/runner/_work/_temp/_runner_file_commands/set_output_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3927173Z NO_TD=False 2025-12-04T09:26:24.3927266Z OLDPWD=/var/lib/jenkins 2025-12-04T09:26:24.3927382Z _=/usr/bin/env 2025-12-04T09:26:24.3927517Z ++ python -c 'import site; print(site.getsitepackages()[0])' 2025-12-04T09:26:24.3975329Z + TORCH_INSTALL_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch 2025-12-04T09:26:24.3975926Z + TORCH_BIN_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/bin 2025-12-04T09:26:24.3976222Z + TORCH_LIB_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/lib 2025-12-04T09:26:24.3976452Z + TORCH_TEST_DIR=/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/test 2025-12-04T09:26:24.3976651Z + BUILD_DIR=build 2025-12-04T09:26:24.3976770Z + BUILD_RENAMED_DIR=build_renamed 2025-12-04T09:26:24.3976900Z + BUILD_BIN_DIR=build/bin 2025-12-04T09:26:24.3977015Z + SHARD_NUMBER=6 2025-12-04T09:26:24.3977121Z + NUM_TEST_SHARDS=6 2025-12-04T09:26:24.3977238Z + export TORCH_SERIALIZATION_DEBUG=1 2025-12-04T09:26:24.3977381Z + TORCH_SERIALIZATION_DEBUG=1 2025-12-04T09:26:24.3977503Z + export VALGRIND=ON 2025-12-04T09:26:24.3977625Z + VALGRIND=ON 2025-12-04T09:26:24.3977748Z + [[ linux-noble-rocm-py3.12-mi300 == *clang9* ]] 2025-12-04T09:26:24.3977905Z + [[ linux-noble-rocm-py3.12-mi300 == *xpu* ]] 2025-12-04T09:26:24.3978030Z + detect_cuda_arch 2025-12-04T09:26:24.3978141Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-12-04T09:26:24.3978282Z + [[ linux-noble-rocm-py3.12-mi300 == *s390x* ]] 2025-12-04T09:26:24.3978405Z + [[ 1 == \1 ]] 2025-12-04T09:26:24.3978494Z + ulimit -c 0 2025-12-04T09:26:24.3978602Z + [[ linux-noble-rocm-py3.12-mi300 != *bazel* ]] 2025-12-04T09:26:24.3978750Z ++ realpath build/custom_test_artifacts 2025-12-04T09:26:24.3984445Z + CUSTOM_TEST_ARTIFACT_BUILD_DIR=/var/lib/jenkins/pytorch/build/custom_test_artifacts 2025-12-04T09:26:24.3984628Z + [[ -n '' ]] 2025-12-04T09:26:24.3984726Z + echo 'Environment variables' 2025-12-04T09:26:24.3984837Z Environment variables 2025-12-04T09:26:24.3984938Z + env 2025-12-04T09:26:24.3990020Z GITHUB_WORKSPACE=/home/runner/_work/pytorch/pytorch 2025-12-04T09:26:24.3990223Z CONTINUE_THROUGH_ERROR=True 2025-12-04T09:26:24.3990364Z BUILD_ENVIRONMENT=linux-noble-rocm-py3.12-mi300 2025-12-04T09:26:24.3990543Z HOSTNAME=linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T09:26:24.3990796Z GITHUB_PATH=/home/runner/_work/_temp/_runner_file_commands/add_path_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3991017Z GITHUB_ACTION=__run_2 2025-12-04T09:26:24.3991141Z PYTORCH_TEST_CUDA_MEM_LEAK_CHECK=0 2025-12-04T09:26:24.3991294Z GITHUB_RUN_NUMBER=14122 2025-12-04T09:26:24.3991408Z TEST_CONFIG=default 2025-12-04T09:26:24.3991559Z RUNNER_NAME=linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T09:26:24.3991722Z GITHUB_REPOSITORY_OWNER_ID=21003710 2025-12-04T09:26:24.3991859Z AWS_DEFAULT_REGION=us-east-1 2025-12-04T09:26:24.3992004Z RUNNER_ARTIFACT_DIR=/home/runner/_work/_temp/artifacts 2025-12-04T09:26:24.3992160Z GITHUB_TRIGGERING_ACTOR=pytorchmergebot 2025-12-04T09:26:24.3992447Z GITHUB_REF_TYPE=branch 2025-12-04T09:26:24.3992579Z BASE_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3992884Z HUGGING_FACE_HUB_TOKEN=*** 2025-12-04T09:26:24.3993142Z *** 2025-12-04T09:26:24.3993252Z GITHUB_REPOSITORY_ID=65600975 2025-12-04T09:26:24.3993383Z GITHUB_ACTIONS=true 2025-12-04T09:26:24.3993513Z SHA1=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3993671Z GITHUB_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.3993884Z GITHUB_WORKFLOW_REF=pytorch/pytorch/.github/workflows/rocm-mi300.yml@refs/heads/main 2025-12-04T09:26:24.3994076Z UCC_HOME=/usr 2025-12-04T09:26:24.3994185Z TORCH_SERIALIZATION_DEBUG=1 2025-12-04T09:26:24.3994415Z RUNNER_ENVIRONMENT=self-hosted 2025-12-04T09:26:24.3994543Z VERBOSE_TEST_LOGS=False 2025-12-04T09:26:24.3994660Z GITHUB_REF=refs/heads/main 2025-12-04T09:26:24.3994776Z RUNNER_OS=Linux 2025-12-04T09:26:24.3994881Z SHARD_NUMBER=6 2025-12-04T09:26:24.3994989Z GITHUB_REF_PROTECTED=true 2025-12-04T09:26:24.3995116Z RUNNER_MANUALLY_TRAP_SIG=1 2025-12-04T09:26:24.3995234Z HOME=/var/lib/jenkins 2025-12-04T09:26:24.3995370Z GITHUB_API_URL=https://api.github.com 2025-12-04T09:26:24.3995519Z PYTORCH_TEST_RERUN_DISABLED_TESTS=1 2025-12-04T09:26:24.3995664Z RUNNER_DOCS_DIR=/home/runner/_work/_temp/docs 2025-12-04T09:26:24.3995800Z LANG=C.UTF-8 2025-12-04T09:26:24.3995922Z UCX_COMMIT=29831d319e6be55cb8c768ca61de335c934ca39e 2025-12-04T09:26:24.3996070Z PYTORCH_TEST_WITH_ROCM=1 2025-12-04T09:26:24.3996235Z RUNNER_TRACKING_ID=github_0ef10b1a-56ca-4445-a225-c9f88dce693c 2025-12-04T09:26:24.3996393Z RUNNER_ARCH=X64 2025-12-04T09:26:24.3996505Z RUNNER_TEMP=/home/runner/_work/_temp 2025-12-04T09:26:24.3996634Z NUM_TEST_SHARDS=6 2025-12-04T09:26:24.3996734Z UCX_HOME=/usr 2025-12-04T09:26:24.3996927Z GITHUB_STATE=/home/runner/_work/_temp/_runner_file_commands/save_state_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3997243Z JOB_NAME=linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T09:26:24.3997467Z MAGMA_HOME=/opt/rocm/magma 2025-12-04T09:26:24.3997665Z GITHUB_ENV=/home/runner/_work/_temp/_runner_file_commands/set_env_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3997983Z GITHUB_EVENT_PATH=/home/runner/_work/_temp/_github_workflow/event.json 2025-12-04T09:26:24.3998172Z GITHUB_EVENT_NAME=schedule 2025-12-04T09:26:24.3998335Z GITHUB_ACTIONS_RUNNER_EXTRA_USER_AGENT=actions-runner-controller/0.12.1 2025-12-04T09:26:24.3998504Z DASHBOARD_TAG= 2025-12-04T09:26:24.3998607Z GITHUB_RUN_ID=19922812470 2025-12-04T09:26:24.3998823Z GITHUB_STEP_SUMMARY=/home/runner/_work/_temp/_runner_file_commands/step_summary_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.3999061Z GITHUB_ACTOR=pytorchmergebot 2025-12-04T09:26:24.3999178Z PR_NUMBER= 2025-12-04T09:26:24.3999276Z GITHUB_RUN_ATTEMPT=1 2025-12-04T09:26:24.3999382Z VALGRIND=ON 2025-12-04T09:26:24.3999484Z ANACONDA_PYTHON_VERSION=3.12 2025-12-04T09:26:24.3999629Z GITHUB_GRAPHQL_URL=https://api.github.com/graphql 2025-12-04T09:26:24.3999770Z TERM=vt100 2025-12-04T09:26:24.3999866Z INSTALLED_VISION=yes 2025-12-04T09:26:24.3999972Z BRANCH=main 2025-12-04T09:26:24.4000074Z OPENSSL_ROOT_DIR=/opt/openssl 2025-12-04T09:26:24.4000192Z TESTS_TO_INCLUDE= 2025-12-04T09:26:24.4000360Z GITHUB_ACTION_PATH=/home/runner/_work/pytorch/pytorch/./.github/actions/setup-rocm 2025-12-04T09:26:24.4000556Z GITHUB_SERVER_URL=https://github.com 2025-12-04T09:26:24.4000701Z PYTORCH_ROCM_ARCH=gfx90a;gfx942;gfx950;gfx1100 2025-12-04T09:26:24.4000859Z UCC_COMMIT=9f4b242cbbd8b1462cbc732eb29316cdfa124b77 2025-12-04T09:26:24.4001001Z REENABLED_ISSUES= 2025-12-04T09:26:24.4001096Z SHLVL=1 2025-12-04T09:26:24.4001184Z MAX_JOBS=126 2025-12-04T09:26:24.4001314Z RUNNER_TEST_RESULTS_DIR=/home/runner/_work/_temp/test-results 2025-12-04T09:26:24.4001465Z GITHUB_ACTOR_ID=97764156 2025-12-04T09:26:24.4001578Z RUNNER_TOOL_CACHE=/home/runner/_work/_tool 2025-12-04T09:26:24.4001735Z GITHUB_WORKFLOW_SHA=ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T09:26:24.4001926Z GITHUB_REF_NAME=main 2025-12-04T09:26:24.4002026Z ROCM_PATH=/opt/rocm 2025-12-04T09:26:24.4002122Z GITHUB_JOB=test 2025-12-04T09:26:24.4002217Z NO_TEST_TIMEOUT=False 2025-12-04T09:26:24.4002331Z GITHUB_REPOSITORY=pytorch/pytorch 2025-12-04T09:26:24.4002451Z LC_ALL=C.UTF-8 2025-12-04T09:26:24.4002549Z GITHUB_RETENTION_DAYS=90 2025-12-04T09:26:24.4002671Z RUNNER_WORKSPACE=/home/runner/_work/pytorch 2025-12-04T09:26:24.4002804Z OPENSSL_DIR=/opt/openssl 2025-12-04T09:26:24.4002916Z GITHUB_ACTION_REPOSITORY= 2025-12-04T09:26:24.4003354Z PATH=/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-12-04T09:26:24.4003704Z GITHUB_BASE_REF= 2025-12-04T09:26:24.4003798Z CI=true 2025-12-04T09:26:24.4003894Z GITHUB_REPOSITORY_OWNER=pytorch 2025-12-04T09:26:24.4004006Z JOB_ID=57116139360 2025-12-04T09:26:24.4004103Z GITHUB_HEAD_REF= 2025-12-04T09:26:24.4004199Z GITHUB_ACTION_REF= 2025-12-04T09:26:24.4004296Z TEST_SHOWLOCALS=False 2025-12-04T09:26:24.4004403Z GITHUB_WORKFLOW=rocm-mi300 2025-12-04T09:26:24.4004517Z DEBIAN_FRONTEND=noninteractive 2025-12-04T09:26:24.4004724Z GITHUB_OUTPUT=/home/runner/_work/_temp/_runner_file_commands/set_output_dafa2f67-5b57-4c53-896f-bda6c3c2cc3d 2025-12-04T09:26:24.4004932Z NO_TD=False 2025-12-04T09:26:24.4005023Z OLDPWD=/var/lib/jenkins 2025-12-04T09:26:24.4005124Z _=/usr/bin/env 2025-12-04T09:26:24.4005218Z + echo 'Testing pytorch' 2025-12-04T09:26:24.4005323Z Testing pytorch 2025-12-04T09:26:24.4005424Z + export LANG=C.UTF-8 2025-12-04T09:26:24.4005526Z + LANG=C.UTF-8 2025-12-04T09:26:24.4005616Z + PR_NUMBER= 2025-12-04T09:26:24.4005717Z + [[ default == \d\e\f\a\u\l\t ]] 2025-12-04T09:26:24.4005837Z + export CUDA_VISIBLE_DEVICES=0 2025-12-04T09:26:24.4005954Z + CUDA_VISIBLE_DEVICES=0 2025-12-04T09:26:24.4006063Z + export HIP_VISIBLE_DEVICES=0 2025-12-04T09:26:24.4006176Z + HIP_VISIBLE_DEVICES=0 2025-12-04T09:26:24.4006292Z + [[ default == \d\i\s\t\r\i\b\u\t\e\d ]] 2025-12-04T09:26:24.4006416Z + [[ default == \s\l\o\w ]] 2025-12-04T09:26:24.4006554Z + [[ linux-noble-rocm-py3.12-mi300 == *slow-gradcheck* ]] 2025-12-04T09:26:24.4006716Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-12-04T09:26:24.4006860Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-12-04T09:26:24.4007002Z + export PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2025-12-04T09:26:24.4007139Z + PYTORCH_TESTING_DEVICE_ONLY_FOR=cuda 2025-12-04T09:26:24.4007264Z + [[ default == *crossref* ]] 2025-12-04T09:26:24.4007388Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-12-04T09:26:24.4007515Z + export VALGRIND=OFF 2025-12-04T09:26:24.4007621Z + VALGRIND=OFF 2025-12-04T09:26:24.4007714Z + rocminfo 2025-12-04T09:26:24.4113640Z ROCk module version 6.12.12 is loaded 2025-12-04T09:26:24.4502463Z ===================== 2025-12-04T09:26:24.4502864Z HSA System Attributes 2025-12-04T09:26:24.4503229Z ===================== 2025-12-04T09:26:24.4503527Z Runtime Version: 1.18 2025-12-04T09:26:24.4503836Z Runtime Ext Version: 1.14 2025-12-04T09:26:24.4504159Z System Timestamp Freq.: 1000.000000MHz 2025-12-04T09:26:24.4504680Z Sig. Max Wait Duration: 18446744073709551615 (0xFFFFFFFFFFFFFFFF) (timestamp count) 2025-12-04T09:26:24.4505232Z Machine Model: LARGE 2025-12-04T09:26:24.4505720Z System Endianness: LITTLE 2025-12-04T09:26:24.4506121Z Mwaitx: DISABLED 2025-12-04T09:26:24.4506439Z XNACK enabled: NO 2025-12-04T09:26:24.4506746Z DMAbuf Support: YES 2025-12-04T09:26:24.4507044Z VMM Support: YES 2025-12-04T09:26:24.4507239Z 2025-12-04T09:26:24.4507351Z ========== 2025-12-04T09:26:24.4507636Z HSA Agents 2025-12-04T09:26:24.4507907Z ========== 2025-12-04T09:26:24.4508174Z ******* 2025-12-04T09:26:24.4508440Z Agent 1 2025-12-04T09:26:24.4508848Z ******* 2025-12-04T09:26:24.4509187Z Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.4509604Z Uuid: CPU-XX 2025-12-04T09:26:24.4510040Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.4510491Z Vendor Name: CPU 2025-12-04T09:26:24.4510915Z Feature: None specified 2025-12-04T09:26:24.4511333Z Profile: FULL_PROFILE 2025-12-04T09:26:24.4511763Z Float Round Mode: NEAR 2025-12-04T09:26:24.4512286Z Max Queue Number: 0(0x0) 2025-12-04T09:26:24.4512710Z Queue Min Size: 0(0x0) 2025-12-04T09:26:24.4513229Z Queue Max Size: 0(0x0) 2025-12-04T09:26:24.4513444Z Queue Type: MULTI 2025-12-04T09:26:24.4513593Z Node: 0 2025-12-04T09:26:24.4513740Z Device Type: CPU 2025-12-04T09:26:24.4513878Z Cache Info: 2025-12-04T09:26:24.4514002Z L1: 49152(0xc000) KB 2025-12-04T09:26:24.4514144Z Chip ID: 0(0x0) 2025-12-04T09:26:24.4514295Z ASIC Revision: 0(0x0) 2025-12-04T09:26:24.4514454Z Cacheline Size: 64(0x40) 2025-12-04T09:26:24.4514615Z Max Clock Freq. (MHz): 3300 2025-12-04T09:26:24.4514766Z BDFID: 0 2025-12-04T09:26:24.4514916Z Internal Node ID: 0 2025-12-04T09:26:24.4515071Z Compute Unit: 64 2025-12-04T09:26:24.4515228Z SIMDs per CU: 0 2025-12-04T09:26:24.4515384Z Shader Engines: 0 2025-12-04T09:26:24.4515543Z Shader Arrs. per Eng.: 0 2025-12-04T09:26:24.4515707Z WatchPts on Addr. Ranges:1 2025-12-04T09:26:24.4515855Z Memory Properties: 2025-12-04T09:26:24.4515971Z Features: None 2025-12-04T09:26:24.4516085Z Pool Info: 2025-12-04T09:26:24.4516193Z Pool 1 2025-12-04T09:26:24.4516381Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T09:26:24.4516545Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T09:26:24.4516700Z Allocatable: TRUE 2025-12-04T09:26:24.4516862Z Alloc Granule: 4KB 2025-12-04T09:26:24.4517030Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4517197Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4517360Z Accessible by all: TRUE 2025-12-04T09:26:24.4517500Z Pool 2 2025-12-04T09:26:24.4517634Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T09:26:24.4517788Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T09:26:24.4517939Z Allocatable: TRUE 2025-12-04T09:26:24.4518098Z Alloc Granule: 4KB 2025-12-04T09:26:24.4518266Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4518433Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4518594Z Accessible by all: TRUE 2025-12-04T09:26:24.4518799Z Pool 3 2025-12-04T09:26:24.4518933Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-12-04T09:26:24.4519084Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T09:26:24.4519235Z Allocatable: TRUE 2025-12-04T09:26:24.4519394Z Alloc Granule: 4KB 2025-12-04T09:26:24.4519559Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4519727Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4519888Z Accessible by all: TRUE 2025-12-04T09:26:24.4520079Z Pool 4 2025-12-04T09:26:24.4520212Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T09:26:24.4520361Z Size: 1584778268(0x5e75cc1c) KB 2025-12-04T09:26:24.4520510Z Allocatable: TRUE 2025-12-04T09:26:24.4520671Z Alloc Granule: 4KB 2025-12-04T09:26:24.4520835Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4521000Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4521161Z Accessible by all: TRUE 2025-12-04T09:26:24.4521302Z ISA Info: 2025-12-04T09:26:24.4521409Z ******* 2025-12-04T09:26:24.4521516Z Agent 2 2025-12-04T09:26:24.4521617Z ******* 2025-12-04T09:26:24.4521749Z Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.4521910Z Uuid: CPU-XX 2025-12-04T09:26:24.4522078Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.4522247Z Vendor Name: CPU 2025-12-04T09:26:24.4522416Z Feature: None specified 2025-12-04T09:26:24.4522575Z Profile: FULL_PROFILE 2025-12-04T09:26:24.4522739Z Float Round Mode: NEAR 2025-12-04T09:26:24.4522902Z Max Queue Number: 0(0x0) 2025-12-04T09:26:24.4523102Z Queue Min Size: 0(0x0) 2025-12-04T09:26:24.4523261Z Queue Max Size: 0(0x0) 2025-12-04T09:26:24.4523420Z Queue Type: MULTI 2025-12-04T09:26:24.4523572Z Node: 1 2025-12-04T09:26:24.4523732Z Device Type: CPU 2025-12-04T09:26:24.4523878Z Cache Info: 2025-12-04T09:26:24.4524007Z L1: 49152(0xc000) KB 2025-12-04T09:26:24.4524155Z Chip ID: 0(0x0) 2025-12-04T09:26:24.4524316Z ASIC Revision: 0(0x0) 2025-12-04T09:26:24.4524480Z Cacheline Size: 64(0x40) 2025-12-04T09:26:24.4524647Z Max Clock Freq. (MHz): 3300 2025-12-04T09:26:24.4524802Z BDFID: 0 2025-12-04T09:26:24.4524961Z Internal Node ID: 1 2025-12-04T09:26:24.4525124Z Compute Unit: 64 2025-12-04T09:26:24.4525283Z SIMDs per CU: 0 2025-12-04T09:26:24.4525445Z Shader Engines: 0 2025-12-04T09:26:24.4525611Z Shader Arrs. per Eng.: 0 2025-12-04T09:26:24.4525781Z WatchPts on Addr. Ranges:1 2025-12-04T09:26:24.4525935Z Memory Properties: 2025-12-04T09:26:24.4526098Z Features: None 2025-12-04T09:26:24.4526215Z Pool Info: 2025-12-04T09:26:24.4526330Z Pool 1 2025-12-04T09:26:24.4526470Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T09:26:24.4526629Z Size: 1585311844(0x5e7df064) KB 2025-12-04T09:26:24.4526788Z Allocatable: TRUE 2025-12-04T09:26:24.4526953Z Alloc Granule: 4KB 2025-12-04T09:26:24.4527127Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4527297Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4527499Z Accessible by all: TRUE 2025-12-04T09:26:24.4527646Z Pool 2 2025-12-04T09:26:24.4527783Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T09:26:24.4527939Z Size: 1585311844(0x5e7df064) KB 2025-12-04T09:26:24.4528098Z Allocatable: TRUE 2025-12-04T09:26:24.4528263Z Alloc Granule: 4KB 2025-12-04T09:26:24.4528435Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4528606Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4528775Z Accessible by all: TRUE 2025-12-04T09:26:24.4528920Z Pool 3 2025-12-04T09:26:24.4529058Z Segment: GLOBAL; FLAGS: KERNARG, FINE GRAINED 2025-12-04T09:26:24.4529222Z Size: 1585311844(0x5e7df064) KB 2025-12-04T09:26:24.4529384Z Allocatable: TRUE 2025-12-04T09:26:24.4529549Z Alloc Granule: 4KB 2025-12-04T09:26:24.4529719Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4529894Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4530062Z Accessible by all: TRUE 2025-12-04T09:26:24.4530207Z Pool 4 2025-12-04T09:26:24.4530344Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T09:26:24.4530500Z Size: 1585311844(0x5e7df064) KB 2025-12-04T09:26:24.4530656Z Allocatable: TRUE 2025-12-04T09:26:24.4530820Z Alloc Granule: 4KB 2025-12-04T09:26:24.4530996Z Alloc Recommended Granule:4KB 2025-12-04T09:26:24.4531168Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4531336Z Accessible by all: TRUE 2025-12-04T09:26:24.4531484Z ISA Info: 2025-12-04T09:26:24.4531600Z ******* 2025-12-04T09:26:24.4531710Z Agent 3 2025-12-04T09:26:24.4531812Z ******* 2025-12-04T09:26:24.4531935Z Name: gfx942 2025-12-04T09:26:24.4532090Z Uuid: GPU-f5e0b55322138365 2025-12-04T09:26:24.4532254Z Marketing Name: AMD Radeon Graphics 2025-12-04T09:26:24.4532425Z Vendor Name: AMD 2025-12-04T09:26:24.4532589Z Feature: KERNEL_DISPATCH 2025-12-04T09:26:24.4532751Z Profile: BASE_PROFILE 2025-12-04T09:26:24.4532919Z Float Round Mode: NEAR 2025-12-04T09:26:24.4533123Z Max Queue Number: 128(0x80) 2025-12-04T09:26:24.4533284Z Queue Min Size: 64(0x40) 2025-12-04T09:26:24.4533480Z Queue Max Size: 131072(0x20000) 2025-12-04T09:26:24.4533638Z Queue Type: MULTI 2025-12-04T09:26:24.4533788Z Node: 2 2025-12-04T09:26:24.4533942Z Device Type: GPU 2025-12-04T09:26:24.4534086Z Cache Info: 2025-12-04T09:26:24.4534209Z L1: 32(0x20) KB 2025-12-04T09:26:24.4534350Z L2: 4096(0x1000) KB 2025-12-04T09:26:24.4534492Z L3: 262144(0x40000) KB 2025-12-04T09:26:24.4534676Z Chip ID: 29861(0x74a5) 2025-12-04T09:26:24.4534832Z ASIC Revision: 1(0x1) 2025-12-04T09:26:24.4535000Z Cacheline Size: 128(0x80) 2025-12-04T09:26:24.4535166Z Max Clock Freq. (MHz): 2100 2025-12-04T09:26:24.4535328Z BDFID: 5376 2025-12-04T09:26:24.4535485Z Internal Node ID: 2 2025-12-04T09:26:24.4535649Z Compute Unit: 304 2025-12-04T09:26:24.4535809Z SIMDs per CU: 4 2025-12-04T09:26:24.4535973Z Shader Engines: 32 2025-12-04T09:26:24.4536138Z Shader Arrs. per Eng.: 1 2025-12-04T09:26:24.4536308Z WatchPts on Addr. Ranges:4 2025-12-04T09:26:24.4536484Z Coherent Host Access: FALSE 2025-12-04T09:26:24.4536638Z Memory Properties: 2025-12-04T09:26:24.4536766Z Features: KERNEL_DISPATCH 2025-12-04T09:26:24.4536920Z Fast F16 Operation: TRUE 2025-12-04T09:26:24.4537091Z Wavefront Size: 64(0x40) 2025-12-04T09:26:24.4537261Z Workgroup Max Size: 1024(0x400) 2025-12-04T09:26:24.4537417Z Workgroup Max Size per Dimension: 2025-12-04T09:26:24.4537553Z x 1024(0x400) 2025-12-04T09:26:24.4537692Z y 1024(0x400) 2025-12-04T09:26:24.4537831Z z 1024(0x400) 2025-12-04T09:26:24.4537984Z Max Waves Per CU: 32(0x20) 2025-12-04T09:26:24.4538149Z Max Work-item Per CU: 2048(0x800) 2025-12-04T09:26:24.4538319Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T09:26:24.4538470Z Grid Max Size per Dimension: 2025-12-04T09:26:24.4538597Z x 2147483647(0x7fffffff) 2025-12-04T09:26:24.4538736Z y 65535(0xffff) 2025-12-04T09:26:24.4538878Z z 65535(0xffff) 2025-12-04T09:26:24.4539036Z Max fbarriers/Workgrp: 32 2025-12-04T09:26:24.4539269Z Packet Processor uCode:: 185 2025-12-04T09:26:24.4539442Z SDMA engine uCode:: 24 2025-12-04T09:26:24.4539609Z IOMMU Support:: None 2025-12-04T09:26:24.4539757Z Pool Info: 2025-12-04T09:26:24.4539872Z Pool 1 2025-12-04T09:26:24.4540013Z Segment: GLOBAL; FLAGS: COARSE GRAINED 2025-12-04T09:26:24.4540177Z Size: 268419072(0xfffc000) KB 2025-12-04T09:26:24.4540338Z Allocatable: TRUE 2025-12-04T09:26:24.4540506Z Alloc Granule: 4KB 2025-12-04T09:26:24.4540679Z Alloc Recommended Granule:2048KB 2025-12-04T09:26:24.4540880Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4541050Z Accessible by all: FALSE 2025-12-04T09:26:24.4541195Z Pool 2 2025-12-04T09:26:24.4541330Z Segment: GLOBAL; FLAGS: EXTENDED FINE GRAINED 2025-12-04T09:26:24.4541482Z Size: 268419072(0xfffc000) KB 2025-12-04T09:26:24.4541636Z Allocatable: TRUE 2025-12-04T09:26:24.4541795Z Alloc Granule: 4KB 2025-12-04T09:26:24.4541989Z Alloc Recommended Granule:2048KB 2025-12-04T09:26:24.4542157Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4542321Z Accessible by all: FALSE 2025-12-04T09:26:24.4542462Z Pool 3 2025-12-04T09:26:24.4542597Z Segment: GLOBAL; FLAGS: FINE GRAINED 2025-12-04T09:26:24.4542749Z Size: 268419072(0xfffc000) KB 2025-12-04T09:26:24.4542902Z Allocatable: TRUE 2025-12-04T09:26:24.4543112Z Alloc Granule: 4KB 2025-12-04T09:26:24.4543277Z Alloc Recommended Granule:2048KB 2025-12-04T09:26:24.4543446Z Alloc Alignment: 4KB 2025-12-04T09:26:24.4543610Z Accessible by all: FALSE 2025-12-04T09:26:24.4543750Z Pool 4 2025-12-04T09:26:24.4543882Z Segment: GROUP 2025-12-04T09:26:24.4544032Z Size: 64(0x40) KB 2025-12-04T09:26:24.4544182Z Allocatable: FALSE 2025-12-04T09:26:24.4544343Z Alloc Granule: 0KB 2025-12-04T09:26:24.4544509Z Alloc Recommended Granule:0KB 2025-12-04T09:26:24.4544676Z Alloc Alignment: 0KB 2025-12-04T09:26:24.4544840Z Accessible by all: FALSE 2025-12-04T09:26:24.4544982Z ISA Info: 2025-12-04T09:26:24.4545091Z ISA 1 2025-12-04T09:26:24.4545228Z Name: amdgcn-amd-amdhsa--gfx942:sramecc+:xnack- 2025-12-04T09:26:24.4545398Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-12-04T09:26:24.4545568Z Profiles: HSA_PROFILE_BASE 2025-12-04T09:26:24.4545735Z Default Rounding Mode: NEAR 2025-12-04T09:26:24.4545904Z Default Rounding Mode: NEAR 2025-12-04T09:26:24.4546062Z Fast f16: TRUE 2025-12-04T09:26:24.4546221Z Workgroup Max Size: 1024(0x400) 2025-12-04T09:26:24.4546370Z Workgroup Max Size per Dimension: 2025-12-04T09:26:24.4546506Z x 1024(0x400) 2025-12-04T09:26:24.4546644Z y 1024(0x400) 2025-12-04T09:26:24.4546778Z z 1024(0x400) 2025-12-04T09:26:24.4546925Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T09:26:24.4547067Z Grid Max Size per Dimension: 2025-12-04T09:26:24.4547197Z x 2147483647(0x7fffffff) 2025-12-04T09:26:24.4547332Z y 65535(0xffff) 2025-12-04T09:26:24.4547467Z z 65535(0xffff) 2025-12-04T09:26:24.4547618Z FBarrier Max Size: 32 2025-12-04T09:26:24.4547804Z ISA 2 2025-12-04T09:26:24.4547949Z Name: amdgcn-amd-amdhsa--gfx9-4-generic:sramecc+:xnack- 2025-12-04T09:26:24.4548128Z Machine Models: HSA_MACHINE_MODEL_LARGE 2025-12-04T09:26:24.4548292Z Profiles: HSA_PROFILE_BASE 2025-12-04T09:26:24.4548457Z Default Rounding Mode: NEAR 2025-12-04T09:26:24.4548632Z Default Rounding Mode: NEAR 2025-12-04T09:26:24.4548790Z Fast f16: TRUE 2025-12-04T09:26:24.4548980Z Workgroup Max Size: 1024(0x400) 2025-12-04T09:26:24.4549131Z Workgroup Max Size per Dimension: 2025-12-04T09:26:24.4549263Z x 1024(0x400) 2025-12-04T09:26:24.4549399Z y 1024(0x400) 2025-12-04T09:26:24.4549537Z z 1024(0x400) 2025-12-04T09:26:24.4549684Z Grid Max Size: 4294967295(0xffffffff) 2025-12-04T09:26:24.4549827Z Grid Max Size per Dimension: 2025-12-04T09:26:24.4549951Z x 2147483647(0x7fffffff) 2025-12-04T09:26:24.4550088Z y 65535(0xffff) 2025-12-04T09:26:24.4550221Z z 65535(0xffff) 2025-12-04T09:26:24.4550371Z FBarrier Max Size: 32 2025-12-04T09:26:24.4550510Z *** Done *** 2025-12-04T09:26:24.4570370Z + rocminfo 2025-12-04T09:26:24.4570597Z + grep -E 'Name:.*\sgfx|Marketing' 2025-12-04T09:26:24.5030117Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.5030316Z Marketing Name: AMD EPYC 9575F 64-Core Processor 2025-12-04T09:26:24.5030563Z Name: gfx942 2025-12-04T09:26:24.5030750Z Marketing Name: AMD Radeon Graphics 2025-12-04T09:26:24.5078408Z + MAYBE_ROCM=rocm/ 2025-12-04T09:26:24.5078551Z + [[ linux-noble-rocm-py3.12-mi300 == *xpu* ]] 2025-12-04T09:26:24.5078708Z + [[ linux-noble-rocm-py3.12-mi300 != *-bazel-* ]] 2025-12-04T09:26:24.5078858Z + pip_install ninja==1.10.2 2025-12-04T09:26:24.5079011Z + pip_install_pkg='python3 -m pip install --progress-bar off' 2025-12-04T09:26:24.5079197Z + python3 -m pip install --progress-bar off ninja==1.10.2 2025-12-04T09:26:24.6947782Z Collecting ninja==1.10.2 2025-12-04T09:26:24.7246618Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl.metadata (5.0 kB) 2025-12-04T09:26:24.7416960Z Downloading ninja-1.10.2-py2.py3-none-manylinux_2_5_x86_64.manylinux1_x86_64.whl (108 kB) 2025-12-04T09:26:24.8561238Z Installing collected packages: ninja 2025-12-04T09:26:24.8561439Z Attempting uninstall: ninja 2025-12-04T09:26:24.8575965Z Found existing installation: ninja 1.11.1.4 2025-12-04T09:26:24.8587434Z Uninstalling ninja-1.11.1.4: 2025-12-04T09:26:24.8722604Z Successfully uninstalled ninja-1.11.1.4 2025-12-04T09:26:24.8820163Z Successfully installed ninja-1.10.2 2025-12-04T09:26:24.9297907Z + export PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-12-04T09:26:24.9299831Z + PATH=/var/lib/jenkins/.local/bin:/opt/cache/bin:/opt/rocm/llvm/bin:/opt/rocm/opencl/bin:/opt/rocm/hip/bin:/opt/rocm/hcc/bin:/opt/rocm/bin:/opt/conda/envs/py_3.12/bin:/opt/conda/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin 2025-12-04T09:26:24.9300989Z + [[ linux-noble-rocm-py3.12-mi300 == *aarch64* ]] 2025-12-04T09:26:24.9301419Z + [[ linux-noble-rocm-py3.12-mi300 == *asan* ]] 2025-12-04T09:26:24.9302025Z + [[ linux-noble-rocm-py3.12-mi300 == *-debug* ]] 2025-12-04T09:26:24.9302435Z + [[ linux-noble-rocm-py3.12-mi300 != *-bazel-* ]] 2025-12-04T09:26:24.9303072Z + echo 'We are not in debug mode: linux-noble-rocm-py3.12-mi300. Expect the assertion to pass' 2025-12-04T09:26:24.9303512Z We are not in debug mode: linux-noble-rocm-py3.12-mi300. Expect the assertion to pass 2025-12-04T09:26:24.9303742Z + cd test 2025-12-04T09:26:24.9303913Z + python -c 'import torch; torch._C._crash_if_debug_asserts_fail(424242)' 2025-12-04T09:26:25.8469753Z + [[ default == \n\o\g\p\u\_\N\O\_\A\V\X\2 ]] 2025-12-04T09:26:25.8470005Z + [[ default == \n\o\g\p\u\_\A\V\X\5\1\2 ]] 2025-12-04T09:26:25.8470205Z + [[ default == \l\e\g\a\c\y\_\n\v\i\d\i\a\_\d\r\i\v\e\r ]] 2025-12-04T09:26:25.8473337Z + DYNAMO_BENCHMARK_FLAGS=() 2025-12-04T09:26:25.8473540Z + [[ default == *pr_time_benchmarks* ]] 2025-12-04T09:26:25.8473725Z + [[ default == *dynamo_eager* ]] 2025-12-04T09:26:25.8473882Z + [[ default == *aot_eager* ]] 2025-12-04T09:26:25.8474040Z + [[ default == *aot_inductor* ]] 2025-12-04T09:26:25.8474200Z + [[ default == *max_autotune_inductor* ]] 2025-12-04T09:26:25.8474367Z + [[ default == *inductor* ]] 2025-12-04T09:26:25.8474521Z + [[ default == *dynamic* ]] 2025-12-04T09:26:25.8474668Z + [[ default == *cpu* ]] 2025-12-04T09:26:25.8474813Z + [[ default == *xpu* ]] 2025-12-04T09:26:25.8474995Z + DYNAMO_BENCHMARK_FLAGS+=(--device cuda) 2025-12-04T09:26:25.8490968Z + [[ linux-noble-rocm-py3.12-mi300 == *libtorch* ]] 2025-12-04T09:26:25.8491468Z + [[ linux-noble-rocm-py3.12-mi300 == *-bazel-* ]] 2025-12-04T09:26:25.8494054Z + cd test 2025-12-04T09:26:25.8494323Z + python -c 'import torch; print(torch.__config__.show())' 2025-12-04T09:26:26.5577728Z PyTorch built with: 2025-12-04T09:26:26.5578011Z - GCC 11.5 2025-12-04T09:26:26.5578166Z - C++ Version: 201703 2025-12-04T09:26:26.5578538Z - Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-12-04T09:26:26.5578967Z - Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-12-04T09:26:26.5579241Z - OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-12-04T09:26:26.5579457Z - LAPACK is enabled (usually provided by MKL) 2025-12-04T09:26:26.5579653Z - NNPACK is enabled 2025-12-04T09:26:26.5579824Z - CPU capability usage: AVX512 2025-12-04T09:26:26.5580006Z - HIP Runtime 7.1.25424 2025-12-04T09:26:26.5580171Z - MIOpen 3.5.1 2025-12-04T09:26:26.5580309Z - Magma 2.9.0 2025-12-04T09:26:26.5582722Z - Build settings: BLAS_INFO=mkl, BUILD_TYPE=Release, COMMIT_SHA=35b7a9a26c5923d98aebaa41a031dae21788a9ee, CXX_COMPILER=/opt/cache/bin/c++, CXX_FLAGS= -fvisibility-inlines-hidden -DUSE_PTHREADPOOL -DNDEBUG -DUSE_KINETO -DLIBKINETO_NOCUPTI -DLIBKINETO_NOXPUPTI=ON -DUSE_FBGEMM -DUSE_FBGEMM_GENAI -DUSE_PYTORCH_QNNPACK -DUSE_XNNPACK -DSYMBOLICATE_MOBILE_DEBUG_HANDLE -O2 -fPIC -DC10_NODEPRECATED -Wall -Wextra -Werror=return-type -Werror=non-virtual-dtor -Werror=range-loop-construct -Werror=bool-operation -Wnarrowing -Wno-missing-field-initializers -Wno-unknown-pragmas -Wno-unused-parameter -Wno-strict-overflow -Wno-strict-aliasing -Wno-stringop-overflow -Wsuggest-override -Wno-psabi -Wno-error=old-style-cast -faligned-new -Wno-maybe-uninitialized -fno-math-errno -fno-trapping-math -Werror=format -Wno-stringop-overflow, LAPACK_INFO=mkl, PERF_WITH_AVX=1, PERF_WITH_AVX2=1, TORCH_VERSION=2.10.0, USE_CUDA=OFF, USE_CUDNN=OFF, USE_CUSPARSELT=OFF, USE_GFLAGS=OFF, USE_GLOG=OFF, USE_GLOO=ON, USE_MKL=ON, USE_MKLDNN=ON, USE_MPI=OFF, USE_NCCL=ON, USE_NNPACK=ON, USE_OPENMP=ON, USE_ROCM=ON, USE_ROCM_KERNEL_ASSERT=OFF, USE_XCCL=OFF, USE_XPU=OFF, 2025-12-04T09:26:26.5585255Z 2025-12-04T09:26:26.7695020Z + cd test 2025-12-04T09:26:26.7695190Z + python -c 'import torch; print(torch.__config__.parallel_info())' 2025-12-04T09:26:27.4482645Z ATen/Parallel: 2025-12-04T09:26:27.4482886Z at::get_num_threads() : 128 2025-12-04T09:26:27.4483168Z at::get_num_interop_threads() : 128 2025-12-04T09:26:27.4483301Z OpenMP 201511 (a.k.a. OpenMP 4.5) 2025-12-04T09:26:27.4483879Z omp_get_max_threads() : 128 2025-12-04T09:26:27.4484103Z Intel(R) oneAPI Math Kernel Library Version 2024.2-Product Build 20240605 for Intel(R) 64 architecture applications 2025-12-04T09:26:27.4484323Z mkl_get_max_threads() : 128 2025-12-04T09:26:27.4484480Z Intel(R) MKL-DNN v3.7.1 (Git Hash 8d263e693366ef8db40acc569cc7d8edf644556d) 2025-12-04T09:26:27.4484654Z std::thread::hardware_concurrency() : 128 2025-12-04T09:26:27.4484785Z Environment variables: 2025-12-04T09:26:27.4484893Z OMP_NUM_THREADS : [not set] 2025-12-04T09:26:27.4485003Z MKL_NUM_THREADS : [not set] 2025-12-04T09:26:27.4485117Z ATen parallel backend: OpenMP 2025-12-04T09:26:27.4485192Z 2025-12-04T09:26:27.6820166Z + [[ default == *numpy_2* ]] 2025-12-04T09:26:27.6821765Z + [[ linux-noble-rocm-py3.12-mi300 == *aarch64* ]] 2025-12-04T09:26:27.6822085Z + [[ default == *backward* ]] 2025-12-04T09:26:27.6822310Z + [[ default == *libtorch_agnostic_targetting* ]] 2025-12-04T09:26:27.6822542Z + [[ default == *xla* ]] 2025-12-04T09:26:27.6822734Z + [[ default == *vllm* ]] 2025-12-04T09:26:27.6822910Z + [[ default == *executorch* ]] 2025-12-04T09:26:27.6823276Z + [[ default == \j\i\t\_\l\e\g\a\c\y ]] 2025-12-04T09:26:27.6823495Z + [[ default == \q\u\a\n\t\i\z\a\t\i\o\n ]] 2025-12-04T09:26:27.6823725Z + [[ linux-noble-rocm-py3.12-mi300 == *libtorch* ]] 2025-12-04T09:26:27.6823961Z + [[ default == distributed ]] 2025-12-04T09:26:27.6824156Z + [[ default == *operator_benchmark* ]] 2025-12-04T09:26:27.6824402Z + [[ default == *operator_microbenchmark* ]] 2025-12-04T09:26:27.6824630Z + [[ default == *attention_microbenchmark* ]] 2025-12-04T09:26:27.6824844Z + [[ default == *inductor_distributed* ]] 2025-12-04T09:26:27.6825052Z + [[ default == *inductor-halide* ]] 2025-12-04T09:26:27.6825262Z + [[ default == *inductor-pallas* ]] 2025-12-04T09:26:27.6825478Z + [[ default == *inductor-triton-cpu* ]] 2025-12-04T09:26:27.6825706Z + [[ default == *inductor-micro-benchmark* ]] 2025-12-04T09:26:27.6825932Z + [[ default == *aoti_cross_compile_for_windows* ]] 2025-12-04T09:26:27.6826165Z + [[ default == *huggingface* ]] 2025-12-04T09:26:27.6826346Z + [[ default == *timm* ]] 2025-12-04T09:26:27.6826529Z + [[ default == cachebench ]] 2025-12-04T09:26:27.6826716Z + [[ default == verify_cachebench ]] 2025-12-04T09:26:27.6826911Z + [[ default == *torchbench* ]] 2025-12-04T09:26:27.6827107Z + [[ default == *inductor_cpp_wrapper* ]] 2025-12-04T09:26:27.6827315Z + [[ default == *inductor_core* ]] 2025-12-04T09:26:27.6827511Z + [[ default == *inductor* ]] 2025-12-04T09:26:27.6827695Z + [[ default == *einops* ]] 2025-12-04T09:26:27.6827873Z + [[ default == *dynamo_core* ]] 2025-12-04T09:26:27.6828070Z + [[ default == *dynamo_wrapped* ]] 2025-12-04T09:26:27.6828288Z + [[ linux-noble-rocm-py3.12-mi300 == *rocm* ]] 2025-12-04T09:26:27.6828495Z + [[ -n '' ]] 2025-12-04T09:26:27.6828641Z + [[ 6 == 1 ]] 2025-12-04T09:26:27.6828789Z + [[ 6 == 2 ]] 2025-12-04T09:26:27.6828931Z + [[ 6 -gt 2 ]] 2025-12-04T09:26:27.6829086Z + install_torchvision 2025-12-04T09:26:27.6829255Z + local orig_preload 2025-12-04T09:26:27.6829418Z + local commit 2025-12-04T09:26:27.6829593Z ++ get_pinned_commit vision 2025-12-04T09:26:27.6829787Z ++ cat .github/ci_commit_pins/vision.txt 2025-12-04T09:26:27.6840016Z + commit=617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:27.6841119Z + orig_preload= 2025-12-04T09:26:27.6841316Z + '[' -n '' ']' 2025-12-04T09:26:27.6841453Z + [[ linux-noble-rocm-py3.12-mi300 == *cuda* ]] 2025-12-04T09:26:27.6841795Z + pip_build_and_install git+https://github.com/pytorch/vision.git@617079d944b0e72632311c30ae2bbdf1168b901e dist/vision 2025-12-04T09:26:27.6842121Z + local build_target=git+https://github.com/pytorch/vision.git@617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:27.6842381Z + local wheel_dir=dist/vision 2025-12-04T09:26:27.6842497Z + local found_whl=0 2025-12-04T09:26:27.6842603Z + for file in "${wheel_dir}"/*.whl 2025-12-04T09:26:27.6842726Z + [[ -f dist/vision/*.whl ]] 2025-12-04T09:26:27.6842834Z + '[' 0 == 0 ']' 2025-12-04T09:26:27.6843393Z + python3 -m pip wheel --no-build-isolation --no-deps -w dist/vision git+https://github.com/pytorch/vision.git@617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:27.8215270Z Collecting git+https://github.com/pytorch/vision.git@617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:27.8217973Z Cloning https://github.com/pytorch/vision.git (to revision 617079d944b0e72632311c30ae2bbdf1168b901e) to /tmp/pip-req-build-dtvxua7w 2025-12-04T09:26:27.8236268Z Running command git clone --filter=blob:none --quiet https://github.com/pytorch/vision.git /tmp/pip-req-build-dtvxua7w 2025-12-04T09:26:31.2495873Z Running command git rev-parse -q --verify 'sha^617079d944b0e72632311c30ae2bbdf1168b901e' 2025-12-04T09:26:31.2512844Z Running command git fetch -q https://github.com/pytorch/vision.git 617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:31.9256266Z Resolved https://github.com/pytorch/vision.git to commit 617079d944b0e72632311c30ae2bbdf1168b901e 2025-12-04T09:26:33.4706081Z Preparing metadata (pyproject.toml) ... [?25l- \ | done 2025-12-04T09:26:33.4731693Z [?25hBuilding wheels for collected packages: torchvision 2025-12-04T09:27:37.8339283Z Building wheel for torchvision (pyproject.toml) ... [?25l- \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | / - \ | done 2025-12-04T09:27:37.8355788Z [?25h Created wheel for torchvision: filename=torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl size=1814523 sha256=8589ba30dde3b2119c80cdc235c00117cf9eaf7b1a86cc9a60ed581e07c83264 2025-12-04T09:27:37.8356781Z Stored in directory: /var/lib/jenkins/.cache/pip/wheels/22/df/b5/2cdf6bb6a10c31c47b56cf4d0441cf0ee834f1c9dee15fb9d9 2025-12-04T09:27:37.8379992Z Successfully built torchvision 2025-12-04T09:27:37.8949018Z + for file in "${wheel_dir}"/*.whl 2025-12-04T09:27:37.8949536Z + pip_install_whl dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl 2025-12-04T09:27:37.8950091Z + args=('dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl') 2025-12-04T09:27:37.8950450Z + local args 2025-12-04T09:27:37.8950787Z + [[ dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl == *\ * ]] 2025-12-04T09:27:37.8951184Z + for path in "${args[@]}" 2025-12-04T09:27:37.8951563Z + echo 'Installing dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl' 2025-12-04T09:27:37.8952086Z Installing dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl 2025-12-04T09:27:37.8952693Z + python3 -mpip install --no-index --no-deps dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl 2025-12-04T09:27:38.0388310Z Processing ./dist/vision/torchvision-0.25.0a0+617079d-cp312-cp312-linux_x86_64.whl 2025-12-04T09:27:38.0432070Z Installing collected packages: torchvision 2025-12-04T09:27:38.2647172Z Successfully installed torchvision-0.25.0a0+617079d 2025-12-04T09:27:38.2998192Z + '[' -n '' ']' 2025-12-04T09:27:38.2998519Z + test_python_shard 6 2025-12-04T09:27:38.2998840Z + [[ -z 6 ]] 2025-12-04T09:27:38.2999665Z + python test/run_test.py --exclude-jit-executor --exclude-distributed-tests --exclude-quantization-tests --shard 6 6 --verbose --upload-artifacts-while-running 2025-12-04T09:27:39.9210132Z Excluding inductor/test_max_autotune on ROCm 2025-12-04T09:27:39.9210397Z Excluding test_cuda_nvml_based_avail on ROCm 2025-12-04T09:27:40.2856089Z Downloading https://ossci-metrics.s3.amazonaws.com/disabled-tests-condensed.json to /var/lib/jenkins/pytorch/test/.pytorch-disabled-tests.json 2025-12-04T09:27:40.6422224Z Ignoring disabled issues: [''] 2025-12-04T09:27:40.6469719Z Found test times from artifacts 2025-12-04T09:27:40.6639921Z Found test times from artifacts 2025-12-04T09:27:40.6645505Z Running all tests 2025-12-04T09:27:40.6847267Z Running parallel tests on 1 processes 2025-12-04T09:27:40.6850318Z Name: tests to run (est. time: 178.49min) 2025-12-04T09:27:40.6850619Z Serial tests (58): 2025-12-04T09:27:40.6850867Z inductor/test_torchinductor 2/2 2025-12-04T09:27:40.6851511Z inductor/test_torchinductor_dynamic_shapes 3/5 2025-12-04T09:27:40.6851863Z inductor/test_torchinductor_codegen_dynamic_shapes 4/4 2025-12-04T09:27:40.6852185Z inductor/test_torchinductor_opinfo 6/10 2025-12-04T09:27:40.6852470Z inductor/test_pattern_matcher 1/1 2025-12-04T09:27:40.6852739Z dynamo/test_dynamic_shapes 1/2 2025-12-04T09:27:40.6853068Z inductor/test_group_batch_fusion 1/1 2025-12-04T09:27:40.6853343Z dynamo/test_logging 1/1 2025-12-04T09:27:40.6853611Z inductor/test_cuda_repro 1/1 2025-12-04T09:27:40.6853866Z inductor/test_binary_folding 1/1 2025-12-04T09:27:40.6854145Z dynamo/test_activation_checkpointing 1/1 2025-12-04T09:27:40.6854691Z dynamo/test_ctx_manager 1/1 2025-12-04T09:27:40.6854954Z inductor/test_inductor_freezing 1/1 2025-12-04T09:27:40.6855219Z dynamo/test_repros 1/1 2025-12-04T09:27:40.6855453Z dynamo/test_misc 1/1 2025-12-04T09:27:40.6855687Z inductor/test_mmdecomp 1/1 2025-12-04T09:27:40.6855938Z inductor/test_perf 1/1 2025-12-04T09:27:40.6856178Z inductor/test_snode_runtime 1/1 2025-12-04T09:27:40.6856443Z inductor/test_flex_attention 2/4 2025-12-04T09:27:40.6856699Z inductor/test_halide 1/1 2025-12-04T09:27:40.6856972Z inductor/test_torchinductor_strided_blocks 1/1 2025-12-04T09:27:40.6857264Z inductor/test_deterministic 1/3 2025-12-04T09:27:40.6857520Z dynamo/test_aot_autograd 1/1 2025-12-04T09:27:40.6857772Z inductor/test_triton_kernels 1/1 2025-12-04T09:27:40.6858030Z dynamo/test_fake_distributed 1/1 2025-12-04T09:27:40.6858321Z inductor/test_triton_extension_backend 1/1 2025-12-04T09:27:40.6858595Z dynamo/test_streams 1/1 2025-12-04T09:27:40.6858840Z inductor/test_padding 1/1 2025-12-04T09:27:40.6859090Z export/test_retraceability 1/1 2025-12-04T09:27:40.6859295Z inductor/test_metrics 1/1 2025-12-04T09:27:40.6859496Z export/test_cpp_serdes 1/1 2025-12-04T09:27:40.6859704Z inductor/test_benchmark_fusion 1/1 2025-12-04T09:27:40.6859922Z inductor/test_compiled_optimizers 1/2 2025-12-04T09:27:40.6860160Z inductor/test_aot_inductor_utils 1/1 2025-12-04T09:27:40.6860374Z inductor/test_control_flow 3/4 2025-12-04T09:27:40.6860572Z test_autograd 1/1 2025-12-04T09:27:40.6860742Z test_dataloader 1/1 2025-12-04T09:27:40.6860924Z test_ops 5/5 2025-12-04T09:27:40.6861087Z test_decomp 6/11 2025-12-04T09:27:40.6861253Z test_nn 1/3 2025-12-04T09:27:40.6861419Z test_transformers 1/1 2025-12-04T09:27:40.6861614Z test_cuda_expandable_segments 1/1 2025-12-04T09:27:40.6861817Z test_fx 3/3 2025-12-04T09:27:40.6861984Z functorch/test_ops 3/5 2025-12-04T09:27:40.6862176Z profiler/test_kineto 1/1 2025-12-04T09:27:40.6862375Z test_ao_sparsity 1/1 2025-12-04T09:27:40.6862568Z test_autoload_enable 1/1 2025-12-04T09:27:40.6862764Z test_cpp_extensions_aot_ninja 1/1 2025-12-04T09:27:40.6863029Z test_cpp_extensions_aot_no_ninja 1/1 2025-12-04T09:27:40.6863244Z test_cpp_extensions_jit 1/1 2025-12-04T09:27:40.6863446Z test_meta 1/2 2025-12-04T09:27:40.6863610Z test_numa_binding 1/1 2025-12-04T09:27:40.6863803Z test_numba_integration 1/1 2025-12-04T09:27:40.6864002Z test_opaque_obj_v2 1/1 2025-12-04T09:27:40.6864181Z test_ops_gradients 1/1 2025-12-04T09:27:40.6864369Z test_spectral_ops 1/1 2025-12-04T09:27:40.6864553Z test_tensorexpr 1/1 2025-12-04T09:27:40.6864729Z test_unary_ufuncs 1/1 2025-12-04T09:27:40.6864911Z Parallel tests (0): 2025-12-04T09:27:40.6865093Z Name: excluded (est. time: 0.0min) 2025-12-04T09:27:40.6865291Z Serial tests (0): 2025-12-04T09:27:40.6865456Z Parallel tests (0): 2025-12-04T09:27:40.6865758Z Running inductor/test_torchinductor 2/2 ... [2025-12-04 09:27:40.685048][2221632.244749949] 2025-12-04T09:27:40.6866101Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:27:40.6866914Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor.py', '--shard-id=2', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:27:40.685302] 2025-12-04T09:31:18.6754631Z 2025-12-04T09:31:18.6755577Z PRINTING LOG FILE of inductor/test_torchinductor 2/2 (test/test-reports/inductor.test_torchinductor_2.2_03b74721959c00d6_.log) 2025-12-04T09:31:18.6756386Z Test results will be stored in test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:31:18.6756950Z ============================= test session starts ============================== 2025-12-04T09:31:18.6765094Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:31:18.6765609Z cachedir: .pytest_cache 2025-12-04T09:31:18.6766077Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:31:18.6766569Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:31:18.6766823Z configfile: pytest.ini 2025-12-04T09:31:18.6767280Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:31:18.6767748Z collecting ... collected 999 items 2025-12-04T09:31:18.6768001Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:31:18.6801985Z Running 250 items in this shard: test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda, test/inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6829262Z 2025-12-04T09:31:18.6829390Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.2578s] [ 0%] 2025-12-04T09:31:18.6829674Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [1.4142s] [ 0%] 2025-12-04T09:31:18.6829959Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.6647s] [ 1%] 2025-12-04T09:31:18.6830239Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.8561s] [ 1%] 2025-12-04T09:31:18.6830526Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [5.1555s] [ 2%] 2025-12-04T09:31:18.6830812Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [3.0679s] [ 2%] 2025-12-04T09:31:18.6831084Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.8399s] [ 2%] 2025-12-04T09:31:18.6831354Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.8535s] [ 2%] 2025-12-04T09:31:18.6831625Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.4229s] [ 2%] 2025-12-04T09:31:18.6831896Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1906s] [ 2%] 2025-12-04T09:31:18.6832169Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.0725s] [ 2%] 2025-12-04T09:31:18.6832439Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.8218s] [ 2%] 2025-12-04T09:31:18.6832708Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.5312s] [ 2%] 2025-12-04T09:31:18.6833012Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.9398s] [ 2%] 2025-12-04T09:31:18.6833280Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [3.0875s] [ 2%] 2025-12-04T09:31:18.6833548Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.7326s] [ 2%] 2025-12-04T09:31:18.6833819Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.8685s] [ 2%] 2025-12-04T09:31:18.6834088Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [3.0231s] [ 2%] 2025-12-04T09:31:18.6834415Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.3446s] [ 2%] 2025-12-04T09:31:18.6834685Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.5044s] [ 2%] 2025-12-04T09:31:18.6834956Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1103s] [ 2%] 2025-12-04T09:31:18.6835226Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1132s] [ 2%] 2025-12-04T09:31:18.6835599Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.9808s] [ 2%] 2025-12-04T09:31:18.6835875Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.8570s] [ 2%] 2025-12-04T09:31:18.6836177Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1213s] [ 2%] 2025-12-04T09:31:18.6836446Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1785s] [ 2%] 2025-12-04T09:31:18.6836729Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.2951s] [ 2%] 2025-12-04T09:31:18.6837006Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.9965s] [ 2%] 2025-12-04T09:31:18.6837289Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1828s] [ 2%] 2025-12-04T09:31:18.6837565Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [2.1271s] [ 2%] 2025-12-04T09:31:18.6837860Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.7176s] [ 2%] 2025-12-04T09:31:18.6838125Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.8589s] [ 2%] 2025-12-04T09:31:18.6838407Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4592s] [ 2%] 2025-12-04T09:31:18.6838671Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.6639s] [ 2%] 2025-12-04T09:31:18.6838936Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4620s] [ 2%] 2025-12-04T09:31:18.6839203Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4429s] [ 2%] 2025-12-04T09:31:18.6839468Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3733s] [ 2%] 2025-12-04T09:31:18.6839732Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4689s] [ 2%] 2025-12-04T09:31:18.6839996Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.1551s] [ 2%] 2025-12-04T09:31:18.6840261Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3695s] [ 2%] 2025-12-04T09:31:18.6840530Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3506s] [ 2%] 2025-12-04T09:31:18.6840797Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3797s] [ 2%] 2025-12-04T09:31:18.6841061Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3002s] [ 2%] 2025-12-04T09:31:18.6841328Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.2986s] [ 2%] 2025-12-04T09:31:18.6841594Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.2884s] [ 2%] 2025-12-04T09:31:18.6841862Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4226s] [ 2%] 2025-12-04T09:31:18.6842129Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3372s] [ 2%] 2025-12-04T09:31:18.6842400Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3594s] [ 2%] 2025-12-04T09:31:18.6842667Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.3707s] [ 2%] 2025-12-04T09:31:18.6842982Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.4181s] [ 2%] 2025-12-04T09:31:18.6843248Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.1468s] [ 2%] 2025-12-04T09:31:18.6843550Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.0799s] [ 2%] 2025-12-04T09:31:18.6843817Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.1712s] [ 2%] 2025-12-04T09:31:18.6844081Z inductor/test_torchinductor.py::GPUTests::test_dropout_deterministic_cuda PASSED [1.2871s] [ 2%] 2025-12-04T09:31:18.6844361Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7832s] [ 2%] 2025-12-04T09:31:18.6844639Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7108s] [ 2%] 2025-12-04T09:31:18.6844952Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6967s] [ 2%] 2025-12-04T09:31:18.6845227Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6822s] [ 2%] 2025-12-04T09:31:18.6845502Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7694s] [ 2%] 2025-12-04T09:31:18.6845777Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7136s] [ 2%] 2025-12-04T09:31:18.6846055Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6578s] [ 2%] 2025-12-04T09:31:18.6846376Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7704s] [ 2%] 2025-12-04T09:31:18.6846657Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7034s] [ 2%] 2025-12-04T09:31:18.6846934Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7643s] [ 2%] 2025-12-04T09:31:18.6847208Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6878s] [ 2%] 2025-12-04T09:31:18.6847480Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.5967s] [ 2%] 2025-12-04T09:31:18.6847755Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.8043s] [ 2%] 2025-12-04T09:31:18.6848027Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6383s] [ 2%] 2025-12-04T09:31:18.6848298Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6303s] [ 2%] 2025-12-04T09:31:18.6848569Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6628s] [ 2%] 2025-12-04T09:31:18.6848841Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.5164s] [ 2%] 2025-12-04T09:31:18.6849117Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6168s] [ 2%] 2025-12-04T09:31:18.6849390Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6421s] [ 2%] 2025-12-04T09:31:18.6849663Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7990s] [ 2%] 2025-12-04T09:31:18.6849939Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7256s] [ 2%] 2025-12-04T09:31:18.6850214Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.4843s] [ 2%] 2025-12-04T09:31:18.6850485Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.4877s] [ 2%] 2025-12-04T09:31:18.6850757Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6846s] [ 2%] 2025-12-04T09:31:18.6851030Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.4489s] [ 2%] 2025-12-04T09:31:18.6851307Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7432s] [ 2%] 2025-12-04T09:31:18.6851580Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7235s] [ 2%] 2025-12-04T09:31:18.6851851Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7069s] [ 2%] 2025-12-04T09:31:18.6852177Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7426s] [ 2%] 2025-12-04T09:31:18.6852450Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.8175s] [ 2%] 2025-12-04T09:31:18.6852720Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [1.0154s] [ 2%] 2025-12-04T09:31:18.6853040Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.8982s] [ 2%] 2025-12-04T09:31:18.6853312Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [1.1010s] [ 2%] 2025-12-04T09:31:18.6853622Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7202s] [ 2%] 2025-12-04T09:31:18.6853898Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.9436s] [ 2%] 2025-12-04T09:31:18.6854172Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7262s] [ 2%] 2025-12-04T09:31:18.6854451Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.4334s] [ 2%] 2025-12-04T09:31:18.6854722Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7091s] [ 2%] 2025-12-04T09:31:18.6854993Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6676s] [ 2%] 2025-12-04T09:31:18.6855265Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7474s] [ 2%] 2025-12-04T09:31:18.6855538Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7145s] [ 2%] 2025-12-04T09:31:18.6855812Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7612s] [ 2%] 2025-12-04T09:31:18.6856085Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7250s] [ 2%] 2025-12-04T09:31:18.6856357Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.8705s] [ 2%] 2025-12-04T09:31:18.6856631Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6464s] [ 2%] 2025-12-04T09:31:18.6856904Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7707s] [ 2%] 2025-12-04T09:31:18.6857176Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7499s] [ 2%] 2025-12-04T09:31:18.6857446Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.7051s] [ 2%] 2025-12-04T09:31:18.6857723Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_slice_scatter_cuda PASSED [0.6804s] [ 2%] 2025-12-04T09:31:18.6857998Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3272s] [ 2%] 2025-12-04T09:31:18.6858272Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3174s] [ 2%] 2025-12-04T09:31:18.6858544Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3362s] [ 2%] 2025-12-04T09:31:18.6858816Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2440s] [ 2%] 2025-12-04T09:31:18.6859087Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2568s] [ 2%] 2025-12-04T09:31:18.6859358Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3307s] [ 2%] 2025-12-04T09:31:18.6859628Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3306s] [ 2%] 2025-12-04T09:31:18.6859897Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3319s] [ 2%] 2025-12-04T09:31:18.6860171Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3746s] [ 2%] 2025-12-04T09:31:18.6860440Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2215s] [ 2%] 2025-12-04T09:31:18.6860754Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3198s] [ 2%] 2025-12-04T09:31:18.6861027Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.9578s] [ 2%] 2025-12-04T09:31:18.6861298Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.7834s] [ 2%] 2025-12-04T09:31:18.6861574Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2322s] [ 2%] 2025-12-04T09:31:18.6861843Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3451s] [ 2%] 2025-12-04T09:31:18.6862114Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3028s] [ 2%] 2025-12-04T09:31:18.6862410Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2946s] [ 2%] 2025-12-04T09:31:18.6862681Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.6502s] [ 2%] 2025-12-04T09:31:18.6862995Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2754s] [ 2%] 2025-12-04T09:31:18.6863267Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3398s] [ 2%] 2025-12-04T09:31:18.6863537Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3442s] [ 2%] 2025-12-04T09:31:18.6863810Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3052s] [ 2%] 2025-12-04T09:31:18.6864081Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.3252s] [ 2%] 2025-12-04T09:31:18.6864354Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1034s] [ 2%] 2025-12-04T09:31:18.6864624Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.1569s] [ 2%] 2025-12-04T09:31:18.6864894Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.9229s] [ 2%] 2025-12-04T09:31:18.6865173Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.6773s] [ 2%] 2025-12-04T09:31:18.6865450Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.4583s] [ 2%] 2025-12-04T09:31:18.6865725Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1076s] [ 2%] 2025-12-04T09:31:18.6865999Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1045s] [ 2%] 2025-12-04T09:31:18.6866270Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3074s] [ 2%] 2025-12-04T09:31:18.6866544Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.2971s] [ 2%] 2025-12-04T09:31:18.6866817Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.8258s] [ 2%] 2025-12-04T09:31:18.6867087Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3376s] [ 2%] 2025-12-04T09:31:18.6867359Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3769s] [ 2%] 2025-12-04T09:31:18.6867629Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.1192s] [ 2%] 2025-12-04T09:31:18.6867897Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3239s] [ 2%] 2025-12-04T09:31:18.6868168Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.1350s] [ 2%] 2025-12-04T09:31:18.6868439Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.3253s] [ 2%] 2025-12-04T09:31:18.6868712Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [1.6430s] [ 2%] 2025-12-04T09:31:18.6868983Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.6979s] [ 2%] 2025-12-04T09:31:18.6869264Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.6982s] [ 2%] 2025-12-04T09:31:18.6869574Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1182s] [ 2%] 2025-12-04T09:31:18.6869844Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1200s] [ 2%] 2025-12-04T09:31:18.6870117Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1157s] [ 2%] 2025-12-04T09:31:18.6870391Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1137s] [ 2%] 2025-12-04T09:31:18.6870660Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1162s] [ 2%] 2025-12-04T09:31:18.6870962Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1132s] [ 2%] 2025-12-04T09:31:18.6871232Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_default_cuda PASSED [0.1241s] [ 2%] 2025-12-04T09:31:18.6871503Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0831s] [ 2%] 2025-12-04T09:31:18.6871779Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0823s] [ 2%] 2025-12-04T09:31:18.6872053Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0845s] [ 2%] 2025-12-04T09:31:18.6872326Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0853s] [ 2%] 2025-12-04T09:31:18.6872599Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0821s] [ 2%] 2025-12-04T09:31:18.6872875Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0831s] [ 2%] 2025-12-04T09:31:18.6873197Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0827s] [ 2%] 2025-12-04T09:31:18.6873470Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0826s] [ 2%] 2025-12-04T09:31:18.6873742Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0827s] [ 2%] 2025-12-04T09:31:18.6874017Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0816s] [ 2%] 2025-12-04T09:31:18.6874288Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0856s] [ 2%] 2025-12-04T09:31:18.6874561Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0828s] [ 2%] 2025-12-04T09:31:18.6874833Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0847s] [ 2%] 2025-12-04T09:31:18.6875106Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0822s] [ 2%] 2025-12-04T09:31:18.6875383Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0842s] [ 2%] 2025-12-04T09:31:18.6875655Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0835s] [ 2%] 2025-12-04T09:31:18.6875927Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0913s] [ 2%] 2025-12-04T09:31:18.6876201Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0838s] [ 2%] 2025-12-04T09:31:18.6876474Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0812s] [ 2%] 2025-12-04T09:31:18.6876747Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0829s] [ 2%] 2025-12-04T09:31:18.6877021Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0831s] [ 2%] 2025-12-04T09:31:18.6877296Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0817s] [ 2%] 2025-12-04T09:31:18.6877569Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0896s] [ 2%] 2025-12-04T09:31:18.6877840Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0812s] [ 2%] 2025-12-04T09:31:18.6878112Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0815s] [ 2%] 2025-12-04T09:31:18.6878424Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0854s] [ 2%] 2025-12-04T09:31:18.6878697Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0812s] [ 2%] 2025-12-04T09:31:18.6878969Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0816s] [ 2%] 2025-12-04T09:31:18.6879241Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0854s] [ 2%] 2025-12-04T09:31:18.6879514Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0813s] [ 2%] 2025-12-04T09:31:18.6879827Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0807s] [ 2%] 2025-12-04T09:31:18.6880104Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0836s] [ 2%] 2025-12-04T09:31:18.6880380Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0842s] [ 2%] 2025-12-04T09:31:18.6880660Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0819s] [ 2%] 2025-12-04T09:31:18.6880933Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0881s] [ 2%] 2025-12-04T09:31:18.6881204Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0814s] [ 2%] 2025-12-04T09:31:18.6881474Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0801s] [ 2%] 2025-12-04T09:31:18.6881744Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0849s] [ 2%] 2025-12-04T09:31:18.6882018Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0801s] [ 2%] 2025-12-04T09:31:18.6882848Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0824s] [ 2%] 2025-12-04T09:31:18.6883158Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0843s] [ 2%] 2025-12-04T09:31:18.6883435Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0834s] [ 2%] 2025-12-04T09:31:18.6883709Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0833s] [ 2%] 2025-12-04T09:31:18.6883978Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0835s] [ 2%] 2025-12-04T09:31:18.6884245Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0815s] [ 2%] 2025-12-04T09:31:18.6884511Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0818s] [ 2%] 2025-12-04T09:31:18.6884779Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0842s] [ 2%] 2025-12-04T09:31:18.6885044Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0884s] [ 2%] 2025-12-04T09:31:18.6885308Z inductor/test_torchinductor.py::GPUTests::test_remove_noop_view_dtype_cuda PASSED [0.0832s] [ 2%] 2025-12-04T09:31:18.6885585Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2033s] [ 2%] 2025-12-04T09:31:18.6885867Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.9857s] [ 2%] 2025-12-04T09:31:18.6886144Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2063s] [ 2%] 2025-12-04T09:31:18.6886422Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1974s] [ 2%] 2025-12-04T09:31:18.6886698Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.3908s] [ 2%] 2025-12-04T09:31:18.6886980Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1919s] [ 2%] 2025-12-04T09:31:18.6887256Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2023s] [ 2%] 2025-12-04T09:31:18.6887577Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2016s] [ 2%] 2025-12-04T09:31:18.6887854Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2005s] [ 2%] 2025-12-04T09:31:18.6888131Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.3993s] [ 2%] 2025-12-04T09:31:18.6888407Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.3860s] [ 2%] 2025-12-04T09:31:18.6888683Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1937s] [ 2%] 2025-12-04T09:31:18.6888994Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1976s] [ 2%] 2025-12-04T09:31:18.6889273Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1942s] [ 2%] 2025-12-04T09:31:18.6889551Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2047s] [ 2%] 2025-12-04T09:31:18.6889831Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.1945s] [ 2%] 2025-12-04T09:31:18.6890108Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2015s] [ 2%] 2025-12-04T09:31:18.6890386Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.3928s] [ 2%] 2025-12-04T09:31:18.6890665Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2048s] [ 2%] 2025-12-04T09:31:18.6890943Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2025s] [ 2%] 2025-12-04T09:31:18.6891224Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2042s] [ 2%] 2025-12-04T09:31:18.6891506Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.4381s] [ 2%] 2025-12-04T09:31:18.6891784Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.3972s] [ 2%] 2025-12-04T09:31:18.6892069Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.3874s] [ 2%] 2025-12-04T09:31:18.6892351Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2003s] [ 2%] 2025-12-04T09:31:18.6892633Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.9972s] [ 2%] 2025-12-04T09:31:18.6892914Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2045s] [ 2%] 2025-12-04T09:31:18.6893244Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.4060s] [ 2%] 2025-12-04T09:31:18.6893530Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2050s] [ 2%] 2025-12-04T09:31:18.6893813Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.4107s] [ 2%] 2025-12-04T09:31:18.6894099Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.3946s] [ 2%] 2025-12-04T09:31:18.6894381Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.3944s] [ 2%] 2025-12-04T09:31:18.6894664Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2067s] [ 2%] 2025-12-04T09:31:18.6894948Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.4064s] [ 2%] 2025-12-04T09:31:18.6895235Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2140s] [ 2%] 2025-12-04T09:31:18.6895525Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2021s] [ 2%] 2025-12-04T09:31:18.6895810Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2100s] [ 2%] 2025-12-04T09:31:18.6896093Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.4059s] [ 2%] 2025-12-04T09:31:18.6896415Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.4093s] [ 2%] 2025-12-04T09:31:18.6896699Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2056s] [ 2%] 2025-12-04T09:31:18.6896982Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2017s] [ 2%] 2025-12-04T09:31:18.6897265Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2246s] [ 2%] 2025-12-04T09:31:18.6897552Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2044s] [ 2%] 2025-12-04T09:31:18.6897865Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.4134s] [ 2%] 2025-12-04T09:31:18.6898148Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2018s] [ 2%] 2025-12-04T09:31:18.6898432Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.2170s] [ 2%] 2025-12-04T09:31:18.6898791Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.3847s] [ 2%] 2025-12-04T09:31:18.6899076Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda PASSED [0.3939s] [ 2%] 2025-12-04T09:31:18.6899361Z inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda FAILED [0.8105s] [ 2%] 2025-12-04T09:31:18.6899522Z 2025-12-04T09:31:18.6899587Z =================================== FAILURES =================================== 2025-12-04T09:31:18.6899773Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6899951Z Traceback (most recent call last): 2025-12-04T09:31:18.6900168Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6900376Z self.common( 2025-12-04T09:31:18.6900536Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6900723Z return func(*args, **kwds) 2025-12-04T09:31:18.6900843Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6901043Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6901249Z check_model( 2025-12-04T09:31:18.6901430Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6901630Z assert_equal_fn( 2025-12-04T09:31:18.6901842Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6902087Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6902237Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6902482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6902758Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6902976Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6903072Z 2025-12-04T09:31:18.6903128Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6903316Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6903562Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6903703Z 2025-12-04T09:31:18.6903756Z The failure occurred for item [2] 2025-12-04T09:31:18.6903835Z 2025-12-04T09:31:18.6903915Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6904179Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6904366Z 2025-12-04T09:31:18.6904462Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6904671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6904897Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6905101Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6905600Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6906033Z graph_break [] 2025-12-04T09:31:18.6906184Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6906391Z Traceback (most recent call last): 2025-12-04T09:31:18.6906604Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6906810Z self.common( 2025-12-04T09:31:18.6906965Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6907144Z return func(*args, **kwds) 2025-12-04T09:31:18.6907261Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6907459Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6907664Z check_model( 2025-12-04T09:31:18.6907842Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6908044Z assert_equal_fn( 2025-12-04T09:31:18.6908254Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6908496Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6908645Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6908892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6909168Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6909342Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6909436Z 2025-12-04T09:31:18.6909485Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6909672Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6909917Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6910061Z 2025-12-04T09:31:18.6910111Z The failure occurred for item [2] 2025-12-04T09:31:18.6910193Z 2025-12-04T09:31:18.6910268Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6910532Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6910721Z 2025-12-04T09:31:18.6910812Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6911018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6911202Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6911402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6911896Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6912320Z graph_break [] 2025-12-04T09:31:18.6912458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6912635Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6912831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6913367Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6913837Z graph_break [] 2025-12-04T09:31:18.6913979Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6914151Z Traceback (most recent call last): 2025-12-04T09:31:18.6914361Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6914565Z self.common( 2025-12-04T09:31:18.6914716Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6914944Z return func(*args, **kwds) 2025-12-04T09:31:18.6915061Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6915257Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.6915461Z check_model( 2025-12-04T09:31:18.6915709Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6915912Z assert_equal_fn( 2025-12-04T09:31:18.6916117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6916356Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6916501Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6916747Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6917022Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6917193Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6917288Z 2025-12-04T09:31:18.6917337Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6917518Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6917752Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.6917887Z 2025-12-04T09:31:18.6917936Z The failure occurred for item [2] 2025-12-04T09:31:18.6918019Z 2025-12-04T09:31:18.6918094Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6918352Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6918541Z 2025-12-04T09:31:18.6918632Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6918838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6919018Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6919216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6919702Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6920125Z graph_break [] 2025-12-04T09:31:18.6920263Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6920438Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6920634Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6921120Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6921549Z graph_break [] 2025-12-04T09:31:18.6921683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6921897Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6922095Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6922578Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6923047Z graph_break [] 2025-12-04T09:31:18.6923191Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6923361Z Traceback (most recent call last): 2025-12-04T09:31:18.6923607Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6923810Z self.common( 2025-12-04T09:31:18.6923961Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6924138Z return func(*args, **kwds) 2025-12-04T09:31:18.6924254Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6924451Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6924657Z check_model( 2025-12-04T09:31:18.6924830Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6925033Z assert_equal_fn( 2025-12-04T09:31:18.6925234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6942080Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6942244Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6942506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6942800Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6943035Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6943128Z 2025-12-04T09:31:18.6943181Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6943372Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6943628Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6943774Z 2025-12-04T09:31:18.6943827Z The failure occurred for item [2] 2025-12-04T09:31:18.6943909Z 2025-12-04T09:31:18.6943987Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6944252Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6944444Z 2025-12-04T09:31:18.6944536Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6944747Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6944927Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6945128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6945618Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6946050Z graph_break [] 2025-12-04T09:31:18.6946188Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6946363Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6946561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6947048Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6960313Z graph_break [] 2025-12-04T09:31:18.6960450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6960627Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6960823Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6961337Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6961760Z graph_break [] 2025-12-04T09:31:18.6961920Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6962100Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6962294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6962777Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6963236Z graph_break [] 2025-12-04T09:31:18.6963375Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6963549Z Traceback (most recent call last): 2025-12-04T09:31:18.6963764Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6963968Z self.common( 2025-12-04T09:31:18.6964120Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6964298Z return func(*args, **kwds) 2025-12-04T09:31:18.6964415Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6964611Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6964814Z check_model( 2025-12-04T09:31:18.6964991Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6965186Z assert_equal_fn( 2025-12-04T09:31:18.6965391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6965633Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6965787Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6966030Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6966299Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6966465Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6966556Z 2025-12-04T09:31:18.6966603Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6966784Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6967024Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6967166Z 2025-12-04T09:31:18.6967213Z The failure occurred for item [2] 2025-12-04T09:31:18.6967293Z 2025-12-04T09:31:18.6967367Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6967623Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6967811Z 2025-12-04T09:31:18.6967901Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6968099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6968309Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6968502Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6968990Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6969407Z graph_break [] 2025-12-04T09:31:18.6969537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6969708Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6969942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6970421Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6970845Z graph_break [] 2025-12-04T09:31:18.6970974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6971147Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6971339Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6971820Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6972238Z graph_break [] 2025-12-04T09:31:18.6972366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6972537Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6972728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6973243Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6973659Z graph_break [] 2025-12-04T09:31:18.6973789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6973958Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6974151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6974629Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6975054Z graph_break [] 2025-12-04T09:31:18.6975218Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6975385Z Traceback (most recent call last): 2025-12-04T09:31:18.6975591Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6975790Z self.common( 2025-12-04T09:31:18.6975937Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6976106Z return func(*args, **kwds) 2025-12-04T09:31:18.6976221Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6976416Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6976618Z check_model( 2025-12-04T09:31:18.6976791Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6977036Z assert_equal_fn( 2025-12-04T09:31:18.6977237Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6977475Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6977616Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6977855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6978124Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6978286Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6978410Z 2025-12-04T09:31:18.6978460Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6978641Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6978880Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6979024Z 2025-12-04T09:31:18.6979073Z The failure occurred for item [2] 2025-12-04T09:31:18.6979150Z 2025-12-04T09:31:18.6979226Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6979480Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6979663Z 2025-12-04T09:31:18.6979754Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6979952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6980124Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6980320Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6980801Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6981222Z graph_break [] 2025-12-04T09:31:18.6981352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6981521Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6981713Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6982196Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6982610Z graph_break [] 2025-12-04T09:31:18.6982742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6982916Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6983153Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6983630Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6984046Z graph_break [] 2025-12-04T09:31:18.6984176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6984346Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6984538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6985017Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6985467Z graph_break [] 2025-12-04T09:31:18.6985597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6985767Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6985956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6986468Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6986884Z graph_break [] 2025-12-04T09:31:18.6987012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6987184Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6987377Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6987855Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6988301Z graph_break [] 2025-12-04T09:31:18.6988432Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6988600Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6988792Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6989271Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6989691Z graph_break [] 2025-12-04T09:31:18.6989829Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.6989994Z Traceback (most recent call last): 2025-12-04T09:31:18.6990199Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.6990398Z self.common( 2025-12-04T09:31:18.6990544Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.6990714Z return func(*args, **kwds) 2025-12-04T09:31:18.6990830Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6991024Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.6991224Z check_model( 2025-12-04T09:31:18.6991395Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.6991590Z assert_equal_fn( 2025-12-04T09:31:18.6991793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.6992026Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.6992168Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.6992408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.6992675Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.6992836Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.6992925Z 2025-12-04T09:31:18.6993015Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.6993196Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.6993438Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.6993625Z 2025-12-04T09:31:18.6993672Z The failure occurred for item [2] 2025-12-04T09:31:18.6993751Z 2025-12-04T09:31:18.6993825Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.6994081Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.6994264Z 2025-12-04T09:31:18.6994354Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.6994553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6994722Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6994951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6995430Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6995857Z graph_break [] 2025-12-04T09:31:18.6995986Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6996152Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6996340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6996817Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6997235Z graph_break [] 2025-12-04T09:31:18.6997361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6997531Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.6997724Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.6998199Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.6998612Z graph_break [] 2025-12-04T09:31:18.6998742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.6998911Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.6999101Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.6999577Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.6999993Z graph_break [] 2025-12-04T09:31:18.7000119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7000285Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7000475Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7000949Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7001365Z graph_break [] 2025-12-04T09:31:18.7001492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7001662Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7001886Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7002363Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7002775Z graph_break [] 2025-12-04T09:31:18.7002900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7003136Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7003363Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7003845Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7004262Z graph_break [] 2025-12-04T09:31:18.7004389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7004556Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7004746Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7005222Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7005645Z graph_break [] 2025-12-04T09:31:18.7005783Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7005948Z Traceback (most recent call last): 2025-12-04T09:31:18.7006159Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7006361Z self.common( 2025-12-04T09:31:18.7006503Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7006672Z return func(*args, **kwds) 2025-12-04T09:31:18.7006783Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7006978Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7007178Z check_model( 2025-12-04T09:31:18.7007352Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7007545Z assert_equal_fn( 2025-12-04T09:31:18.7007749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7008011Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7008154Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7008392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7008663Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7008825Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7008916Z 2025-12-04T09:31:18.7008963Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7009142Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7009384Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7009524Z 2025-12-04T09:31:18.7009575Z The failure occurred for item [2] 2025-12-04T09:31:18.7009654Z 2025-12-04T09:31:18.7009728Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7009980Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7010207Z 2025-12-04T09:31:18.7010298Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7010495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7010661Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7010853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7011364Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7011782Z graph_break [] 2025-12-04T09:31:18.7011914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7012084Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7012277Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7012756Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7013210Z graph_break [] 2025-12-04T09:31:18.7013341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7013512Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7013707Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7014184Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7014608Z graph_break [] 2025-12-04T09:31:18.7014736Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7014905Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7015094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7015570Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7015983Z graph_break [] 2025-12-04T09:31:18.7016112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7016279Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7016470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7016945Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7017360Z graph_break [] 2025-12-04T09:31:18.7017488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7017658Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7017852Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7018333Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7018794Z graph_break [] 2025-12-04T09:31:18.7018925Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7019094Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7019284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7019793Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7020208Z graph_break [] 2025-12-04T09:31:18.7020338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7020507Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7020699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7021175Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7021591Z graph_break [] 2025-12-04T09:31:18.7021718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7021886Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7022077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7022556Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7023016Z graph_break [] 2025-12-04T09:31:18.7023155Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7023320Z Traceback (most recent call last): 2025-12-04T09:31:18.7023527Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7023727Z self.common( 2025-12-04T09:31:18.7023874Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7024043Z return func(*args, **kwds) 2025-12-04T09:31:18.7024155Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7024350Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7024549Z check_model( 2025-12-04T09:31:18.7024724Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7024917Z assert_equal_fn( 2025-12-04T09:31:18.7025118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7025355Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7025498Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7025740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7026043Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7026206Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7026296Z 2025-12-04T09:31:18.7026342Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7026524Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7026764Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7026904Z 2025-12-04T09:31:18.7026996Z The failure occurred for item [2] 2025-12-04T09:31:18.7027078Z 2025-12-04T09:31:18.7027152Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7027406Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7027590Z 2025-12-04T09:31:18.7027679Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7027878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7028074Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7028312Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7028795Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7029219Z graph_break [] 2025-12-04T09:31:18.7029349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7029522Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7029712Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7030190Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7030609Z graph_break [] 2025-12-04T09:31:18.7030740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7030913Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7031104Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7031583Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7032006Z graph_break [] 2025-12-04T09:31:18.7032138Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7032307Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7032499Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7033029Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7033448Z graph_break [] 2025-12-04T09:31:18.7033578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7033747Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7033942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7034416Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7034833Z graph_break [] 2025-12-04T09:31:18.7034961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7035134Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7035327Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7035841Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7036259Z graph_break [] 2025-12-04T09:31:18.7036388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7036559Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7036750Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7037255Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7037678Z graph_break [] 2025-12-04T09:31:18.7037808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7037976Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7038165Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7038642Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7039061Z graph_break [] 2025-12-04T09:31:18.7039192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7039360Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7039549Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7040025Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7040439Z graph_break [] 2025-12-04T09:31:18.7040567Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7040738Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7040926Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7041404Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7041819Z graph_break [] 2025-12-04T09:31:18.7041956Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7042119Z Traceback (most recent call last): 2025-12-04T09:31:18.7042321Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7042517Z self.common( 2025-12-04T09:31:18.7042661Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7042828Z return func(*args, **kwds) 2025-12-04T09:31:18.7042977Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7043170Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7043368Z check_model( 2025-12-04T09:31:18.7043539Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7043728Z assert_equal_fn( 2025-12-04T09:31:18.7043971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7044204Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7044342Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7044581Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7044844Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7045006Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7045094Z 2025-12-04T09:31:18.7045140Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7045356Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7045579Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7045711Z 2025-12-04T09:31:18.7045758Z The failure occurred for item [2] 2025-12-04T09:31:18.7045840Z 2025-12-04T09:31:18.7045913Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7046164Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7046346Z 2025-12-04T09:31:18.7046435Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7046632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7046799Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7046988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7047471Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7047891Z graph_break [] 2025-12-04T09:31:18.7048022Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7048189Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7048379Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7048857Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7049267Z graph_break [] 2025-12-04T09:31:18.7049395Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7049566Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7049757Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7050232Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7050643Z graph_break [] 2025-12-04T09:31:18.7050770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7050938Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7051126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7051603Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7052049Z graph_break [] 2025-12-04T09:31:18.7052178Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7052345Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7052532Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7053050Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7053463Z graph_break [] 2025-12-04T09:31:18.7053616Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7053786Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7053975Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7054454Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7054868Z graph_break [] 2025-12-04T09:31:18.7054994Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7055159Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7055349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7055824Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7056240Z graph_break [] 2025-12-04T09:31:18.7056371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7056538Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7056725Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7057198Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7057612Z graph_break [] 2025-12-04T09:31:18.7057739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7057906Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7058092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7058566Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7058978Z graph_break [] 2025-12-04T09:31:18.7059102Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7059269Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7059459Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7059934Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7060391Z graph_break [] 2025-12-04T09:31:18.7060516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7060686Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7060875Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7061351Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7061765Z graph_break [] 2025-12-04T09:31:18.7061916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7062086Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7062275Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7062754Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7063213Z graph_break [] 2025-12-04T09:31:18.7063350Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7063514Z Traceback (most recent call last): 2025-12-04T09:31:18.7063716Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7063910Z self.common( 2025-12-04T09:31:18.7064057Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7064222Z return func(*args, **kwds) 2025-12-04T09:31:18.7064330Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7064523Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7064725Z check_model( 2025-12-04T09:31:18.7064896Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7065087Z assert_equal_fn( 2025-12-04T09:31:18.7065284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7065514Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7065651Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7065890Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7066157Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7066316Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7066402Z 2025-12-04T09:31:18.7066449Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7066628Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7066866Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7067004Z 2025-12-04T09:31:18.7067052Z The failure occurred for item [2] 2025-12-04T09:31:18.7067128Z 2025-12-04T09:31:18.7067204Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7067453Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7067634Z 2025-12-04T09:31:18.7067724Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7067921Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7068089Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7068280Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7068831Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7069245Z graph_break [] 2025-12-04T09:31:18.7069373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7069543Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7069738Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7070251Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7070674Z graph_break [] 2025-12-04T09:31:18.7070806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7070981Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7071174Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7071654Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7072071Z graph_break [] 2025-12-04T09:31:18.7072201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7072372Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7072563Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7073090Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7073507Z graph_break [] 2025-12-04T09:31:18.7073637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7073807Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7073999Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7074477Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7074895Z graph_break [] 2025-12-04T09:31:18.7075024Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7075199Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7075393Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7075875Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7076294Z graph_break [] 2025-12-04T09:31:18.7076425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7076596Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7076789Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7077302Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7077715Z graph_break [] 2025-12-04T09:31:18.7077844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7078016Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7078206Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7078749Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7079169Z graph_break [] 2025-12-04T09:31:18.7079302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7079470Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7079659Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7080141Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7080557Z graph_break [] 2025-12-04T09:31:18.7080692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7080859Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7081045Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7081514Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7081936Z graph_break [] 2025-12-04T09:31:18.7082066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7082237Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7082436Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7082922Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7083384Z graph_break [] 2025-12-04T09:31:18.7083522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7083698Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7083898Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7084384Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7084807Z graph_break [] 2025-12-04T09:31:18.7084943Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7085116Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7085312Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7085796Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7086255Z graph_break [] 2025-12-04T09:31:18.7086398Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7086567Z Traceback (most recent call last): 2025-12-04T09:31:18.7086773Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7086973Z self.common( 2025-12-04T09:31:18.7087150Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7087325Z return func(*args, **kwds) 2025-12-04T09:31:18.7087439Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7087630Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7087836Z check_model( 2025-12-04T09:31:18.7088013Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7088203Z assert_equal_fn( 2025-12-04T09:31:18.7088406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7088640Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7088782Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7089023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7089296Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7089461Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7089548Z 2025-12-04T09:31:18.7089597Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7089774Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7090018Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7090155Z 2025-12-04T09:31:18.7090204Z The failure occurred for item [2] 2025-12-04T09:31:18.7090285Z 2025-12-04T09:31:18.7090360Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7090615Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7090798Z 2025-12-04T09:31:18.7090887Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7091087Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7091259Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7091455Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7091940Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7092362Z graph_break [] 2025-12-04T09:31:18.7092494Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7092667Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7092860Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7093584Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7094002Z graph_break [] 2025-12-04T09:31:18.7094136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7094360Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7094557Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7095045Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7095468Z graph_break [] 2025-12-04T09:31:18.7095602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7095807Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7096003Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7096483Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7096910Z graph_break [] 2025-12-04T09:31:18.7097040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7097215Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7097408Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7097885Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7098305Z graph_break [] 2025-12-04T09:31:18.7098437Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7098619Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7098814Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7099298Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7099722Z graph_break [] 2025-12-04T09:31:18.7099856Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7100033Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7100226Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7100704Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7101127Z graph_break [] 2025-12-04T09:31:18.7101258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7101430Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7101622Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7102104Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7102523Z graph_break [] 2025-12-04T09:31:18.7102654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7102856Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7103093Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7103572Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7103992Z graph_break [] 2025-12-04T09:31:18.7104123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7104329Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7104524Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7105009Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7105426Z graph_break [] 2025-12-04T09:31:18.7105550Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7105723Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7105919Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7106404Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7106826Z graph_break [] 2025-12-04T09:31:18.7106959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7107140Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7107337Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7107821Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7108249Z graph_break [] 2025-12-04T09:31:18.7108381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7108560Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7108755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7109242Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7109666Z graph_break [] 2025-12-04T09:31:18.7109799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7109974Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7110170Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7110658Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7111077Z graph_break [] 2025-12-04T09:31:18.7111220Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7111424Z Traceback (most recent call last): 2025-12-04T09:31:18.7111633Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7111837Z self.common( 2025-12-04T09:31:18.7111988Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7112159Z return func(*args, **kwds) 2025-12-04T09:31:18.7112275Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7112474Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7112682Z check_model( 2025-12-04T09:31:18.7112890Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7113137Z assert_equal_fn( 2025-12-04T09:31:18.7113341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7113585Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7113735Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7113982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7114255Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7114419Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7114512Z 2025-12-04T09:31:18.7114559Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7114747Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7114996Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7115141Z 2025-12-04T09:31:18.7115189Z The failure occurred for item [2] 2025-12-04T09:31:18.7115272Z 2025-12-04T09:31:18.7115348Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7115613Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7115798Z 2025-12-04T09:31:18.7115889Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7116089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7116260Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7116454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7116943Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7117366Z graph_break [] 2025-12-04T09:31:18.7117502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7117680Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7117876Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7118356Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7118780Z graph_break [] 2025-12-04T09:31:18.7118857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7118927Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7119026Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7119378Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7119453Z graph_break [] 2025-12-04T09:31:18.7119530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7119588Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7119688Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7120070Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7120112Z graph_break [] 2025-12-04T09:31:18.7120189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7120248Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7120348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7120691Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7120734Z graph_break [] 2025-12-04T09:31:18.7120808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7120873Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7120970Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7121318Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7121359Z graph_break [] 2025-12-04T09:31:18.7121436Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7121492Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7121593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7121936Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7121976Z graph_break [] 2025-12-04T09:31:18.7122053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7122111Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7122211Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7122583Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7122625Z graph_break [] 2025-12-04T09:31:18.7122700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7122761Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7122858Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7123239Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7123310Z graph_break [] 2025-12-04T09:31:18.7123388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7123443Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7123542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7123924Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7123964Z graph_break [] 2025-12-04T09:31:18.7124043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7124104Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7124205Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7124545Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7124587Z graph_break [] 2025-12-04T09:31:18.7124660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7124722Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7124822Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7125165Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7125206Z graph_break [] 2025-12-04T09:31:18.7125281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7125337Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7125437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7125791Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7125830Z graph_break [] 2025-12-04T09:31:18.7125910Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7131089Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7131202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7131547Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7131593Z graph_break [] 2025-12-04T09:31:18.7131670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7131728Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7131829Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7132174Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7132253Z graph_break [] 2025-12-04T09:31:18.7132338Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7132386Z Traceback (most recent call last): 2025-12-04T09:31:18.7132522Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7132560Z self.common( 2025-12-04T09:31:18.7132654Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7132699Z return func(*args, **kwds) 2025-12-04T09:31:18.7132769Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7132903Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7132986Z check_model( 2025-12-04T09:31:18.7133106Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7133150Z assert_equal_fn( 2025-12-04T09:31:18.7133294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7133359Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7133409Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7133574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7133651Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7133708Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7133713Z 2025-12-04T09:31:18.7133762Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7133865Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7133969Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7133979Z 2025-12-04T09:31:18.7134025Z The failure occurred for item [2] 2025-12-04T09:31:18.7134027Z 2025-12-04T09:31:18.7134105Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7134253Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7134255Z 2025-12-04T09:31:18.7134350Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7134426Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7134484Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7134589Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7134940Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7134982Z graph_break [] 2025-12-04T09:31:18.7135056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7135115Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7135213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7135559Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7135597Z graph_break [] 2025-12-04T09:31:18.7135671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7135730Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7135874Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7136215Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7136254Z graph_break [] 2025-12-04T09:31:18.7136327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7136383Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7136508Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7136852Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7136892Z graph_break [] 2025-12-04T09:31:18.7136965Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7137021Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7137117Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7137466Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7137503Z graph_break [] 2025-12-04T09:31:18.7137577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7137635Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7137737Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7138076Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7138114Z graph_break [] 2025-12-04T09:31:18.7138186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7138243Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7138341Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7138683Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7138724Z graph_break [] 2025-12-04T09:31:18.7138796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7138852Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7138948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7139293Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7139330Z graph_break [] 2025-12-04T09:31:18.7139406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7139461Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7139585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7139924Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7139962Z graph_break [] 2025-12-04T09:31:18.7140034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7140091Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7140210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7140550Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7140591Z graph_break [] 2025-12-04T09:31:18.7140664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7140724Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7140820Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7141164Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7141205Z graph_break [] 2025-12-04T09:31:18.7141278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7141336Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7141433Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7141780Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7141817Z graph_break [] 2025-12-04T09:31:18.7141891Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7141945Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7142045Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7142384Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7142423Z graph_break [] 2025-12-04T09:31:18.7142495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7142550Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7142646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7143043Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7143083Z graph_break [] 2025-12-04T09:31:18.7143155Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7143210Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7143344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7143686Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7143722Z graph_break [] 2025-12-04T09:31:18.7143795Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7143850Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7143979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7144320Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7144360Z graph_break [] 2025-12-04T09:31:18.7144442Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7144490Z Traceback (most recent call last): 2025-12-04T09:31:18.7144618Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7144658Z self.common( 2025-12-04T09:31:18.7144748Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7144791Z return func(*args, **kwds) 2025-12-04T09:31:18.7144831Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7144962Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7145001Z check_model( 2025-12-04T09:31:18.7145117Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7145162Z assert_equal_fn( 2025-12-04T09:31:18.7145302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7145364Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7145410Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7145571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7145644Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7145700Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7145702Z 2025-12-04T09:31:18.7145749Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7145852Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7145953Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7145956Z 2025-12-04T09:31:18.7146004Z The failure occurred for item [2] 2025-12-04T09:31:18.7146006Z 2025-12-04T09:31:18.7146081Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7146226Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7146229Z 2025-12-04T09:31:18.7146317Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7146391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7146447Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7146548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7146889Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7146953Z graph_break [] 2025-12-04T09:31:18.7147027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7147083Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7147180Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7147544Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7147583Z graph_break [] 2025-12-04T09:31:18.7147656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7147716Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7147815Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7148157Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7148194Z graph_break [] 2025-12-04T09:31:18.7148268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7148322Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7148420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7148762Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7148801Z graph_break [] 2025-12-04T09:31:18.7148875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7148929Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7149026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7149367Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7149407Z graph_break [] 2025-12-04T09:31:18.7149479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7149539Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7149636Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7149981Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7150018Z graph_break [] 2025-12-04T09:31:18.7150092Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7150148Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7150245Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7150587Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7150656Z graph_break [] 2025-12-04T09:31:18.7150730Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7150784Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7150881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7151221Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7151282Z graph_break [] 2025-12-04T09:31:18.7151354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7151412Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7151507Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7151853Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7151891Z graph_break [] 2025-12-04T09:31:18.7151965Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7152020Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7152118Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7152459Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7152498Z graph_break [] 2025-12-04T09:31:18.7152572Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7152629Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7152725Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7153109Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7153150Z graph_break [] 2025-12-04T09:31:18.7153222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7153283Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7153378Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7153723Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7153761Z graph_break [] 2025-12-04T09:31:18.7153833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7153891Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7153987Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7154333Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7154411Z graph_break [] 2025-12-04T09:31:18.7154485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7154539Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7154636Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7154977Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7155042Z graph_break [] 2025-12-04T09:31:18.7155115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7155172Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7155268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7155612Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7155651Z graph_break [] 2025-12-04T09:31:18.7155723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7159590Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7159687Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7160033Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7160076Z graph_break [] 2025-12-04T09:31:18.7160150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7160204Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7160301Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7160642Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7160681Z graph_break [] 2025-12-04T09:31:18.7160764Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7160813Z Traceback (most recent call last): 2025-12-04T09:31:18.7160938Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7160978Z self.common( 2025-12-04T09:31:18.7161065Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7161110Z return func(*args, **kwds) 2025-12-04T09:31:18.7161149Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7161276Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7161313Z check_model( 2025-12-04T09:31:18.7161431Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7161470Z assert_equal_fn( 2025-12-04T09:31:18.7161611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7161671Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7161717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7161877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7161989Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7162044Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7162047Z 2025-12-04T09:31:18.7162092Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7162196Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7162299Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7162301Z 2025-12-04T09:31:18.7162348Z The failure occurred for item [2] 2025-12-04T09:31:18.7162350Z 2025-12-04T09:31:18.7162446Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7162594Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7162596Z 2025-12-04T09:31:18.7162687Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7162763Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7162819Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7162919Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7163320Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7163359Z graph_break [] 2025-12-04T09:31:18.7163435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7163490Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7163591Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7163933Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7163971Z graph_break [] 2025-12-04T09:31:18.7164043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7164104Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7164201Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7164549Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7164588Z graph_break [] 2025-12-04T09:31:18.7164663Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7164718Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7164815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7165155Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7165196Z graph_break [] 2025-12-04T09:31:18.7165271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7165325Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7165421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7165795Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7165834Z graph_break [] 2025-12-04T09:31:18.7165906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7165964Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7166059Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7166435Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7166475Z graph_break [] 2025-12-04T09:31:18.7166548Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7166602Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7166699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7167040Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7167079Z graph_break [] 2025-12-04T09:31:18.7167154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7167208Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7167305Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7167650Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7167688Z graph_break [] 2025-12-04T09:31:18.7167760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7167816Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7167911Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7168254Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7168292Z graph_break [] 2025-12-04T09:31:18.7168366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7168419Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7168516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7168858Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7168894Z graph_break [] 2025-12-04T09:31:18.7168969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7169026Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7169124Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7169494Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7169533Z graph_break [] 2025-12-04T09:31:18.7169606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7169663Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7169760Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7170153Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7170193Z graph_break [] 2025-12-04T09:31:18.7170267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7170321Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7170417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7170761Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7170798Z graph_break [] 2025-12-04T09:31:18.7170874Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7170928Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7171024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7171365Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7171403Z graph_break [] 2025-12-04T09:31:18.7171475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7171530Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7171625Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7171969Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7172007Z graph_break [] 2025-12-04T09:31:18.7172081Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7172135Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7172231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7172576Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7172613Z graph_break [] 2025-12-04T09:31:18.7172690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7172744Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7172842Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7173246Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7173286Z graph_break [] 2025-12-04T09:31:18.7173361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7173414Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7173511Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7173878Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7173917Z graph_break [] 2025-12-04T09:31:18.7174001Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7174049Z Traceback (most recent call last): 2025-12-04T09:31:18.7174173Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7174214Z self.common( 2025-12-04T09:31:18.7174304Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7174352Z return func(*args, **kwds) 2025-12-04T09:31:18.7174391Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7174521Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7174558Z check_model( 2025-12-04T09:31:18.7174678Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7174717Z assert_equal_fn( 2025-12-04T09:31:18.7174858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7174921Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7174969Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7175127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7175203Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7175257Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7175259Z 2025-12-04T09:31:18.7175309Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7175409Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7175517Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7175520Z 2025-12-04T09:31:18.7175568Z The failure occurred for item [2] 2025-12-04T09:31:18.7175570Z 2025-12-04T09:31:18.7175645Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7175792Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7175794Z 2025-12-04T09:31:18.7175882Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7175955Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7176012Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7176111Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7176482Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7176520Z graph_break [] 2025-12-04T09:31:18.7176623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7176680Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7176776Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7177120Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7177159Z graph_break [] 2025-12-04T09:31:18.7177253Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7177313Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7177409Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7177757Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7177794Z graph_break [] 2025-12-04T09:31:18.7177867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7177921Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7178018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7178361Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7178399Z graph_break [] 2025-12-04T09:31:18.7178472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7178527Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7178622Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7178963Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7179001Z graph_break [] 2025-12-04T09:31:18.7179074Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7179133Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7179229Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7179573Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7179612Z graph_break [] 2025-12-04T09:31:18.7179685Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7179738Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7179835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7180175Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7180213Z graph_break [] 2025-12-04T09:31:18.7180313Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7180368Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7180464Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7180806Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7180843Z graph_break [] 2025-12-04T09:31:18.7180942Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7180997Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7181093Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7181436Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7181475Z graph_break [] 2025-12-04T09:31:18.7181547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7181601Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7181696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7182037Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7182075Z graph_break [] 2025-12-04T09:31:18.7182147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7182207Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7182303Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7182644Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7182681Z graph_break [] 2025-12-04T09:31:18.7182753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7182813Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7182910Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7183307Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7183346Z graph_break [] 2025-12-04T09:31:18.7183419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7183473Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7183569Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7183912Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7183951Z graph_break [] 2025-12-04T09:31:18.7184024Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7184116Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7184210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7184553Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7184593Z graph_break [] 2025-12-04T09:31:18.7184665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7184750Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7184847Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7185187Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7185225Z graph_break [] 2025-12-04T09:31:18.7185298Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7185352Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7185447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7185787Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7185826Z graph_break [] 2025-12-04T09:31:18.7185898Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7185955Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7186052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7186395Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7186432Z graph_break [] 2025-12-04T09:31:18.7186504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7186560Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7186655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7186994Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7187032Z graph_break [] 2025-12-04T09:31:18.7187106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7187164Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7187262Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7187607Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7187644Z graph_break [] 2025-12-04T09:31:18.7187718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7187796Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7187893Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7188237Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7188277Z graph_break [] 2025-12-04T09:31:18.7188357Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7188426Z Traceback (most recent call last): 2025-12-04T09:31:18.7188552Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7188590Z self.common( 2025-12-04T09:31:18.7188677Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7188722Z return func(*args, **kwds) 2025-12-04T09:31:18.7188760Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7188886Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7188923Z check_model( 2025-12-04T09:31:18.7189038Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7189076Z assert_equal_fn( 2025-12-04T09:31:18.7189214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7189273Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7189319Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7189478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7189551Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7189607Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7189609Z 2025-12-04T09:31:18.7189655Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7189755Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7189857Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7189859Z 2025-12-04T09:31:18.7189904Z The failure occurred for item [2] 2025-12-04T09:31:18.7189907Z 2025-12-04T09:31:18.7189980Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7190127Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7190129Z 2025-12-04T09:31:18.7190217Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7190291Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7190348Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7190449Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7190787Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7190826Z graph_break [] 2025-12-04T09:31:18.7190897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7190954Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7191049Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7191391Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7191454Z graph_break [] 2025-12-04T09:31:18.7191530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7191588Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7191687Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7192054Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7192091Z graph_break [] 2025-12-04T09:31:18.7192165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7192221Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7192319Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7192656Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7192693Z graph_break [] 2025-12-04T09:31:18.7192766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7192822Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7192918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7193286Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7193326Z graph_break [] 2025-12-04T09:31:18.7193399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7193458Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7193556Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7193907Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7193945Z graph_break [] 2025-12-04T09:31:18.7194018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7194075Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7194170Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7194511Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7194550Z graph_break [] 2025-12-04T09:31:18.7194621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7194681Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7194777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7195115Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7195192Z graph_break [] 2025-12-04T09:31:18.7195265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7195320Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7195417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7195789Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7195826Z graph_break [] 2025-12-04T09:31:18.7195901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7195957Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7196054Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7196397Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7196435Z graph_break [] 2025-12-04T09:31:18.7196507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7196569Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7196663Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7197005Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7197045Z graph_break [] 2025-12-04T09:31:18.7197145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7197203Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7197299Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7197642Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7197679Z graph_break [] 2025-12-04T09:31:18.7197753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7197808Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7197906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7198250Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7198287Z graph_break [] 2025-12-04T09:31:18.7198360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7198414Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7198511Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7198855Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7198920Z graph_break [] 2025-12-04T09:31:18.7198995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7199050Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7199145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7199513Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7199550Z graph_break [] 2025-12-04T09:31:18.7199622Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7199679Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7199777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7200124Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7200164Z graph_break [] 2025-12-04T09:31:18.7200237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7200294Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7200389Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7200732Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7200773Z graph_break [] 2025-12-04T09:31:18.7200845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7200900Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7200994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7201337Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7201374Z graph_break [] 2025-12-04T09:31:18.7201448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7201505Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7201602Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7201941Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7201980Z graph_break [] 2025-12-04T09:31:18.7202052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7202108Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7202204Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7202544Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7202603Z graph_break [] 2025-12-04T09:31:18.7202675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7202730Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7202825Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7203242Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7203279Z graph_break [] 2025-12-04T09:31:18.7203361Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7203408Z Traceback (most recent call last): 2025-12-04T09:31:18.7203536Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7203574Z self.common( 2025-12-04T09:31:18.7203663Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7203706Z return func(*args, **kwds) 2025-12-04T09:31:18.7203745Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7203870Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7203907Z check_model( 2025-12-04T09:31:18.7204024Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7204065Z assert_equal_fn( 2025-12-04T09:31:18.7204205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7204266Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7204314Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7204476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7204548Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7204603Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7204605Z 2025-12-04T09:31:18.7204651Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7204755Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7204858Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7204862Z 2025-12-04T09:31:18.7204909Z The failure occurred for item [2] 2025-12-04T09:31:18.7204911Z 2025-12-04T09:31:18.7204989Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7205134Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7205137Z 2025-12-04T09:31:18.7205226Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7205300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7205355Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7205452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7205797Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7205834Z graph_break [] 2025-12-04T09:31:18.7205906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7205960Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7206096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7206439Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7206478Z graph_break [] 2025-12-04T09:31:18.7206553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7206611Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7206729Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7207073Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7207112Z graph_break [] 2025-12-04T09:31:18.7207184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7207239Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7207336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7207682Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7207719Z graph_break [] 2025-12-04T09:31:18.7207794Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7207848Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7207948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7208287Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7208326Z graph_break [] 2025-12-04T09:31:18.7208400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7208457Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7208555Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7208894Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7208936Z graph_break [] 2025-12-04T09:31:18.7209006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7209064Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7209160Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7209501Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7209539Z graph_break [] 2025-12-04T09:31:18.7209613Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7209668Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7209794Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7210133Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7210171Z graph_break [] 2025-12-04T09:31:18.7210245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7210298Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7210416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7210758Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7210799Z graph_break [] 2025-12-04T09:31:18.7210871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7210927Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7211023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7211448Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7211485Z graph_break [] 2025-12-04T09:31:18.7211560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7211617Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7211717Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7212057Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7212093Z graph_break [] 2025-12-04T09:31:18.7212168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7212224Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7212324Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7212665Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7212705Z graph_break [] 2025-12-04T09:31:18.7212777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7212832Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7212963Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7213308Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7213345Z graph_break [] 2025-12-04T09:31:18.7213419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7213473Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7213607Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7213949Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7213985Z graph_break [] 2025-12-04T09:31:18.7214060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7214113Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7214235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7214582Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7214622Z graph_break [] 2025-12-04T09:31:18.7214695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7214749Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7214845Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7215195Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7215232Z graph_break [] 2025-12-04T09:31:18.7215307Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7215360Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7215458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7215801Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7215838Z graph_break [] 2025-12-04T09:31:18.7215912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7215968Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7216066Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7216414Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7216454Z graph_break [] 2025-12-04T09:31:18.7216527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7216585Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7216680Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7217028Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7217066Z graph_break [] 2025-12-04T09:31:18.7217140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7217194Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7217292Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7217656Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7217693Z graph_break [] 2025-12-04T09:31:18.7217766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7217820Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7217938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7218280Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7218319Z graph_break [] 2025-12-04T09:31:18.7218391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7218447Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7218543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7218888Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7218926Z graph_break [] 2025-12-04T09:31:18.7219008Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7219055Z Traceback (most recent call last): 2025-12-04T09:31:18.7219182Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7219220Z self.common( 2025-12-04T09:31:18.7219308Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7219351Z return func(*args, **kwds) 2025-12-04T09:31:18.7219390Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7219516Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7219555Z check_model( 2025-12-04T09:31:18.7219671Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7219710Z assert_equal_fn( 2025-12-04T09:31:18.7219850Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7219911Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7219957Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7220117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7220190Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7220243Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7220245Z 2025-12-04T09:31:18.7220293Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7220388Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7220481Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7220483Z 2025-12-04T09:31:18.7220529Z The failure occurred for item [2] 2025-12-04T09:31:18.7220531Z 2025-12-04T09:31:18.7220607Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7220754Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7220756Z 2025-12-04T09:31:18.7220868Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7220940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7220997Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7221094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7221438Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7221503Z graph_break [] 2025-12-04T09:31:18.7221576Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7221631Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7221727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7222072Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7222110Z graph_break [] 2025-12-04T09:31:18.7222183Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7222241Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7222338Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7222684Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7222724Z graph_break [] 2025-12-04T09:31:18.7222796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7222850Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7222993Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7223336Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7223373Z graph_break [] 2025-12-04T09:31:18.7223447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7223501Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7223596Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7223938Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7223975Z graph_break [] 2025-12-04T09:31:18.7224050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7224107Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7224204Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7224547Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7224626Z graph_break [] 2025-12-04T09:31:18.7224698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7224753Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7224849Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7225194Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7225233Z graph_break [] 2025-12-04T09:31:18.7225331Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7225386Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7225481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7225826Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7225863Z graph_break [] 2025-12-04T09:31:18.7225935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7225989Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7226084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7226427Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7226470Z graph_break [] 2025-12-04T09:31:18.7226541Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7226595Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7226691Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7227035Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7227073Z graph_break [] 2025-12-04T09:31:18.7227147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7227206Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7227302Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7227647Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7227683Z graph_break [] 2025-12-04T09:31:18.7227757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7227813Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7227910Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7228255Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7228324Z graph_break [] 2025-12-04T09:31:18.7228396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7228452Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7228548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7228888Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7228926Z graph_break [] 2025-12-04T09:31:18.7229024Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7229080Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7229176Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7229523Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7229559Z graph_break [] 2025-12-04T09:31:18.7229633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7229686Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7229783Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7230126Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7230165Z graph_break [] 2025-12-04T09:31:18.7230237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7230292Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7230388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7230727Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7230764Z graph_break [] 2025-12-04T09:31:18.7230837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7230893Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7230988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7231362Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7231400Z graph_break [] 2025-12-04T09:31:18.7231473Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7231527Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7231623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7231965Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7232031Z graph_break [] 2025-12-04T09:31:18.7232103Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7232161Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7232257Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7232599Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7232636Z graph_break [] 2025-12-04T09:31:18.7232727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7232783Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7232879Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7233279Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7233316Z graph_break [] 2025-12-04T09:31:18.7233390Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7233443Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7233540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7233881Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7233920Z graph_break [] 2025-12-04T09:31:18.7233993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7234047Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7234144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7234485Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7234524Z graph_break [] 2025-12-04T09:31:18.7234596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7234654Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7234751Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7235098Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7235134Z graph_break [] 2025-12-04T09:31:18.7235217Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7235263Z Traceback (most recent call last): 2025-12-04T09:31:18.7235388Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7235425Z self.common( 2025-12-04T09:31:18.7235516Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7235560Z return func(*args, **kwds) 2025-12-04T09:31:18.7235600Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7235725Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7235802Z check_model( 2025-12-04T09:31:18.7235917Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7235956Z assert_equal_fn( 2025-12-04T09:31:18.7236093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7236153Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7236198Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7236357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7236466Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7236520Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7236522Z 2025-12-04T09:31:18.7236568Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7236661Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7236756Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7236758Z 2025-12-04T09:31:18.7236803Z The failure occurred for item [2] 2025-12-04T09:31:18.7236804Z 2025-12-04T09:31:18.7236877Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7237024Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7237026Z 2025-12-04T09:31:18.7237115Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7237189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7237246Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7237344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7237687Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7237727Z graph_break [] 2025-12-04T09:31:18.7237798Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7237854Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7237950Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7238293Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7238329Z graph_break [] 2025-12-04T09:31:18.7238404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7238461Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7238557Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7238899Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7238938Z graph_break [] 2025-12-04T09:31:18.7239011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7239068Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7239164Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7239505Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7239573Z graph_break [] 2025-12-04T09:31:18.7239645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7239703Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7239798Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7240160Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7240198Z graph_break [] 2025-12-04T09:31:18.7240273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7240334Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7240433Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7240773Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7240814Z graph_break [] 2025-12-04T09:31:18.7240885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7240943Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7241038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7241380Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7241422Z graph_break [] 2025-12-04T09:31:18.7241494Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7241550Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7241646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7241991Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7242029Z graph_break [] 2025-12-04T09:31:18.7242105Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7242163Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7242260Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7242604Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7242646Z graph_break [] 2025-12-04T09:31:18.7242719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7242778Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7242875Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7243263Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7243338Z graph_break [] 2025-12-04T09:31:18.7243411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7243472Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7243570Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7243941Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7243978Z graph_break [] 2025-12-04T09:31:18.7244052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7244111Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7244208Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7244549Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7244588Z graph_break [] 2025-12-04T09:31:18.7244659Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7244715Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7244811Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7245153Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7245195Z graph_break [] 2025-12-04T09:31:18.7245269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7245326Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7245422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7245766Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7245803Z graph_break [] 2025-12-04T09:31:18.7245878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7245935Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7246032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7246374Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7246412Z graph_break [] 2025-12-04T09:31:18.7246484Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7246543Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7246638Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7246980Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7247045Z graph_break [] 2025-12-04T09:31:18.7247117Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7247175Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7247270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7247640Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7247679Z graph_break [] 2025-12-04T09:31:18.7247754Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7247810Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7247906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7248244Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7248284Z graph_break [] 2025-12-04T09:31:18.7248356Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7248418Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7248513Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7248856Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7248896Z graph_break [] 2025-12-04T09:31:18.7248969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7249026Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7249122Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7249465Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7249502Z graph_break [] 2025-12-04T09:31:18.7249575Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7249630Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7249726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7250068Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7250105Z graph_break [] 2025-12-04T09:31:18.7250178Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7250236Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7250332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7250674Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7250745Z graph_break [] 2025-12-04T09:31:18.7250816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7250875Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7250970Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7251333Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7251370Z graph_break [] 2025-12-04T09:31:18.7251444Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7251503Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7251599Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7251944Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7251983Z graph_break [] 2025-12-04T09:31:18.7252064Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7252111Z Traceback (most recent call last): 2025-12-04T09:31:18.7252238Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7252276Z self.common( 2025-12-04T09:31:18.7252363Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7252409Z return func(*args, **kwds) 2025-12-04T09:31:18.7252446Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7252575Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7252612Z check_model( 2025-12-04T09:31:18.7252730Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7252769Z assert_equal_fn( 2025-12-04T09:31:18.7252906Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7253003Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7253048Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7253209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7253281Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7253336Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7253339Z 2025-12-04T09:31:18.7253383Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7253478Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7253569Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7253571Z 2025-12-04T09:31:18.7253617Z The failure occurred for item [2] 2025-12-04T09:31:18.7253619Z 2025-12-04T09:31:18.7253692Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7253841Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7253843Z 2025-12-04T09:31:18.7253930Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7254005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7254104Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7254205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7254548Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7254585Z graph_break [] 2025-12-04T09:31:18.7254657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7254711Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7254835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7255178Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7255218Z graph_break [] 2025-12-04T09:31:18.7255290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7255350Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7255444Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7255787Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7255824Z graph_break [] 2025-12-04T09:31:18.7255898Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7255955Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7256052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7256394Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7256431Z graph_break [] 2025-12-04T09:31:18.7256504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7256558Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7256657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7257002Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7257042Z graph_break [] 2025-12-04T09:31:18.7257114Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7257173Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7257269Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7257615Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7257654Z graph_break [] 2025-12-04T09:31:18.7257729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7257809Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7257908Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7258256Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7258293Z graph_break [] 2025-12-04T09:31:18.7258366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7258420Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7258540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7258882Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7258924Z graph_break [] 2025-12-04T09:31:18.7258996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7259054Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7259149Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7259496Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7259534Z graph_break [] 2025-12-04T09:31:18.7259609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7259664Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7259765Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7260109Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7260148Z graph_break [] 2025-12-04T09:31:18.7260221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7260280Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7260379Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7260722Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7260762Z graph_break [] 2025-12-04T09:31:18.7260836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7260895Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7260991Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7261336Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7261374Z graph_break [] 2025-12-04T09:31:18.7261450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7261505Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7261631Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7261972Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7262008Z graph_break [] 2025-12-04T09:31:18.7262084Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7262139Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7262261Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7262602Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7262645Z graph_break [] 2025-12-04T09:31:18.7262718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7262775Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7262872Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7263269Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7263306Z graph_break [] 2025-12-04T09:31:18.7263383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7263438Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7263536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7263878Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7263916Z graph_break [] 2025-12-04T09:31:18.7263992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7264046Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7264146Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7264487Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7264529Z graph_break [] 2025-12-04T09:31:18.7264601Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7264659Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7264755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7265099Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7265138Z graph_break [] 2025-12-04T09:31:18.7265212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7265269Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7265412Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7265753Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7265792Z graph_break [] 2025-12-04T09:31:18.7265866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7265922Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7266052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7266397Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7266437Z graph_break [] 2025-12-04T09:31:18.7266511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7266568Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7266664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7267007Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7267045Z graph_break [] 2025-12-04T09:31:18.7267121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7267176Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7267275Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7267618Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7267655Z graph_break [] 2025-12-04T09:31:18.7267731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7267789Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7267887Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7268229Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7268270Z graph_break [] 2025-12-04T09:31:18.7268342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7268402Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7268499Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7268847Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7268885Z graph_break [] 2025-12-04T09:31:18.7268959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7269018Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7269139Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7269481Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7269518Z graph_break [] 2025-12-04T09:31:18.7269604Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7269650Z Traceback (most recent call last): 2025-12-04T09:31:18.7269801Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7269839Z self.common( 2025-12-04T09:31:18.7269929Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7269972Z return func(*args, **kwds) 2025-12-04T09:31:18.7270016Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7270143Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7270183Z check_model( 2025-12-04T09:31:18.7270298Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7270339Z assert_equal_fn( 2025-12-04T09:31:18.7270477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7270541Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7270586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7270751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7270824Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7270880Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7270883Z 2025-12-04T09:31:18.7270929Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7271035Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7271139Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7271144Z 2025-12-04T09:31:18.7271190Z The failure occurred for item [2] 2025-12-04T09:31:18.7271192Z 2025-12-04T09:31:18.7271268Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7271414Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7271416Z 2025-12-04T09:31:18.7271507Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7271580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7271639Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7271741Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7272083Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7272121Z graph_break [] 2025-12-04T09:31:18.7272196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7272251Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7272354Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7272697Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7272762Z graph_break [] 2025-12-04T09:31:18.7272837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7272896Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7273031Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7273405Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7273445Z graph_break [] 2025-12-04T09:31:18.7273519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7273578Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7273675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7274018Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7274056Z graph_break [] 2025-12-04T09:31:18.7274129Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7274184Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7274282Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7274627Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7274665Z graph_break [] 2025-12-04T09:31:18.7274741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7274801Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7274902Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7275251Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7275293Z graph_break [] 2025-12-04T09:31:18.7275366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7275424Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7275521Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7275869Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7275906Z graph_break [] 2025-12-04T09:31:18.7275982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7276037Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7276137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7276479Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7276550Z graph_break [] 2025-12-04T09:31:18.7276624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7276679Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7276777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7277123Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7277191Z graph_break [] 2025-12-04T09:31:18.7277264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7277322Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7277417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7277762Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7277798Z graph_break [] 2025-12-04T09:31:18.7277872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7277930Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7278029Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7278374Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7278415Z graph_break [] 2025-12-04T09:31:18.7278489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7278548Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7278646Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7278987Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7279028Z graph_break [] 2025-12-04T09:31:18.7279103Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7279160Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7279258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7279605Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7279642Z graph_break [] 2025-12-04T09:31:18.7279716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7279772Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7279871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7280215Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7280278Z graph_break [] 2025-12-04T09:31:18.7280352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7280407Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7280506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7280848Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7280888Z graph_break [] 2025-12-04T09:31:18.7280982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7281040Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7281137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7281481Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7281519Z graph_break [] 2025-12-04T09:31:18.7281593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7281649Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7281746Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7282085Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7282126Z graph_break [] 2025-12-04T09:31:18.7282202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7282255Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7282352Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7282693Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7282732Z graph_break [] 2025-12-04T09:31:18.7282808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7282869Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7283008Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7283354Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7283391Z graph_break [] 2025-12-04T09:31:18.7283466Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7283521Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7283618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7283964Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7284038Z graph_break [] 2025-12-04T09:31:18.7284113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7284168Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7284264Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7284603Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7284642Z graph_break [] 2025-12-04T09:31:18.7284741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7284800Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7284896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7285242Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7285280Z graph_break [] 2025-12-04T09:31:18.7285355Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7285413Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7285511Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7285855Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7285893Z graph_break [] 2025-12-04T09:31:18.7285968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7286025Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7286124Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7286464Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7286502Z graph_break [] 2025-12-04T09:31:18.7286576Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7286636Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7286734Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7287081Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7287119Z graph_break [] 2025-12-04T09:31:18.7287197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7287252Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7287350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7287694Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7287757Z graph_break [] 2025-12-04T09:31:18.7287841Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7287888Z Traceback (most recent call last): 2025-12-04T09:31:18.7288017Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7288053Z self.common( 2025-12-04T09:31:18.7288142Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7288185Z return func(*args, **kwds) 2025-12-04T09:31:18.7288225Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7288353Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7288417Z check_model( 2025-12-04T09:31:18.7288535Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7288576Z assert_equal_fn( 2025-12-04T09:31:18.7288714Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7288777Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7288823Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7288983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7289056Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7289111Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7289114Z 2025-12-04T09:31:18.7289159Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7289257Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7289353Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7289355Z 2025-12-04T09:31:18.7289408Z The failure occurred for item [2] 2025-12-04T09:31:18.7289410Z 2025-12-04T09:31:18.7289486Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7289636Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7289638Z 2025-12-04T09:31:18.7291868Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7291950Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7292009Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7292110Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7292459Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7292501Z graph_break [] 2025-12-04T09:31:18.7292574Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7292631Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7292730Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7293121Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7293159Z graph_break [] 2025-12-04T09:31:18.7293235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7293292Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7293391Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7293779Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7293818Z graph_break [] 2025-12-04T09:31:18.7293894Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7293948Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7294044Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7294427Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7294467Z graph_break [] 2025-12-04T09:31:18.7294541Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7294596Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7294692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7295035Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7295073Z graph_break [] 2025-12-04T09:31:18.7295149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7295207Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7295303Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7295652Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7295693Z graph_break [] 2025-12-04T09:31:18.7295766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7295820Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7295917Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7296259Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7296299Z graph_break [] 2025-12-04T09:31:18.7296373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7296428Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7296523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7296864Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7296901Z graph_break [] 2025-12-04T09:31:18.7296976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7297030Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7297127Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7297495Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7297534Z graph_break [] 2025-12-04T09:31:18.7297607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7297661Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7297758Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7298124Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7298164Z graph_break [] 2025-12-04T09:31:18.7298239Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7298296Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7298392Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7298734Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7298770Z graph_break [] 2025-12-04T09:31:18.7298846Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7298903Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7299000Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7299341Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7299382Z graph_break [] 2025-12-04T09:31:18.7299456Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7299510Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7299607Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7299954Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7299992Z graph_break [] 2025-12-04T09:31:18.7300065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7300121Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7300215Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7300555Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7300594Z graph_break [] 2025-12-04T09:31:18.7300670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7300725Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7300822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7301163Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7301227Z graph_break [] 2025-12-04T09:31:18.7301300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7301354Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7301451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7301813Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7301853Z graph_break [] 2025-12-04T09:31:18.7301926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7301983Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7302078Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7302421Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7302458Z graph_break [] 2025-12-04T09:31:18.7302530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7302588Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7302683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7303107Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7303148Z graph_break [] 2025-12-04T09:31:18.7303221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7303278Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7303375Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7303718Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7303756Z graph_break [] 2025-12-04T09:31:18.7303829Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7303885Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7303983Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7304326Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7304363Z graph_break [] 2025-12-04T09:31:18.7304435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7304491Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7304587Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7304929Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7305003Z graph_break [] 2025-12-04T09:31:18.7305076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7305130Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7305226Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7305594Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7305633Z graph_break [] 2025-12-04T09:31:18.7305707Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7305765Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7305862Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7306206Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7306244Z graph_break [] 2025-12-04T09:31:18.7306316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7306375Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7306470Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7306809Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7306848Z graph_break [] 2025-12-04T09:31:18.7306920Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7306977Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7307074Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7307415Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7307453Z graph_break [] 2025-12-04T09:31:18.7307526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7307583Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7307679Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7308020Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7308058Z graph_break [] 2025-12-04T09:31:18.7308130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7308189Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7308285Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7308628Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7308698Z graph_break [] 2025-12-04T09:31:18.7308779Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7308826Z Traceback (most recent call last): 2025-12-04T09:31:18.7308955Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7308993Z self.common( 2025-12-04T09:31:18.7309085Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7309149Z return func(*args, **kwds) 2025-12-04T09:31:18.7309190Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7309318Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7309356Z check_model( 2025-12-04T09:31:18.7309473Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7309513Z assert_equal_fn( 2025-12-04T09:31:18.7309653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7309713Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7309759Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7309918Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7309992Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7310047Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7310050Z 2025-12-04T09:31:18.7310097Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7310199Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7310304Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7310307Z 2025-12-04T09:31:18.7310352Z The failure occurred for item [2] 2025-12-04T09:31:18.7310354Z 2025-12-04T09:31:18.7310429Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7310576Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7310578Z 2025-12-04T09:31:18.7310666Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7310740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7310800Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7310897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7311240Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7311280Z graph_break [] 2025-12-04T09:31:18.7311352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7311408Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7311503Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7311845Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7311881Z graph_break [] 2025-12-04T09:31:18.7311955Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7312042Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7312140Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7312485Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7312523Z graph_break [] 2025-12-04T09:31:18.7312595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7312671Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7312767Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7313148Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7313187Z graph_break [] 2025-12-04T09:31:18.7313259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7313314Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7313409Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7313754Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7313791Z graph_break [] 2025-12-04T09:31:18.7313871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7313932Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7314033Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7314374Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7314412Z graph_break [] 2025-12-04T09:31:18.7314483Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7314540Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7314637Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7314977Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7315018Z graph_break [] 2025-12-04T09:31:18.7315090Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7315145Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7315239Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7315579Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7315615Z graph_break [] 2025-12-04T09:31:18.7315688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7315782Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7315878Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7316217Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7316255Z graph_break [] 2025-12-04T09:31:18.7316327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7316410Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7316506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7316849Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7316888Z graph_break [] 2025-12-04T09:31:18.7316960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7317018Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7317112Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7317453Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7317490Z graph_break [] 2025-12-04T09:31:18.7317563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7317621Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7317718Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7318061Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7318100Z graph_break [] 2025-12-04T09:31:18.7318172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7318228Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7318325Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7318668Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7318707Z graph_break [] 2025-12-04T09:31:18.7318779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7318834Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7318929Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7319273Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7319309Z graph_break [] 2025-12-04T09:31:18.7319382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7319463Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7319560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7319900Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7319937Z graph_break [] 2025-12-04T09:31:18.7320009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7320065Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7320182Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7320524Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7320564Z graph_break [] 2025-12-04T09:31:18.7320635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7320690Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7320785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7321129Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7321167Z graph_break [] 2025-12-04T09:31:18.7321240Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7321296Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7321393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7321735Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7321773Z graph_break [] 2025-12-04T09:31:18.7321845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7321903Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7322000Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7322342Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7322381Z graph_break [] 2025-12-04T09:31:18.7322452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7322507Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7322603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7322994Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7323030Z graph_break [] 2025-12-04T09:31:18.7323103Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7323157Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7323295Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7323636Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7323674Z graph_break [] 2025-12-04T09:31:18.7323745Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7323800Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7323927Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7324268Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7324307Z graph_break [] 2025-12-04T09:31:18.7324379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7324437Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7324532Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7324875Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7324912Z graph_break [] 2025-12-04T09:31:18.7324985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7325043Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7325143Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7325483Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7325520Z graph_break [] 2025-12-04T09:31:18.7325593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7325651Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7325748Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7326087Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7326126Z graph_break [] 2025-12-04T09:31:18.7326197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7326253Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7326347Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7326687Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7326724Z graph_break [] 2025-12-04T09:31:18.7326796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7326852Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7326972Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7327315Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7327354Z graph_break [] 2025-12-04T09:31:18.7327426Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7327481Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7327597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7327938Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7327977Z graph_break [] 2025-12-04T09:31:18.7328057Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7328104Z Traceback (most recent call last): 2025-12-04T09:31:18.7328230Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7328268Z self.common( 2025-12-04T09:31:18.7328355Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7328399Z return func(*args, **kwds) 2025-12-04T09:31:18.7328437Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7328566Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7328603Z check_model( 2025-12-04T09:31:18.7328720Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7328759Z assert_equal_fn( 2025-12-04T09:31:18.7328898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7328958Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7329006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7329165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7329239Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7329292Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7329294Z 2025-12-04T09:31:18.7329340Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7329441Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7329546Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7329551Z 2025-12-04T09:31:18.7329597Z The failure occurred for item [2] 2025-12-04T09:31:18.7329599Z 2025-12-04T09:31:18.7329672Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7329818Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7329820Z 2025-12-04T09:31:18.7329907Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7329982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7330038Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7330139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7330480Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7330545Z graph_break [] 2025-12-04T09:31:18.7330623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7330678Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7330774Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7331137Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7331175Z graph_break [] 2025-12-04T09:31:18.7331248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7331308Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7331407Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7331752Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7331789Z graph_break [] 2025-12-04T09:31:18.7331863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7331917Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7332015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7332357Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7332397Z graph_break [] 2025-12-04T09:31:18.7332469Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7332523Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7332618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7332994Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7333033Z graph_break [] 2025-12-04T09:31:18.7333105Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7333163Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7333260Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7333603Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7333640Z graph_break [] 2025-12-04T09:31:18.7333712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7333766Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7333865Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7334205Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7334287Z graph_break [] 2025-12-04T09:31:18.7334360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7334414Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7334509Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7334891Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7334928Z graph_break [] 2025-12-04T09:31:18.7335000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7335055Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7335152Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7335494Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7335530Z graph_break [] 2025-12-04T09:31:18.7335602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7335656Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7335754Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7336095Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7336133Z graph_break [] 2025-12-04T09:31:18.7336207Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7336264Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7336358Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7336701Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7336739Z graph_break [] 2025-12-04T09:31:18.7336811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7336868Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7336964Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7337308Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7337344Z graph_break [] 2025-12-04T09:31:18.7337417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7337470Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7337569Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7337913Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7337975Z graph_break [] 2025-12-04T09:31:18.7338048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7338101Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7338199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7338541Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7338603Z graph_break [] 2025-12-04T09:31:18.7338675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7338729Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7338824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7339167Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7339204Z graph_break [] 2025-12-04T09:31:18.7339278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7339332Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7339429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7339772Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7339812Z graph_break [] 2025-12-04T09:31:18.7339886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7339939Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7340036Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7340376Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7340415Z graph_break [] 2025-12-04T09:31:18.7340487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7340544Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7340638Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7340985Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7341023Z graph_break [] 2025-12-04T09:31:18.7341096Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7341156Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7341251Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7341598Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7341659Z graph_break [] 2025-12-04T09:31:18.7341735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7341789Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7341886Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7342227Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7342284Z graph_break [] 2025-12-04T09:31:18.7342357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7342413Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7342507Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7342849Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7342885Z graph_break [] 2025-12-04T09:31:18.7342998Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7343054Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7343149Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7343492Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7343531Z graph_break [] 2025-12-04T09:31:18.7343603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7343660Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7343758Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7344102Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7344142Z graph_break [] 2025-12-04T09:31:18.7344215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7344274Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7344368Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7344712Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7344749Z graph_break [] 2025-12-04T09:31:18.7344822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7344881Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7344976Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7345319Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7345390Z graph_break [] 2025-12-04T09:31:18.7345463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7345517Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7345614Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7345959Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7345998Z graph_break [] 2025-12-04T09:31:18.7346105Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7346163Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7346257Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7346604Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7346642Z graph_break [] 2025-12-04T09:31:18.7346713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7346768Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7346862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7347206Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7347244Z graph_break [] 2025-12-04T09:31:18.7347317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7347375Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7347471Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7347813Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7347850Z graph_break [] 2025-12-04T09:31:18.7347925Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7347981Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7348079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7348432Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7348473Z graph_break [] 2025-12-04T09:31:18.7348554Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7348602Z Traceback (most recent call last): 2025-12-04T09:31:18.7348727Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7348764Z self.common( 2025-12-04T09:31:18.7348853Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7348896Z return func(*args, **kwds) 2025-12-04T09:31:18.7348935Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7349062Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7349127Z check_model( 2025-12-04T09:31:18.7349242Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7349280Z assert_equal_fn( 2025-12-04T09:31:18.7349420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7349481Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7349527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7349723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7349798Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7349852Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7349854Z 2025-12-04T09:31:18.7349900Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7349996Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7350089Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7350091Z 2025-12-04T09:31:18.7350137Z The failure occurred for item [2] 2025-12-04T09:31:18.7350139Z 2025-12-04T09:31:18.7350212Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7350357Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7350360Z 2025-12-04T09:31:18.7350446Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7350520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7350576Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7350676Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7351019Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7351057Z graph_break [] 2025-12-04T09:31:18.7351128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7351182Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7351278Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7351619Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7351657Z graph_break [] 2025-12-04T09:31:18.7351729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7351787Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7351883Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7352225Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7352262Z graph_break [] 2025-12-04T09:31:18.7352338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7352393Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7352489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7365155Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7365192Z graph_break [] 2025-12-04T09:31:18.7365264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7365320Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7365415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7381126Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7381170Z graph_break [] 2025-12-04T09:31:18.7381245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7381305Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7381403Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7381747Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7381785Z graph_break [] 2025-12-04T09:31:18.7381864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7381918Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7382014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7382361Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7382398Z graph_break [] 2025-12-04T09:31:18.7382469Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7382523Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7382618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7382987Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7383027Z graph_break [] 2025-12-04T09:31:18.7383103Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7383158Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7383255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7383597Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7383634Z graph_break [] 2025-12-04T09:31:18.7383710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7383765Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7383861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7384284Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7384322Z graph_break [] 2025-12-04T09:31:18.7384394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7384452Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7384549Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7384936Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7384975Z graph_break [] 2025-12-04T09:31:18.7385050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7385108Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7385206Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7385550Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7385586Z graph_break [] 2025-12-04T09:31:18.7385662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7385715Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7385812Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7386156Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7386193Z graph_break [] 2025-12-04T09:31:18.7386265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7386321Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7386416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7386759Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7386795Z graph_break [] 2025-12-04T09:31:18.7386871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7386924Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7387020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7387360Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7387396Z graph_break [] 2025-12-04T09:31:18.7387473Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7387528Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7387624Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7387967Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7388030Z graph_break [] 2025-12-04T09:31:18.7388104Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7388159Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7388254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7402419Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7402458Z graph_break [] 2025-12-04T09:31:18.7402536Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7402590Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7402687Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7403045Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7403083Z graph_break [] 2025-12-04T09:31:18.7403158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7403216Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7403314Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7403655Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7403695Z graph_break [] 2025-12-04T09:31:18.7403769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7403824Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7403919Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7404265Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7404302Z graph_break [] 2025-12-04T09:31:18.7404376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7404431Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7404526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7404865Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7404902Z graph_break [] 2025-12-04T09:31:18.7404976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7405032Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7405213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7405551Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7405700Z graph_break [] 2025-12-04T09:31:18.7405773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7405830Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7405926Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7406304Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7406342Z graph_break [] 2025-12-04T09:31:18.7406414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7406474Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7406571Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7406913Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7406951Z graph_break [] 2025-12-04T09:31:18.7407026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7407085Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7407181Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7407519Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7407560Z graph_break [] 2025-12-04T09:31:18.7407633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7407689Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7407785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7408129Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7408165Z graph_break [] 2025-12-04T09:31:18.7408240Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7408299Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7408395Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7408738Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7408774Z graph_break [] 2025-12-04T09:31:18.7408848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7408904Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7409001Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7409340Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7409406Z graph_break [] 2025-12-04T09:31:18.7409480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7409538Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7409634Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7409997Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7410034Z graph_break [] 2025-12-04T09:31:18.7410109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7410164Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7410261Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7410607Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7410644Z graph_break [] 2025-12-04T09:31:18.7410718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7410779Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7410879Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7411219Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7411260Z graph_break [] 2025-12-04T09:31:18.7411332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7411389Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7411484Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7411826Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7411863Z graph_break [] 2025-12-04T09:31:18.7411946Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7411996Z Traceback (most recent call last): 2025-12-04T09:31:18.7412122Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7412163Z self.common( 2025-12-04T09:31:18.7412251Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7412295Z return func(*args, **kwds) 2025-12-04T09:31:18.7412333Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7412460Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7412496Z check_model( 2025-12-04T09:31:18.7412613Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7412652Z assert_equal_fn( 2025-12-04T09:31:18.7412791Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7412874Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7412921Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7413108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7413181Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7413235Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7413237Z 2025-12-04T09:31:18.7413282Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7413376Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7413504Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7413506Z 2025-12-04T09:31:18.7413552Z The failure occurred for item [2] 2025-12-04T09:31:18.7413554Z 2025-12-04T09:31:18.7413628Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7413775Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7413777Z 2025-12-04T09:31:18.7413865Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7413938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7413995Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7414095Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7414443Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7414480Z graph_break [] 2025-12-04T09:31:18.7414553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7414612Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7414708Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7415050Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7415087Z graph_break [] 2025-12-04T09:31:18.7415159Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7415218Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7415314Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7415652Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7415692Z graph_break [] 2025-12-04T09:31:18.7415763Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7415820Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7415916Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7416257Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7416294Z graph_break [] 2025-12-04T09:31:18.7416365Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7416457Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7416555Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7416898Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7416934Z graph_break [] 2025-12-04T09:31:18.7417007Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7417083Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7417181Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7417521Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7417560Z graph_break [] 2025-12-04T09:31:18.7417632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7417687Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7417784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7418124Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7418162Z graph_break [] 2025-12-04T09:31:18.7418234Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7418291Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7418386Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7418728Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7418764Z graph_break [] 2025-12-04T09:31:18.7418837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7418892Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7418989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7419327Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7419366Z graph_break [] 2025-12-04T09:31:18.7419438Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7419492Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7419589Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7419929Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7419966Z graph_break [] 2025-12-04T09:31:18.7420038Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7420125Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7420221Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7420565Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7420602Z graph_break [] 2025-12-04T09:31:18.7420677Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7420734Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7420852Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7421193Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7421232Z graph_break [] 2025-12-04T09:31:18.7421305Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7421360Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7421456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7421798Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7421836Z graph_break [] 2025-12-04T09:31:18.7421908Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7421964Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7422058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7422400Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7422437Z graph_break [] 2025-12-04T09:31:18.7422510Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7422563Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7422662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7423043Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7423082Z graph_break [] 2025-12-04T09:31:18.7423155Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7423209Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7423305Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7423645Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7423682Z graph_break [] 2025-12-04T09:31:18.7423754Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7423809Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7423942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7424281Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7424317Z graph_break [] 2025-12-04T09:31:18.7424389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7424443Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7424565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7424908Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7424947Z graph_break [] 2025-12-04T09:31:18.7425021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7425078Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7425174Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7425515Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7425553Z graph_break [] 2025-12-04T09:31:18.7425624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7425679Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7425778Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7426116Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7426153Z graph_break [] 2025-12-04T09:31:18.7426226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7426280Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7426377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7426715Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7426753Z graph_break [] 2025-12-04T09:31:18.7426826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7426879Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7426976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7427315Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7427352Z graph_break [] 2025-12-04T09:31:18.7427423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7427481Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7427601Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7427940Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7427977Z graph_break [] 2025-12-04T09:31:18.7428049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7428105Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7428231Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7428573Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7428613Z graph_break [] 2025-12-04T09:31:18.7428685Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7428742Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7428838Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7429182Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7429220Z graph_break [] 2025-12-04T09:31:18.7429292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7429346Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7429442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7429781Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7429818Z graph_break [] 2025-12-04T09:31:18.7429890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7429947Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7430044Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7430388Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7430426Z graph_break [] 2025-12-04T09:31:18.7430501Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7430555Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7430652Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7430995Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7431033Z graph_break [] 2025-12-04T09:31:18.7431106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7431162Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7431282Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7431623Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7431660Z graph_break [] 2025-12-04T09:31:18.7431733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7431787Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7431915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7432256Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7432294Z graph_break [] 2025-12-04T09:31:18.7432367Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7432423Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7432519Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7432863Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7432900Z graph_break [] 2025-12-04T09:31:18.7433002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7433059Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7433156Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7433500Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7433538Z graph_break [] 2025-12-04T09:31:18.7433612Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7433667Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7433765Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7434106Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7434144Z graph_break [] 2025-12-04T09:31:18.7434226Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7434272Z Traceback (most recent call last): 2025-12-04T09:31:18.7434399Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7434435Z self.common( 2025-12-04T09:31:18.7434524Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7434566Z return func(*args, **kwds) 2025-12-04T09:31:18.7434605Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7434732Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7434770Z check_model( 2025-12-04T09:31:18.7434885Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7434956Z assert_equal_fn( 2025-12-04T09:31:18.7435093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7435152Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7435197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7435356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7435428Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7435482Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7435484Z 2025-12-04T09:31:18.7435556Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7435659Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7435762Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7435766Z 2025-12-04T09:31:18.7435812Z The failure occurred for item [2] 2025-12-04T09:31:18.7435814Z 2025-12-04T09:31:18.7435886Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7436031Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7436033Z 2025-12-04T09:31:18.7436121Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7436194Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7436250Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7436349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7436691Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7436729Z graph_break [] 2025-12-04T09:31:18.7436802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7436856Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7436953Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7437299Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7437337Z graph_break [] 2025-12-04T09:31:18.7437409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7437467Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7437565Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7437907Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7437944Z graph_break [] 2025-12-04T09:31:18.7438017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7438072Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7438169Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7438511Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7438573Z graph_break [] 2025-12-04T09:31:18.7438646Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7438700Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7438795Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7439156Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7439195Z graph_break [] 2025-12-04T09:31:18.7439268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7439325Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7439423Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7439766Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7439804Z graph_break [] 2025-12-04T09:31:18.7439875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7439929Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7440026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7440366Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7440405Z graph_break [] 2025-12-04T09:31:18.7440478Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7440532Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7440628Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7440969Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7441010Z graph_break [] 2025-12-04T09:31:18.7441085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7441142Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7441236Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7441581Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7441618Z graph_break [] 2025-12-04T09:31:18.7441691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7441745Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7441841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7442185Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7442247Z graph_break [] 2025-12-04T09:31:18.7442320Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7442378Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7442475Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7442817Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7442878Z graph_break [] 2025-12-04T09:31:18.7442983Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7443041Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7443138Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7443484Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7443524Z graph_break [] 2025-12-04T09:31:18.7443599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7443656Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7443753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7444097Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7444136Z graph_break [] 2025-12-04T09:31:18.7444212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7444266Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7444362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7444700Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7444739Z graph_break [] 2025-12-04T09:31:18.7444812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7444867Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7444964Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7445305Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7445343Z graph_break [] 2025-12-04T09:31:18.7445414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7445470Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7445565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7445913Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7445983Z graph_break [] 2025-12-04T09:31:18.7446057Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7446111Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7446210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7446552Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7446627Z graph_break [] 2025-12-04T09:31:18.7446701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7446758Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7446854Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7447196Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7447234Z graph_break [] 2025-12-04T09:31:18.7447306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7447365Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7447461Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7447806Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7447846Z graph_break [] 2025-12-04T09:31:18.7447919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7447974Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7448074Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7448414Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7448451Z graph_break [] 2025-12-04T09:31:18.7448523Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7448578Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7448674Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7449015Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7449055Z graph_break [] 2025-12-04T09:31:18.7449127Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7449182Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7449278Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7449619Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7449680Z graph_break [] 2025-12-04T09:31:18.7449756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7449813Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7449909Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7450253Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7450290Z graph_break [] 2025-12-04T09:31:18.7450399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7450456Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7450553Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7450895Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7450933Z graph_break [] 2025-12-04T09:31:18.7451005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7451063Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7451158Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7451505Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7451543Z graph_break [] 2025-12-04T09:31:18.7451618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7451671Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7451767Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7452114Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7452151Z graph_break [] 2025-12-04T09:31:18.7452227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7452284Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7452381Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7452726Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7452766Z graph_break [] 2025-12-04T09:31:18.7452839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7452895Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7453027Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7453373Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7453445Z graph_break [] 2025-12-04T09:31:18.7453520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7453578Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7453674Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7454019Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7454057Z graph_break [] 2025-12-04T09:31:18.7454161Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7454217Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7454314Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7454657Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7454697Z graph_break [] 2025-12-04T09:31:18.7454770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7454829Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7454924Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7455268Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7455306Z graph_break [] 2025-12-04T09:31:18.7455381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7455439Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7455537Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7455877Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7455917Z graph_break [] 2025-12-04T09:31:18.7455992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7456048Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7456145Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7456491Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7456529Z graph_break [] 2025-12-04T09:31:18.7456601Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7456656Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7456750Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7457093Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7457155Z graph_break [] 2025-12-04T09:31:18.7457238Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7457285Z Traceback (most recent call last): 2025-12-04T09:31:18.7457410Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7457447Z self.common( 2025-12-04T09:31:18.7457535Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7457578Z return func(*args, **kwds) 2025-12-04T09:31:18.7457616Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7457742Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7457802Z check_model( 2025-12-04T09:31:18.7457918Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7457958Z assert_equal_fn( 2025-12-04T09:31:18.7458095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7458157Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7458202Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7458361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7458433Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7458486Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7458488Z 2025-12-04T09:31:18.7458533Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7458628Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7458721Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7458723Z 2025-12-04T09:31:18.7458769Z The failure occurred for item [2] 2025-12-04T09:31:18.7458771Z 2025-12-04T09:31:18.7458846Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7458990Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7458993Z 2025-12-04T09:31:18.7459080Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7459152Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7459209Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7459306Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7459647Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7459685Z graph_break [] 2025-12-04T09:31:18.7459760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7459815Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7459910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7460252Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7460288Z graph_break [] 2025-12-04T09:31:18.7460365Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7460423Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7460520Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7460895Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7460934Z graph_break [] 2025-12-04T09:31:18.7461006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7461061Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7461157Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7461521Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7461559Z graph_break [] 2025-12-04T09:31:18.7461633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7461692Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7461787Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7462127Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7462163Z graph_break [] 2025-12-04T09:31:18.7462238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7462296Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7462395Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7462746Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7462786Z graph_break [] 2025-12-04T09:31:18.7462860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7462917Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7463053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7463397Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7463434Z graph_break [] 2025-12-04T09:31:18.7463507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7463562Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7463658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7463998Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7464034Z graph_break [] 2025-12-04T09:31:18.7464107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7464160Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7464258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7464599Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7464670Z graph_break [] 2025-12-04T09:31:18.7464742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7464799Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7464894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7465262Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7465301Z graph_break [] 2025-12-04T09:31:18.7465375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7465433Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7465527Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7465870Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7465907Z graph_break [] 2025-12-04T09:31:18.7465984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7466041Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7466139Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7466482Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7466522Z graph_break [] 2025-12-04T09:31:18.7466595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7466649Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7466747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7467092Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7467130Z graph_break [] 2025-12-04T09:31:18.7467201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7467258Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7467352Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7467690Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7467726Z graph_break [] 2025-12-04T09:31:18.7467799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7467854Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7467949Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7468287Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7468345Z graph_break [] 2025-12-04T09:31:18.7468418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7468473Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7468568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7468929Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7468968Z graph_break [] 2025-12-04T09:31:18.7469041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7469097Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7469191Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7469530Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7469566Z graph_break [] 2025-12-04T09:31:18.7469639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7469693Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7469788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7470126Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7470165Z graph_break [] 2025-12-04T09:31:18.7470236Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7470293Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7470389Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7470732Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7470770Z graph_break [] 2025-12-04T09:31:18.7470842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7470899Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7470994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7471336Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7471373Z graph_break [] 2025-12-04T09:31:18.7471447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7471501Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7471596Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7471938Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7471996Z graph_break [] 2025-12-04T09:31:18.7472069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7472126Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7472220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7472581Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7472623Z graph_break [] 2025-12-04T09:31:18.7472695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7472757Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7472854Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7473236Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7473274Z graph_break [] 2025-12-04T09:31:18.7473348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7473408Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7473507Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7473847Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7473886Z graph_break [] 2025-12-04T09:31:18.7473958Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7474015Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7474110Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7474453Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7474491Z graph_break [] 2025-12-04T09:31:18.7474563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7474623Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7474717Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7475064Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7475101Z graph_break [] 2025-12-04T09:31:18.7475174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7475231Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7475329Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7475668Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7475755Z graph_break [] 2025-12-04T09:31:18.7475827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7475883Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7475981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7476346Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7476386Z graph_break [] 2025-12-04T09:31:18.7476458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7476518Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7476615Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7476962Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7476998Z graph_break [] 2025-12-04T09:31:18.7477074Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7477131Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7477229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7477568Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7477608Z graph_break [] 2025-12-04T09:31:18.7477679Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7477737Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7477833Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7478177Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7478216Z graph_break [] 2025-12-04T09:31:18.7478287Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7478349Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7478445Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7478785Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7478823Z graph_break [] 2025-12-04T09:31:18.7478898Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7478955Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7479054Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7479397Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7479481Z graph_break [] 2025-12-04T09:31:18.7479554Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7479612Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7479709Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7480070Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7480108Z graph_break [] 2025-12-04T09:31:18.7480179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7480240Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7480336Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7480678Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7480716Z graph_break [] 2025-12-04T09:31:18.7480798Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7480845Z Traceback (most recent call last): 2025-12-04T09:31:18.7480975Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7481011Z self.common( 2025-12-04T09:31:18.7481101Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7481146Z return func(*args, **kwds) 2025-12-04T09:31:18.7481186Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7481314Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7481353Z check_model( 2025-12-04T09:31:18.7481467Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7481508Z assert_equal_fn( 2025-12-04T09:31:18.7481645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7481706Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7481754Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7481912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7481984Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7482039Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7482041Z 2025-12-04T09:31:18.7482088Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7482189Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7482292Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7482294Z 2025-12-04T09:31:18.7482338Z The failure occurred for item [2] 2025-12-04T09:31:18.7482340Z 2025-12-04T09:31:18.7482415Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7482563Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7482565Z 2025-12-04T09:31:18.7482652Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7482724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7482810Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7482909Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7483298Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7483338Z graph_break [] 2025-12-04T09:31:18.7483411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7483493Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7483592Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7483935Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7483974Z graph_break [] 2025-12-04T09:31:18.7484048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7484105Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7484202Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7484544Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7484581Z graph_break [] 2025-12-04T09:31:18.7484653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7484712Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7484807Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7485148Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7485186Z graph_break [] 2025-12-04T09:31:18.7485260Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7485315Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7485411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7485756Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7485794Z graph_break [] 2025-12-04T09:31:18.7485867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7485923Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7486020Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7486363Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7486400Z graph_break [] 2025-12-04T09:31:18.7486472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7486560Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7486658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7487001Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7487040Z graph_break [] 2025-12-04T09:31:18.7487114Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7487168Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7487289Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7487633Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7487670Z graph_break [] 2025-12-04T09:31:18.7487743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7487797Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7487894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7488236Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7488275Z graph_break [] 2025-12-04T09:31:18.7488346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7488403Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7488498Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7488839Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7488878Z graph_break [] 2025-12-04T09:31:18.7488950Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7489009Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7489105Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7489449Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7489487Z graph_break [] 2025-12-04T09:31:18.7489559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7489617Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7489713Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7490055Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7490092Z graph_break [] 2025-12-04T09:31:18.7490163Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7490219Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7490340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7490681Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7490721Z graph_break [] 2025-12-04T09:31:18.7490794Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7490850Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7493294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7493646Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7493691Z graph_break [] 2025-12-04T09:31:18.7493766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7493822Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7493919Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7494265Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7494303Z graph_break [] 2025-12-04T09:31:18.7494376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7494430Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7494529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7494867Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7494905Z graph_break [] 2025-12-04T09:31:18.7494977Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7495032Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7495135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7495474Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7495516Z graph_break [] 2025-12-04T09:31:18.7495587Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7495642Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7495738Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7496081Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7496119Z graph_break [] 2025-12-04T09:31:18.7496192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7496249Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7496390Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7496733Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7496771Z graph_break [] 2025-12-04T09:31:18.7496843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7496899Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7497016Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7497358Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7497398Z graph_break [] 2025-12-04T09:31:18.7497470Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7497525Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7497621Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7497964Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7498001Z graph_break [] 2025-12-04T09:31:18.7498074Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7498128Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7498227Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7498572Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7498611Z graph_break [] 2025-12-04T09:31:18.7498683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7498741Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7498839Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7499181Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7499220Z graph_break [] 2025-12-04T09:31:18.7499292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7499351Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7499447Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7499792Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7499829Z graph_break [] 2025-12-04T09:31:18.7499901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7499957Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7500079Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7500422Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7500460Z graph_break [] 2025-12-04T09:31:18.7500534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7500589Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7500708Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7501052Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7501091Z graph_break [] 2025-12-04T09:31:18.7501162Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7501220Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7501315Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7501657Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7501694Z graph_break [] 2025-12-04T09:31:18.7501766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7501820Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7501919Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7502257Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7502296Z graph_break [] 2025-12-04T09:31:18.7502370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7502427Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7502526Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7502868Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7502907Z graph_break [] 2025-12-04T09:31:18.7503017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7503074Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7503169Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7503512Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7503549Z graph_break [] 2025-12-04T09:31:18.7503623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7503679Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7503812Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7504155Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7504191Z graph_break [] 2025-12-04T09:31:18.7504265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7504322Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7504456Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7504802Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7504841Z graph_break [] 2025-12-04T09:31:18.7504915Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7504971Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7505067Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7505408Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7505447Z graph_break [] 2025-12-04T09:31:18.7505519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7505573Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7505670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7506010Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7506046Z graph_break [] 2025-12-04T09:31:18.7506118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7506174Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7506272Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7506616Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7506654Z graph_break [] 2025-12-04T09:31:18.7506728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7506782Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7506879Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7507221Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7507259Z graph_break [] 2025-12-04T09:31:18.7507341Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7507389Z Traceback (most recent call last): 2025-12-04T09:31:18.7507522Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7507592Z self.common( 2025-12-04T09:31:18.7507683Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7507729Z return func(*args, **kwds) 2025-12-04T09:31:18.7507767Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7507896Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7507933Z check_model( 2025-12-04T09:31:18.7508049Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7508087Z assert_equal_fn( 2025-12-04T09:31:18.7508251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7508312Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7508359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7508522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7508597Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7508652Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7508656Z 2025-12-04T09:31:18.7508701Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7508806Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7508909Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7508911Z 2025-12-04T09:31:18.7508958Z The failure occurred for item [2] 2025-12-04T09:31:18.7508960Z 2025-12-04T09:31:18.7509035Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7509183Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7509187Z 2025-12-04T09:31:18.7509274Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7509348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7509403Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7509503Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7509844Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7509884Z graph_break [] 2025-12-04T09:31:18.7509957Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7510012Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7510107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7510453Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7510491Z graph_break [] 2025-12-04T09:31:18.7510563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7510621Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7510716Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7511064Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7511128Z graph_break [] 2025-12-04T09:31:18.7511201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7511256Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7511353Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7511695Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7511756Z graph_break [] 2025-12-04T09:31:18.7511828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7511883Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7511977Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7512322Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7512359Z graph_break [] 2025-12-04T09:31:18.7512431Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7512489Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7512584Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7512968Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7513007Z graph_break [] 2025-12-04T09:31:18.7513080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7513134Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7513230Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7513570Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7513609Z graph_break [] 2025-12-04T09:31:18.7513681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7513737Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7513832Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7514174Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7514212Z graph_break [] 2025-12-04T09:31:18.7514283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7514338Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7514434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7514776Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7514853Z graph_break [] 2025-12-04T09:31:18.7514928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7514982Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7515080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7515421Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7515458Z graph_break [] 2025-12-04T09:31:18.7515559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7515619Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7515714Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7516058Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7516096Z graph_break [] 2025-12-04T09:31:18.7516168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7516226Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7516321Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7516666Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7516704Z graph_break [] 2025-12-04T09:31:18.7516776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7516830Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7516926Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7517270Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7517307Z graph_break [] 2025-12-04T09:31:18.7517380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7517435Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7517530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7517870Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7517908Z graph_break [] 2025-12-04T09:31:18.7517979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7518034Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7518128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7518467Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7518540Z graph_break [] 2025-12-04T09:31:18.7518614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7518667Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7518763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7519106Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7519144Z graph_break [] 2025-12-04T09:31:18.7519235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7519293Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7519389Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7519731Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7519768Z graph_break [] 2025-12-04T09:31:18.7519839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7519894Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7519989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7520330Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7520368Z graph_break [] 2025-12-04T09:31:18.7520440Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7520498Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7520594Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7520935Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7520974Z graph_break [] 2025-12-04T09:31:18.7521048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7521104Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7521200Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7521543Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7521581Z graph_break [] 2025-12-04T09:31:18.7521652Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7521706Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7521801Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7522144Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7522205Z graph_break [] 2025-12-04T09:31:18.7522278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7522332Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7522429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7522768Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7522806Z graph_break [] 2025-12-04T09:31:18.7522901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7523005Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7523102Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7523449Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7523487Z graph_break [] 2025-12-04T09:31:18.7523559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7523616Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7523711Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7524055Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7524093Z graph_break [] 2025-12-04T09:31:18.7524166Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7524223Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7524319Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7524664Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7524701Z graph_break [] 2025-12-04T09:31:18.7524776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7524831Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7524926Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7525273Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7525310Z graph_break [] 2025-12-04T09:31:18.7525382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7525439Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7525535Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7525880Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7525917Z graph_break [] 2025-12-04T09:31:18.7526032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7526086Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7526182Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7526521Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7526559Z graph_break [] 2025-12-04T09:31:18.7526656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7526713Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7526809Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7527152Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7527190Z graph_break [] 2025-12-04T09:31:18.7527262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7527317Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7527411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7527755Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7527792Z graph_break [] 2025-12-04T09:31:18.7527866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7527923Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7528019Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7528360Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7528398Z graph_break [] 2025-12-04T09:31:18.7528472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7528528Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7528625Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7528968Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7529005Z graph_break [] 2025-12-04T09:31:18.7529077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7529134Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7529228Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7529574Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7529611Z graph_break [] 2025-12-04T09:31:18.7529712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7529766Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7529862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7530200Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7530238Z graph_break [] 2025-12-04T09:31:18.7530330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7530387Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7530483Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7530824Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7530863Z graph_break [] 2025-12-04T09:31:18.7530935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7530992Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7531087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7531431Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7531468Z graph_break [] 2025-12-04T09:31:18.7531543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7531597Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7531694Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7532037Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7532074Z graph_break [] 2025-12-04T09:31:18.7532157Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7532203Z Traceback (most recent call last): 2025-12-04T09:31:18.7532332Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7532369Z self.common( 2025-12-04T09:31:18.7532462Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7532505Z return func(*args, **kwds) 2025-12-04T09:31:18.7532545Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7532673Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7532712Z check_model( 2025-12-04T09:31:18.7532828Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7532867Z assert_equal_fn( 2025-12-04T09:31:18.7533032Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7533095Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7533141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7533301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7533412Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7533465Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7533467Z 2025-12-04T09:31:18.7533514Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7533616Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7533721Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7533723Z 2025-12-04T09:31:18.7533768Z The failure occurred for item [2] 2025-12-04T09:31:18.7533770Z 2025-12-04T09:31:18.7533844Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7534022Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7534024Z 2025-12-04T09:31:18.7534115Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7534190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7534248Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7534345Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7534689Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7534727Z graph_break [] 2025-12-04T09:31:18.7534802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7534858Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7534954Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7535297Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7535337Z graph_break [] 2025-12-04T09:31:18.7535412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7535469Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7535565Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7535912Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7535949Z graph_break [] 2025-12-04T09:31:18.7536023Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7536079Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7536174Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7536514Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7536552Z graph_break [] 2025-12-04T09:31:18.7536623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7536680Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7536774Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7537115Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7537181Z graph_break [] 2025-12-04T09:31:18.7537254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7537310Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7537406Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7537770Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7537808Z graph_break [] 2025-12-04T09:31:18.7537882Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7537939Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7538035Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7538375Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7538413Z graph_break [] 2025-12-04T09:31:18.7538484Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7538541Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7538635Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7538976Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7539016Z graph_break [] 2025-12-04T09:31:18.7539089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7539143Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7539238Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7539580Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7539617Z graph_break [] 2025-12-04T09:31:18.7539689Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7539745Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7539841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7540187Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7540224Z graph_break [] 2025-12-04T09:31:18.7540296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7540356Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7540450Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7540791Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7540851Z graph_break [] 2025-12-04T09:31:18.7540924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7540981Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7541077Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7541446Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7541484Z graph_break [] 2025-12-04T09:31:18.7541556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7541613Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7541708Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7542052Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7542090Z graph_break [] 2025-12-04T09:31:18.7542161Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7542218Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7542312Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7542651Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7542689Z graph_break [] 2025-12-04T09:31:18.7542761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7542814Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7542910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7543349Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7543387Z graph_break [] 2025-12-04T09:31:18.7543460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7543517Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7543612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7543956Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7543993Z graph_break [] 2025-12-04T09:31:18.7544065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7544122Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7544220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7544561Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7577402Z graph_break [] 2025-12-04T09:31:18.7577533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7577705Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7577896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7589968Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7590480Z graph_break [] 2025-12-04T09:31:18.7590609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7590784Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7590976Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7591454Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7591871Z graph_break [] 2025-12-04T09:31:18.7591997Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7592167Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7592355Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7592830Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7593286Z graph_break [] 2025-12-04T09:31:18.7593414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7593580Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7593766Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7594248Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7594663Z graph_break [] 2025-12-04T09:31:18.7594789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7594957Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7595145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7595618Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7596031Z graph_break [] 2025-12-04T09:31:18.7596156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7596325Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7596514Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7596990Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7597450Z graph_break [] 2025-12-04T09:31:18.7597578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7597748Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7597936Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7598440Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7598858Z graph_break [] 2025-12-04T09:31:18.7598983Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7599156Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7599347Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7599821Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7600234Z graph_break [] 2025-12-04T09:31:18.7600358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7600527Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7600715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7601191Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7601609Z graph_break [] 2025-12-04T09:31:18.7601734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7601905Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7602095Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7602584Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7603051Z graph_break [] 2025-12-04T09:31:18.7603177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7603348Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7603536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7604015Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7604430Z graph_break [] 2025-12-04T09:31:18.7604556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7604726Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7604917Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7605393Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7605859Z graph_break [] 2025-12-04T09:31:18.7605985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7606150Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7606338Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7606867Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7607280Z graph_break [] 2025-12-04T09:31:18.7607405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7607577Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7607767Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7608241Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7608656Z graph_break [] 2025-12-04T09:31:18.7608780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7608946Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7609140Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7609612Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7610030Z graph_break [] 2025-12-04T09:31:18.7610154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7610321Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7610508Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7610985Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7611399Z graph_break [] 2025-12-04T09:31:18.7611526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7611693Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7611881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7612357Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7612772Z graph_break [] 2025-12-04T09:31:18.7612896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7613100Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7613291Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7613762Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7614215Z graph_break [] 2025-12-04T09:31:18.7614342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7614509Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7614697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7615199Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7615613Z graph_break [] 2025-12-04T09:31:18.7615738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7615903Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7616096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7616573Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7616987Z graph_break [] 2025-12-04T09:31:18.7617115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7617281Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7617473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7617946Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7618362Z graph_break [] 2025-12-04T09:31:18.7618497Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7618660Z Traceback (most recent call last): 2025-12-04T09:31:18.7618867Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7619064Z self.common( 2025-12-04T09:31:18.7619209Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7619377Z return func(*args, **kwds) 2025-12-04T09:31:18.7619489Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7619679Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7619875Z check_model( 2025-12-04T09:31:18.7620046Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7620236Z assert_equal_fn( 2025-12-04T09:31:18.7620432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7620664Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7620805Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7621042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7621310Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7621469Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7621558Z 2025-12-04T09:31:18.7621605Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7621775Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7621996Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7622156Z 2025-12-04T09:31:18.7622202Z The failure occurred for item [2] 2025-12-04T09:31:18.7622283Z 2025-12-04T09:31:18.7622357Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7622608Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7622789Z 2025-12-04T09:31:18.7622877Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7623106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7623273Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7623503Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7623982Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7624398Z graph_break [] 2025-12-04T09:31:18.7624531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7624700Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7624888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7625366Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7625785Z graph_break [] 2025-12-04T09:31:18.7625911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7626081Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7626274Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7626753Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7627166Z graph_break [] 2025-12-04T09:31:18.7627292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7627457Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7627648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7628121Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7628535Z graph_break [] 2025-12-04T09:31:18.7628659Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7628825Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7629012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7629490Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7629906Z graph_break [] 2025-12-04T09:31:18.7630030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7630200Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7630424Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7630899Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7631312Z graph_break [] 2025-12-04T09:31:18.7631436Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7631601Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7631811Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7632282Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7632696Z graph_break [] 2025-12-04T09:31:18.7632821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7633020Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7633207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7633685Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7634099Z graph_break [] 2025-12-04T09:31:18.7634223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7634390Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7634581Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7635136Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7635547Z graph_break [] 2025-12-04T09:31:18.7635672Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7635837Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7636025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7636498Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7636913Z graph_break [] 2025-12-04T09:31:18.7637037Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7637257Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7637446Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7637926Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7638341Z graph_break [] 2025-12-04T09:31:18.7638465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7638635Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7638863Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7639337Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7639752Z graph_break [] 2025-12-04T09:31:18.7639877Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7640044Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7640262Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7640739Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7641158Z graph_break [] 2025-12-04T09:31:18.7641282Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7641449Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7641636Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7642109Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7642526Z graph_break [] 2025-12-04T09:31:18.7642651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7642816Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7643051Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7643526Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7643941Z graph_break [] 2025-12-04T09:31:18.7644066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7644232Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7644421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7644899Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7645316Z graph_break [] 2025-12-04T09:31:18.7645440Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7645606Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7645791Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7646263Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7646679Z graph_break [] 2025-12-04T09:31:18.7646804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7646971Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7647158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7647675Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7648088Z graph_break [] 2025-12-04T09:31:18.7648212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7648380Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7648599Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7649072Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7649490Z graph_break [] 2025-12-04T09:31:18.7649615Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7649780Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7649971Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7650449Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7650867Z graph_break [] 2025-12-04T09:31:18.7650990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7651155Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7651340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7651816Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7652230Z graph_break [] 2025-12-04T09:31:18.7652358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7652526Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7652713Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7653256Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7653674Z graph_break [] 2025-12-04T09:31:18.7653800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7653968Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7654156Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7654634Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7655053Z graph_break [] 2025-12-04T09:31:18.7655177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7655350Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7655538Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7656053Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7656469Z graph_break [] 2025-12-04T09:31:18.7656596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7656767Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7656954Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7657453Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7657868Z graph_break [] 2025-12-04T09:31:18.7657993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7658160Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7658349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7658828Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7659245Z graph_break [] 2025-12-04T09:31:18.7659370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7659540Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7659728Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7660209Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7660622Z graph_break [] 2025-12-04T09:31:18.7660745Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7660909Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7661095Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7661568Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7661984Z graph_break [] 2025-12-04T09:31:18.7662113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7662280Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7662469Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7662980Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7663397Z graph_break [] 2025-12-04T09:31:18.7663524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7663691Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7663879Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7664390Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7664803Z graph_break [] 2025-12-04T09:31:18.7664926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7665093Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7665281Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7665783Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7666200Z graph_break [] 2025-12-04T09:31:18.7666322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7666491Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7666678Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7667155Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7667572Z graph_break [] 2025-12-04T09:31:18.7667698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7667867Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7668054Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7668541Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7668953Z graph_break [] 2025-12-04T09:31:18.7669077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7669242Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7669429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7669904Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7670320Z graph_break [] 2025-12-04T09:31:18.7670445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7670611Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7670799Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7671271Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7671687Z graph_break [] 2025-12-04T09:31:18.7671813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7671981Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7672170Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7672675Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7673130Z graph_break [] 2025-12-04T09:31:18.7673256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7673424Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7673613Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7674125Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7674545Z graph_break [] 2025-12-04T09:31:18.7674670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7674834Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7675022Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7675495Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7675910Z graph_break [] 2025-12-04T09:31:18.7676035Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7676206Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7676397Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7676875Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7677290Z graph_break [] 2025-12-04T09:31:18.7677427Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7677593Z Traceback (most recent call last): 2025-12-04T09:31:18.7677800Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7678000Z self.common( 2025-12-04T09:31:18.7678149Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7678317Z return func(*args, **kwds) 2025-12-04T09:31:18.7678429Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7678622Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7678822Z check_model( 2025-12-04T09:31:18.7678994Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7679185Z assert_equal_fn( 2025-12-04T09:31:18.7679384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7679620Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7679762Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7680006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7680279Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7680439Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7680527Z 2025-12-04T09:31:18.7680572Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7680782Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7681004Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7681134Z 2025-12-04T09:31:18.7681180Z The failure occurred for item [2] 2025-12-04T09:31:18.7681258Z 2025-12-04T09:31:18.7681333Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7681586Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7681767Z 2025-12-04T09:31:18.7681855Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7682076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7682244Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7682437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7682925Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7683379Z graph_break [] 2025-12-04T09:31:18.7683512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7683677Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7683864Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7684341Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7684758Z graph_break [] 2025-12-04T09:31:18.7684887Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7685058Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7685247Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7685725Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7686140Z graph_break [] 2025-12-04T09:31:18.7686269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7686435Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7686622Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7687098Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7687517Z graph_break [] 2025-12-04T09:31:18.7687650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7687816Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7688004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7688483Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7688897Z graph_break [] 2025-12-04T09:31:18.7689068Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7689237Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7689429Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7689904Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7690319Z graph_break [] 2025-12-04T09:31:18.7690476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7690643Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7690830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7691304Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7691722Z graph_break [] 2025-12-04T09:31:18.7691846Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7692016Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7692202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7692680Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7693128Z graph_break [] 2025-12-04T09:31:18.7693260Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7693426Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7693612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7694086Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7694498Z graph_break [] 2025-12-04T09:31:18.7694628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7694795Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7694981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7695453Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7695870Z graph_break [] 2025-12-04T09:31:18.7695995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7696162Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7696353Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7696835Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7697249Z graph_break [] 2025-12-04T09:31:18.7697418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7697589Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7697779Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7698255Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7698668Z graph_break [] 2025-12-04T09:31:18.7698830Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7698997Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7699184Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7699658Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7700080Z graph_break [] 2025-12-04T09:31:18.7700204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7700372Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7700560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7701036Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7701449Z graph_break [] 2025-12-04T09:31:18.7701583Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7701750Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7701937Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7702412Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7702826Z graph_break [] 2025-12-04T09:31:18.7702990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7703156Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7703344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7703826Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7704245Z graph_break [] 2025-12-04T09:31:18.7704371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7704538Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7704727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7705205Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7705624Z graph_break [] 2025-12-04T09:31:18.7705751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7705960Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7706148Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7706626Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7707040Z graph_break [] 2025-12-04T09:31:18.7707169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7707370Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7710735Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7711218Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7711640Z graph_break [] 2025-12-04T09:31:18.7711769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7711939Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7712128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7712609Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7713070Z graph_break [] 2025-12-04T09:31:18.7713197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7713367Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7713558Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7714033Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7714449Z graph_break [] 2025-12-04T09:31:18.7714578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7714750Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7714938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7715408Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7715824Z graph_break [] 2025-12-04T09:31:18.7715953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7716123Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7716314Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7716793Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7717207Z graph_break [] 2025-12-04T09:31:18.7717335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7717548Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7717738Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7718218Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7718632Z graph_break [] 2025-12-04T09:31:18.7718757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7718963Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7719152Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7719633Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7720052Z graph_break [] 2025-12-04T09:31:18.7720177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7720345Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7720533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7721007Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7721427Z graph_break [] 2025-12-04T09:31:18.7721552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7721723Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7721913Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7722389Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7722804Z graph_break [] 2025-12-04T09:31:18.7722960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7723131Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7723318Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7723796Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7724212Z graph_break [] 2025-12-04T09:31:18.7724336Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7724503Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7724692Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7725169Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7725587Z graph_break [] 2025-12-04T09:31:18.7725711Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7725921Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7726108Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7726582Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7726996Z graph_break [] 2025-12-04T09:31:18.7727121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7727320Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7727419Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7727762Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7727804Z graph_break [] 2025-12-04T09:31:18.7727877Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7727937Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7728034Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7728377Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7728414Z graph_break [] 2025-12-04T09:31:18.7728489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7728550Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7728648Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7728992Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7729028Z graph_break [] 2025-12-04T09:31:18.7729101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7729157Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7729254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7729594Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7729634Z graph_break [] 2025-12-04T09:31:18.7729706Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7729764Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7729860Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7730207Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7730243Z graph_break [] 2025-12-04T09:31:18.7730317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7730404Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7730500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7730839Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7730875Z graph_break [] 2025-12-04T09:31:18.7730948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7731023Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7731119Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7731456Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7731496Z graph_break [] 2025-12-04T09:31:18.7731567Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7731623Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7731717Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7732060Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7732097Z graph_break [] 2025-12-04T09:31:18.7732169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7732228Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7732324Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7732667Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7732704Z graph_break [] 2025-12-04T09:31:18.7732776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7732833Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7732972Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7733314Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7733353Z graph_break [] 2025-12-04T09:31:18.7733435Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7733483Z Traceback (most recent call last): 2025-12-04T09:31:18.7733616Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7733655Z self.common( 2025-12-04T09:31:18.7733746Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7733792Z return func(*args, **kwds) 2025-12-04T09:31:18.7733833Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7733962Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7733999Z check_model( 2025-12-04T09:31:18.7734116Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7734197Z assert_equal_fn( 2025-12-04T09:31:18.7734342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7734403Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7734450Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7734609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7734688Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7734771Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7734776Z 2025-12-04T09:31:18.7734822Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7734927Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7735028Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7735032Z 2025-12-04T09:31:18.7735077Z The failure occurred for item [2] 2025-12-04T09:31:18.7735079Z 2025-12-04T09:31:18.7735154Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7735301Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7735303Z 2025-12-04T09:31:18.7735392Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7735467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7735526Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7735626Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7735967Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7736008Z graph_break [] 2025-12-04T09:31:18.7736080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7736136Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7736231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7736580Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7736618Z graph_break [] 2025-12-04T09:31:18.7736690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7736749Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7736843Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7737186Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7737223Z graph_break [] 2025-12-04T09:31:18.7737296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7737350Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7737447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7737790Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7737857Z graph_break [] 2025-12-04T09:31:18.7737928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7737983Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7738079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7738451Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7738491Z graph_break [] 2025-12-04T09:31:18.7738564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7738625Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7738720Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7739063Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7739099Z graph_break [] 2025-12-04T09:31:18.7739171Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7739225Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7739322Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7739662Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7739702Z graph_break [] 2025-12-04T09:31:18.7739773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7739829Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7739925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7740266Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7740306Z graph_break [] 2025-12-04T09:31:18.7740378Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7740433Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7740531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7740870Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7740906Z graph_break [] 2025-12-04T09:31:18.7740978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7741032Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7741129Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7741467Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7753534Z graph_break [] 2025-12-04T09:31:18.7753606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7753665Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7753762Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7754138Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7754176Z graph_break [] 2025-12-04T09:31:18.7754248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7754307Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7754404Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7754749Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7754785Z graph_break [] 2025-12-04T09:31:18.7754858Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7754912Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7755011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7755351Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7755391Z graph_break [] 2025-12-04T09:31:18.7755462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7755518Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7755613Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7755955Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7755994Z graph_break [] 2025-12-04T09:31:18.7756065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7756120Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7756218Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7756561Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7756597Z graph_break [] 2025-12-04T09:31:18.7756670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7756724Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7756822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7757161Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7757231Z graph_break [] 2025-12-04T09:31:18.7757303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7757358Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7757454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7757820Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7757858Z graph_break [] 2025-12-04T09:31:18.7757929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7757984Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7758080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7758423Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7758459Z graph_break [] 2025-12-04T09:31:18.7758532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7758588Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7758687Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7759032Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7759071Z graph_break [] 2025-12-04T09:31:18.7759144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7759197Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7759293Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7759632Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7759670Z graph_break [] 2025-12-04T09:31:18.7759742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7759797Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7759894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7760232Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7760270Z graph_break [] 2025-12-04T09:31:18.7760342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7760396Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7760493Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7760833Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7760901Z graph_break [] 2025-12-04T09:31:18.7760974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7761032Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7761127Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7761485Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7761523Z graph_break [] 2025-12-04T09:31:18.7761597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7761655Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7761752Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7762094Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7762131Z graph_break [] 2025-12-04T09:31:18.7762205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7762262Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7762361Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7762700Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7762739Z graph_break [] 2025-12-04T09:31:18.7762813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7762867Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7762995Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7763340Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7763377Z graph_break [] 2025-12-04T09:31:18.7763448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7763505Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7763602Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7763941Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7763977Z graph_break [] 2025-12-04T09:31:18.7764051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7764108Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7764204Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7764542Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7764625Z graph_break [] 2025-12-04T09:31:18.7764698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7764755Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7764851Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7765223Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7765262Z graph_break [] 2025-12-04T09:31:18.7765334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7765388Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7765486Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7765825Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7765862Z graph_break [] 2025-12-04T09:31:18.7765933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7765990Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7766089Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7766433Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7766471Z graph_break [] 2025-12-04T09:31:18.7766543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7766599Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7766694Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7767034Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7767073Z graph_break [] 2025-12-04T09:31:18.7767144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7767201Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7767296Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7767637Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7767674Z graph_break [] 2025-12-04T09:31:18.7767745Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7767801Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7767897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7768240Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7768305Z graph_break [] 2025-12-04T09:31:18.7768377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7768433Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7768530Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7768870Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7768929Z graph_break [] 2025-12-04T09:31:18.7769003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7769057Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7769154Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7769498Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7769535Z graph_break [] 2025-12-04T09:31:18.7769606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7769661Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7769757Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7770098Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7770137Z graph_break [] 2025-12-04T09:31:18.7770209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7770262Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7770357Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7770697Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7770735Z graph_break [] 2025-12-04T09:31:18.7770808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7770864Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7770961Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7771307Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7771344Z graph_break [] 2025-12-04T09:31:18.7771416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7771473Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7771567Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7771912Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7771975Z graph_break [] 2025-12-04T09:31:18.7772048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7772102Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7772198Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7772540Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7772598Z graph_break [] 2025-12-04T09:31:18.7772682Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7772729Z Traceback (most recent call last): 2025-12-04T09:31:18.7772856Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7772895Z self.common( 2025-12-04T09:31:18.7773018Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7773063Z return func(*args, **kwds) 2025-12-04T09:31:18.7773101Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7773227Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7773266Z check_model( 2025-12-04T09:31:18.7773382Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7773420Z assert_equal_fn( 2025-12-04T09:31:18.7773562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7773624Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7773670Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7773831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7773905Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7773959Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7773962Z 2025-12-04T09:31:18.7774007Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7774109Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7774211Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7774213Z 2025-12-04T09:31:18.7774261Z The failure occurred for item [2] 2025-12-04T09:31:18.7774263Z 2025-12-04T09:31:18.7774337Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7774486Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7774488Z 2025-12-04T09:31:18.7774581Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7774654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7774711Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7774809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7775152Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7775191Z graph_break [] 2025-12-04T09:31:18.7775264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7775319Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7775416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7775805Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7775845Z graph_break [] 2025-12-04T09:31:18.7775917Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7775976Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7776071Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7776440Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7776481Z graph_break [] 2025-12-04T09:31:18.7776555Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7776611Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7776706Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7777049Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7777086Z graph_break [] 2025-12-04T09:31:18.7777160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7777213Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7777311Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7777655Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7777694Z graph_break [] 2025-12-04T09:31:18.7777767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7777824Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7777920Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7778266Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7778308Z graph_break [] 2025-12-04T09:31:18.7778381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7778437Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7778533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7786165Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7786203Z graph_break [] 2025-12-04T09:31:18.7786283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7786338Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7786434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7786827Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7786866Z graph_break [] 2025-12-04T09:31:18.7786938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7786995Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7787090Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7787466Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7787509Z graph_break [] 2025-12-04T09:31:18.7787581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7787635Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7787729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7788068Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7788105Z graph_break [] 2025-12-04T09:31:18.7788179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7788236Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7788332Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7788678Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7788716Z graph_break [] 2025-12-04T09:31:18.7788787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7788847Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7788942Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7789294Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7789335Z graph_break [] 2025-12-04T09:31:18.7789406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7789460Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7789556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7789896Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7789932Z graph_break [] 2025-12-04T09:31:18.7790009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7790063Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7790158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7790522Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7790560Z graph_break [] 2025-12-04T09:31:18.7790632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7790689Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7790784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7791146Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7791186Z graph_break [] 2025-12-04T09:31:18.7791257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7791311Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7791408Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7791750Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7791786Z graph_break [] 2025-12-04T09:31:18.7791861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7791916Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7792011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7792352Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7792390Z graph_break [] 2025-12-04T09:31:18.7792461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7792516Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7792612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7792986Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7793025Z graph_break [] 2025-12-04T09:31:18.7793096Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7793156Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7793251Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7793592Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7793628Z graph_break [] 2025-12-04T09:31:18.7793703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7793758Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7793854Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7794235Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7794273Z graph_break [] 2025-12-04T09:31:18.7794345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7794404Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7794500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7794880Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7794919Z graph_break [] 2025-12-04T09:31:18.7794994Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7795050Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7795144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7795488Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7795525Z graph_break [] 2025-12-04T09:31:18.7795599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7795656Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7795751Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7796092Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7796130Z graph_break [] 2025-12-04T09:31:18.7796202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7796263Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7796357Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7796698Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7796736Z graph_break [] 2025-12-04T09:31:18.7796812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7796870Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7796966Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7797305Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7797342Z graph_break [] 2025-12-04T09:31:18.7797417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7797471Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7797568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7797933Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7797973Z graph_break [] 2025-12-04T09:31:18.7798045Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7798105Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7798200Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7798569Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7798608Z graph_break [] 2025-12-04T09:31:18.7798683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7798739Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7798835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7799178Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7799214Z graph_break [] 2025-12-04T09:31:18.7799289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7799347Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7799444Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7799783Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7799823Z graph_break [] 2025-12-04T09:31:18.7799895Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7799951Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7800048Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7800391Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7800430Z graph_break [] 2025-12-04T09:31:18.7800504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7800565Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7800661Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7801004Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7801040Z graph_break [] 2025-12-04T09:31:18.7801114Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7801170Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7801266Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7801605Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7801669Z graph_break [] 2025-12-04T09:31:18.7801741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7801798Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7801894Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7802254Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7802294Z graph_break [] 2025-12-04T09:31:18.7802366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7802423Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7802519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7802860Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7802897Z graph_break [] 2025-12-04T09:31:18.7803014Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7803071Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7803168Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7803510Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7803551Z graph_break [] 2025-12-04T09:31:18.7803622Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7803677Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7803773Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7804115Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7804153Z graph_break [] 2025-12-04T09:31:18.7804226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7804283Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7804379Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7804722Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7804759Z graph_break [] 2025-12-04T09:31:18.7804834Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7804889Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7804985Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7805326Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7805396Z graph_break [] 2025-12-04T09:31:18.7805467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7805525Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7805622Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7805990Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7806029Z graph_break [] 2025-12-04T09:31:18.7806101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7806161Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7806256Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7806600Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7806637Z graph_break [] 2025-12-04T09:31:18.7806710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7806765Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7806861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7807199Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7807238Z graph_break [] 2025-12-04T09:31:18.7807310Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7807364Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7807459Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7807799Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7807837Z graph_break [] 2025-12-04T09:31:18.7807918Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7807966Z Traceback (most recent call last): 2025-12-04T09:31:18.7808091Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7808130Z self.common( 2025-12-04T09:31:18.7808216Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7808263Z return func(*args, **kwds) 2025-12-04T09:31:18.7808302Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7808428Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7808466Z check_model( 2025-12-04T09:31:18.7808583Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7808621Z assert_equal_fn( 2025-12-04T09:31:18.7808759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7808843Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7808889Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7809047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7809121Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7809175Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7809177Z 2025-12-04T09:31:18.7809225Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7809326Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7809449Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7809452Z 2025-12-04T09:31:18.7809498Z The failure occurred for item [2] 2025-12-04T09:31:18.7809500Z 2025-12-04T09:31:18.7809573Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7809720Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7809723Z 2025-12-04T09:31:18.7809811Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7809886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7809943Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7810042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7810382Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7810422Z graph_break [] 2025-12-04T09:31:18.7810495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7810553Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7810648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7810987Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7811026Z graph_break [] 2025-12-04T09:31:18.7811099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7811158Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7811253Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7811596Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7811634Z graph_break [] 2025-12-04T09:31:18.7811707Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7811761Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7811857Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7812196Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7812234Z graph_break [] 2025-12-04T09:31:18.7812306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7812384Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7812480Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7812820Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7812857Z graph_break [] 2025-12-04T09:31:18.7812969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7813065Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7813161Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7813502Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7813540Z graph_break [] 2025-12-04T09:31:18.7813612Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7813666Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7813763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7814107Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7814144Z graph_break [] 2025-12-04T09:31:18.7814216Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7814272Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7814367Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7814707Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7814744Z graph_break [] 2025-12-04T09:31:18.7814815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7814872Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7814966Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7815304Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7815342Z graph_break [] 2025-12-04T09:31:18.7815414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7815468Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7815565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7815907Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7815944Z graph_break [] 2025-12-04T09:31:18.7816015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7816103Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7816199Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7816541Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7816579Z graph_break [] 2025-12-04T09:31:18.7816650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7816726Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7816823Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7817164Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7817203Z graph_break [] 2025-12-04T09:31:18.7817275Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7817329Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7817425Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7817771Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7817808Z graph_break [] 2025-12-04T09:31:18.7817881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7817939Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7818032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7818373Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7818410Z graph_break [] 2025-12-04T09:31:18.7818481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7818537Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7818632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7818968Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7819006Z graph_break [] 2025-12-04T09:31:18.7819078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7819132Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7819229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7819571Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7819609Z graph_break [] 2025-12-04T09:31:18.7819681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7819761Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7819856Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7820196Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7820233Z graph_break [] 2025-12-04T09:31:18.7820304Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7820358Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7820474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7820815Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7820854Z graph_break [] 2025-12-04T09:31:18.7820926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7820983Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7821079Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7821420Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7821457Z graph_break [] 2025-12-04T09:31:18.7821528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7821585Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7821680Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7822026Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7822063Z graph_break [] 2025-12-04T09:31:18.7822134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7822189Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7822284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7822625Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7822662Z graph_break [] 2025-12-04T09:31:18.7822734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7822787Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7822883Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7823259Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7823297Z graph_break [] 2025-12-04T09:31:18.7823368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7823425Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7823555Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7823896Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7823934Z graph_break [] 2025-12-04T09:31:18.7824005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7824063Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7824185Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7824527Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7824567Z graph_break [] 2025-12-04T09:31:18.7824639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7824695Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7824792Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7825134Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7825171Z graph_break [] 2025-12-04T09:31:18.7825243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7825297Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7825395Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7825733Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7825771Z graph_break [] 2025-12-04T09:31:18.7825842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7825899Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7825995Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7826340Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7826378Z graph_break [] 2025-12-04T09:31:18.7826450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7826504Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7826600Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7826941Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7826978Z graph_break [] 2025-12-04T09:31:18.7827049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7827106Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7827228Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7827568Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7827605Z graph_break [] 2025-12-04T09:31:18.7827677Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7827732Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7827849Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7828195Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7828233Z graph_break [] 2025-12-04T09:31:18.7828306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7828362Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7828457Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7828798Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7828836Z graph_break [] 2025-12-04T09:31:18.7828908Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7828965Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7829062Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7829401Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7829438Z graph_break [] 2025-12-04T09:31:18.7829510Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7829568Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7829664Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7830008Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7830045Z graph_break [] 2025-12-04T09:31:18.7830119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7830173Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7830269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7830612Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7830649Z graph_break [] 2025-12-04T09:31:18.7830720Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7830777Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7830892Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7831231Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7831268Z graph_break [] 2025-12-04T09:31:18.7831340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7831396Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7831518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7831861Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7831899Z graph_break [] 2025-12-04T09:31:18.7831972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7832025Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7832121Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7832467Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7832505Z graph_break [] 2025-12-04T09:31:18.7832576Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7832632Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7832729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7833101Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7833139Z graph_break [] 2025-12-04T09:31:18.7833209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7833267Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7833364Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7833707Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7833745Z graph_break [] 2025-12-04T09:31:18.7833817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7833873Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7833970Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7834317Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7834354Z graph_break [] 2025-12-04T09:31:18.7834425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7834480Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7834608Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7834947Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7834984Z graph_break [] 2025-12-04T09:31:18.7835055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7835109Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7835229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7835570Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7835609Z graph_break [] 2025-12-04T09:31:18.7835681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7835735Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7835830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7836172Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7836210Z graph_break [] 2025-12-04T09:31:18.7836290Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7836338Z Traceback (most recent call last): 2025-12-04T09:31:18.7836467Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7836507Z self.common( 2025-12-04T09:31:18.7836596Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7836639Z return func(*args, **kwds) 2025-12-04T09:31:18.7836678Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7836804Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7836841Z check_model( 2025-12-04T09:31:18.7836955Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7836995Z assert_equal_fn( 2025-12-04T09:31:18.7837132Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7837194Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7837239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7837399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7837471Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7837525Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7837528Z 2025-12-04T09:31:18.7837572Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7837672Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7837773Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7837775Z 2025-12-04T09:31:18.7837821Z The failure occurred for item [2] 2025-12-04T09:31:18.7837824Z 2025-12-04T09:31:18.7837897Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7838042Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7838068Z 2025-12-04T09:31:18.7838155Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7838229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7838285Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7838382Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7838745Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7838782Z graph_break [] 2025-12-04T09:31:18.7838855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7838909Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7839006Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7839344Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7839383Z graph_break [] 2025-12-04T09:31:18.7839454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7839515Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7839613Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7839957Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7839999Z graph_break [] 2025-12-04T09:31:18.7840072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7840128Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7840223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7840568Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7840606Z graph_break [] 2025-12-04T09:31:18.7840752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7840805Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7840901Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7841240Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7841277Z graph_break [] 2025-12-04T09:31:18.7841348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7841406Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7841504Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7841848Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7841923Z graph_break [] 2025-12-04T09:31:18.7841996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7842051Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7842147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7842486Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7842548Z graph_break [] 2025-12-04T09:31:18.7842624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7842680Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7842777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7843160Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7843198Z graph_break [] 2025-12-04T09:31:18.7843270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7843326Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7843420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7843761Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7843800Z graph_break [] 2025-12-04T09:31:18.7843871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7843925Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7844020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7844360Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7844398Z graph_break [] 2025-12-04T09:31:18.7844470Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7844528Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7844623Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7845017Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7845055Z graph_break [] 2025-12-04T09:31:18.7845125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7845183Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7845278Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7845621Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7845697Z graph_break [] 2025-12-04T09:31:18.7845770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7845826Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7845921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7846265Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7846327Z graph_break [] 2025-12-04T09:31:18.7846401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7846454Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7846551Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7846897Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7846934Z graph_break [] 2025-12-04T09:31:18.7847006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7847062Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7847159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7847508Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7847548Z graph_break [] 2025-12-04T09:31:18.7847619Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7847673Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7847768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7848109Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7848145Z graph_break [] 2025-12-04T09:31:18.7848219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7848273Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7848369Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7848711Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7848747Z graph_break [] 2025-12-04T09:31:18.7848820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7848876Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7848972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7849318Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7849381Z graph_break [] 2025-12-04T09:31:18.7849453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7849510Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7849604Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7849948Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7849984Z graph_break [] 2025-12-04T09:31:18.7850077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7850132Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7850229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7850573Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7850614Z graph_break [] 2025-12-04T09:31:18.7850686Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7850742Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7850837Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7851183Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7851224Z graph_break [] 2025-12-04T09:31:18.7851296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7851351Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7851447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7851790Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7851829Z graph_break [] 2025-12-04T09:31:18.7851907Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7851965Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7852060Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7852405Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7852444Z graph_break [] 2025-12-04T09:31:18.7852516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7852576Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7852673Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7853051Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7853126Z graph_break [] 2025-12-04T09:31:18.7853199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7853259Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7853354Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7853697Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7853735Z graph_break [] 2025-12-04T09:31:18.7853843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7853900Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7853998Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7854341Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7854381Z graph_break [] 2025-12-04T09:31:18.7854454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7854514Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7854610Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7854957Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7854998Z graph_break [] 2025-12-04T09:31:18.7855070Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7855125Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7855220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7855568Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7855604Z graph_break [] 2025-12-04T09:31:18.7855681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7855738Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7855836Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7856179Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7856217Z graph_break [] 2025-12-04T09:31:18.7856288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7856345Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7856441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7856786Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7856851Z graph_break [] 2025-12-04T09:31:18.7856923Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7856981Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7857076Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7857422Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7857459Z graph_break [] 2025-12-04T09:31:18.7857551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7857608Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7857705Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7858051Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7858089Z graph_break [] 2025-12-04T09:31:18.7858160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7858217Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7858313Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7858751Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7858792Z graph_break [] 2025-12-04T09:31:18.7858863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7858919Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7859015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7859356Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7859394Z graph_break [] 2025-12-04T09:31:18.7859470Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7859526Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7859623Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7859968Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7860005Z graph_break [] 2025-12-04T09:31:18.7860077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7860132Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7860227Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7860571Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7860609Z graph_break [] 2025-12-04T09:31:18.7860714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7860769Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7860863Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7861205Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7861241Z graph_break [] 2025-12-04T09:31:18.7861332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7861388Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7861486Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7861834Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7861872Z graph_break [] 2025-12-04T09:31:18.7861945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7862005Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7862102Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7862450Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7862490Z graph_break [] 2025-12-04T09:31:18.7862565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7862626Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7862722Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7863101Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7863140Z graph_break [] 2025-12-04T09:31:18.7863219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7863273Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7863376Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7863721Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7863769Z graph_break [] 2025-12-04T09:31:18.7863844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7863906Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7864010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7864357Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7864398Z graph_break [] 2025-12-04T09:31:18.7864509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7864567Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7864663Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7865006Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7865046Z graph_break [] 2025-12-04T09:31:18.7865143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7865199Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7865294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7865633Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7865677Z graph_break [] 2025-12-04T09:31:18.7865761Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7865813Z Traceback (most recent call last): 2025-12-04T09:31:18.7865948Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7865989Z self.common( 2025-12-04T09:31:18.7866086Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7866134Z return func(*args, **kwds) 2025-12-04T09:31:18.7866180Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7866310Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 725, in check_model_gpu 2025-12-04T09:31:18.7866358Z check_model( 2025-12-04T09:31:18.7866476Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7866524Z assert_equal_fn( 2025-12-04T09:31:18.7866666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7866731Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7866780Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7866947Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7867024Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7867086Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7867088Z 2025-12-04T09:31:18.7867135Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7867239Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7867338Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.7867341Z 2025-12-04T09:31:18.7867394Z The failure occurred for item [2] 2025-12-04T09:31:18.7867396Z 2025-12-04T09:31:18.7867473Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7867623Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7867625Z 2025-12-04T09:31:18.7867712Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7867786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7867843Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7867942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7868286Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7868349Z graph_break [] 2025-12-04T09:31:18.7868423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7868478Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7868575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7868942Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7868981Z graph_break [] 2025-12-04T09:31:18.7869053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7869114Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7869210Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7869554Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7869590Z graph_break [] 2025-12-04T09:31:18.7869663Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7869719Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7869815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7870157Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7870196Z graph_break [] 2025-12-04T09:31:18.7870273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7870328Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7870427Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7870772Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7870812Z graph_break [] 2025-12-04T09:31:18.7870885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7870945Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7871040Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7871385Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7871424Z graph_break [] 2025-12-04T09:31:18.7871501Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7871559Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7871655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7871995Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7872059Z graph_break [] 2025-12-04T09:31:18.7872132Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7872187Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7872284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7872648Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7872686Z graph_break [] 2025-12-04T09:31:18.7872759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7872815Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7872910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7873286Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7873328Z graph_break [] 2025-12-04T09:31:18.7873399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7873456Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7873550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7873889Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7873928Z graph_break [] 2025-12-04T09:31:18.7874003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7874061Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7874160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7874508Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7874552Z graph_break [] 2025-12-04T09:31:18.7874626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7874687Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7874783Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7875130Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7875168Z graph_break [] 2025-12-04T09:31:18.7875241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7875300Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7875396Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7875737Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7875805Z graph_break [] 2025-12-04T09:31:18.7875880Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7875935Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7876032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7876398Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7876438Z graph_break [] 2025-12-04T09:31:18.7876512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7876571Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7876666Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7877009Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7877048Z graph_break [] 2025-12-04T09:31:18.7877120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7877178Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7877274Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7877613Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7877652Z graph_break [] 2025-12-04T09:31:18.7877726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7877780Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7877877Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7878219Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7878259Z graph_break [] 2025-12-04T09:31:18.7878333Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7878391Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7878487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7878834Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7878875Z graph_break [] 2025-12-04T09:31:18.7878948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7879007Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7879103Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7879444Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7879505Z graph_break [] 2025-12-04T09:31:18.7879578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7879633Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7879728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7880089Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7880128Z graph_break [] 2025-12-04T09:31:18.7880201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7880260Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7880356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7880700Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7880739Z graph_break [] 2025-12-04T09:31:18.7880811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7880869Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7880965Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7881308Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7881346Z graph_break [] 2025-12-04T09:31:18.7881419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7881475Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7881573Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7881916Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7881955Z graph_break [] 2025-12-04T09:31:18.7882026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7882086Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7882183Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7882527Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7882564Z graph_break [] 2025-12-04T09:31:18.7882637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7882696Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7882792Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7883186Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7883274Z graph_break [] 2025-12-04T09:31:18.7883348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7883403Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7883502Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7883871Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7883911Z graph_break [] 2025-12-04T09:31:18.7883983Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7884045Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7884142Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7884488Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7884527Z graph_break [] 2025-12-04T09:31:18.7884598Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7884654Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7884750Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7885097Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7885135Z graph_break [] 2025-12-04T09:31:18.7885208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7885265Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7885360Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7885703Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7885744Z graph_break [] 2025-12-04T09:31:18.7885815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7885871Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7885969Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7886309Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7886346Z graph_break [] 2025-12-04T09:31:18.7886418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7886476Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7886572Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7886916Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7886981Z graph_break [] 2025-12-04T09:31:18.7887058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7887117Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7887215Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7887584Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7887623Z graph_break [] 2025-12-04T09:31:18.7887695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7887753Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7887851Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7888196Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7888236Z graph_break [] 2025-12-04T09:31:18.7888308Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7888365Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7888462Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7888802Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7888839Z graph_break [] 2025-12-04T09:31:18.7888912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7888968Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7889068Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7889420Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7889459Z graph_break [] 2025-12-04T09:31:18.7889532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7889590Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7889687Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7890026Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7890063Z graph_break [] 2025-12-04T09:31:18.7890134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7890189Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7890286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7890627Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7890693Z graph_break [] 2025-12-04T09:31:18.7890768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7890821Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7890920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7891287Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7891327Z graph_break [] 2025-12-04T09:31:18.7891401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7891464Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7891562Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7891908Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7891949Z graph_break [] 2025-12-04T09:31:18.7894565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7894629Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7894734Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7895156Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7895202Z graph_break [] 2025-12-04T09:31:18.7895276Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7895332Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7895428Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7895772Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7895810Z graph_break [] 2025-12-04T09:31:18.7895883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7895941Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7896039Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7896381Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7896417Z graph_break [] 2025-12-04T09:31:18.7896490Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7896544Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7896642Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7896982Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7897081Z graph_break [] 2025-12-04T09:31:18.7897154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7897210Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7897308Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7897688Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7897725Z graph_break [] 2025-12-04T09:31:18.7897800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7897860Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7897964Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7898311Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7898348Z graph_break [] 2025-12-04T09:31:18.7898431Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7898479Z Traceback (most recent call last): 2025-12-04T09:31:18.7898613Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7898652Z self.common( 2025-12-04T09:31:18.7898742Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7898788Z return func(*args, **kwds) 2025-12-04T09:31:18.7898830Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7898960Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7898998Z check_model( 2025-12-04T09:31:18.7899116Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7899156Z assert_equal_fn( 2025-12-04T09:31:18.7899299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7899362Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7899410Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7899574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7899648Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7899705Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7899710Z 2025-12-04T09:31:18.7899755Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7899859Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7899962Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7899966Z 2025-12-04T09:31:18.7900011Z The failure occurred for item [2] 2025-12-04T09:31:18.7900013Z 2025-12-04T09:31:18.7900088Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7900236Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7900238Z 2025-12-04T09:31:18.7900330Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7900404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7900464Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7900598Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7900940Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7900977Z graph_break [] 2025-12-04T09:31:18.7901051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7901107Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7901227Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7901566Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7901605Z graph_break [] 2025-12-04T09:31:18.7901678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7901736Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7901833Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7902175Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7902214Z graph_break [] 2025-12-04T09:31:18.7902285Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7902342Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7902442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7902783Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7902820Z graph_break [] 2025-12-04T09:31:18.7902893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7902984Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7903084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7903424Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7903464Z graph_break [] 2025-12-04T09:31:18.7903537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7903595Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7903692Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7904039Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7904076Z graph_break [] 2025-12-04T09:31:18.7904149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7904203Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7904351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7904692Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7904730Z graph_break [] 2025-12-04T09:31:18.7904802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7904857Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7904980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7905322Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7905362Z graph_break [] 2025-12-04T09:31:18.7905433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7905487Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7905583Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7905923Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7905961Z graph_break [] 2025-12-04T09:31:18.7906034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7906088Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7906185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7906528Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7906567Z graph_break [] 2025-12-04T09:31:18.7906640Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7906698Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7906796Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7907140Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7907179Z graph_break [] 2025-12-04T09:31:18.7907250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7907308Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7907404Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7907745Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7907783Z graph_break [] 2025-12-04T09:31:18.7907857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7907911Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7908006Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7908383Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7908422Z graph_break [] 2025-12-04T09:31:18.7908498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7908559Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7908654Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7909029Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7909069Z graph_break [] 2025-12-04T09:31:18.7909141Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7909197Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7909293Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7909635Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7909673Z graph_break [] 2025-12-04T09:31:18.7909746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7909801Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7909895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7910237Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7910274Z graph_break [] 2025-12-04T09:31:18.7910346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7910403Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7910499Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7910842Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7910881Z graph_break [] 2025-12-04T09:31:18.7910952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7911008Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7911103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7911444Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7911481Z graph_break [] 2025-12-04T09:31:18.7911554Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7911611Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7911706Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7948866Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7948903Z graph_break [] 2025-12-04T09:31:18.7948978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7949033Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7949131Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7949533Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7949581Z graph_break [] 2025-12-04T09:31:18.7949655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7949710Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7949806Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7950160Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7950200Z graph_break [] 2025-12-04T09:31:18.7950274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7950328Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7950425Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7950790Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7950835Z graph_break [] 2025-12-04T09:31:18.7950914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7950973Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7951085Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7951433Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7951472Z graph_break [] 2025-12-04T09:31:18.7951543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7951604Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7951699Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7952044Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7952080Z graph_break [] 2025-12-04T09:31:18.7952155Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7952212Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7952309Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7952696Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7952734Z graph_break [] 2025-12-04T09:31:18.7952807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7952862Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7952993Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7953366Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7953409Z graph_break [] 2025-12-04T09:31:18.7953481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7953538Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7953633Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7953981Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7954018Z graph_break [] 2025-12-04T09:31:18.7954092Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7954147Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7954242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7954583Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7954621Z graph_break [] 2025-12-04T09:31:18.7954694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7954750Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7954846Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7955188Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7955226Z graph_break [] 2025-12-04T09:31:18.7955301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7955356Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7955451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7955793Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7955829Z graph_break [] 2025-12-04T09:31:18.7955904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7955960Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7956057Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7956451Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7956489Z graph_break [] 2025-12-04T09:31:18.7956561Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7956617Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7956714Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7957085Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7957125Z graph_break [] 2025-12-04T09:31:18.7957197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7957256Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7957352Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7957693Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7957729Z graph_break [] 2025-12-04T09:31:18.7957803Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7957858Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7957953Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7958299Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7958336Z graph_break [] 2025-12-04T09:31:18.7958409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7958465Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7958562Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7958901Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7958940Z graph_break [] 2025-12-04T09:31:18.7959012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7959067Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7959163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7959504Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7959540Z graph_break [] 2025-12-04T09:31:18.7959613Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7959667Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7959764Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7960133Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7960171Z graph_break [] 2025-12-04T09:31:18.7960246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7960300Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7960398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7960759Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7960797Z graph_break [] 2025-12-04T09:31:18.7960871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7960928Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7961024Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7961369Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7961406Z graph_break [] 2025-12-04T09:31:18.7961479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7961536Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7961632Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7961973Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7962010Z graph_break [] 2025-12-04T09:31:18.7962083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7962137Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7962232Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7962579Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7962617Z graph_break [] 2025-12-04T09:31:18.7962690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7962746Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7962840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7963235Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7963271Z graph_break [] 2025-12-04T09:31:18.7963344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7963398Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7963494Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7963879Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7963916Z graph_break [] 2025-12-04T09:31:18.7963988Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7964043Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7964138Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7964515Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7964553Z graph_break [] 2025-12-04T09:31:18.7964626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7964684Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7964778Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7965124Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7965161Z graph_break [] 2025-12-04T09:31:18.7965238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7965292Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7965388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7965730Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7965768Z graph_break [] 2025-12-04T09:31:18.7965849Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7965896Z Traceback (most recent call last): 2025-12-04T09:31:18.7966025Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7966062Z self.common( 2025-12-04T09:31:18.7966153Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7966196Z return func(*args, **kwds) 2025-12-04T09:31:18.7966236Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7966363Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7966402Z check_model( 2025-12-04T09:31:18.7966516Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7966556Z assert_equal_fn( 2025-12-04T09:31:18.7966698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7966759Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7966804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7966965Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7967040Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7967097Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7967100Z 2025-12-04T09:31:18.7967146Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7967249Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7967381Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7967383Z 2025-12-04T09:31:18.7967429Z The failure occurred for item [2] 2025-12-04T09:31:18.7967431Z 2025-12-04T09:31:18.7967506Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7967652Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7967654Z 2025-12-04T09:31:18.7967743Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7967839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7967897Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7967994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7968340Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7968378Z graph_break [] 2025-12-04T09:31:18.7968451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7968505Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7968603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7968949Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7968986Z graph_break [] 2025-12-04T09:31:18.7969060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7969118Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7969213Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7969557Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7969596Z graph_break [] 2025-12-04T09:31:18.7969669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7969725Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7969822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7970162Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7970201Z graph_break [] 2025-12-04T09:31:18.7970273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7970327Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7970422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7970770Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7970807Z graph_break [] 2025-12-04T09:31:18.7970879Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7970967Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7971068Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7971412Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7971452Z graph_break [] 2025-12-04T09:31:18.7971523Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7971600Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7971695Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7972038Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7972080Z graph_break [] 2025-12-04T09:31:18.7972151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7972206Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7972302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7972643Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7972679Z graph_break [] 2025-12-04T09:31:18.7972755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7972813Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7972910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7973291Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7973329Z graph_break [] 2025-12-04T09:31:18.7973401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7973459Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7973553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7973897Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7973938Z graph_break [] 2025-12-04T09:31:18.7974011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7974069Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7974165Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7974515Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7974551Z graph_break [] 2025-12-04T09:31:18.7974624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7974728Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7974824Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7975169Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7975206Z graph_break [] 2025-12-04T09:31:18.7975279Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7975368Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7975463Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7975803Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7975842Z graph_break [] 2025-12-04T09:31:18.7975914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7975971Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7976067Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7976411Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7976448Z graph_break [] 2025-12-04T09:31:18.7976520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7976575Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7976671Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7977012Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7977050Z graph_break [] 2025-12-04T09:31:18.7977121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7977178Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7977272Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7977611Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7977651Z graph_break [] 2025-12-04T09:31:18.7977723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7977778Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7977873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7978219Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7978255Z graph_break [] 2025-12-04T09:31:18.7978328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7978415Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7978512Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7978852Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7978889Z graph_break [] 2025-12-04T09:31:18.7978961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7979042Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7979139Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7979483Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7979523Z graph_break [] 2025-12-04T09:31:18.7979594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7979650Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7979745Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7980086Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7980123Z graph_break [] 2025-12-04T09:31:18.7980195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7980251Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7980348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7980687Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7980724Z graph_break [] 2025-12-04T09:31:18.7980796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7980852Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7980946Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7981291Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7981334Z graph_break [] 2025-12-04T09:31:18.7981407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7981465Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7981561Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7981905Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7981944Z graph_break [] 2025-12-04T09:31:18.7982020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7982102Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7982199Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7982543Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7982585Z graph_break [] 2025-12-04T09:31:18.7982656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7982737Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7982835Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7983216Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7983258Z graph_break [] 2025-12-04T09:31:18.7983333Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7983391Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7983487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7983831Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7983870Z graph_break [] 2025-12-04T09:31:18.7983945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7984003Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7984101Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7984441Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7984480Z graph_break [] 2025-12-04T09:31:18.7984552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7984607Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7984706Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7985048Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7985089Z graph_break [] 2025-12-04T09:31:18.7985161Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7985223Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7985320Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7985669Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7985706Z graph_break [] 2025-12-04T09:31:18.7985780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7985869Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7985966Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7986308Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7986346Z graph_break [] 2025-12-04T09:31:18.7986417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7986477Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7986603Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7986947Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7986987Z graph_break [] 2025-12-04T09:31:18.7987059Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7987118Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7987214Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7987563Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7987600Z graph_break [] 2025-12-04T09:31:18.7987673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7987731Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7987830Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7988168Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7988205Z graph_break [] 2025-12-04T09:31:18.7988277Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7988333Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7988430Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7988773Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7988813Z graph_break [] 2025-12-04T09:31:18.7988888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7988946Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7989041Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7989386Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7989422Z graph_break [] 2025-12-04T09:31:18.7989498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7989574Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7989672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7990016Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7990054Z graph_break [] 2025-12-04T09:31:18.7990129Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7990186Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7990306Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7990652Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7990694Z graph_break [] 2025-12-04T09:31:18.7990766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7990826Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7990922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7991269Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7991307Z graph_break [] 2025-12-04T09:31:18.7991385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7991444Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7991545Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7991891Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7991930Z graph_break [] 2025-12-04T09:31:18.7992002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7992061Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7992160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7992503Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7992546Z graph_break [] 2025-12-04T09:31:18.7992619Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7992677Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7992773Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7993167Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7993205Z graph_break [] 2025-12-04T09:31:18.7993280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7993333Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7993465Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7993806Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7993843Z graph_break [] 2025-12-04T09:31:18.7993915Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7993970Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7994097Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7994439Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7994479Z graph_break [] 2025-12-04T09:31:18.7994551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7994606Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7994702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7995047Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7995084Z graph_break [] 2025-12-04T09:31:18.7995157Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7995214Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.7995311Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.7995653Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.7995692Z graph_break [] 2025-12-04T09:31:18.7995765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7995822Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7995922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7996264Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7996303Z graph_break [] 2025-12-04T09:31:18.7996375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7996435Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7996530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7996876Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7996913Z graph_break [] 2025-12-04T09:31:18.7996995Z _______________ GPUTests.test_var_mean_tile_reduction_True_cuda ________________ 2025-12-04T09:31:18.7997041Z Traceback (most recent call last): 2025-12-04T09:31:18.7997194Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 5770, in test_var_mean 2025-12-04T09:31:18.7997231Z self.common( 2025-12-04T09:31:18.7997321Z File "/opt/conda/envs/py_3.12/lib/python3.12/contextlib.py", line 81, in inner 2025-12-04T09:31:18.7997364Z return func(*args, **kwds) 2025-12-04T09:31:18.7997405Z ^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7997533Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 692, in check_model_gpu 2025-12-04T09:31:18.7997572Z check_model( 2025-12-04T09:31:18.7997687Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 566, in check_model 2025-12-04T09:31:18.7997726Z assert_equal_fn( 2025-12-04T09:31:18.7997886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:31:18.7997953Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:31:18.7997998Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:31:18.7998162Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:31:18.7998235Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:31:18.7998288Z AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.7998290Z 2025-12-04T09:31:18.7998337Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.7998437Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.7998540Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.7998542Z 2025-12-04T09:31:18.7998590Z The failure occurred for item [2] 2025-12-04T09:31:18.7998592Z 2025-12-04T09:31:18.7998666Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.7998812Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.7998815Z 2025-12-04T09:31:18.7998906Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.7998980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7999036Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7999134Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.7999480Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.7999520Z graph_break [] 2025-12-04T09:31:18.7999593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.7999651Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.7999750Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8000098Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8000135Z graph_break [] 2025-12-04T09:31:18.8000209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8000267Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8000368Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8000710Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8000772Z graph_break [] 2025-12-04T09:31:18.8000844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8000900Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8000995Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8001356Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8001394Z graph_break [] 2025-12-04T09:31:18.8001465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8001520Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8001616Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8001956Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8001993Z graph_break [] 2025-12-04T09:31:18.8002065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8002122Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8002220Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8002563Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8002605Z graph_break [] 2025-12-04T09:31:18.8002678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8002736Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8002831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8003215Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8003253Z graph_break [] 2025-12-04T09:31:18.8003325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8003381Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8003477Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8003817Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8003853Z graph_break [] 2025-12-04T09:31:18.8003926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8003980Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8004077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8004420Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8004491Z graph_break [] 2025-12-04T09:31:18.8004562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8004616Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8004711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8005050Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8005120Z graph_break [] 2025-12-04T09:31:18.8005193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8005251Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8005346Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8005691Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8005729Z graph_break [] 2025-12-04T09:31:18.8005801Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8005857Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8005956Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8006300Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8006343Z graph_break [] 2025-12-04T09:31:18.8006416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8006471Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8006566Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8006907Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8006946Z graph_break [] 2025-12-04T09:31:18.8007018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8007073Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8007167Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8007509Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8007546Z graph_break [] 2025-12-04T09:31:18.8007618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8007672Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8007768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8008109Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8008177Z graph_break [] 2025-12-04T09:31:18.8008250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8008307Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8008402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8008744Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8008803Z graph_break [] 2025-12-04T09:31:18.8008875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8008931Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8009025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8009368Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8009404Z graph_break [] 2025-12-04T09:31:18.8009477Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8009531Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8009626Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8009966Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8010006Z graph_break [] 2025-12-04T09:31:18.8010077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8010135Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8010230Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8010573Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8010611Z graph_break [] 2025-12-04T09:31:18.8010683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8010738Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8010833Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8011175Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8011211Z graph_break [] 2025-12-04T09:31:18.8011284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8011338Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8011435Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8011779Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8011840Z graph_break [] 2025-12-04T09:31:18.8011911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8011967Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8012062Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8012402Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8012439Z graph_break [] 2025-12-04T09:31:18.8012533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8012592Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8012687Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8013070Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8013106Z graph_break [] 2025-12-04T09:31:18.8013179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8013235Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8013331Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8013675Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8013714Z graph_break [] 2025-12-04T09:31:18.8013786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8013843Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8013938Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8014280Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8014316Z graph_break [] 2025-12-04T09:31:18.8014390Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8014447Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8014542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8014890Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8014926Z graph_break [] 2025-12-04T09:31:18.8014999Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8015055Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8015151Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8015495Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8015562Z graph_break [] 2025-12-04T09:31:18.8015633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8015687Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8015782Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8016124Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8016161Z graph_break [] 2025-12-04T09:31:18.8016258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8016316Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8016411Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8016754Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8016791Z graph_break [] 2025-12-04T09:31:18.8016863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8016918Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8017014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8017357Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8017396Z graph_break [] 2025-12-04T09:31:18.8017467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8017525Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8017622Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8017963Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8018000Z graph_break [] 2025-12-04T09:31:18.8018072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8018130Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8018225Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8018567Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8018603Z graph_break [] 2025-12-04T09:31:18.8018675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8018731Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8018828Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8019172Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8019232Z graph_break [] 2025-12-04T09:31:18.8019303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8019359Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8019454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8019795Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8019832Z graph_break [] 2025-12-04T09:31:18.8019929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8019987Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8020082Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8020425Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8020461Z graph_break [] 2025-12-04T09:31:18.8020534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8020588Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8020684Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8021034Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8021073Z graph_break [] 2025-12-04T09:31:18.8021145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8021200Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8021296Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8021635Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8021673Z graph_break [] 2025-12-04T09:31:18.8021746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8021801Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8021896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8022237Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8022274Z graph_break [] 2025-12-04T09:31:18.8022345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8022402Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8022498Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8022839Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8022900Z graph_break [] 2025-12-04T09:31:18.8023009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8023066Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8023162Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8023503Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8023541Z graph_break [] 2025-12-04T09:31:18.8023645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8023702Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8023797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8024140Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8024176Z graph_break [] 2025-12-04T09:31:18.8024248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8024302Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8024398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8024740Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8024777Z graph_break [] 2025-12-04T09:31:18.8024852Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8024907Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8025003Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8025349Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8025387Z graph_break [] 2025-12-04T09:31:18.8025460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8025515Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8025610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8025953Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8025990Z graph_break [] 2025-12-04T09:31:18.8026062Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8026119Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8026215Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8026558Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8026596Z graph_break [] 2025-12-04T09:31:18.8026702Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8026756Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8026852Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8027195Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8027233Z graph_break [] 2025-12-04T09:31:18.8027328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8027384Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8027479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8027819Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8027857Z graph_break [] 2025-12-04T09:31:18.8027929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8027986Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8028082Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8028424Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8028461Z graph_break [] 2025-12-04T09:31:18.8028534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8028591Z stats [('calls_captured', 12), ('unique_graphs', 2)] 2025-12-04T09:31:18.8028687Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:31:18.8029030Z inductor [('triton_bundler_save_kernel', 80), ('benchmarking.InductorBenchmarker.benchmark', 10), ('benchmarking.InductorBenchmarker.benchmark_gpu', 10), ('async_compile_cache_miss', 8), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 2)] 2025-12-04T09:31:18.8029067Z graph_break [] 2025-12-04T09:31:18.8029140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:31:18.8029196Z stats [('calls_captured', 6), ('unique_graphs', 1)] 2025-12-04T09:31:18.8029294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:31:18.8029635Z inductor [('triton_bundler_save_kernel', 40), ('benchmarking.InductorBenchmarker.benchmark', 5), ('benchmarking.InductorBenchmarker.benchmark_gpu', 5), ('async_compile_cache_miss', 4), ('async_compile_cache_hit', 2), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:31:18.8029672Z graph_break [] 2025-12-04T09:31:18.8029901Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml - 2025-12-04T09:31:18.8029962Z =========================== short test summary info ============================ 2025-12-04T09:31:18.8030156Z FAILED [5.1555s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8030159Z 2025-12-04T09:31:18.8030205Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8030305Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8030431Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8030433Z 2025-12-04T09:31:18.8030477Z The failure occurred for item [2] 2025-12-04T09:31:18.8030479Z 2025-12-04T09:31:18.8030554Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8030702Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8030704Z 2025-12-04T09:31:18.8030792Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8030986Z FAILED [0.2033s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8030989Z 2025-12-04T09:31:18.8031035Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8031133Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8031233Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8031236Z 2025-12-04T09:31:18.8031280Z The failure occurred for item [2] 2025-12-04T09:31:18.8031284Z 2025-12-04T09:31:18.8031357Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8031502Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8031504Z 2025-12-04T09:31:18.8031589Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8031763Z FAILED [0.9857s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8031766Z 2025-12-04T09:31:18.8031810Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8031904Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8031997Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8032001Z 2025-12-04T09:31:18.8032045Z The failure occurred for item [2] 2025-12-04T09:31:18.8032046Z 2025-12-04T09:31:18.8032118Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8032263Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8032265Z 2025-12-04T09:31:18.8032350Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8032522Z FAILED [0.2063s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8032524Z 2025-12-04T09:31:18.8032570Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8032668Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8032767Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8032770Z 2025-12-04T09:31:18.8032813Z The failure occurred for item [2] 2025-12-04T09:31:18.8032815Z 2025-12-04T09:31:18.8032888Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8033068Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8033070Z 2025-12-04T09:31:18.8033155Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8033326Z FAILED [0.1974s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8033328Z 2025-12-04T09:31:18.8033373Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8033470Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8033568Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8033610Z 2025-12-04T09:31:18.8033653Z The failure occurred for item [2] 2025-12-04T09:31:18.8033656Z 2025-12-04T09:31:18.8033727Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8033871Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8033873Z 2025-12-04T09:31:18.8033957Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8034129Z FAILED [0.1919s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8034131Z 2025-12-04T09:31:18.8034174Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8034296Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8034394Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8034396Z 2025-12-04T09:31:18.8034442Z The failure occurred for item [2] 2025-12-04T09:31:18.8034444Z 2025-12-04T09:31:18.8034516Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8034659Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8034660Z 2025-12-04T09:31:18.8034744Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8034917Z FAILED [0.2023s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8034919Z 2025-12-04T09:31:18.8034963Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8035060Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8035159Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8035161Z 2025-12-04T09:31:18.8035205Z The failure occurred for item [2] 2025-12-04T09:31:18.8035207Z 2025-12-04T09:31:18.8035279Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8035421Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8035423Z 2025-12-04T09:31:18.8035508Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8035683Z FAILED [0.2016s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8035685Z 2025-12-04T09:31:18.8035729Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8035826Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8035925Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8035927Z 2025-12-04T09:31:18.8035972Z The failure occurred for item [2] 2025-12-04T09:31:18.8035977Z 2025-12-04T09:31:18.8036049Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8036192Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8036194Z 2025-12-04T09:31:18.8036278Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8036451Z FAILED [0.2005s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8036453Z 2025-12-04T09:31:18.8036496Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8036596Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8036695Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8036697Z 2025-12-04T09:31:18.8036741Z The failure occurred for item [2] 2025-12-04T09:31:18.8036765Z 2025-12-04T09:31:18.8036837Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8036981Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8036983Z 2025-12-04T09:31:18.8037066Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8037239Z FAILED [0.3860s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8037241Z 2025-12-04T09:31:18.8037285Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8037404Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8037499Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8037501Z 2025-12-04T09:31:18.8037544Z The failure occurred for item [2] 2025-12-04T09:31:18.8037546Z 2025-12-04T09:31:18.8037620Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8037765Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8037766Z 2025-12-04T09:31:18.8037851Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8038023Z FAILED [0.1937s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8038024Z 2025-12-04T09:31:18.8038069Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8038167Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8038269Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8038271Z 2025-12-04T09:31:18.8038315Z The failure occurred for item [2] 2025-12-04T09:31:18.8038317Z 2025-12-04T09:31:18.8038388Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8038535Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8038537Z 2025-12-04T09:31:18.8038622Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8038794Z FAILED [0.1976s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8038796Z 2025-12-04T09:31:18.8038838Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8038937Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8039036Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8039038Z 2025-12-04T09:31:18.8039083Z The failure occurred for item [2] 2025-12-04T09:31:18.8039085Z 2025-12-04T09:31:18.8039158Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8039303Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8039305Z 2025-12-04T09:31:18.8039389Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8039561Z FAILED [0.1942s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8039562Z 2025-12-04T09:31:18.8039607Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8039703Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8039806Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8039808Z 2025-12-04T09:31:18.8039851Z The failure occurred for item [2] 2025-12-04T09:31:18.8039852Z 2025-12-04T09:31:18.8039928Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8040093Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8040096Z 2025-12-04T09:31:18.8040181Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8040353Z FAILED [0.2047s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8040355Z 2025-12-04T09:31:18.8040399Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8040495Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8040615Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8040617Z 2025-12-04T09:31:18.8040664Z The failure occurred for item [2] 2025-12-04T09:31:18.8040666Z 2025-12-04T09:31:18.8040738Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8040883Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8040885Z 2025-12-04T09:31:18.8040969Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8041141Z FAILED [0.1945s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8041143Z 2025-12-04T09:31:18.8041186Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8041283Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8041382Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8041384Z 2025-12-04T09:31:18.8041428Z The failure occurred for item [2] 2025-12-04T09:31:18.8041429Z 2025-12-04T09:31:18.8041501Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8041643Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8041646Z 2025-12-04T09:31:18.8041732Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8041903Z FAILED [0.2015s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8041905Z 2025-12-04T09:31:18.8041948Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8042045Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8042145Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8042148Z 2025-12-04T09:31:18.8042193Z The failure occurred for item [2] 2025-12-04T09:31:18.8042194Z 2025-12-04T09:31:18.8042270Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8042411Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8042416Z 2025-12-04T09:31:18.8042500Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8042671Z FAILED [0.2048s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8042673Z 2025-12-04T09:31:18.8042717Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8042813Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8042911Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8042913Z 2025-12-04T09:31:18.8043004Z The failure occurred for item [2] 2025-12-04T09:31:18.8043005Z 2025-12-04T09:31:18.8043078Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8043223Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8043267Z 2025-12-04T09:31:18.8043351Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8043523Z FAILED [0.2025s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8043525Z 2025-12-04T09:31:18.8043568Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8043665Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8043764Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8043766Z 2025-12-04T09:31:18.8043835Z The failure occurred for item [2] 2025-12-04T09:31:18.8043837Z 2025-12-04T09:31:18.8043909Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8044055Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8044059Z 2025-12-04T09:31:18.8044146Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8044320Z FAILED [0.2042s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8044322Z 2025-12-04T09:31:18.8044367Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8044463Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8044563Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8044565Z 2025-12-04T09:31:18.8044609Z The failure occurred for item [2] 2025-12-04T09:31:18.8044610Z 2025-12-04T09:31:18.8044683Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8044824Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8044827Z 2025-12-04T09:31:18.8044912Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8045082Z FAILED [0.4381s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8045086Z 2025-12-04T09:31:18.8045128Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8045222Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8045313Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8045315Z 2025-12-04T09:31:18.8045359Z The failure occurred for item [2] 2025-12-04T09:31:18.8045362Z 2025-12-04T09:31:18.8045436Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8045579Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8045583Z 2025-12-04T09:31:18.8045667Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8045838Z FAILED [0.3972s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8045840Z 2025-12-04T09:31:18.8045883Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8045975Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8046068Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8046070Z 2025-12-04T09:31:18.8046114Z The failure occurred for item [2] 2025-12-04T09:31:18.8046116Z 2025-12-04T09:31:18.8046191Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8046335Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8046337Z 2025-12-04T09:31:18.8046458Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8046631Z FAILED [0.3874s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8046633Z 2025-12-04T09:31:18.8046678Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8046771Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8046863Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8046865Z 2025-12-04T09:31:18.8046909Z The failure occurred for item [2] 2025-12-04T09:31:18.8046910Z 2025-12-04T09:31:18.8047004Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8047146Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8047148Z 2025-12-04T09:31:18.8047234Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8047408Z FAILED [0.2003s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8047411Z 2025-12-04T09:31:18.8047454Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8047553Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8047652Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8047654Z 2025-12-04T09:31:18.8047698Z The failure occurred for item [2] 2025-12-04T09:31:18.8047700Z 2025-12-04T09:31:18.8047773Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8047916Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8047918Z 2025-12-04T09:31:18.8048002Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8048180Z FAILED [0.9972s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8048182Z 2025-12-04T09:31:18.8048224Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8048316Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8048407Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8048409Z 2025-12-04T09:31:18.8048453Z The failure occurred for item [2] 2025-12-04T09:31:18.8048455Z 2025-12-04T09:31:18.8048525Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8048670Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8048672Z 2025-12-04T09:31:18.8048757Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8048930Z FAILED [0.2045s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8048932Z 2025-12-04T09:31:18.8048975Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8049072Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8049172Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8049174Z 2025-12-04T09:31:18.8049217Z The failure occurred for item [2] 2025-12-04T09:31:18.8049218Z 2025-12-04T09:31:18.8049290Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8049434Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8049436Z 2025-12-04T09:31:18.8049520Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8049715Z FAILED [0.2050s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8049718Z 2025-12-04T09:31:18.8049761Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8049859Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8049956Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8049958Z 2025-12-04T09:31:18.8050002Z The failure occurred for item [2] 2025-12-04T09:31:18.8050003Z 2025-12-04T09:31:18.8050075Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8050238Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8050240Z 2025-12-04T09:31:18.8050325Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8050505Z FAILED [0.3946s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8050508Z 2025-12-04T09:31:18.8050551Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8050644Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8050734Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8050736Z 2025-12-04T09:31:18.8050781Z The failure occurred for item [2] 2025-12-04T09:31:18.8050782Z 2025-12-04T09:31:18.8050855Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8050999Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8051001Z 2025-12-04T09:31:18.8051085Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8051256Z FAILED [0.3944s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8051260Z 2025-12-04T09:31:18.8051304Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8051395Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8051485Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8051487Z 2025-12-04T09:31:18.8051530Z The failure occurred for item [2] 2025-12-04T09:31:18.8051531Z 2025-12-04T09:31:18.8051603Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8051746Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8051748Z 2025-12-04T09:31:18.8051832Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8052004Z FAILED [0.2067s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8052009Z 2025-12-04T09:31:18.8052052Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8052151Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8052253Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8052255Z 2025-12-04T09:31:18.8052299Z The failure occurred for item [2] 2025-12-04T09:31:18.8052301Z 2025-12-04T09:31:18.8052373Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8052517Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8052521Z 2025-12-04T09:31:18.8052606Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8052782Z FAILED [0.4064s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8052808Z 2025-12-04T09:31:18.8052852Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8052988Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8053079Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8053081Z 2025-12-04T09:31:18.8053126Z The failure occurred for item [2] 2025-12-04T09:31:18.8053128Z 2025-12-04T09:31:18.8053201Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8053343Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8053345Z 2025-12-04T09:31:18.8053463Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8053636Z FAILED [0.2140s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8053640Z 2025-12-04T09:31:18.8053685Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8053782Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8053883Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8053885Z 2025-12-04T09:31:18.8053929Z The failure occurred for item [2] 2025-12-04T09:31:18.8053931Z 2025-12-04T09:31:18.8054003Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8054146Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8054147Z 2025-12-04T09:31:18.8054237Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8054412Z FAILED [0.2021s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8054416Z 2025-12-04T09:31:18.8054459Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8054559Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8054661Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8054663Z 2025-12-04T09:31:18.8054709Z The failure occurred for item [2] 2025-12-04T09:31:18.8054711Z 2025-12-04T09:31:18.8054785Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8054933Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8054934Z 2025-12-04T09:31:18.8055019Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8055194Z FAILED [0.2100s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8055196Z 2025-12-04T09:31:18.8055241Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8055340Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8055441Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8055445Z 2025-12-04T09:31:18.8055488Z The failure occurred for item [2] 2025-12-04T09:31:18.8055489Z 2025-12-04T09:31:18.8055563Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8055709Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8055711Z 2025-12-04T09:31:18.8055797Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8055971Z FAILED [0.4059s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8055973Z 2025-12-04T09:31:18.8056018Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8056145Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8056237Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8056239Z 2025-12-04T09:31:18.8056282Z The failure occurred for item [2] 2025-12-04T09:31:18.8056284Z 2025-12-04T09:31:18.8056358Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8056501Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8056503Z 2025-12-04T09:31:18.8056590Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8056793Z FAILED [0.4093s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8056795Z 2025-12-04T09:31:18.8056838Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8056933Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8057024Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8057026Z 2025-12-04T09:31:18.8057072Z The failure occurred for item [2] 2025-12-04T09:31:18.8057073Z 2025-12-04T09:31:18.8057146Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8057289Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8057291Z 2025-12-04T09:31:18.8057377Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8057549Z FAILED [0.2056s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8057552Z 2025-12-04T09:31:18.8057595Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8057694Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8057794Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8057797Z 2025-12-04T09:31:18.8057840Z The failure occurred for item [2] 2025-12-04T09:31:18.8057842Z 2025-12-04T09:31:18.8057915Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8058057Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8058059Z 2025-12-04T09:31:18.8058145Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8058317Z FAILED [0.2017s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8058319Z 2025-12-04T09:31:18.8058362Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8058459Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8058560Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8058562Z 2025-12-04T09:31:18.8058607Z The failure occurred for item [2] 2025-12-04T09:31:18.8058608Z 2025-12-04T09:31:18.8058682Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8058823Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8058826Z 2025-12-04T09:31:18.8058910Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8059086Z FAILED [0.2246s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8059088Z 2025-12-04T09:31:18.8059132Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8059230Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8059353Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8059355Z 2025-12-04T09:31:18.8059400Z The failure occurred for item [2] 2025-12-04T09:31:18.8059402Z 2025-12-04T09:31:18.8059474Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8059618Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8059620Z 2025-12-04T09:31:18.8059704Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8059899Z FAILED [0.2044s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8059901Z 2025-12-04T09:31:18.8059946Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8060045Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8060143Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8060146Z 2025-12-04T09:31:18.8060190Z The failure occurred for item [2] 2025-12-04T09:31:18.8060192Z 2025-12-04T09:31:18.8060264Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8060406Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8060408Z 2025-12-04T09:31:18.8060492Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8060666Z FAILED [0.4134s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8060668Z 2025-12-04T09:31:18.8060713Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8060805Z Greatest absolute difference: 0.58544921875 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8060897Z Greatest relative difference: 0.57568359375 at index (0, 1) (up to 0.001 allowed) 2025-12-04T09:31:18.8060900Z 2025-12-04T09:31:18.8060944Z The failure occurred for item [2] 2025-12-04T09:31:18.8060946Z 2025-12-04T09:31:18.8061021Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8061164Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8061168Z 2025-12-04T09:31:18.8061253Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8061427Z FAILED [0.2018s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8061430Z 2025-12-04T09:31:18.8061474Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8061572Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8061672Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8061676Z 2025-12-04T09:31:18.8061720Z The failure occurred for item [2] 2025-12-04T09:31:18.8061721Z 2025-12-04T09:31:18.8061793Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8061938Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8061939Z 2025-12-04T09:31:18.8062023Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8062197Z FAILED [0.2170s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8062199Z 2025-12-04T09:31:18.8062247Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8062345Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8062448Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8062471Z 2025-12-04T09:31:18.8062514Z The failure occurred for item [2] 2025-12-04T09:31:18.8062516Z 2025-12-04T09:31:18.8062588Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8062731Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8062733Z 2025-12-04T09:31:18.8062819Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8063030Z FAILED [0.8105s] inductor/test_torchinductor.py::GPUTests::test_var_mean_tile_reduction_True_cuda - AssertionError: Tensor-likes are not close! 2025-12-04T09:31:18.8063032Z 2025-12-04T09:31:18.8063108Z Mismatched elements: 4 / 4 (100.0%) 2025-12-04T09:31:18.8063207Z Greatest absolute difference: 0.5851404070854187 at index (0, 3) (up to 1e-05 allowed) 2025-12-04T09:31:18.8063306Z Greatest relative difference: 0.5756681561470032 at index (0, 1) (up to 1.3e-06 allowed) 2025-12-04T09:31:18.8063309Z 2025-12-04T09:31:18.8063354Z The failure occurred for item [2] 2025-12-04T09:31:18.8063355Z 2025-12-04T09:31:18.8063429Z To execute this test, run the following from the base repo dir: 2025-12-04T09:31:18.8063571Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor.py GPUTests.test_var_mean_tile_reduction_True_cuda 2025-12-04T09:31:18.8063574Z 2025-12-04T09:31:18.8063658Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:31:18.8063729Z ================== 43 failed, 207 passed in 207.57s (0:03:27) ================== 2025-12-04T09:31:18.8063731Z 2025-12-04T09:31:18.8063907Z FINISHED PRINTING LOG FILE of inductor/test_torchinductor 2/2 (test/test-reports/inductor.test_torchinductor_2.2_03b74721959c00d6_.log) 2025-12-04T09:31:18.8063910Z 2025-12-04T09:31:18.8064031Z Finished inductor/test_torchinductor 2/2 ... [2025-12-04 09:31:18.678155][2221850.237853475], took 3.63min 2025-12-04T09:31:18.8064270Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:31:21.1432771Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:31:21.1438716Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:31:21.1438930Z Uploading artifacts took 0.00 seconds 2025-12-04T09:31:21.1439849Z inductor/test_torchinductor 2/2 failed! 2025-12-04T09:31:21.1441186Z Running inductor/test_torchinductor_dynamic_shapes 3/5 ... [2025-12-04 09:31:21.144025][2221852.703725094] 2025-12-04T09:31:21.1441435Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:31:21.1444851Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_dynamic_shapes.py', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:31:21.144362] 2025-12-04T09:31:31.7697770Z 2025-12-04T09:31:31.7698284Z inductor/test_torchinductor_dynamic_shapes 3/5 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_dynamic_shapes_3.5_d26631035a8f19c9_.log 2025-12-04T09:31:31.7698785Z Running 0 items in this shard: 2025-12-04T09:31:31.7698910Z 2025-12-04T09:31:31.7699123Z Finished inductor/test_torchinductor_dynamic_shapes 3/5 ... [2025-12-04 09:31:31.769570][2221863.329270114], took 0.18min 2025-12-04T09:31:31.7700936Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:31:32.1279867Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:31:32.1299076Z Running inductor/test_torchinductor_codegen_dynamic_shapes 4/4 ... [2025-12-04 09:31:32.129710][2221863.689408306] 2025-12-04T09:31:32.1305571Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:31:32.1306409Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_codegen_dynamic_shapes.py', '--shard-id=4', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:31:32.130017] 2025-12-04T09:31:41.5547531Z 2025-12-04T09:31:41.5548370Z inductor/test_torchinductor_codegen_dynamic_shapes 4/4 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_codegen_dynamic_shapes_4.4_c3a48aa59b7bd363_.log 2025-12-04T09:31:41.5548765Z Running 0 items in this shard: 2025-12-04T09:31:41.5558303Z 2025-12-04T09:31:41.5558483Z Finished inductor/test_torchinductor_codegen_dynamic_shapes 4/4 ... [2025-12-04 09:31:41.554578][2221873.11427526], took 0.16min 2025-12-04T09:31:41.5558938Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:31:41.8358643Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:31:41.8375377Z Running inductor/test_torchinductor_opinfo 6/10 ... [2025-12-04 09:31:41.837318][2221873.39701565] 2025-12-04T09:31:41.8375640Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:31:41.8378758Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_opinfo.py', '--shard-id=6', '--num-shards=10', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:31:41.837676] 2025-12-04T09:31:55.9113896Z 2025-12-04T09:31:55.9114711Z inductor/test_torchinductor_opinfo 6/10 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_torchinductor_opinfo_6.10_c51cf8c27621adcd_.log 2025-12-04T09:31:55.9131595Z Running 100 items in this shard: test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_fft_fftshift_cuda_float64, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16, test/inductor/test_torchinductor_opinfo.py::TestInductorOpInfoCUDA::test_comprehensive_nn_functional_glu_cuda_float16 2025-12-04T09:31:55.9153167Z 2025-12-04T09:31:55.9153464Z Finished inductor/test_torchinductor_opinfo 6/10 ... [2025-12-04 09:31:55.911319][2221887.471018204], took 0.23min 2025-12-04T09:31:55.9161184Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:31:56.3364251Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:31:56.3384357Z Running inductor/test_pattern_matcher 1/1 ... [2025-12-04 09:31:56.337686][2221887.897385352] 2025-12-04T09:31:56.3385543Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:31:56.3386029Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_pattern_matcher.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:31:56.337988] 2025-12-04T09:41:23.8648249Z 2025-12-04T09:41:23.8649316Z PRINTING LOG FILE of inductor/test_pattern_matcher 1/1 (test/test-reports/inductor.test_pattern_matcher_1.1_cd2f695dc21e99ed_.log) 2025-12-04T09:41:23.8649919Z Test results will be stored in test-reports/python-pytest/inductor.test_pattern_matcher/inductor.test_pattern_matcher-0b9817369f625712.xml 2025-12-04T09:41:23.8651682Z ============================= test session starts ============================== 2025-12-04T09:41:23.8651917Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:41:23.8652138Z cachedir: .pytest_cache 2025-12-04T09:41:23.8652381Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:41:23.8652637Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:41:23.8652768Z configfile: pytest.ini 2025-12-04T09:41:23.8653135Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:41:23.8653390Z collecting ... collected 52 items 2025-12-04T09:41:23.8653540Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:41:23.8683179Z Running 250 items in this shard: test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes, test/inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes 2025-12-04T09:41:23.8711850Z 2025-12-04T09:41:23.8711971Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [14.5214s] [ 0%] 2025-12-04T09:41:23.8712257Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [1.7821s] [ 0%] 2025-12-04T09:41:23.8712548Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.4260s] [ 1%] 2025-12-04T09:41:23.8713082Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:32:22.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8713791Z E1204 09:32:22.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8714261Z E1204 09:32:22.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8714576Z E1204 09:32:22.633000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8715054Z E1204 09:32:22.633000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8715516Z E1204 09:32:22.633000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8715823Z E1204 09:32:24.201000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8716296Z E1204 09:32:24.201000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8716747Z E1204 09:32:24.201000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8717052Z E1204 09:32:24.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8717519Z E1204 09:32:24.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8717973Z E1204 09:32:24.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8718281Z E1204 09:32:24.221000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8718753Z E1204 09:32:24.221000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8719270Z E1204 09:32:24.221000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8719576Z E1204 09:32:24.245000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8720047Z E1204 09:32:24.245000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8720636Z E1204 09:32:24.245000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8720949Z E1204 09:32:24.267000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8721418Z E1204 09:32:24.267000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8721871Z E1204 09:32:24.267000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8722175Z E1204 09:32:24.269000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8722641Z E1204 09:32:24.269000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8723148Z E1204 09:32:24.269000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8723454Z E1204 09:32:24.271000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8723930Z E1204 09:32:24.271000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8724396Z E1204 09:32:24.271000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8724699Z E1204 09:32:24.283000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8725174Z E1204 09:32:24.283000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8725624Z E1204 09:32:24.283000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8725932Z E1204 09:32:24.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8726401Z E1204 09:32:24.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8726851Z E1204 09:32:24.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8727155Z E1204 09:32:24.308000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8727622Z E1204 09:32:24.308000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8728072Z E1204 09:32:24.308000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8728429Z E1204 09:32:24.310000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8728898Z E1204 09:32:24.310000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8729352Z E1204 09:32:24.310000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8729683Z E1204 09:32:25.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8730152Z E1204 09:32:25.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8730605Z E1204 09:32:25.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8730909Z E1204 09:32:25.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8731377Z E1204 09:32:25.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8731831Z E1204 09:32:25.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8732043Z PASSED [4.8139s] [ 1%] 2025-12-04T09:41:23.8732400Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0007s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.8732832Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5878s] [ 2%] 2025-12-04T09:41:23.8733144Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5499s] [ 2%] 2025-12-04T09:41:23.8733403Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6646s] [ 2%] 2025-12-04T09:41:23.8733661Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5646s] [ 2%] 2025-12-04T09:41:23.8733919Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4353s] [ 2%] 2025-12-04T09:41:23.8734179Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6208s] [ 2%] 2025-12-04T09:41:23.8734440Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7353s] [ 2%] 2025-12-04T09:41:23.8734697Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6787s] [ 2%] 2025-12-04T09:41:23.8734954Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.0919s] [ 2%] 2025-12-04T09:41:23.8735210Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6670s] [ 2%] 2025-12-04T09:41:23.8735465Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7510s] [ 2%] 2025-12-04T09:41:23.8735862Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm W1204 09:32:47.546000 18571 site-packages/torch/_inductor/utils.py:1354] Failed to remove temporary cache dir at /tmp/tmp7zrdco2g 2025-12-04T09:41:23.8736267Z W1204 09:32:47.546000 18571 site-packages/torch/_inductor/utils.py:1354] Traceback (most recent call last): 2025-12-04T09:41:23.8736626Z W1204 09:32:47.546000 18571 site-packages/torch/_inductor/utils.py:1354] File "/opt/conda/envs/py_3.12/lib/python3.12/shutil.py", line 662, in _rmtree_safe_fd 2025-12-04T09:41:23.8736969Z W1204 09:32:47.546000 18571 site-packages/torch/_inductor/utils.py:1354] os.rmdir(name, dir_fd=dirfd) 2025-12-04T09:41:23.8737328Z W1204 09:32:47.546000 18571 site-packages/torch/_inductor/utils.py:1354] OSError: [Errno 39] Directory not empty: '/tmp/tmp7zrdco2g/triton' 2025-12-04T09:41:23.8737677Z W1204 09:32:47.547000 18571 site-packages/torch/_inductor/utils.py:1354] Failed to remove temporary cache dir at /tmp/tmp7zrdco2g 2025-12-04T09:41:23.8737985Z W1204 09:32:47.547000 18571 site-packages/torch/_inductor/utils.py:1354] Traceback (most recent call last): 2025-12-04T09:41:23.8738325Z W1204 09:32:47.547000 18571 site-packages/torch/_inductor/utils.py:1354] File "/opt/conda/envs/py_3.12/lib/python3.12/shutil.py", line 662, in _rmtree_safe_fd 2025-12-04T09:41:23.8738690Z W1204 09:32:47.547000 18571 site-packages/torch/_inductor/utils.py:1354] os.rmdir(name, dir_fd=dirfd) 2025-12-04T09:41:23.8738998Z W1204 09:32:47.547000 18571 site-packages/torch/_inductor/utils.py:1354] OSError: [Errno 39] Directory not empty: '/tmp/tmp7zrdco2g' 2025-12-04T09:41:23.8739226Z PASSED [2.4275s] [ 2%] 2025-12-04T09:41:23.8739408Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.9298s] [ 2%] 2025-12-04T09:41:23.8739667Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.3869s] [ 2%] 2025-12-04T09:41:23.8739923Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [4.0486s] [ 2%] 2025-12-04T09:41:23.8740177Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5864s] [ 2%] 2025-12-04T09:41:23.8740434Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6451s] [ 2%] 2025-12-04T09:41:23.8740689Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7002s] [ 2%] 2025-12-04T09:41:23.8740947Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4312s] [ 2%] 2025-12-04T09:41:23.8741204Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4427s] [ 2%] 2025-12-04T09:41:23.8741465Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5709s] [ 2%] 2025-12-04T09:41:23.8741721Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.8461s] [ 2%] 2025-12-04T09:41:23.8741976Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [3.0841s] [ 2%] 2025-12-04T09:41:23.8742231Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [3.2147s] [ 2%] 2025-12-04T09:41:23.8742485Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.9284s] [ 2%] 2025-12-04T09:41:23.8742742Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4717s] [ 2%] 2025-12-04T09:41:23.8743045Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4321s] [ 2%] 2025-12-04T09:41:23.8743299Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.9798s] [ 2%] 2025-12-04T09:41:23.8743559Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5790s] [ 2%] 2025-12-04T09:41:23.8743817Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6550s] [ 2%] 2025-12-04T09:41:23.8744074Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5138s] [ 2%] 2025-12-04T09:41:23.8744337Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7360s] [ 2%] 2025-12-04T09:41:23.8744593Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6464s] [ 2%] 2025-12-04T09:41:23.8744851Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.0849s] [ 2%] 2025-12-04T09:41:23.8745106Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6903s] [ 2%] 2025-12-04T09:41:23.8745362Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6915s] [ 2%] 2025-12-04T09:41:23.8745621Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6889s] [ 2%] 2025-12-04T09:41:23.8745876Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7107s] [ 2%] 2025-12-04T09:41:23.8746177Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6639s] [ 2%] 2025-12-04T09:41:23.8746433Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7080s] [ 2%] 2025-12-04T09:41:23.8746692Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.0149s] [ 2%] 2025-12-04T09:41:23.8746948Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6964s] [ 2%] 2025-12-04T09:41:23.8747203Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.7062s] [ 2%] 2025-12-04T09:41:23.8747491Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5782s] [ 2%] 2025-12-04T09:41:23.8747750Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6355s] [ 2%] 2025-12-04T09:41:23.8748008Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.4610s] [ 2%] 2025-12-04T09:41:23.8748265Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.6976s] [ 2%] 2025-12-04T09:41:23.8748521Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [2.0115s] [ 2%] 2025-12-04T09:41:23.8748778Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm PASSED [1.5638s] [ 2%] 2025-12-04T09:41:23.8749048Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.8618s] [ 2%] 2025-12-04T09:41:23.8749336Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7926s] [ 2%] 2025-12-04T09:41:23.8749625Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.8377s] [ 2%] 2025-12-04T09:41:23.8749910Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7986s] [ 2%] 2025-12-04T09:41:23.8750195Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7567s] [ 2%] 2025-12-04T09:41:23.8750477Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7331s] [ 2%] 2025-12-04T09:41:23.8750761Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7907s] [ 2%] 2025-12-04T09:41:23.8751043Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.6846s] [ 2%] 2025-12-04T09:41:23.8751323Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.6884s] [ 2%] 2025-12-04T09:41:23.8751610Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [1.3106s] [ 2%] 2025-12-04T09:41:23.8751897Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.8316s] [ 2%] 2025-12-04T09:41:23.8752181Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7004s] [ 2%] 2025-12-04T09:41:23.8752462Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7202s] [ 2%] 2025-12-04T09:41:23.8752745Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.6963s] [ 2%] 2025-12-04T09:41:23.8753093Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7026s] [ 2%] 2025-12-04T09:41:23.8753375Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7086s] [ 2%] 2025-12-04T09:41:23.8753659Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7037s] [ 2%] 2025-12-04T09:41:23.8753943Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7048s] [ 2%] 2025-12-04T09:41:23.8754260Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.6926s] [ 2%] 2025-12-04T09:41:23.8754557Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7031s] [ 2%] 2025-12-04T09:41:23.8754847Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.6960s] [ 2%] 2025-12-04T09:41:23.8755214Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7032s] [ 2%] 2025-12-04T09:41:23.8755508Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [1.2087s] [ 2%] 2025-12-04T09:41:23.8755802Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7235s] [ 2%] 2025-12-04T09:41:23.8756094Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7179s] [ 2%] 2025-12-04T09:41:23.8756387Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7191s] [ 2%] 2025-12-04T09:41:23.8756716Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7119s] [ 2%] 2025-12-04T09:41:23.8757005Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7096s] [ 2%] 2025-12-04T09:41:23.8757292Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7090s] [ 2%] 2025-12-04T09:41:23.8757582Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7127s] [ 2%] 2025-12-04T09:41:23.8757874Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7227s] [ 2%] 2025-12-04T09:41:23.8758163Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7239s] [ 2%] 2025-12-04T09:41:23.8758451Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7132s] [ 2%] 2025-12-04T09:41:23.8758740Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7215s] [ 2%] 2025-12-04T09:41:23.8759030Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7182s] [ 2%] 2025-12-04T09:41:23.8759321Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [1.1876s] [ 2%] 2025-12-04T09:41:23.8759613Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7267s] [ 2%] 2025-12-04T09:41:23.8759904Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7344s] [ 2%] 2025-12-04T09:41:23.8760195Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7218s] [ 2%] 2025-12-04T09:41:23.8760483Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7197s] [ 2%] 2025-12-04T09:41:23.8760771Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7192s] [ 2%] 2025-12-04T09:41:23.8761061Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7264s] [ 2%] 2025-12-04T09:41:23.8761351Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7287s] [ 2%] 2025-12-04T09:41:23.8761643Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7218s] [ 2%] 2025-12-04T09:41:23.8761933Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7114s] [ 2%] 2025-12-04T09:41:23.8762220Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7085s] [ 2%] 2025-12-04T09:41:23.8762506Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7154s] [ 2%] 2025-12-04T09:41:23.8762794Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7180s] [ 2%] 2025-12-04T09:41:23.8763129Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_bad_cases PASSED [0.7337s] [ 2%] 2025-12-04T09:41:23.8763418Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.4216s] [ 2%] 2025-12-04T09:41:23.8763706Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9276s] [ 2%] 2025-12-04T09:41:23.8763995Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9256s] [ 2%] 2025-12-04T09:41:23.8764333Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9005s] [ 2%] 2025-12-04T09:41:23.8764622Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9044s] [ 2%] 2025-12-04T09:41:23.8764908Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8683s] [ 2%] 2025-12-04T09:41:23.8765193Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8547s] [ 2%] 2025-12-04T09:41:23.8765480Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.1106s] [ 2%] 2025-12-04T09:41:23.8765801Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.2727s] [ 2%] 2025-12-04T09:41:23.8766090Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.1993s] [ 2%] 2025-12-04T09:41:23.8766381Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.2403s] [ 2%] 2025-12-04T09:41:23.8766670Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9068s] [ 2%] 2025-12-04T09:41:23.8766959Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8664s] [ 2%] 2025-12-04T09:41:23.8767247Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8409s] [ 2%] 2025-12-04T09:41:23.8767541Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.6657s] [ 2%] 2025-12-04T09:41:23.8767833Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.8675s] [ 2%] 2025-12-04T09:41:23.8768128Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.4771s] [ 2%] 2025-12-04T09:41:23.8768416Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.1485s] [ 2%] 2025-12-04T09:41:23.8768709Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9811s] [ 2%] 2025-12-04T09:41:23.8768998Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8281s] [ 2%] 2025-12-04T09:41:23.8769287Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8440s] [ 2%] 2025-12-04T09:41:23.8769576Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8443s] [ 2%] 2025-12-04T09:41:23.8769866Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8199s] [ 2%] 2025-12-04T09:41:23.8770152Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8287s] [ 2%] 2025-12-04T09:41:23.8770440Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.4038s] [ 2%] 2025-12-04T09:41:23.8770729Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8555s] [ 2%] 2025-12-04T09:41:23.8771021Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8710s] [ 2%] 2025-12-04T09:41:23.8771309Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9831s] [ 2%] 2025-12-04T09:41:23.8771597Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.2977s] [ 2%] 2025-12-04T09:41:23.8771889Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8630s] [ 2%] 2025-12-04T09:41:23.8772181Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.0015s] [ 2%] 2025-12-04T09:41:23.8772469Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.2536s] [ 2%] 2025-12-04T09:41:23.8772757Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.0632s] [ 2%] 2025-12-04T09:41:23.8773100Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9788s] [ 2%] 2025-12-04T09:41:23.8773429Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8513s] [ 2%] 2025-12-04T09:41:23.8773715Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.0240s] [ 2%] 2025-12-04T09:41:23.8774003Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.1187s] [ 2%] 2025-12-04T09:41:23.8774289Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9508s] [ 2%] 2025-12-04T09:41:23.8774580Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8289s] [ 2%] 2025-12-04T09:41:23.8774910Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8198s] [ 2%] 2025-12-04T09:41:23.8775198Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.6044s] [ 2%] 2025-12-04T09:41:23.8775484Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8606s] [ 2%] 2025-12-04T09:41:23.8775779Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8672s] [ 2%] 2025-12-04T09:41:23.8776068Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [2.0032s] [ 2%] 2025-12-04T09:41:23.8776359Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.9980s] [ 2%] 2025-12-04T09:41:23.8776647Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.6204s] [ 2%] 2025-12-04T09:41:23.8776937Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.9957s] [ 2%] 2025-12-04T09:41:23.8777224Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [1.8623s] [ 2%] 2025-12-04T09:41:23.8777512Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_epi_works PASSED [3.0301s] [ 2%] 2025-12-04T09:41:23.8777945Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:26.568000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8778551Z E1204 09:36:26.568000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8779026Z E1204 09:36:26.568000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8779344Z E1204 09:36:26.607000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8779838Z E1204 09:36:26.607000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8780303Z E1204 09:36:26.607000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8780616Z E1204 09:36:28.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8781092Z E1204 09:36:28.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8781548Z E1204 09:36:28.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8781862Z E1204 09:36:28.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8782338Z E1204 09:36:28.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8782821Z E1204 09:36:28.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8783216Z E1204 09:36:28.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8783692Z E1204 09:36:28.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8784182Z E1204 09:36:28.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8784493Z E1204 09:36:28.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8784967Z E1204 09:36:28.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8785429Z E1204 09:36:28.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8785738Z E1204 09:36:28.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8786214Z E1204 09:36:28.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8786675Z E1204 09:36:28.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8786982Z E1204 09:36:28.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8787457Z E1204 09:36:28.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8787916Z E1204 09:36:28.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8788226Z E1204 09:36:28.144000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8788704Z E1204 09:36:28.144000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8789161Z E1204 09:36:28.144000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8789472Z E1204 09:36:28.157000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8789945Z E1204 09:36:28.157000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8790404Z E1204 09:36:28.157000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8790712Z E1204 09:36:28.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8791188Z E1204 09:36:28.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8791689Z E1204 09:36:28.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8792000Z E1204 09:36:28.183000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8792474Z E1204 09:36:28.183000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8793015Z E1204 09:36:28.183000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8793380Z E1204 09:36:28.185000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8793861Z E1204 09:36:28.185000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8794525Z E1204 09:36:28.185000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8794834Z E1204 09:36:29.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8795306Z E1204 09:36:29.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8795758Z E1204 09:36:29.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8796065Z E1204 09:36:29.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8796538Z E1204 09:36:29.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8797000Z E1204 09:36:29.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8797207Z PASSED [4.7283s] [ 2%] 2025-12-04T09:41:23.8797535Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:31.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8798124Z E1204 09:36:31.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8798583Z E1204 09:36:31.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8798891Z E1204 09:36:31.322000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8799363Z E1204 09:36:31.322000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8799815Z E1204 09:36:31.322000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8800120Z E1204 09:36:32.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8800593Z E1204 09:36:32.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8801078Z E1204 09:36:32.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8801381Z E1204 09:36:32.787000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8801852Z E1204 09:36:32.787000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8802303Z E1204 09:36:32.787000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8802634Z E1204 09:36:32.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8803231Z E1204 09:36:32.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8803685Z E1204 09:36:32.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8803989Z E1204 09:36:32.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8804458Z E1204 09:36:32.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8804911Z E1204 09:36:32.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8805213Z E1204 09:36:32.856000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8805685Z E1204 09:36:32.856000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8806136Z E1204 09:36:32.856000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8806439Z E1204 09:36:32.858000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8806913Z E1204 09:36:32.858000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8807369Z E1204 09:36:32.858000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8807675Z E1204 09:36:32.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8808150Z E1204 09:36:32.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8808604Z E1204 09:36:32.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8808908Z E1204 09:36:32.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8809382Z E1204 09:36:32.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8809832Z E1204 09:36:32.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8810172Z E1204 09:36:32.876000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8810644Z E1204 09:36:32.876000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8811094Z E1204 09:36:32.876000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8811396Z E1204 09:36:32.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8811894Z E1204 09:36:32.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8812346Z E1204 09:36:32.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8812650Z E1204 09:36:32.902000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8813181Z E1204 09:36:32.902000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8813639Z E1204 09:36:32.902000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8813949Z E1204 09:36:34.612000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8814416Z E1204 09:36:34.612000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8814870Z E1204 09:36:34.612000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8815178Z E1204 09:36:34.649000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8815645Z E1204 09:36:34.649000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8816098Z E1204 09:36:34.649000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8816301Z PASSED [4.8196s] [ 2%] 2025-12-04T09:41:23.8816627Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:36.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8817214Z E1204 09:36:36.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8817664Z E1204 09:36:36.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8817967Z E1204 09:36:36.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8818434Z E1204 09:36:36.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8818886Z E1204 09:36:36.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8819230Z E1204 09:36:37.648000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8819698Z E1204 09:36:37.648000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8820148Z E1204 09:36:37.648000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8820498Z E1204 09:36:37.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8820973Z E1204 09:36:37.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8821433Z E1204 09:36:37.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8821742Z E1204 09:36:37.670000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8822213Z E1204 09:36:37.670000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8825193Z E1204 09:36:37.670000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8825506Z E1204 09:36:37.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8825980Z E1204 09:36:37.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8826438Z E1204 09:36:37.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8826747Z E1204 09:36:37.719000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8827222Z E1204 09:36:37.719000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8827727Z E1204 09:36:37.719000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8828038Z E1204 09:36:37.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8828518Z E1204 09:36:37.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8828973Z E1204 09:36:37.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8829281Z E1204 09:36:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8829756Z E1204 09:36:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8830214Z E1204 09:36:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8830523Z E1204 09:36:37.736000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8831031Z E1204 09:36:37.736000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8831493Z E1204 09:36:37.736000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8831805Z E1204 09:36:37.738000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8832328Z E1204 09:36:37.738000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8832785Z E1204 09:36:37.738000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8833141Z E1204 09:36:37.762000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8833611Z E1204 09:36:37.762000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8834064Z E1204 09:36:37.762000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8834437Z E1204 09:36:37.764000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8834911Z E1204 09:36:37.764000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8835363Z E1204 09:36:37.764000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8835667Z E1204 09:36:39.472000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8836136Z E1204 09:36:39.472000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8836586Z E1204 09:36:39.472000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8836892Z E1204 09:36:39.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8837360Z E1204 09:36:39.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8837813Z E1204 09:36:39.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8838017Z PASSED [4.9816s] [ 2%] 2025-12-04T09:41:23.8838346Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:41.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8838933Z E1204 09:36:41.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8839387Z E1204 09:36:41.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8839719Z E1204 09:36:41.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8840192Z E1204 09:36:41.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8840642Z E1204 09:36:41.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8840948Z E1204 09:36:42.690000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8841460Z E1204 09:36:42.690000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8841911Z E1204 09:36:42.690000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8842215Z E1204 09:36:42.692000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8842686Z E1204 09:36:42.692000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8843199Z E1204 09:36:42.692000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8843544Z E1204 09:36:42.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8844022Z E1204 09:36:42.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8844477Z E1204 09:36:42.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8844786Z E1204 09:36:42.739000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8845258Z E1204 09:36:42.739000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8845723Z E1204 09:36:42.739000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8846034Z E1204 09:36:42.763000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8846506Z E1204 09:36:42.763000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8846963Z E1204 09:36:42.763000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8847273Z E1204 09:36:42.765000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8847749Z E1204 09:36:42.765000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8848209Z E1204 09:36:42.765000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8848519Z E1204 09:36:42.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8849014Z E1204 09:36:42.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8849466Z E1204 09:36:42.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8849768Z E1204 09:36:42.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8850263Z E1204 09:36:42.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8850715Z E1204 09:36:42.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8851022Z E1204 09:36:42.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8851493Z E1204 09:36:42.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8851943Z E1204 09:36:42.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8852249Z E1204 09:36:42.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8852735Z E1204 09:36:42.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8853238Z E1204 09:36:42.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8853544Z E1204 09:36:42.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8854013Z E1204 09:36:42.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8854467Z E1204 09:36:42.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8854775Z E1204 09:36:44.517000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8855246Z E1204 09:36:44.517000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8855698Z E1204 09:36:44.517000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8856005Z E1204 09:36:44.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8856473Z E1204 09:36:44.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8856929Z E1204 09:36:44.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8857132Z PASSED [4.9753s] [ 2%] 2025-12-04T09:41:23.8857455Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:46.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8858066Z E1204 09:36:46.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8858516Z E1204 09:36:46.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8858819Z E1204 09:36:46.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8859317Z E1204 09:36:46.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8859771Z E1204 09:36:46.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8860078Z E1204 09:36:47.580000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8860544Z E1204 09:36:47.580000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8860992Z E1204 09:36:47.580000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8861298Z E1204 09:36:47.582000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8861800Z E1204 09:36:47.582000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8862254Z E1204 09:36:47.582000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8862558Z E1204 09:36:47.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8863135Z E1204 09:36:47.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8863606Z E1204 09:36:47.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8863957Z E1204 09:36:47.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8864436Z E1204 09:36:47.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8864891Z E1204 09:36:47.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8865198Z E1204 09:36:47.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8865671Z E1204 09:36:47.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8866127Z E1204 09:36:47.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8866437Z E1204 09:36:47.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8866908Z E1204 09:36:47.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8867402Z E1204 09:36:47.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8867704Z E1204 09:36:47.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8868215Z E1204 09:36:47.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8868670Z E1204 09:36:47.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8868972Z E1204 09:36:47.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8869455Z E1204 09:36:47.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8869905Z E1204 09:36:47.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8870209Z E1204 09:36:47.673000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8870707Z E1204 09:36:47.673000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8871162Z E1204 09:36:47.673000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8871466Z E1204 09:36:47.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8871949Z E1204 09:36:47.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8872410Z E1204 09:36:47.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8872715Z E1204 09:36:47.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8873269Z E1204 09:36:47.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8873726Z E1204 09:36:47.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8874030Z E1204 09:36:49.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8874498Z E1204 09:36:49.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8874948Z E1204 09:36:49.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8875263Z E1204 09:36:49.456000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8875737Z E1204 09:36:49.456000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8876217Z E1204 09:36:49.456000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8876418Z PASSED [4.9594s] [ 2%] 2025-12-04T09:41:23.8876741Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:51.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8877372Z E1204 09:36:51.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8877826Z E1204 09:36:51.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8894236Z E1204 09:36:51.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8894823Z E1204 09:36:51.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8895317Z E1204 09:36:51.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8895625Z E1204 09:36:52.581000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8896315Z E1204 09:36:52.581000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8896782Z E1204 09:36:52.581000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8897084Z E1204 09:36:52.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8897551Z E1204 09:36:52.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8898002Z E1204 09:36:52.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8898321Z E1204 09:36:52.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8898806Z E1204 09:36:52.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8899263Z E1204 09:36:52.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8899576Z E1204 09:36:52.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8900067Z E1204 09:36:52.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8900527Z E1204 09:36:52.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8900846Z E1204 09:36:52.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8901324Z E1204 09:36:52.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8901826Z E1204 09:36:52.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8902134Z E1204 09:36:52.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8902610Z E1204 09:36:52.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8903224Z E1204 09:36:52.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8903533Z E1204 09:36:52.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8904018Z E1204 09:36:52.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8904479Z E1204 09:36:52.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8904782Z E1204 09:36:52.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8905259Z E1204 09:36:52.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8905732Z E1204 09:36:52.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8906031Z E1204 09:36:52.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8906501Z E1204 09:36:52.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8906948Z E1204 09:36:52.671000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8907246Z E1204 09:36:52.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8907713Z E1204 09:36:52.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8908157Z E1204 09:36:52.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8908458Z E1204 09:36:52.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8908923Z E1204 09:36:52.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8909370Z E1204 09:36:52.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8909675Z E1204 09:36:54.419000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8910139Z E1204 09:36:54.419000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8910609Z E1204 09:36:54.419000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8910907Z E1204 09:36:54.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8911375Z E1204 09:36:54.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8911820Z E1204 09:36:54.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8912063Z PASSED [4.9346s] [ 2%] 2025-12-04T09:41:23.8912393Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:36:56.574000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8913022Z E1204 09:36:56.574000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8913472Z E1204 09:36:56.574000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8913771Z E1204 09:36:56.610000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8914238Z E1204 09:36:56.610000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8914708Z E1204 09:36:56.610000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8915009Z E1204 09:36:58.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8915476Z E1204 09:36:58.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8915923Z E1204 09:36:58.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8916227Z E1204 09:36:58.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8916695Z E1204 09:36:58.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8917140Z E1204 09:36:58.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8917441Z E1204 09:36:58.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8917908Z E1204 09:36:58.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8918352Z E1204 09:36:58.138000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8918652Z E1204 09:36:58.163000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8919117Z E1204 09:36:58.163000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8919584Z E1204 09:36:58.163000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8919883Z E1204 09:36:58.187000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8920346Z E1204 09:36:58.187000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8920794Z E1204 09:36:58.187000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8921130Z E1204 09:36:58.189000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8921593Z E1204 09:36:58.189000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8922043Z E1204 09:36:58.189000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8922340Z E1204 09:36:58.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8922802Z E1204 09:36:58.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8923309Z E1204 09:36:58.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8923606Z E1204 09:36:58.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8924070Z E1204 09:36:58.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8924518Z E1204 09:36:58.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8924818Z E1204 09:36:58.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8925282Z E1204 09:36:58.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8925730Z E1204 09:36:58.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8926031Z E1204 09:36:58.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8926496Z E1204 09:36:58.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8926941Z E1204 09:36:58.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8927240Z E1204 09:36:58.232000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8927707Z E1204 09:36:58.232000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8928156Z E1204 09:36:58.232000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8928478Z E1204 09:36:59.944000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8928942Z E1204 09:36:59.944000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8929386Z E1204 09:36:59.944000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8929719Z E1204 09:36:59.980000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8930184Z E1204 09:36:59.980000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8930631Z E1204 09:36:59.980000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8930830Z PASSED [5.5212s] [ 2%] 2025-12-04T09:41:23.8931152Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:01.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8931731Z E1204 09:37:01.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8932202Z E1204 09:37:01.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8932505Z E1204 09:37:01.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8933016Z E1204 09:37:01.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8933466Z E1204 09:37:01.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8933767Z E1204 09:37:02.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8934234Z E1204 09:37:02.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8934685Z E1204 09:37:02.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8934988Z E1204 09:37:02.988000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8935456Z E1204 09:37:02.988000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8935908Z E1204 09:37:02.988000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8936209Z E1204 09:37:03.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8936676Z E1204 09:37:03.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8937123Z E1204 09:37:03.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8937447Z E1204 09:37:03.033000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8937911Z E1204 09:37:03.033000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8938360Z E1204 09:37:03.033000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8938701Z E1204 09:37:03.056000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8939168Z E1204 09:37:03.056000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8939617Z E1204 09:37:03.056000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8939918Z E1204 09:37:03.058000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8940383Z E1204 09:37:03.058000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8940854Z E1204 09:37:03.058000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8941154Z E1204 09:37:03.060000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8941623Z E1204 09:37:03.060000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8942073Z E1204 09:37:03.060000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8942371Z E1204 09:37:03.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8942834Z E1204 09:37:03.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8943325Z E1204 09:37:03.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8943624Z E1204 09:37:03.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8944085Z E1204 09:37:03.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8944535Z E1204 09:37:03.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8944834Z E1204 09:37:03.099000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8945297Z E1204 09:37:03.099000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8945745Z E1204 09:37:03.099000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8946071Z E1204 09:37:03.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8946534Z E1204 09:37:03.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8946986Z E1204 09:37:03.101000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8947286Z E1204 09:37:04.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8947791Z E1204 09:37:04.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8948238Z E1204 09:37:04.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8948539Z E1204 09:37:04.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8949000Z E1204 09:37:04.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8949446Z E1204 09:37:04.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8949665Z PASSED [4.9259s] [ 2%] 2025-12-04T09:41:23.8949986Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:06.412000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8950569Z E1204 09:37:06.412000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8951021Z E1204 09:37:06.412000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8951321Z E1204 09:37:06.451000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8951787Z E1204 09:37:06.451000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8952236Z E1204 09:37:06.451000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8952535Z E1204 09:37:08.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8953041Z E1204 09:37:08.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8953501Z E1204 09:37:08.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8953808Z E1204 09:37:08.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8954283Z E1204 09:37:08.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8954733Z E1204 09:37:08.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8955059Z E1204 09:37:08.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8955524Z E1204 09:37:08.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8955973Z E1204 09:37:08.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8956274Z E1204 09:37:08.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8956775Z E1204 09:37:08.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8957222Z E1204 09:37:08.118000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8957524Z E1204 09:37:08.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8957988Z E1204 09:37:08.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8958440Z E1204 09:37:08.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8958772Z E1204 09:37:08.145000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8959241Z E1204 09:37:08.145000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8959693Z E1204 09:37:08.145000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8959995Z E1204 09:37:08.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8960463Z E1204 09:37:08.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8960916Z E1204 09:37:08.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8961218Z E1204 09:37:08.160000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8961685Z E1204 09:37:08.160000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8962134Z E1204 09:37:08.160000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8962437Z E1204 09:37:08.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8962905Z E1204 09:37:08.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8963393Z E1204 09:37:08.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8963694Z E1204 09:37:08.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8964187Z E1204 09:37:08.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8964635Z E1204 09:37:08.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8964937Z E1204 09:37:08.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8965436Z E1204 09:37:08.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8965885Z E1204 09:37:08.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8966190Z E1204 09:37:09.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8966660Z E1204 09:37:09.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8967110Z E1204 09:37:09.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8967409Z E1204 09:37:09.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8967899Z E1204 09:37:09.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8968348Z E1204 09:37:09.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8968546Z PASSED [5.0999s] [ 2%] 2025-12-04T09:41:23.8968870Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:11.512000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8969450Z E1204 09:37:11.512000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8969904Z E1204 09:37:11.512000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8970204Z E1204 09:37:11.550000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8970669Z E1204 09:37:11.550000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8971116Z E1204 09:37:11.550000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8971418Z E1204 09:37:13.371000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8971884Z E1204 09:37:13.371000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8972332Z E1204 09:37:13.371000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8972636Z E1204 09:37:13.373000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8973161Z E1204 09:37:13.373000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8973614Z E1204 09:37:13.373000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8973917Z E1204 09:37:13.394000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8974424Z E1204 09:37:13.394000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8974875Z E1204 09:37:13.394000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8975178Z E1204 09:37:13.421000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8975643Z E1204 09:37:13.421000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8976090Z E1204 09:37:13.421000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8976413Z E1204 09:37:13.446000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8976877Z E1204 09:37:13.446000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8977323Z E1204 09:37:13.446000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8977624Z E1204 09:37:13.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8978090Z E1204 09:37:13.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8978542Z E1204 09:37:13.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8978847Z E1204 09:37:13.449000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8979312Z E1204 09:37:13.449000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8979763Z E1204 09:37:13.449000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8980064Z E1204 09:37:13.463000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8980527Z E1204 09:37:13.463000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8980979Z E1204 09:37:13.463000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8981280Z E1204 09:37:13.465000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8981746Z E1204 09:37:13.465000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8982226Z E1204 09:37:13.465000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8982529Z E1204 09:37:13.489000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8983170Z E1204 09:37:13.489000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8983623Z E1204 09:37:13.489000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8983924Z E1204 09:37:13.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8984393Z E1204 09:37:13.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8984847Z E1204 09:37:13.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8985152Z E1204 09:37:15.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8985639Z E1204 09:37:15.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8986086Z E1204 09:37:15.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8986389Z E1204 09:37:15.244000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8986858Z E1204 09:37:15.244000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8987308Z E1204 09:37:15.244000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8987512Z PASSED [5.2720s] [ 2%] 2025-12-04T09:41:23.8987835Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:16.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8988421Z E1204 09:37:16.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8988869Z E1204 09:37:16.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8989173Z E1204 09:37:16.831000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8989639Z E1204 09:37:16.831000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8990089Z E1204 09:37:16.831000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8990395Z E1204 09:37:18.336000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8990878Z E1204 09:37:18.336000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8991327Z E1204 09:37:18.336000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8991627Z E1204 09:37:18.338000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8992115Z E1204 09:37:18.338000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8992566Z E1204 09:37:18.338000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8992868Z E1204 09:37:18.358000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8993378Z E1204 09:37:18.358000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8993827Z E1204 09:37:18.358000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8994130Z E1204 09:37:18.385000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8994633Z E1204 09:37:18.385000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8995082Z E1204 09:37:18.385000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8995388Z E1204 09:37:18.409000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8995860Z E1204 09:37:18.409000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8996310Z E1204 09:37:18.409000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8996616Z E1204 09:37:18.411000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8997083Z E1204 09:37:18.411000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8997538Z E1204 09:37:18.411000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8997845Z E1204 09:37:18.413000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8998316Z E1204 09:37:18.413000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.8998771Z E1204 09:37:18.413000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.8999073Z E1204 09:37:18.426000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.8999540Z E1204 09:37:18.426000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9000002Z E1204 09:37:18.426000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9000302Z E1204 09:37:18.428000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9000772Z E1204 09:37:18.428000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9001249Z E1204 09:37:18.428000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9001558Z E1204 09:37:18.452000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9002027Z E1204 09:37:18.452000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9002480Z E1204 09:37:18.452000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9002783Z E1204 09:37:18.454000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9003327Z E1204 09:37:18.454000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9003793Z E1204 09:37:18.454000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9004093Z E1204 09:37:20.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9004557Z E1204 09:37:20.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9005003Z E1204 09:37:20.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9005302Z E1204 09:37:20.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9005771Z E1204 09:37:20.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9006215Z E1204 09:37:20.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9006416Z PASSED [4.7895s] [ 2%] 2025-12-04T09:41:23.9006735Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:21.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9007323Z E1204 09:37:21.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9007774Z E1204 09:37:21.583000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9008075Z E1204 09:37:21.631000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9008537Z E1204 09:37:21.631000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9008999Z E1204 09:37:21.631000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9009300Z E1204 09:37:23.120000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9009765Z E1204 09:37:23.120000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9010238Z E1204 09:37:23.120000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9010538Z E1204 09:37:23.122000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9011003Z E1204 09:37:23.122000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9011449Z E1204 09:37:23.122000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9011749Z E1204 09:37:23.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9012218Z E1204 09:37:23.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9012683Z E1204 09:37:23.142000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9013016Z E1204 09:37:23.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9013481Z E1204 09:37:23.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9013927Z E1204 09:37:23.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9014227Z E1204 09:37:23.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9014696Z E1204 09:37:23.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9015146Z E1204 09:37:23.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9015449Z E1204 09:37:23.195000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9015911Z E1204 09:37:23.195000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9016360Z E1204 09:37:23.195000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9016662Z E1204 09:37:23.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9017129Z E1204 09:37:23.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9017601Z E1204 09:37:23.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9017901Z E1204 09:37:23.210000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9018367Z E1204 09:37:23.210000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9018849Z E1204 09:37:23.210000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9019149Z E1204 09:37:23.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9019612Z E1204 09:37:23.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9020057Z E1204 09:37:23.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9020356Z E1204 09:37:23.236000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9020821Z E1204 09:37:23.236000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9021289Z E1204 09:37:23.236000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9021590Z E1204 09:37:23.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9022073Z E1204 09:37:23.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9022525Z E1204 09:37:23.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9022833Z E1204 09:37:24.979000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9023395Z E1204 09:37:24.979000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9023849Z E1204 09:37:24.979000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9024154Z E1204 09:37:25.016000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9024622Z E1204 09:37:25.016000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9025071Z E1204 09:37:25.016000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9025276Z PASSED [4.9500s] [ 2%] 2025-12-04T09:41:23.9025604Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:26.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9026192Z E1204 09:37:26.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9026668Z E1204 09:37:26.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9026975Z E1204 09:37:26.559000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9027445Z E1204 09:37:26.559000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9027935Z E1204 09:37:26.559000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9028241Z E1204 09:37:28.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9028712Z E1204 09:37:28.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9029165Z E1204 09:37:28.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9029472Z E1204 09:37:28.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9029945Z E1204 09:37:28.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9030417Z E1204 09:37:28.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9030721Z E1204 09:37:28.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9031190Z E1204 09:37:28.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9031635Z E1204 09:37:28.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9031934Z E1204 09:37:28.151000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9032401Z E1204 09:37:28.151000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9032850Z E1204 09:37:28.151000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9033187Z E1204 09:37:28.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9033657Z E1204 09:37:28.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9034111Z E1204 09:37:28.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9034413Z E1204 09:37:28.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9034881Z E1204 09:37:28.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9035350Z E1204 09:37:28.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9035651Z E1204 09:37:28.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9036120Z E1204 09:37:28.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9036571Z E1204 09:37:28.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9036908Z E1204 09:37:28.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9037373Z E1204 09:37:28.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9037821Z E1204 09:37:28.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9038123Z E1204 09:37:28.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9038587Z E1204 09:37:28.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9039055Z E1204 09:37:28.193000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9039357Z E1204 09:37:28.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9039821Z E1204 09:37:28.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9040270Z E1204 09:37:28.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9040571Z E1204 09:37:28.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9041040Z E1204 09:37:28.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9041491Z E1204 09:37:28.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9041794Z E1204 09:37:29.967000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9042258Z E1204 09:37:29.967000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9042709Z E1204 09:37:29.967000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9043049Z E1204 09:37:30.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9043519Z E1204 09:37:30.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9043972Z E1204 09:37:30.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9044201Z PASSED [5.6212s] [ 2%] 2025-12-04T09:41:23.9044524Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:32.165000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9045106Z E1204 09:37:32.165000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9045552Z E1204 09:37:32.165000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9045894Z E1204 09:37:32.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9046358Z E1204 09:37:32.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9046809Z E1204 09:37:32.203000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9047108Z E1204 09:37:33.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9047571Z E1204 09:37:33.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9048044Z E1204 09:37:33.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9048349Z E1204 09:37:33.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9048817Z E1204 09:37:33.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9049268Z E1204 09:37:33.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9049571Z E1204 09:37:33.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9050039Z E1204 09:37:33.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9050485Z E1204 09:37:33.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9050784Z E1204 09:37:33.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9051249Z E1204 09:37:33.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9051696Z E1204 09:37:33.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9051998Z E1204 09:37:33.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9052465Z E1204 09:37:33.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9052911Z E1204 09:37:33.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9053275Z E1204 09:37:33.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9053738Z E1204 09:37:33.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9054184Z E1204 09:37:33.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9054528Z E1204 09:37:33.875000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9054998Z E1204 09:37:33.875000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9055449Z E1204 09:37:33.875000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9055750Z E1204 09:37:33.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9056216Z E1204 09:37:33.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9056665Z E1204 09:37:33.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9056990Z E1204 09:37:33.890000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9057456Z E1204 09:37:33.890000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9057906Z E1204 09:37:33.890000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9058206Z E1204 09:37:33.914000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9058671Z E1204 09:37:33.914000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9059121Z E1204 09:37:33.914000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9059422Z E1204 09:37:33.916000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9059888Z E1204 09:37:33.916000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9060339Z E1204 09:37:33.916000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9060640Z E1204 09:37:35.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9061105Z E1204 09:37:35.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9061554Z E1204 09:37:35.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9061853Z E1204 09:37:35.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9062340Z E1204 09:37:35.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9062789Z E1204 09:37:35.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9063151Z PASSED [4.8772s] [ 2%] 2025-12-04T09:41:23.9063502Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:37.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9064086Z E1204 09:37:37.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9064534Z E1204 09:37:37.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9064836Z E1204 09:37:37.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9065302Z E1204 09:37:37.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9065768Z E1204 09:37:37.067000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9066071Z E1204 09:37:38.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9066536Z E1204 09:37:38.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9066985Z E1204 09:37:38.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9067284Z E1204 09:37:38.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9067747Z E1204 09:37:38.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9068194Z E1204 09:37:38.654000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9068494Z E1204 09:37:38.674000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9068962Z E1204 09:37:38.674000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9069412Z E1204 09:37:38.674000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9069712Z E1204 09:37:38.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9070178Z E1204 09:37:38.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9070624Z E1204 09:37:38.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9070923Z E1204 09:37:38.724000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9071410Z E1204 09:37:38.724000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9071859Z E1204 09:37:38.724000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9072163Z E1204 09:37:38.726000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9072650Z E1204 09:37:38.726000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9073135Z E1204 09:37:38.726000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9073437Z E1204 09:37:38.728000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9073912Z E1204 09:37:38.728000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9074364Z E1204 09:37:38.728000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9074693Z E1204 09:37:38.741000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9075165Z E1204 09:37:38.741000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9075616Z E1204 09:37:38.741000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9075916Z E1204 09:37:38.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9076381Z E1204 09:37:38.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9076830Z E1204 09:37:38.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9077131Z E1204 09:37:38.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9077598Z E1204 09:37:38.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9078047Z E1204 09:37:38.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9078349Z E1204 09:37:38.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9078815Z E1204 09:37:38.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9079267Z E1204 09:37:38.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9079567Z E1204 09:37:40.314000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9080055Z E1204 09:37:40.314000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9080504Z E1204 09:37:40.314000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9080804Z E1204 09:37:40.352000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9081313Z E1204 09:37:40.352000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9081762Z E1204 09:37:40.352000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9081963Z PASSED [4.9148s] [ 2%] 2025-12-04T09:41:23.9082287Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:41.948000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9082875Z E1204 09:37:41.948000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9083363Z E1204 09:37:41.948000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9083689Z E1204 09:37:41.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9084152Z E1204 09:37:41.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9084599Z E1204 09:37:41.986000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9084900Z E1204 09:37:43.448000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9085364Z E1204 09:37:43.448000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9085812Z E1204 09:37:43.448000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9086113Z E1204 09:37:43.450000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9086579Z E1204 09:37:43.450000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9087025Z E1204 09:37:43.450000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9087325Z E1204 09:37:43.471000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9087789Z E1204 09:37:43.471000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9088236Z E1204 09:37:43.471000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9088537Z E1204 09:37:43.497000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9089028Z E1204 09:37:43.497000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9089481Z E1204 09:37:43.497000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9089784Z E1204 09:37:43.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9090284Z E1204 09:37:43.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9090734Z E1204 09:37:43.521000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9091040Z E1204 09:37:43.523000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9091507Z E1204 09:37:43.523000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9091956Z E1204 09:37:43.523000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9092257Z E1204 09:37:43.525000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9092737Z E1204 09:37:43.525000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9093232Z E1204 09:37:43.525000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9093533Z E1204 09:37:43.538000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9094000Z E1204 09:37:43.538000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9094449Z E1204 09:37:43.538000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9094754Z E1204 09:37:43.540000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9095218Z E1204 09:37:43.540000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9095668Z E1204 09:37:43.540000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9095967Z E1204 09:37:43.564000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9096434Z E1204 09:37:43.564000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9096884Z E1204 09:37:43.564000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9097186Z E1204 09:37:43.566000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9097654Z E1204 09:37:43.566000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9098122Z E1204 09:37:43.566000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9098423Z E1204 09:37:45.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9098888Z E1204 09:37:45.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9099371Z E1204 09:37:45.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9099673Z E1204 09:37:45.355000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9100139Z E1204 09:37:45.355000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9100586Z E1204 09:37:45.355000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9100787Z PASSED [4.9339s] [ 2%] 2025-12-04T09:41:23.9101109Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:46.893000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9101716Z E1204 09:37:46.893000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9102165Z E1204 09:37:46.893000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9102467Z E1204 09:37:46.932000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9103034Z E1204 09:37:46.932000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9103484Z E1204 09:37:46.932000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9103789Z E1204 09:37:49.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9104254Z E1204 09:37:49.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9104704Z E1204 09:37:49.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9105006Z E1204 09:37:49.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9105472Z E1204 09:37:49.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9105925Z E1204 09:37:49.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9106304Z E1204 09:37:49.194000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9106770Z E1204 09:37:49.194000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9107240Z E1204 09:37:49.194000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9107541Z E1204 09:37:49.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9108033Z E1204 09:37:49.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9108483Z E1204 09:37:49.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9108786Z E1204 09:37:49.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9109253Z E1204 09:37:49.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9109702Z E1204 09:37:49.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9110001Z E1204 09:37:49.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9110487Z E1204 09:37:49.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9110935Z E1204 09:37:49.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9111239Z E1204 09:37:49.252000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9111706Z E1204 09:37:49.252000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9112155Z E1204 09:37:49.252000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9112457Z E1204 09:37:49.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9112924Z E1204 09:37:49.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9113407Z E1204 09:37:49.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9113709Z E1204 09:37:49.268000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9114174Z E1204 09:37:49.268000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9114626Z E1204 09:37:49.268000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9114931Z E1204 09:37:49.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9115395Z E1204 09:37:49.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9115877Z E1204 09:37:49.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9116180Z E1204 09:37:49.294000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9116645Z E1204 09:37:49.294000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9117127Z E1204 09:37:49.294000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9117431Z E1204 09:37:50.951000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9117895Z E1204 09:37:50.951000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9118345Z E1204 09:37:50.951000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9118645Z E1204 09:37:50.991000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9119112Z E1204 09:37:50.991000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9119579Z E1204 09:37:50.991000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9119779Z PASSED [5.6768s] [ 2%] 2025-12-04T09:41:23.9120101Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:52.570000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9120691Z E1204 09:37:52.570000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9121138Z E1204 09:37:52.570000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9121443Z E1204 09:37:52.608000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9121908Z E1204 09:37:52.608000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9122359Z E1204 09:37:52.608000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9122661Z E1204 09:37:54.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9123163Z E1204 09:37:54.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9123609Z E1204 09:37:54.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9123913Z E1204 09:37:54.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9124378Z E1204 09:37:54.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9124851Z E1204 09:37:54.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9125155Z E1204 09:37:54.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9125630Z E1204 09:37:54.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9126124Z E1204 09:37:54.197000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9126427Z E1204 09:37:54.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9126895Z E1204 09:37:54.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9127344Z E1204 09:37:54.223000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9127649Z E1204 09:37:54.247000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9128115Z E1204 09:37:54.247000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9128586Z E1204 09:37:54.247000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9128891Z E1204 09:37:54.249000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9129359Z E1204 09:37:54.249000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9129810Z E1204 09:37:54.249000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9129953Z E1204 09:37:54.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9130249Z E1204 09:37:54.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9130374Z E1204 09:37:54.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9130517Z E1204 09:37:54.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9130805Z E1204 09:37:54.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9130932Z E1204 09:37:54.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9131074Z E1204 09:37:54.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9131365Z E1204 09:37:54.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9131505Z E1204 09:37:54.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9131645Z E1204 09:37:54.290000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9131934Z E1204 09:37:54.290000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9132058Z E1204 09:37:54.290000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9132225Z E1204 09:37:54.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9132517Z E1204 09:37:54.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9132643Z E1204 09:37:54.292000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9132783Z E1204 09:37:56.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9133124Z E1204 09:37:56.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9133274Z E1204 09:37:56.002000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9133414Z E1204 09:37:56.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9133707Z E1204 09:37:56.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9133830Z E1204 09:37:56.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9133873Z PASSED [4.9964s] [ 2%] 2025-12-04T09:41:23.9134132Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:37:57.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9134432Z E1204 09:37:57.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9134559Z E1204 09:37:57.695000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9134701Z E1204 09:37:57.733000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9134993Z E1204 09:37:57.733000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9135116Z E1204 09:37:57.733000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9135261Z E1204 09:37:59.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9135551Z E1204 09:37:59.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9135698Z E1204 09:37:59.418000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9135837Z E1204 09:37:59.420000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9136126Z E1204 09:37:59.420000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9136253Z E1204 09:37:59.420000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9136430Z E1204 09:37:59.440000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9136723Z E1204 09:37:59.440000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9136849Z E1204 09:37:59.440000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9136991Z E1204 09:37:59.467000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9137280Z E1204 09:37:59.467000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9137429Z E1204 09:37:59.467000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9137569Z E1204 09:37:59.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9137861Z E1204 09:37:59.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9137986Z E1204 09:37:59.491000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9138127Z E1204 09:37:59.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9138418Z E1204 09:37:59.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9138543Z E1204 09:37:59.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9138686Z E1204 09:37:59.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9138983Z E1204 09:37:59.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9139110Z E1204 09:37:59.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9139253Z E1204 09:37:59.509000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9139542Z E1204 09:37:59.509000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9139670Z E1204 09:37:59.509000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9139823Z E1204 09:37:59.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9140114Z E1204 09:37:59.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9140238Z E1204 09:37:59.510000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9140401Z E1204 09:37:59.534000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9140689Z E1204 09:37:59.534000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9140817Z E1204 09:37:59.534000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9140960Z E1204 09:37:59.536000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9141252Z E1204 09:37:59.536000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9141390Z E1204 09:37:59.536000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9141531Z E1204 09:38:01.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9141821Z E1204 09:38:01.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9141946Z E1204 09:38:01.251000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9142089Z E1204 09:38:01.289000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9142376Z E1204 09:38:01.289000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9142506Z E1204 09:38:01.289000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9142550Z PASSED [5.3135s] [ 2%] 2025-12-04T09:41:23.9142809Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:02.965000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9143229Z E1204 09:38:02.965000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9143353Z E1204 09:38:02.965000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9143497Z E1204 09:38:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9143788Z E1204 09:38:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9143915Z E1204 09:38:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9144078Z E1204 09:38:04.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9144365Z E1204 09:38:04.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9144490Z E1204 09:38:04.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9144663Z E1204 09:38:04.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9144954Z E1204 09:38:04.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9145078Z E1204 09:38:04.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9145220Z E1204 09:38:04.549000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9145508Z E1204 09:38:04.549000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9145657Z E1204 09:38:04.549000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9145801Z E1204 09:38:04.575000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9146092Z E1204 09:38:04.575000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9146219Z E1204 09:38:04.575000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9146359Z E1204 09:38:04.599000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9146648Z E1204 09:38:04.599000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9146846Z E1204 09:38:04.599000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9147036Z E1204 09:38:04.601000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9147338Z E1204 09:38:04.601000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9147499Z E1204 09:38:04.601000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9147760Z E1204 09:38:04.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9148072Z E1204 09:38:04.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9148228Z E1204 09:38:04.603000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9148416Z E1204 09:38:04.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9148719Z E1204 09:38:04.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9148877Z E1204 09:38:04.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9149036Z E1204 09:38:04.618000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9149380Z E1204 09:38:04.618000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9149517Z E1204 09:38:04.618000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9149688Z E1204 09:38:04.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9150011Z E1204 09:38:04.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9150157Z E1204 09:38:04.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9150345Z E1204 09:38:04.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9150649Z E1204 09:38:04.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9150803Z E1204 09:38:04.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9150950Z E1204 09:38:06.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9151291Z E1204 09:38:06.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9151437Z E1204 09:38:06.248000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9151604Z E1204 09:38:06.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9151923Z E1204 09:38:06.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9152054Z E1204 09:38:06.285000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9152145Z PASSED [5.0019s] [ 2%] 2025-12-04T09:41:23.9152418Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:08.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9152736Z E1204 09:38:08.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9152875Z E1204 09:38:08.495000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9153102Z E1204 09:38:08.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9153443Z E1204 09:38:08.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9153580Z E1204 09:38:08.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9153749Z E1204 09:38:10.024000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9154082Z E1204 09:38:10.024000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9154230Z E1204 09:38:10.024000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9154392Z E1204 09:38:10.026000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9154717Z E1204 09:38:10.026000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9154866Z E1204 09:38:10.026000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9155038Z E1204 09:38:10.045000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9155355Z E1204 09:38:10.045000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9155506Z E1204 09:38:10.045000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9155685Z E1204 09:38:10.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9155986Z E1204 09:38:10.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9156147Z E1204 09:38:10.069000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9156303Z E1204 09:38:10.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9156639Z E1204 09:38:10.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9156797Z E1204 09:38:10.092000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9156949Z E1204 09:38:10.094000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9157269Z E1204 09:38:10.094000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9157406Z E1204 09:38:10.094000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9163863Z E1204 09:38:10.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9164228Z E1204 09:38:10.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9164358Z E1204 09:38:10.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9164505Z E1204 09:38:10.108000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9164841Z E1204 09:38:10.108000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9164968Z E1204 09:38:10.108000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9165110Z E1204 09:38:10.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9165400Z E1204 09:38:10.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9165529Z E1204 09:38:10.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9165670Z E1204 09:38:10.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9165985Z E1204 09:38:10.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9166117Z E1204 09:38:10.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9166259Z E1204 09:38:10.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9166560Z E1204 09:38:10.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9166686Z E1204 09:38:10.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9166837Z E1204 09:38:11.672000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9167125Z E1204 09:38:11.672000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9167256Z E1204 09:38:11.672000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9167400Z E1204 09:38:11.706000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9167695Z E1204 09:38:11.706000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9167829Z E1204 09:38:11.706000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9167870Z PASSED [5.3390s] [ 2%] 2025-12-04T09:41:23.9168137Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:13.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9168442Z E1204 09:38:13.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9168574Z E1204 09:38:13.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9168718Z E1204 09:38:13.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9169033Z E1204 09:38:13.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9169160Z E1204 09:38:13.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9169309Z E1204 09:38:14.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9169597Z E1204 09:38:14.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9169723Z E1204 09:38:14.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9169884Z E1204 09:38:14.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9170174Z E1204 09:38:14.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9170300Z E1204 09:38:14.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9170443Z E1204 09:38:14.823000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9170735Z E1204 09:38:14.823000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9170865Z E1204 09:38:14.823000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9171012Z E1204 09:38:14.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9171305Z E1204 09:38:14.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9171432Z E1204 09:38:14.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9171575Z E1204 09:38:14.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9171864Z E1204 09:38:14.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9171996Z E1204 09:38:14.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9172135Z E1204 09:38:14.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9172439Z E1204 09:38:14.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9172569Z E1204 09:38:14.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9172709Z E1204 09:38:14.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9173102Z E1204 09:38:14.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9173229Z E1204 09:38:14.874000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9173373Z E1204 09:38:14.886000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9173664Z E1204 09:38:14.886000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9173794Z E1204 09:38:14.886000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9173935Z E1204 09:38:14.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9174242Z E1204 09:38:14.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9174365Z E1204 09:38:14.888000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9174507Z E1204 09:38:14.911000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9174799Z E1204 09:38:14.911000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9174922Z E1204 09:38:14.911000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9175065Z E1204 09:38:14.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9175359Z E1204 09:38:14.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9175485Z E1204 09:38:14.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9175626Z E1204 09:38:16.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9175914Z E1204 09:38:16.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9176037Z E1204 09:38:16.629000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9176179Z E1204 09:38:16.668000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9176468Z E1204 09:38:16.668000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9176607Z E1204 09:38:16.668000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9176649Z PASSED [4.9581s] [ 2%] 2025-12-04T09:41:23.9176908Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:18.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9177223Z E1204 09:38:18.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9177349Z E1204 09:38:18.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9177489Z E1204 09:38:18.227000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9177781Z E1204 09:38:18.227000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9177904Z E1204 09:38:18.227000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9178044Z E1204 09:38:19.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9178343Z E1204 09:38:19.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9178467Z E1204 09:38:19.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9178609Z E1204 09:38:19.759000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9178897Z E1204 09:38:19.759000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9179021Z E1204 09:38:19.759000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9179162Z E1204 09:38:19.779000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9179452Z E1204 09:38:19.779000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9179578Z E1204 09:38:19.779000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9179719Z E1204 09:38:19.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9180009Z E1204 09:38:19.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9180133Z E1204 09:38:19.804000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9180276Z E1204 09:38:19.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9180564Z E1204 09:38:19.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9180700Z E1204 09:38:19.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9180839Z E1204 09:38:19.830000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9181126Z E1204 09:38:19.830000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9181272Z E1204 09:38:19.830000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9181414Z E1204 09:38:19.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9181704Z E1204 09:38:19.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9181828Z E1204 09:38:19.832000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9181968Z E1204 09:38:19.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9182258Z E1204 09:38:19.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9182393Z E1204 09:38:19.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9182532Z E1204 09:38:19.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9182823Z E1204 09:38:19.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9183056Z E1204 09:38:19.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9183198Z E1204 09:38:19.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9183488Z E1204 09:38:19.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9183611Z E1204 09:38:19.871000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9183754Z E1204 09:38:19.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9184044Z E1204 09:38:19.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9184169Z E1204 09:38:19.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9184312Z E1204 09:38:21.441000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9184602Z E1204 09:38:21.441000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9184741Z E1204 09:38:21.441000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9184883Z E1204 09:38:21.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9185170Z E1204 09:38:21.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9185295Z E1204 09:38:21.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9185361Z PASSED [4.8647s] [ 2%] 2025-12-04T09:41:23.9185621Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:23.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9185912Z E1204 09:38:23.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9186035Z E1204 09:38:23.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9186178Z E1204 09:38:23.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9186470Z E1204 09:38:23.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9186609Z E1204 09:38:23.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9186750Z E1204 09:38:24.592000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9187037Z E1204 09:38:24.592000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9187160Z E1204 09:38:24.592000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9187300Z E1204 09:38:24.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9187590Z E1204 09:38:24.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9187712Z E1204 09:38:24.594000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9187855Z E1204 09:38:24.615000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9188142Z E1204 09:38:24.615000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9188265Z E1204 09:38:24.615000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9188409Z E1204 09:38:24.641000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9188700Z E1204 09:38:24.641000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9188836Z E1204 09:38:24.641000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9188975Z E1204 09:38:24.665000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9189264Z E1204 09:38:24.665000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9189416Z E1204 09:38:24.665000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9189558Z E1204 09:38:24.667000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9189851Z E1204 09:38:24.667000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9189975Z E1204 09:38:24.667000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9190116Z E1204 09:38:24.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9190406Z E1204 09:38:24.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9190543Z E1204 09:38:24.669000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9190684Z E1204 09:38:24.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9190976Z E1204 09:38:24.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9191098Z E1204 09:38:24.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9191239Z E1204 09:38:24.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9191528Z E1204 09:38:24.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9191657Z E1204 09:38:24.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9191800Z E1204 09:38:24.708000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9192089Z E1204 09:38:24.708000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9192213Z E1204 09:38:24.708000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9192353Z E1204 09:38:24.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9192644Z E1204 09:38:24.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9192769Z E1204 09:38:24.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9192919Z E1204 09:38:27.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9193256Z E1204 09:38:27.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9193379Z E1204 09:38:27.159000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9193549Z E1204 09:38:27.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9193837Z E1204 09:38:27.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9193962Z E1204 09:38:27.206000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9194001Z FAILED [5.2916s] [ 2%] 2025-12-04T09:41:23.9194261Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:28.345000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9194552Z E1204 09:38:28.345000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9194691Z E1204 09:38:28.345000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9194831Z E1204 09:38:28.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9195118Z E1204 09:38:28.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9195243Z E1204 09:38:28.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9195382Z E1204 09:38:29.882000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9195672Z E1204 09:38:29.882000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9195794Z E1204 09:38:29.882000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9195936Z E1204 09:38:29.884000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9196226Z E1204 09:38:29.884000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9196349Z E1204 09:38:29.884000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9196490Z E1204 09:38:29.904000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9196780Z E1204 09:38:29.904000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9196923Z E1204 09:38:29.904000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9197063Z E1204 09:38:29.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9197350Z E1204 09:38:29.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9197473Z E1204 09:38:29.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9197641Z E1204 09:38:29.954000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9197931Z E1204 09:38:29.954000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9198054Z E1204 09:38:29.954000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9198194Z E1204 09:38:29.956000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9198485Z E1204 09:38:29.956000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9198623Z E1204 09:38:29.956000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9198762Z E1204 09:38:29.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9199052Z E1204 09:38:29.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9199177Z E1204 09:38:29.958000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9199317Z E1204 09:38:29.971000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9199608Z E1204 09:38:29.971000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9199732Z E1204 09:38:29.971000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9199872Z E1204 09:38:29.973000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9200160Z E1204 09:38:29.973000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9200285Z E1204 09:38:29.973000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9200424Z E1204 09:38:29.997000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9200721Z E1204 09:38:29.997000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9200846Z E1204 09:38:29.997000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9200997Z E1204 09:38:29.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9201287Z E1204 09:38:29.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9201409Z E1204 09:38:29.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9201551Z E1204 09:38:31.715000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9201861Z E1204 09:38:31.715000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9201987Z E1204 09:38:31.715000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9202127Z E1204 09:38:31.752000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9202417Z E1204 09:38:31.752000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9202542Z E1204 09:38:31.752000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9202594Z PASSED [4.9445s] [ 2%] 2025-12-04T09:41:23.9202858Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:33.280000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9203200Z E1204 09:38:33.280000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9203324Z E1204 09:38:33.280000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9203464Z E1204 09:38:33.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9203757Z E1204 09:38:33.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9203882Z E1204 09:38:33.317000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9204022Z E1204 09:38:34.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9204311Z E1204 09:38:34.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9204434Z E1204 09:38:34.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9204575Z E1204 09:38:34.808000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9204864Z E1204 09:38:34.808000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9204989Z E1204 09:38:34.808000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9205157Z E1204 09:38:34.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9205447Z E1204 09:38:34.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9205572Z E1204 09:38:34.828000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9205738Z E1204 09:38:34.854000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9206026Z E1204 09:38:34.854000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9206151Z E1204 09:38:34.854000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9206291Z E1204 09:38:34.877000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9206580Z E1204 09:38:34.877000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9206705Z E1204 09:38:34.877000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9206866Z E1204 09:38:34.879000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9207155Z E1204 09:38:34.879000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9207280Z E1204 09:38:34.879000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9207420Z E1204 09:38:34.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9207709Z E1204 09:38:34.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9207834Z E1204 09:38:34.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9207977Z E1204 09:38:34.894000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9208268Z E1204 09:38:34.894000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9208392Z E1204 09:38:34.894000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9208534Z E1204 09:38:34.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9208825Z E1204 09:38:34.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9208950Z E1204 09:38:34.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9209090Z E1204 09:38:34.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9209394Z E1204 09:38:34.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9209517Z E1204 09:38:34.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9209658Z E1204 09:38:34.922000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9209970Z E1204 09:38:34.922000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9210094Z E1204 09:38:34.922000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9210236Z E1204 09:38:36.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9210523Z E1204 09:38:36.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9210645Z E1204 09:38:36.628000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9210802Z E1204 09:38:36.664000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9211089Z E1204 09:38:36.664000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9211212Z E1204 09:38:36.664000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9211252Z PASSED [4.8883s] [ 2%] 2025-12-04T09:41:23.9211511Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:38.179000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9211804Z E1204 09:38:38.179000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9211929Z E1204 09:38:38.179000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9212070Z E1204 09:38:38.215000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9212361Z E1204 09:38:38.215000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9212485Z E1204 09:38:38.215000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9212628Z E1204 09:38:39.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9212919Z E1204 09:38:39.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9213080Z E1204 09:38:39.767000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9213221Z E1204 09:38:39.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9213525Z E1204 09:38:39.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9213649Z E1204 09:38:39.769000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9213789Z E1204 09:38:39.789000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9214109Z E1204 09:38:39.789000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9214232Z E1204 09:38:39.789000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9214375Z E1204 09:38:39.815000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9214662Z E1204 09:38:39.815000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9214786Z E1204 09:38:39.815000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9214942Z E1204 09:38:39.838000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9215229Z E1204 09:38:39.838000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9215353Z E1204 09:38:39.838000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9215493Z E1204 09:38:39.840000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9215784Z E1204 09:38:39.840000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9215907Z E1204 09:38:39.840000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9216054Z E1204 09:38:39.842000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9216345Z E1204 09:38:39.842000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9216469Z E1204 09:38:39.842000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9216610Z E1204 09:38:39.855000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9216897Z E1204 09:38:39.855000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9217023Z E1204 09:38:39.855000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9217163Z E1204 09:38:39.857000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9217466Z E1204 09:38:39.857000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9217589Z E1204 09:38:39.857000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9217729Z E1204 09:38:39.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9218042Z E1204 09:38:39.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9218167Z E1204 09:38:39.881000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9218311Z E1204 09:38:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9218602Z E1204 09:38:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9218728Z E1204 09:38:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9218868Z E1204 09:38:41.591000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9219176Z E1204 09:38:41.591000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9219300Z E1204 09:38:41.591000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9219440Z E1204 09:38:41.627000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9219728Z E1204 09:38:41.627000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9219851Z E1204 09:38:41.627000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9219892Z PASSED [4.9485s] [ 2%] 2025-12-04T09:41:23.9220152Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:43.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9220444Z E1204 09:38:43.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9220570Z E1204 09:38:43.162000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9220709Z E1204 09:38:43.199000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9220997Z E1204 09:38:43.199000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9221123Z E1204 09:38:43.199000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9221266Z E1204 09:38:44.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9221565Z E1204 09:38:44.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9221691Z E1204 09:38:44.999000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9221830Z E1204 09:38:45.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9222149Z E1204 09:38:45.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9222275Z E1204 09:38:45.001000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9222416Z E1204 09:38:45.021000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9222712Z E1204 09:38:45.021000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9222835Z E1204 09:38:45.021000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9223089Z E1204 09:38:45.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9223393Z E1204 09:38:45.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9223517Z E1204 09:38:45.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9223657Z E1204 09:38:45.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9223945Z E1204 09:38:45.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9224070Z E1204 09:38:45.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9224212Z E1204 09:38:45.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9224501Z E1204 09:38:45.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9224625Z E1204 09:38:45.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9224768Z E1204 09:38:45.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9225063Z E1204 09:38:45.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9225190Z E1204 09:38:45.075000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9225337Z E1204 09:38:45.088000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9225626Z E1204 09:38:45.088000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9225769Z E1204 09:38:45.088000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9225908Z E1204 09:38:45.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9226196Z E1204 09:38:45.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9226347Z E1204 09:38:45.090000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9226490Z E1204 09:38:45.113000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9226779Z E1204 09:38:45.113000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9226904Z E1204 09:38:45.113000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9227048Z E1204 09:38:45.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9227339Z E1204 09:38:45.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9227476Z E1204 09:38:45.116000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9227618Z E1204 09:38:47.217000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9227906Z E1204 09:38:47.217000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9228027Z E1204 09:38:47.217000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9228169Z E1204 09:38:47.255000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9228459Z E1204 09:38:47.255000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9228581Z E1204 09:38:47.255000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9228623Z PASSED [5.8405s] [ 2%] 2025-12-04T09:41:23.9228882Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:48.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9229172Z E1204 09:38:48.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9229297Z E1204 09:38:48.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9229439Z E1204 09:38:49.027000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9229726Z E1204 09:38:49.027000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9229861Z E1204 09:38:49.027000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9230002Z E1204 09:38:50.793000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9230310Z E1204 09:38:50.793000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9230435Z E1204 09:38:50.793000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9230575Z E1204 09:38:50.796000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9230865Z E1204 09:38:50.796000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9230988Z E1204 09:38:50.796000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9231129Z E1204 09:38:50.816000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9231431Z E1204 09:38:50.816000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9231557Z E1204 09:38:50.816000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9231699Z E1204 09:38:50.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9231986Z E1204 09:38:50.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9232110Z E1204 09:38:50.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9232250Z E1204 09:38:50.868000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9232541Z E1204 09:38:50.868000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9232664Z E1204 09:38:50.868000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9232806Z E1204 09:38:50.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9233141Z E1204 09:38:50.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9233266Z E1204 09:38:50.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9233409Z E1204 09:38:50.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9233699Z E1204 09:38:50.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9233844Z E1204 09:38:50.872000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9233982Z E1204 09:38:50.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9234271Z E1204 09:38:50.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9234426Z E1204 09:38:50.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9234567Z E1204 09:38:50.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9234855Z E1204 09:38:50.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9234979Z E1204 09:38:50.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9235120Z E1204 09:38:50.910000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9235408Z E1204 09:38:50.910000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9235545Z E1204 09:38:50.910000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9235685Z E1204 09:38:50.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9235979Z E1204 09:38:50.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9236102Z E1204 09:38:50.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9236243Z E1204 09:38:53.111000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9236533Z E1204 09:38:53.111000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9236657Z E1204 09:38:53.111000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9236801Z E1204 09:38:53.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9237088Z E1204 09:38:53.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9237211Z E1204 09:38:53.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9237250Z PASSED [5.9006s] [ 2%] 2025-12-04T09:41:23.9237513Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:38:54.949000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9237802Z E1204 09:38:54.949000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9237938Z E1204 09:38:54.949000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9238079Z E1204 09:38:54.987000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9238366Z E1204 09:38:54.987000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9238514Z E1204 09:38:54.987000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9238655Z E1204 09:38:56.976000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9238950Z E1204 09:38:56.976000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9239073Z E1204 09:38:56.976000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9239216Z E1204 09:38:56.978000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9239505Z E1204 09:38:56.978000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9239639Z E1204 09:38:56.978000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9239782Z E1204 09:38:57.004000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9240070Z E1204 09:38:57.004000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9240194Z E1204 09:38:57.004000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9240333Z E1204 09:38:57.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9240623Z E1204 09:38:57.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9240746Z E1204 09:38:57.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9240889Z E1204 09:38:57.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9241180Z E1204 09:38:57.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9241303Z E1204 09:38:57.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9241447Z E1204 09:38:57.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9241734Z E1204 09:38:57.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9241867Z E1204 09:38:57.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9242007Z E1204 09:38:57.059000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9242295Z E1204 09:38:57.059000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9242419Z E1204 09:38:57.059000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9242581Z E1204 09:38:57.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9242873Z E1204 09:38:57.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9243038Z E1204 09:38:57.071000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9243180Z E1204 09:38:57.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9243471Z E1204 09:38:57.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9243614Z E1204 09:38:57.073000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9243754Z E1204 09:38:57.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9244043Z E1204 09:38:57.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9244167Z E1204 09:38:57.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9244307Z E1204 09:38:57.100000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9244597Z E1204 09:38:57.100000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9244720Z E1204 09:38:57.100000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9244861Z E1204 09:38:59.297000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9245149Z E1204 09:38:59.297000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9245273Z E1204 09:38:59.297000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9245414Z E1204 09:38:59.335000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9245712Z E1204 09:38:59.335000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9245838Z E1204 09:38:59.335000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9245891Z PASSED [6.7337s] [ 2%] 2025-12-04T09:41:23.9246152Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:01.666000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9246441Z E1204 09:39:01.666000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9246566Z E1204 09:39:01.666000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9246734Z E1204 09:39:01.701000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9247023Z E1204 09:39:01.701000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9247148Z E1204 09:39:01.701000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9247288Z E1204 09:39:03.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9247579Z E1204 09:39:03.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9247715Z E1204 09:39:03.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9247856Z E1204 09:39:03.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9248146Z E1204 09:39:03.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9248482Z E1204 09:39:03.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9248623Z E1204 09:39:03.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9248916Z E1204 09:39:03.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9249042Z E1204 09:39:03.846000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9249183Z E1204 09:39:03.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9249475Z E1204 09:39:03.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9249598Z E1204 09:39:03.873000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9249739Z E1204 09:39:03.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9250033Z E1204 09:39:03.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9250159Z E1204 09:39:03.896000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9250312Z E1204 09:39:03.898000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9250601Z E1204 09:39:03.898000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9250728Z E1204 09:39:03.898000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9250897Z E1204 09:39:03.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9251189Z E1204 09:39:03.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9251313Z E1204 09:39:03.900000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9251454Z E1204 09:39:03.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9251743Z E1204 09:39:03.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9251879Z E1204 09:39:03.913000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9252024Z E1204 09:39:03.915000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9252314Z E1204 09:39:03.915000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9252441Z E1204 09:39:03.915000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9252583Z E1204 09:39:03.939000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9252874Z E1204 09:39:03.939000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9253043Z E1204 09:39:03.939000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9253184Z E1204 09:39:03.942000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9253474Z E1204 09:39:03.942000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9253598Z E1204 09:39:03.942000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9253740Z E1204 09:39:06.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9254029Z E1204 09:39:06.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9254154Z E1204 09:39:06.188000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9254294Z E1204 09:39:06.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9254614Z E1204 09:39:06.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9254737Z E1204 09:39:06.230000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9254777Z PASSED [6.5878s] [ 2%] 2025-12-04T09:41:23.9255070Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:09.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9255363Z E1204 09:39:09.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9255490Z E1204 09:39:09.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9255630Z E1204 09:39:09.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9255918Z E1204 09:39:09.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9256062Z E1204 09:39:09.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9256205Z E1204 09:39:10.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9256497Z E1204 09:39:10.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9256623Z E1204 09:39:10.697000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9256764Z E1204 09:39:10.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9257051Z E1204 09:39:10.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9257178Z E1204 09:39:10.699000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9257318Z E1204 09:39:10.718000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9257607Z E1204 09:39:10.718000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9257730Z E1204 09:39:10.718000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9257871Z E1204 09:39:10.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9258159Z E1204 09:39:10.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9258284Z E1204 09:39:10.743000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9258532Z E1204 09:39:10.766000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9258822Z E1204 09:39:10.766000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9258946Z E1204 09:39:10.766000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9259086Z E1204 09:39:10.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9259399Z E1204 09:39:10.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9259523Z E1204 09:39:10.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9259666Z E1204 09:39:10.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9259955Z E1204 09:39:10.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9260078Z E1204 09:39:10.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9260238Z E1204 09:39:10.782000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9260526Z E1204 09:39:10.782000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9260651Z E1204 09:39:10.782000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9260791Z E1204 09:39:10.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9261083Z E1204 09:39:10.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9261208Z E1204 09:39:10.784000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9261349Z E1204 09:39:10.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9261638Z E1204 09:39:10.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9261761Z E1204 09:39:10.807000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9261902Z E1204 09:39:10.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9262191Z E1204 09:39:10.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9262317Z E1204 09:39:10.809000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9262456Z E1204 09:39:13.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9262761Z E1204 09:39:13.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9262886Z E1204 09:39:13.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9263155Z E1204 09:39:13.984000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9263474Z E1204 09:39:13.984000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9263599Z E1204 09:39:13.984000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9263641Z PASSED [8.5775s] [ 2%] 2025-12-04T09:41:23.9263899Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:16.813000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9264188Z E1204 09:39:16.813000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9264311Z E1204 09:39:16.813000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9264469Z E1204 09:39:16.851000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9264758Z E1204 09:39:16.851000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9264881Z E1204 09:39:16.851000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9265022Z E1204 09:39:18.567000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9265310Z E1204 09:39:18.567000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9265437Z E1204 09:39:18.567000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9265578Z E1204 09:39:18.569000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9265868Z E1204 09:39:18.569000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9265992Z E1204 09:39:18.569000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9266134Z E1204 09:39:18.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9266425Z E1204 09:39:18.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9266548Z E1204 09:39:18.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9266692Z E1204 09:39:18.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9267000Z E1204 09:39:18.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9267124Z E1204 09:39:18.616000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9267265Z E1204 09:39:18.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9267574Z E1204 09:39:18.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9267697Z E1204 09:39:18.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9267839Z E1204 09:39:18.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9268128Z E1204 09:39:18.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9268251Z E1204 09:39:18.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9268394Z E1204 09:39:18.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9268696Z E1204 09:39:18.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9268822Z E1204 09:39:18.644000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9268961Z E1204 09:39:18.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9269250Z E1204 09:39:18.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9269374Z E1204 09:39:18.656000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9269517Z E1204 09:39:18.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9269805Z E1204 09:39:18.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9269929Z E1204 09:39:18.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9270070Z E1204 09:39:18.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9270358Z E1204 09:39:18.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9270485Z E1204 09:39:18.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9270625Z E1204 09:39:18.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9270915Z E1204 09:39:18.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9271051Z E1204 09:39:18.684000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9271191Z E1204 09:39:20.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9271499Z E1204 09:39:20.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9271623Z E1204 09:39:20.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9271764Z E1204 09:39:20.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9272052Z E1204 09:39:20.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9272176Z E1204 09:39:20.382000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9272215Z PASSED [5.9334s] [ 2%] 2025-12-04T09:41:23.9272478Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:22.754000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9272796Z E1204 09:39:22.754000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9272919Z E1204 09:39:22.754000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9273100Z E1204 09:39:22.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9273387Z E1204 09:39:22.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9273512Z E1204 09:39:22.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9273655Z E1204 09:39:24.453000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9273944Z E1204 09:39:24.453000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9274069Z E1204 09:39:24.453000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9274208Z E1204 09:39:24.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9274496Z E1204 09:39:24.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9274622Z E1204 09:39:24.455000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9274763Z E1204 09:39:24.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9275071Z E1204 09:39:24.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9275195Z E1204 09:39:24.476000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9275335Z E1204 09:39:24.502000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9275649Z E1204 09:39:24.502000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9275776Z E1204 09:39:24.502000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9275916Z E1204 09:39:24.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9276205Z E1204 09:39:24.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9276327Z E1204 09:39:24.526000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9276468Z E1204 09:39:24.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9276771Z E1204 09:39:24.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9276895Z E1204 09:39:24.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9277036Z E1204 09:39:24.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9277328Z E1204 09:39:24.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9277453Z E1204 09:39:24.530000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9277595Z E1204 09:39:24.542000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9277884Z E1204 09:39:24.542000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9278007Z E1204 09:39:24.542000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9278148Z E1204 09:39:24.544000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9278435Z E1204 09:39:24.544000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9278558Z E1204 09:39:24.544000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9278701Z E1204 09:39:24.571000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9278988Z E1204 09:39:24.571000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9279125Z E1204 09:39:24.571000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9279270Z E1204 09:39:24.573000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9279564Z E1204 09:39:24.573000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9279709Z E1204 09:39:24.573000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9279854Z E1204 09:39:26.272000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9280146Z E1204 09:39:26.272000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9280272Z E1204 09:39:26.272000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9280417Z E1204 09:39:26.311000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9280708Z E1204 09:39:26.311000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9280853Z E1204 09:39:26.311000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9280894Z PASSED [6.3896s] [ 2%] 2025-12-04T09:41:23.9281157Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:29.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9281450Z E1204 09:39:29.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9281578Z E1204 09:39:29.191000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9281720Z E1204 09:39:29.229000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9282009Z E1204 09:39:29.229000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9282137Z E1204 09:39:29.229000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9282279Z E1204 09:39:32.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9282571Z E1204 09:39:32.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9282695Z E1204 09:39:32.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9282840Z E1204 09:39:32.018000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9283167Z E1204 09:39:32.018000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9283310Z E1204 09:39:32.018000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9283453Z E1204 09:39:32.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9283745Z E1204 09:39:32.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9283897Z E1204 09:39:32.038000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9284038Z E1204 09:39:32.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9284330Z E1204 09:39:32.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9284453Z E1204 09:39:32.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9284595Z E1204 09:39:32.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9284884Z E1204 09:39:32.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9285020Z E1204 09:39:32.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9285162Z E1204 09:39:32.089000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9285450Z E1204 09:39:32.089000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9285575Z E1204 09:39:32.089000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9285716Z E1204 09:39:32.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9286011Z E1204 09:39:32.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9286135Z E1204 09:39:32.091000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9286280Z E1204 09:39:32.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9286570Z E1204 09:39:32.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9286694Z E1204 09:39:32.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9286838Z E1204 09:39:32.106000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9287127Z E1204 09:39:32.106000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9287403Z E1204 09:39:32.106000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9287544Z E1204 09:39:32.129000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9287834Z E1204 09:39:32.129000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9287979Z E1204 09:39:32.129000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9288122Z E1204 09:39:32.132000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9288417Z E1204 09:39:32.132000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9288542Z E1204 09:39:32.132000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9288683Z E1204 09:39:33.852000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9288971Z E1204 09:39:33.852000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9289107Z E1204 09:39:33.852000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9289248Z E1204 09:39:34.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9289539Z E1204 09:39:34.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9289662Z E1204 09:39:34.658000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9289704Z PASSED [7.6341s] [ 2%] 2025-12-04T09:41:23.9289966Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:36.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9290260Z E1204 09:39:36.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9290387Z E1204 09:39:36.806000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9290528Z E1204 09:39:36.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9290817Z E1204 09:39:36.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9290941Z E1204 09:39:36.844000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9291086Z E1204 09:39:40.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9291375Z E1204 09:39:40.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9291510Z E1204 09:39:40.047000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9291651Z E1204 09:39:40.050000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9291939Z E1204 09:39:40.050000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9292084Z E1204 09:39:40.050000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9292224Z E1204 09:39:40.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9292513Z E1204 09:39:40.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9292639Z E1204 09:39:40.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9292781Z E1204 09:39:40.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9293174Z E1204 09:39:40.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9293313Z E1204 09:39:40.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9293455Z E1204 09:39:40.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9293742Z E1204 09:39:40.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9293868Z E1204 09:39:40.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9294007Z E1204 09:39:40.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9294298Z E1204 09:39:40.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9294421Z E1204 09:39:40.126000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9294563Z E1204 09:39:40.128000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9294855Z E1204 09:39:40.128000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9294978Z E1204 09:39:40.128000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9295120Z E1204 09:39:40.141000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9295409Z E1204 09:39:40.141000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9295534Z E1204 09:39:40.141000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9295688Z E1204 09:39:40.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9295976Z E1204 09:39:40.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9296101Z E1204 09:39:40.143000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9296276Z E1204 09:39:40.167000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9296565Z E1204 09:39:40.167000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9296689Z E1204 09:39:40.167000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9296829Z E1204 09:39:40.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9297120Z E1204 09:39:40.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9297262Z E1204 09:39:40.170000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9297403Z E1204 09:39:43.328000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9297692Z E1204 09:39:43.328000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9297818Z E1204 09:39:43.328000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9297958Z E1204 09:39:43.367000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9298248Z E1204 09:39:43.367000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9298372Z E1204 09:39:43.367000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9298412Z PASSED [9.1953s] [ 2%] 2025-12-04T09:41:23.9298671Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:45.985000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9298964Z E1204 09:39:45.985000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9299087Z E1204 09:39:45.985000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9299230Z E1204 09:39:46.020000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9299524Z E1204 09:39:46.020000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9299658Z E1204 09:39:46.020000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9299799Z E1204 09:39:48.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9300085Z E1204 09:39:48.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9300209Z E1204 09:39:48.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9300370Z E1204 09:39:48.051000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9300660Z E1204 09:39:48.051000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9300785Z E1204 09:39:48.051000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9300924Z E1204 09:39:48.076000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9301327Z E1204 09:39:48.076000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9301462Z E1204 09:39:48.076000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9301605Z E1204 09:39:48.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9301896Z E1204 09:39:48.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9302025Z E1204 09:39:48.107000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9302165Z E1204 09:39:48.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9302458Z E1204 09:39:48.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9302584Z E1204 09:39:48.131000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9302724Z E1204 09:39:48.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9303090Z E1204 09:39:48.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9303213Z E1204 09:39:48.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9303354Z E1204 09:39:48.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9303645Z E1204 09:39:48.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9303770Z E1204 09:39:48.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9303925Z E1204 09:39:48.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9304216Z E1204 09:39:48.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9304341Z E1204 09:39:48.148000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9304481Z E1204 09:39:48.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9304797Z E1204 09:39:48.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9304922Z E1204 09:39:48.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9305063Z E1204 09:39:48.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9305350Z E1204 09:39:48.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9305474Z E1204 09:39:48.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9305629Z E1204 09:39:48.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9305919Z E1204 09:39:48.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9306046Z E1204 09:39:48.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9306186Z E1204 09:39:51.516000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9306475Z E1204 09:39:51.516000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9306601Z E1204 09:39:51.516000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9306743Z E1204 09:39:51.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9307032Z E1204 09:39:51.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9307158Z E1204 09:39:51.554000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9307198Z PASSED [8.2092s] [ 2%] 2025-12-04T09:41:23.9307457Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:39:54.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9307747Z E1204 09:39:54.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9307870Z E1204 09:39:54.212000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9308021Z E1204 09:39:54.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9308312Z E1204 09:39:54.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9308437Z E1204 09:39:54.250000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9308597Z E1204 09:39:56.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9308887Z E1204 09:39:56.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9309012Z E1204 09:39:56.640000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9309152Z E1204 09:39:56.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9309440Z E1204 09:39:56.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9309564Z E1204 09:39:56.642000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9309716Z E1204 09:39:56.662000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9310005Z E1204 09:39:56.662000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9310130Z E1204 09:39:56.662000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9310271Z E1204 09:39:56.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9310563Z E1204 09:39:56.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9310689Z E1204 09:39:56.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9310828Z E1204 09:39:56.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9311117Z E1204 09:39:56.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9311240Z E1204 09:39:56.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9311381Z E1204 09:39:56.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9311669Z E1204 09:39:56.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9311794Z E1204 09:39:56.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9311935Z E1204 09:39:56.716000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9312237Z E1204 09:39:56.716000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9312362Z E1204 09:39:56.716000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9312501Z E1204 09:39:56.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9312824Z E1204 09:39:56.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9312991Z E1204 09:39:56.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9313133Z E1204 09:39:56.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9313421Z E1204 09:39:56.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9313546Z E1204 09:39:56.731000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9313704Z E1204 09:39:56.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9313990Z E1204 09:39:56.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9314116Z E1204 09:39:56.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9314256Z E1204 09:39:56.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9314546Z E1204 09:39:56.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9314669Z E1204 09:39:56.757000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9314814Z E1204 09:39:58.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9315108Z E1204 09:39:58.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9315232Z E1204 09:39:58.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9315375Z E1204 09:39:58.761000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9315664Z E1204 09:39:58.761000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9315791Z E1204 09:39:58.761000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9315830Z PASSED [7.6348s] [ 2%] 2025-12-04T09:41:23.9316091Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:01.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9316392Z E1204 09:40:01.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9316517Z E1204 09:40:01.870000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9316658Z E1204 09:40:01.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9316971Z E1204 09:40:01.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9317097Z E1204 09:40:01.912000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9317237Z E1204 09:40:04.470000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9317528Z E1204 09:40:04.470000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9317651Z E1204 09:40:04.470000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9317803Z E1204 09:40:04.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9318093Z E1204 09:40:04.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9318218Z E1204 09:40:04.473000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9318362Z E1204 09:40:04.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9318649Z E1204 09:40:04.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9318775Z E1204 09:40:04.493000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9318914Z E1204 09:40:04.519000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9319205Z E1204 09:40:04.519000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9319330Z E1204 09:40:04.519000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9319471Z E1204 09:40:04.543000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9319758Z E1204 09:40:04.543000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9319883Z E1204 09:40:04.543000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9320025Z E1204 09:40:04.545000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9320333Z E1204 09:40:04.545000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9320458Z E1204 09:40:04.545000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9320599Z E1204 09:40:04.547000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9320910Z E1204 09:40:04.547000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9321035Z E1204 09:40:04.547000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9321176Z E1204 09:40:04.561000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9321471Z E1204 09:40:04.561000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9321595Z E1204 09:40:04.561000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9321736Z E1204 09:40:04.563000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9322036Z E1204 09:40:04.563000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9322160Z E1204 09:40:04.563000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9322301Z E1204 09:40:04.587000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9322589Z E1204 09:40:04.587000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9322713Z E1204 09:40:04.587000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9322855Z E1204 09:40:04.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9323200Z E1204 09:40:04.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9323324Z E1204 09:40:04.589000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9323465Z E1204 09:40:07.237000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9323757Z E1204 09:40:07.237000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9323884Z E1204 09:40:07.237000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9324024Z E1204 09:40:07.275000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9324489Z E1204 09:40:07.275000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9324637Z E1204 09:40:07.275000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9324677Z PASSED [8.2170s] [ 2%] 2025-12-04T09:41:23.9324936Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:10.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9325252Z E1204 09:40:10.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9325377Z E1204 09:40:10.049000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9325519Z E1204 09:40:10.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9325807Z E1204 09:40:10.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9325930Z E1204 09:40:10.087000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9326071Z E1204 09:40:12.254000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9326376Z E1204 09:40:12.254000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9326498Z E1204 09:40:12.254000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9326643Z E1204 09:40:12.257000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9326932Z E1204 09:40:12.257000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9327058Z E1204 09:40:12.257000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9327200Z E1204 09:40:12.277000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9327490Z E1204 09:40:12.277000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9327614Z E1204 09:40:12.277000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9327755Z E1204 09:40:12.303000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9328044Z E1204 09:40:12.303000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9328169Z E1204 09:40:12.303000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9328311Z E1204 09:40:12.327000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9328599Z E1204 09:40:12.327000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9328746Z E1204 09:40:12.327000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9328885Z E1204 09:40:12.329000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9329195Z E1204 09:40:12.329000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9329322Z E1204 09:40:12.329000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9329461Z E1204 09:40:12.331000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9329752Z E1204 09:40:12.331000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9329876Z E1204 09:40:12.331000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9330017Z E1204 09:40:12.344000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9330306Z E1204 09:40:12.344000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9330444Z E1204 09:40:12.344000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9330585Z E1204 09:40:12.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9330874Z E1204 09:40:12.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9330998Z E1204 09:40:12.346000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9331138Z E1204 09:40:12.370000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9331429Z E1204 09:40:12.370000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9331553Z E1204 09:40:12.370000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9331693Z E1204 09:40:12.372000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9331980Z E1204 09:40:12.372000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9332105Z E1204 09:40:12.372000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9332247Z E1204 09:40:15.410000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9332540Z E1204 09:40:15.410000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9332677Z E1204 09:40:15.410000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9332817Z E1204 09:40:15.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9333148Z E1204 09:40:15.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9333304Z E1204 09:40:15.447000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9333346Z PASSED [7.7920s] [ 2%] 2025-12-04T09:41:23.9333604Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:17.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9333894Z E1204 09:40:17.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9334019Z E1204 09:40:17.834000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9334159Z E1204 09:40:17.869000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9334466Z E1204 09:40:17.869000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9334591Z E1204 09:40:17.869000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9335079Z E1204 09:40:20.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9335373Z E1204 09:40:20.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9335498Z E1204 09:40:20.147000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9335637Z E1204 09:40:20.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9335928Z E1204 09:40:20.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9336053Z E1204 09:40:20.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9336193Z E1204 09:40:20.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9336482Z E1204 09:40:20.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9336604Z E1204 09:40:20.169000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9336751Z E1204 09:40:20.196000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9337039Z E1204 09:40:20.196000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9337188Z E1204 09:40:20.196000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9337329Z E1204 09:40:20.220000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9337622Z E1204 09:40:20.220000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9337768Z E1204 09:40:20.220000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9337908Z E1204 09:40:20.222000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9338197Z E1204 09:40:20.222000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9338321Z E1204 09:40:20.222000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9338463Z E1204 09:40:20.224000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9338756Z E1204 09:40:20.224000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9338895Z E1204 09:40:20.224000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9339037Z E1204 09:40:20.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9339328Z E1204 09:40:20.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9339453Z E1204 09:40:20.238000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9339594Z E1204 09:40:20.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9339889Z E1204 09:40:20.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9340012Z E1204 09:40:20.240000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9340155Z E1204 09:40:20.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9340443Z E1204 09:40:20.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9340569Z E1204 09:40:20.264000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9340711Z E1204 09:40:20.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9341003Z E1204 09:40:20.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9341140Z E1204 09:40:20.266000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9341280Z E1204 09:40:23.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9341570Z E1204 09:40:23.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9341698Z E1204 09:40:23.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9341868Z E1204 09:40:23.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9342162Z E1204 09:40:23.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9342288Z E1204 09:40:23.140000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9342331Z PASSED [8.1779s] [ 2%] 2025-12-04T09:41:23.9342590Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:26.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9342926Z E1204 09:40:26.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9343127Z E1204 09:40:26.034000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9343270Z E1204 09:40:26.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9343561Z E1204 09:40:26.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9343688Z E1204 09:40:26.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9343834Z E1204 09:40:29.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9344130Z E1204 09:40:29.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9344257Z E1204 09:40:29.103000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9344399Z E1204 09:40:29.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9344690Z E1204 09:40:29.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9344816Z E1204 09:40:29.105000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9344961Z E1204 09:40:29.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9345247Z E1204 09:40:29.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9345395Z E1204 09:40:29.124000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9345540Z E1204 09:40:29.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9345828Z E1204 09:40:29.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9345955Z E1204 09:40:29.149000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9346128Z E1204 09:40:29.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9346426Z E1204 09:40:29.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9346552Z E1204 09:40:29.172000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9346694Z E1204 09:40:29.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9346984Z E1204 09:40:29.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9347122Z E1204 09:40:29.174000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9347267Z E1204 09:40:29.177000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9347557Z E1204 09:40:29.177000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9347684Z E1204 09:40:29.177000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9347824Z E1204 09:40:29.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9348114Z E1204 09:40:29.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9348239Z E1204 09:40:29.190000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9348383Z E1204 09:40:29.192000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9348679Z E1204 09:40:29.192000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9348803Z E1204 09:40:29.192000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9348947Z E1204 09:40:29.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9349237Z E1204 09:40:29.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9349364Z E1204 09:40:29.216000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9349517Z E1204 09:40:29.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9349812Z E1204 09:40:29.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9349936Z E1204 09:40:29.218000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9350099Z E1204 09:40:32.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9350390Z E1204 09:40:32.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9350514Z E1204 09:40:32.204000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9350659Z E1204 09:40:32.241000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9350949Z E1204 09:40:32.241000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9351073Z E1204 09:40:32.241000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9351415Z PASSED [7.9915s] [ 2%] 2025-12-04T09:41:23.9351676Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:34.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9351968Z E1204 09:40:34.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9352091Z E1204 09:40:34.030000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9352235Z E1204 09:40:34.068000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9352526Z E1204 09:40:34.068000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9352652Z E1204 09:40:34.068000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9352793Z E1204 09:40:37.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9353136Z E1204 09:40:37.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9353260Z E1204 09:40:37.700000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9353404Z E1204 09:40:37.702000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9353700Z E1204 09:40:37.702000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9353823Z E1204 09:40:37.702000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9354024Z E1204 09:40:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9354312Z E1204 09:40:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9354440Z E1204 09:40:37.723000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9354610Z E1204 09:40:37.756000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9354900Z E1204 09:40:37.756000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9355025Z E1204 09:40:37.756000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9355169Z E1204 09:40:37.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9355465Z E1204 09:40:37.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9355610Z E1204 09:40:37.781000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9355752Z E1204 09:40:37.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9356040Z E1204 09:40:37.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9356167Z E1204 09:40:37.783000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9356309Z E1204 09:40:37.785000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9356603Z E1204 09:40:37.785000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9356734Z E1204 09:40:37.785000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9356875Z E1204 09:40:37.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9357169Z E1204 09:40:37.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9357293Z E1204 09:40:37.798000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9357437Z E1204 09:40:37.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9357730Z E1204 09:40:37.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9357858Z E1204 09:40:37.800000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9358011Z E1204 09:40:37.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9358300Z E1204 09:40:37.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9358427Z E1204 09:40:37.824000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9358567Z E1204 09:40:37.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9358888Z E1204 09:40:37.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9359012Z E1204 09:40:37.826000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9359155Z E1204 09:40:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9359446Z E1204 09:40:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9359573Z E1204 09:40:39.883000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9359727Z E1204 09:40:39.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9360024Z E1204 09:40:39.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9360151Z E1204 09:40:39.920000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9360191Z PASSED [7.5915s] [ 2%] 2025-12-04T09:41:23.9360450Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:41.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9360740Z E1204 09:40:41.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9360867Z E1204 09:40:41.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9361009Z E1204 09:40:41.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9361302Z E1204 09:40:41.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9361428Z E1204 09:40:41.791000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9361568Z E1204 09:40:43.636000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9361860Z E1204 09:40:43.636000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9361985Z E1204 09:40:43.636000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9362142Z E1204 09:40:43.638000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9362432Z E1204 09:40:43.638000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9362558Z E1204 09:40:43.638000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9362700Z E1204 09:40:43.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9363061Z E1204 09:40:43.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9363190Z E1204 09:40:43.659000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9363329Z E1204 09:40:43.686000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9363620Z E1204 09:40:43.686000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9363744Z E1204 09:40:43.686000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9363908Z E1204 09:40:43.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9364198Z E1204 09:40:43.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9364325Z E1204 09:40:43.710000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9364467Z E1204 09:40:43.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9364759Z E1204 09:40:43.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9364887Z E1204 09:40:43.712000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9365029Z E1204 09:40:43.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9365322Z E1204 09:40:43.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9365447Z E1204 09:40:43.714000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9365592Z E1204 09:40:43.727000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9365886Z E1204 09:40:43.727000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9366013Z E1204 09:40:43.727000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9366156Z E1204 09:40:43.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9366462Z E1204 09:40:43.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9366589Z E1204 09:40:43.729000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9366730Z E1204 09:40:43.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9367042Z E1204 09:40:43.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9367167Z E1204 09:40:43.753000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9367310Z E1204 09:40:43.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9367598Z E1204 09:40:43.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9367725Z E1204 09:40:43.755000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9367867Z E1204 09:40:46.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9368167Z E1204 09:40:46.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9368294Z E1204 09:40:46.186000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9368435Z E1204 09:40:46.225000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9368725Z E1204 09:40:46.225000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9368851Z E1204 09:40:46.225000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9368894Z PASSED [7.0981s] [ 2%] 2025-12-04T09:41:23.9369157Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:48.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9369448Z E1204 09:40:48.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9369575Z E1204 09:40:48.802000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9369714Z E1204 09:40:48.839000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9370004Z E1204 09:40:48.839000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9370130Z E1204 09:40:48.839000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9370273Z E1204 09:40:51.061000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9370576Z E1204 09:40:51.061000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9370703Z E1204 09:40:51.061000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9370847Z E1204 09:40:51.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9371289Z E1204 09:40:51.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9371416Z E1204 09:40:51.063000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9371556Z E1204 09:40:51.084000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9371847Z E1204 09:40:51.084000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9371971Z E1204 09:40:51.084000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9372115Z E1204 09:40:51.109000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9372416Z E1204 09:40:51.109000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9372542Z E1204 09:40:51.109000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9372684Z E1204 09:40:51.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9373144Z E1204 09:40:51.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9373269Z E1204 09:40:51.133000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9373412Z E1204 09:40:51.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9373711Z E1204 09:40:51.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9373837Z E1204 09:40:51.135000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9373983Z E1204 09:40:51.137000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9374273Z E1204 09:40:51.137000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9374400Z E1204 09:40:51.137000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9374547Z E1204 09:40:51.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9374837Z E1204 09:40:51.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9374979Z E1204 09:40:51.150000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9375120Z E1204 09:40:51.152000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9375445Z E1204 09:40:51.152000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9375568Z E1204 09:40:51.152000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9375713Z E1204 09:40:51.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9376010Z E1204 09:40:51.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9376135Z E1204 09:40:51.176000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9376279Z E1204 09:40:51.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9376587Z E1204 09:40:51.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9376714Z E1204 09:40:51.178000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9376855Z E1204 09:40:53.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9377146Z E1204 09:40:53.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9377272Z E1204 09:40:53.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9377414Z E1204 09:40:53.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9377705Z E1204 09:40:53.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9377829Z E1204 09:40:53.110000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9377871Z PASSED [6.2239s] [ 2%] 2025-12-04T09:41:23.9378135Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:40:54.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9378427Z E1204 09:40:54.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9378551Z E1204 09:40:54.990000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9378694Z E1204 09:40:55.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9378993Z E1204 09:40:55.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9379120Z E1204 09:40:55.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9379263Z E1204 09:40:56.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9379572Z E1204 09:40:56.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9379700Z E1204 09:40:56.768000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9379840Z E1204 09:40:56.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9380134Z E1204 09:40:56.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9380260Z E1204 09:40:56.770000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9380402Z E1204 09:40:56.795000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9380708Z E1204 09:40:56.795000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9380832Z E1204 09:40:56.795000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9380975Z E1204 09:40:56.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9381264Z E1204 09:40:56.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9381392Z E1204 09:40:56.820000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9381534Z E1204 09:40:56.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9381825Z E1204 09:40:56.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9381950Z E1204 09:40:56.843000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9382094Z E1204 09:40:56.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9382388Z E1204 09:40:56.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9382512Z E1204 09:40:56.845000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9382659Z E1204 09:40:56.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9383012Z E1204 09:40:56.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9383161Z E1204 09:40:56.847000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9383301Z E1204 09:40:56.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9383591Z E1204 09:40:56.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9383750Z E1204 09:40:56.860000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9383890Z E1204 09:40:56.862000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9384185Z E1204 09:40:56.862000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9384312Z E1204 09:40:56.862000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9384453Z E1204 09:40:56.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9384750Z E1204 09:40:56.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9384902Z E1204 09:40:56.885000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9385043Z E1204 09:40:56.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9385336Z E1204 09:40:56.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9385463Z E1204 09:40:56.887000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9385603Z E1204 09:40:58.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9385896Z E1204 09:40:58.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9386020Z E1204 09:40:58.650000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9386164Z E1204 09:40:58.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9386454Z E1204 09:40:58.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9386580Z E1204 09:40:58.688000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9386621Z PASSED [5.4039s] [ 2%] 2025-12-04T09:41:23.9386887Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:41:01.175000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9387177Z E1204 09:41:01.175000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9387312Z E1204 09:41:01.175000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9387456Z E1204 09:41:01.214000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9387746Z E1204 09:41:01.214000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9387895Z E1204 09:41:01.214000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9388036Z E1204 09:41:02.981000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9388326Z E1204 09:41:02.981000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9388448Z E1204 09:41:02.981000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9388591Z E1204 09:41:02.983000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9388882Z E1204 09:41:02.983000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9389022Z E1204 09:41:02.983000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9389169Z E1204 09:41:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9389461Z E1204 09:41:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9389586Z E1204 09:41:03.003000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9389725Z E1204 09:41:03.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9390016Z E1204 09:41:03.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9390141Z E1204 09:41:03.029000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9390281Z E1204 09:41:03.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9390569Z E1204 09:41:03.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9390692Z E1204 09:41:03.053000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9390836Z E1204 09:41:03.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9391125Z E1204 09:41:03.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9391271Z E1204 09:41:03.055000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9391412Z E1204 09:41:03.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9391701Z E1204 09:41:03.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9391847Z E1204 09:41:03.057000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9391987Z E1204 09:41:03.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9392276Z E1204 09:41:03.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9392400Z E1204 09:41:03.070000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9392541Z E1204 09:41:03.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9392829Z E1204 09:41:03.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9393010Z E1204 09:41:03.072000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9393150Z E1204 09:41:03.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9393443Z E1204 09:41:03.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9393568Z E1204 09:41:03.096000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9393708Z E1204 09:41:03.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9393999Z E1204 09:41:03.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9394123Z E1204 09:41:03.098000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9394265Z E1204 09:41:04.892000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9394553Z E1204 09:41:04.892000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9394677Z E1204 09:41:04.892000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9394818Z E1204 09:41:04.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9395107Z E1204 09:41:04.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9395231Z E1204 09:41:04.930000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9395294Z PASSED [6.3212s] [ 2%] 2025-12-04T09:41:23.9395555Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:41:06.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9395848Z E1204 09:41:06.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9396005Z E1204 09:41:06.682000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9396145Z E1204 09:41:06.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9396433Z E1204 09:41:06.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9396558Z E1204 09:41:06.721000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9396698Z E1204 09:41:08.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9396990Z E1204 09:41:08.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9397133Z E1204 09:41:08.528000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9397274Z E1204 09:41:08.531000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9397562Z E1204 09:41:08.531000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9397687Z E1204 09:41:08.531000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9397826Z E1204 09:41:08.552000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9398120Z E1204 09:41:08.552000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9398244Z E1204 09:41:08.552000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9398386Z E1204 09:41:08.578000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9398676Z E1204 09:41:08.578000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9398798Z E1204 09:41:08.578000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9398940Z E1204 09:41:08.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9399230Z E1204 09:41:08.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9399368Z E1204 09:41:08.602000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9399510Z E1204 09:41:08.604000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9399796Z E1204 09:41:08.604000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9399920Z E1204 09:41:08.604000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9400082Z E1204 09:41:08.606000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9400374Z E1204 09:41:08.606000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9400497Z E1204 09:41:08.606000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9400639Z E1204 09:41:08.619000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9400926Z E1204 09:41:08.619000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9401063Z E1204 09:41:08.619000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9401204Z E1204 09:41:08.621000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9401490Z E1204 09:41:08.621000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9401615Z E1204 09:41:08.621000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9401755Z E1204 09:41:08.645000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9402044Z E1204 09:41:08.645000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9402168Z E1204 09:41:08.645000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9402313Z E1204 09:41:08.647000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9402604Z E1204 09:41:08.647000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9402727Z E1204 09:41:08.647000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9402867Z E1204 09:41:10.492000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9403189Z E1204 09:41:10.492000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9403314Z E1204 09:41:10.492000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9403472Z E1204 09:41:10.529000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9403760Z E1204 09:41:10.529000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9403882Z E1204 09:41:10.529000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9403924Z PASSED [5.9776s] [ 2%] 2025-12-04T09:41:23.9404342Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes E1204 09:41:12.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9404667Z E1204 09:41:12.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9404802Z E1204 09:41:12.652000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9404966Z E1204 09:41:12.689000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9405265Z E1204 09:41:12.689000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9405450Z E1204 09:41:12.689000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9405607Z E1204 09:41:14.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9405918Z E1204 09:41:14.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9406064Z E1204 09:41:14.923000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9406226Z E1204 09:41:14.925000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9406549Z E1204 09:41:14.925000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9406688Z E1204 09:41:14.925000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9406850Z E1204 09:41:14.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9407160Z E1204 09:41:14.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9407314Z E1204 09:41:14.946000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9407485Z E1204 09:41:14.972000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9407791Z E1204 09:41:14.972000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9407938Z E1204 09:41:14.972000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9408106Z E1204 09:41:14.996000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9408416Z E1204 09:41:14.996000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9408545Z E1204 09:41:14.996000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9408725Z E1204 09:41:14.998000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9409640Z E1204 09:41:14.998000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9409776Z E1204 09:41:14.998000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9409944Z E1204 09:41:15.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9410243Z E1204 09:41:15.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9410409Z E1204 09:41:15.000000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9410578Z E1204 09:41:15.013000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9410890Z E1204 09:41:15.013000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9411026Z E1204 09:41:15.013000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9411185Z E1204 09:41:15.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9411531Z E1204 09:41:15.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 81920 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9411669Z E1204 09:41:15.015000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9411831Z E1204 09:41:15.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9412132Z E1204 09:41:15.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 98304 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9412274Z E1204 09:41:15.039000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9412436Z E1204 09:41:15.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9412760Z E1204 09:41:15.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 131072 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9416258Z E1204 09:41:15.041000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9416416Z E1204 09:41:17.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9416744Z E1204 09:41:17.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9416869Z E1204 09:41:17.007000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9417013Z E1204 09:41:17.044000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:41:23.9417338Z E1204 09:41:17.044000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:41:23.9417466Z E1204 09:41:17.044000 18571 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:41:23.9417510Z PASSED [6.2689s] [ 2%] 2025-12-04T09:41:23.9417798Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9418079Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0009s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9418357Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0011s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9418654Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9418929Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9419207Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0008s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9419484Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9419760Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9420040Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9420317Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9420599Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9420878Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9421165Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9421442Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9421735Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9422015Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9422291Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9422563Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9422841Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9423163Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9423442Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9423720Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9423995Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9424278Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9424552Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9424829Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9425104Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9425386Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9425663Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9425963Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9426241Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9426555Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9426833Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9427110Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9427385Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9427685Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9427962Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9428240Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9428516Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9428793Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9429069Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9429344Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9429617Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9429895Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9430170Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9430461Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9430734Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9431029Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9431304Z inductor/test_pattern_matcher.py::TestPatternMatcher::test_remove_noop_pass_with_remove_passes SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:41:23.9431311Z 2025-12-04T09:41:23.9431372Z =================================== FAILURES =================================== 2025-12-04T09:41:23.9431466Z ______________ TestPatternMatcher.test_mixed_mm_exhaustive_dtypes ______________ 2025-12-04T09:41:23.9431516Z Traceback (most recent call last): 2025-12-04T09:41:23.9431680Z File "/var/lib/jenkins/pytorch/test/inductor/test_pattern_matcher.py", line 395, in test_mixed_mm_exhaustive_dtypes 2025-12-04T09:41:23.9431760Z self._test_mixed_impl(fn, args, True, False, rtol=0.16, atol=1e-4) 2025-12-04T09:41:23.9431904Z File "/var/lib/jenkins/pytorch/test/inductor/test_pattern_matcher.py", line 325, in _test_mixed_impl 2025-12-04T09:41:23.9431982Z FileCheck().check("k_idx").check(".to(").check("tl.dot").run(code) 2025-12-04T09:41:23.9432057Z RuntimeError: Expected to find ".to(" but did not find it 2025-12-04T09:41:23.9432097Z Searched string: 2025-12-04T09:41:23.9432159Z acc = tl.zeros((BLOCK_M, BLOCK_N), dtype=ACC_TYPE) 2025-12-04T09:41:23.9432162Z 2025-12-04T09:41:23.9432216Z for k_idx in range(0, tl.cdiv(K, BLOCK_K)): 2025-12-04T09:41:23.9432219Z 2025-12-04T09:41:23.9432278Z a_k_idx_vals = offs_k[None, :] + (k_idx * BLOCK_K) 2025-12-04T09:41:23.9432335Z b_k_idx_vals = offs_k[:, None] + (k_idx * BLOCK_K) 2025-12-04T09:41:23.9432337Z 2025-12-04T09:41:23.9432383Z idx_m = offs_a_m[:, None] 2025-12-04T09:41:23.9432427Z idx_n = a_k_idx_vals 2025-12-04T09:41:23.9432472Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9432516Z a = tl.load(A + (xindex)) 2025-12-04T09:41:23.9432518Z 2025-12-04T09:41:23.9432560Z idx_m = b_k_idx_vals 2025-12-04T09:41:23.9432603Z idx_n = offs_b_n[None, :] 2025-12-04T09:41:23.9432646Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9432686Z b = tl.load(B + (xindex)) 2025-12-04T09:41:23.9432688Z 2025-12-04T09:41:23.9432691Z 2025-12-04T09:41:23.9432763Z acc += tl.dot(a, b, allow_tf32=ALLOW_TF32, out_dtype=ACC_TYPE) 2025-12-04T09:41:23.9432765Z 2025-12-04T09:41:23.9432767Z 2025-12-04T09:41:23.9432823Z # rematerialize rm and rn to save registers 2025-12-04T09:41:23.9432876Z rm = pid_m * BLOCK_M + tl.arange(0, BLOCK_M) 2025-12-04T09:41:23.9432928Z rn = pid_n * BLOCK_N + tl.arange(0, BLOCK_N) 2025-12-04T09:41:23.9433004Z idx_m = rm[:, None] 2025-12-04T09:41:23.9433043Z idx_n = rn[None, :] 2025-12-04T09:41:23.9433088Z mask = (idx_m < M) & (idx_n < N) 2025-12-04T09:41:23.9433091Z 2025-12-04T09:41:23.9433135Z # inductor generates a suffix 2025-12-04T09:41:23.9433179Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9433270Z tl.store(out_ptr0 + (tl.broadcast_to(xindex, [BLOCK_M, BLOCK_N])), acc, mask) 2025-12-04T09:41:23.9433311Z ''', device_str='cuda') 2025-12-04T09:41:23.9433313Z 2025-12-04T09:41:23.9433314Z 2025-12-04T09:41:23.9433363Z async_compile.wait(globals()) 2025-12-04T09:41:23.9433401Z del async_compile 2025-12-04T09:41:23.9433427Z 2025-12-04T09:41:23.9433465Z class Runner: 2025-12-04T09:41:23.9433512Z def __init__(self, partitions): 2025-12-04T09:41:23.9433559Z self.partitions = partitions 2025-12-04T09:41:23.9433561Z 2025-12-04T09:41:23.9433611Z def recursively_apply_fns(self, fns): 2025-12-04T09:41:23.9433654Z new_callables = [] 2025-12-04T09:41:23.9433707Z for fn, c in zip(fns, self.partitions): 2025-12-04T09:41:23.9433758Z new_callables.append(fn(c)) 2025-12-04T09:41:23.9433806Z self.partitions = new_callables 2025-12-04T09:41:23.9433808Z 2025-12-04T09:41:23.9433851Z def call(self, args): 2025-12-04T09:41:23.9433893Z arg0_1, arg1_1 = args 2025-12-04T09:41:23.9433961Z args.clear() 2025-12-04T09:41:23.9434021Z assert_size_stride(arg0_1, (256, 256), (256, 1)) 2025-12-04T09:41:23.9434080Z assert_size_stride(arg1_1, (256, 256), (256, 1)) 2025-12-04T09:41:23.9434127Z with torch.cuda._DeviceGuard(0): 2025-12-04T09:41:23.9434175Z torch.cuda.set_device(0) 2025-12-04T09:41:23.9434252Z buf0 = empty_strided_cuda((256, 256), (256, 1), torch.bfloat16) 2025-12-04T09:41:23.9434346Z # Topologically Sorted Source Nodes: [to], Original ATen: [aten._to_copy] 2025-12-04T09:41:23.9434390Z stream0 = get_raw_stream(0) 2025-12-04T09:41:23.9434474Z triton_poi_fused__to_copy_0.run(arg0_1, buf0, 65536, stream=stream0) 2025-12-04T09:41:23.9434512Z del arg0_1 2025-12-04T09:41:23.9434584Z buf1 = empty_strided_cuda((256, 256), (256, 1), torch.bfloat16) 2025-12-04T09:41:23.9434708Z # Topologically Sorted Source Nodes: [to, mm], Original ATen: [aten._to_copy, aten.mm] 2025-12-04T09:41:23.9434755Z stream0 = get_raw_stream(0) 2025-12-04T09:41:23.9434849Z triton_tem_fused__to_copy_mm_1.run(arg1_1, buf0, buf1, 256, 1, 1, stream=stream0) 2025-12-04T09:41:23.9434889Z del arg1_1 2025-12-04T09:41:23.9434926Z del buf0 2025-12-04T09:41:23.9434968Z return (buf1, ) 2025-12-04T09:41:23.9434970Z 2025-12-04T09:41:23.9435019Z runner = Runner(partitions=[]) 2025-12-04T09:41:23.9435057Z call = runner.call 2025-12-04T09:41:23.9435132Z recursively_apply_fns = runner.recursively_apply_fns 2025-12-04T09:41:23.9435134Z 2025-12-04T09:41:23.9435136Z 2025-12-04T09:41:23.9435197Z def benchmark_compiled_module(times=10, repeat=10): 2025-12-04T09:41:23.9435256Z from torch._dynamo.testing import rand_strided 2025-12-04T09:41:23.9435322Z from torch._inductor.utils import print_performance 2025-12-04T09:41:23.9435408Z arg0_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.int8) 2025-12-04T09:41:23.9435495Z arg1_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.bfloat16) 2025-12-04T09:41:23.9435542Z fn = lambda: call([arg0_1, arg1_1]) 2025-12-04T09:41:23.9435612Z return print_performance(fn, times=times, repeat=repeat) 2025-12-04T09:41:23.9435614Z 2025-12-04T09:41:23.9435617Z 2025-12-04T09:41:23.9435661Z if __name__ == "__main__": 2025-12-04T09:41:23.9435743Z from torch._inductor.wrapper_benchmark import compiled_module_main 2025-12-04T09:41:23.9435813Z compiled_module_main('None', benchmark_compiled_module) 2025-12-04T09:41:23.9435851Z From CHECK: .to( 2025-12-04T09:41:23.9435853Z 2025-12-04T09:41:23.9435854Z 2025-12-04T09:41:23.9435930Z To execute this test, run the following from the base repo dir: 2025-12-04T09:41:23.9436090Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_pattern_matcher.py TestPatternMatcher.test_mixed_mm_exhaustive_dtypes 2025-12-04T09:41:23.9436093Z 2025-12-04T09:41:23.9436184Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:41:23.9436265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9436310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9436370Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9436488Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9436849Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9436888Z graph_break [] 2025-12-04T09:41:23.9436937Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9437013Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9437057Z Autotune Choices Stats: 2025-12-04T09:41:23.9437462Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_59", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.006240000016987324, "best_triton_pos": 0} 2025-12-04T09:41:23.9437510Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9437553Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9437603Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9437850Z triton_mm_59 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9438089Z triton_mm_62 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9438334Z triton_mm_67 0.0064 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9438565Z triton_mm_58 0.0064 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9438796Z triton_mm_54 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9439026Z triton_mm_55 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9439258Z triton_mm_57 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9439490Z triton_mm_63 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9439721Z triton_mm_66 0.0065 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9439953Z triton_mm_61 0.0065 ms 95.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9440086Z SingleProcess AUTOTUNE benchmarking takes 0.2556 seconds and 0.2963 seconds precompiling for 36 choices 2025-12-04T09:41:23.9440129Z Autotune Choices Stats: 2025-12-04T09:41:23.9440501Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_129", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006279999855905771, "best_triton_pos": 0} 2025-12-04T09:41:23.9440556Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9440597Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9440645Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9440912Z triton_mm_129 0.0063 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9441147Z triton_mm_127 0.0065 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9441381Z triton_mm_131 0.0070 ms 89.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9441609Z triton_mm_134 0.0078 ms 80.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9441840Z triton_mm_128 0.0079 ms 79.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9442081Z triton_mm_135 0.0091 ms 69.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9442315Z triton_mm_133 0.0091 ms 69.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9442545Z triton_mm_130 0.0091 ms 68.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9442774Z triton_mm_132 0.0092 ms 68.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9443053Z triton_mm_144 0.0125 ms 50.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9443184Z SingleProcess AUTOTUNE benchmarking takes 0.1757 seconds and 0.4536 seconds precompiling for 36 choices 2025-12-04T09:41:23.9443226Z Autotune Choices Stats: 2025-12-04T09:41:23.9443590Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_203", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.005880000069737434, "best_triton_pos": 0} 2025-12-04T09:41:23.9443635Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9443675Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9443728Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9443963Z triton_mm_203 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9444220Z triton_mm_207 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9444454Z triton_mm_201 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9444711Z triton_mm_202 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9444942Z triton_mm_205 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9445173Z triton_mm_199 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9445404Z triton_mm_210 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9445636Z triton_mm_206 0.0061 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9445877Z triton_mm_204 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9446111Z triton_mm_198 0.0064 ms 91.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9446242Z SingleProcess AUTOTUNE benchmarking takes 0.2087 seconds and 0.3190 seconds precompiling for 36 choices 2025-12-04T09:41:23.9446319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9446365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9446425Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9446530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9446885Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9446925Z graph_break [] 2025-12-04T09:41:23.9446973Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9447050Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9447091Z Autotune Choices Stats: 2025-12-04T09:41:23.9447461Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_2923", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0061599998734891415, "best_triton_pos": 0} 2025-12-04T09:41:23.9447504Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9447546Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9447593Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9447844Z triton_mm_2923 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9448080Z triton_mm_2917 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9448335Z triton_mm_2916 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9448570Z triton_mm_2920 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9448804Z triton_mm_2925 0.0064 ms 95.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9449039Z triton_mm_2921 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9449276Z triton_mm_2928 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9449521Z triton_mm_2919 0.0065 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9449757Z triton_mm_2929 0.0065 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9449990Z triton_mm_2922 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9450121Z SingleProcess AUTOTUNE benchmarking takes 0.2141 seconds and 0.2906 seconds precompiling for 36 choices 2025-12-04T09:41:23.9450163Z Autotune Choices Stats: 2025-12-04T09:41:23.9450535Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_2991", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006359000224620104, "best_triton_pos": 0} 2025-12-04T09:41:23.9450579Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9450618Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9450665Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9450900Z triton_mm_2991 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9451135Z triton_mm_2989 0.0071 ms 89.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9451366Z triton_mm_2993 0.0076 ms 84.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9451607Z triton_mm_2996 0.0082 ms 77.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9451837Z triton_mm_2990 0.0082 ms 77.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9452094Z triton_mm_2994 0.0092 ms 69.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9452331Z triton_mm_2997 0.0092 ms 69.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9452567Z triton_mm_2992 0.0094 ms 67.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9452799Z triton_mm_2995 0.0096 ms 66.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9453100Z triton_mm_3006 0.0121 ms 52.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9453340Z SingleProcess AUTOTUNE benchmarking takes 0.1940 seconds and 0.4575 seconds precompiling for 36 choices 2025-12-04T09:41:23.9453412Z Autotune Choices Stats: 2025-12-04T09:41:23.9453787Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3065", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9453830Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9453871Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9453924Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9454162Z triton_mm_3065 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9454404Z triton_mm_3069 0.0061 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9454638Z triton_mm_3061 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9454868Z triton_mm_3064 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9455103Z triton_mm_3067 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9455335Z triton_mm_3063 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9455598Z triton_mm_3073 0.0066 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9455830Z triton_mm_3060 0.0067 ms 91.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9456088Z triton_mm_3071 0.0067 ms 91.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9456321Z triton_mm_3066 0.0069 ms 87.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9456450Z SingleProcess AUTOTUNE benchmarking takes 0.2097 seconds and 0.3222 seconds precompiling for 36 choices 2025-12-04T09:41:23.9456528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9456571Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9456630Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9456733Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9457104Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9457142Z graph_break [] 2025-12-04T09:41:23.9457193Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9457268Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9457312Z Autotune Choices Stats: 2025-12-04T09:41:23.9457678Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3138", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9457721Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9457762Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9457810Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9458046Z triton_mm_3138 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9458280Z triton_mm_3144 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9458513Z triton_mm_3135 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9458746Z triton_mm_3137 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9458977Z triton_mm_3136 0.0062 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9459225Z triton_mm_3141 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9459457Z triton_mm_3133 0.0066 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9459712Z triton_mm_3132 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9459946Z triton_mm_3139 0.0066 ms 91.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9460179Z triton_mm_3143 0.0067 ms 91.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9460308Z SingleProcess AUTOTUNE benchmarking takes 0.2036 seconds and 0.2828 seconds precompiling for 36 choices 2025-12-04T09:41:23.9460349Z Autotune Choices Stats: 2025-12-04T09:41:23.9460719Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3205", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006719000171869993, "best_triton_pos": 0} 2025-12-04T09:41:23.9460771Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9460812Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9460859Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9461095Z triton_mm_3205 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9461333Z triton_mm_3207 0.0072 ms 93.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9461631Z triton_mm_3209 0.0074 ms 90.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9461877Z triton_mm_3206 0.0083 ms 81.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9462108Z triton_mm_3212 0.0085 ms 79.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9462338Z triton_mm_3210 0.0093 ms 72.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9462572Z triton_mm_3208 0.0093 ms 72.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9462805Z triton_mm_3213 0.0093 ms 72.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9463111Z triton_mm_3211 0.0096 ms 70.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9463341Z triton_mm_3214 0.0123 ms 54.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9463504Z SingleProcess AUTOTUNE benchmarking takes 0.1920 seconds and 0.4622 seconds precompiling for 36 choices 2025-12-04T09:41:23.9463545Z Autotune Choices Stats: 2025-12-04T09:41:23.9463927Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3284", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9463974Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9464012Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9464063Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9464297Z triton_mm_3284 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9464554Z triton_mm_3289 0.0061 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9464785Z triton_mm_3282 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9465019Z triton_mm_3287 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9465252Z triton_mm_3277 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9465495Z triton_mm_3285 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9465735Z triton_mm_3279 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9465971Z triton_mm_3281 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9466204Z triton_mm_3280 0.0064 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9466436Z triton_mm_3283 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9466565Z SingleProcess AUTOTUNE benchmarking takes 0.2001 seconds and 0.3361 seconds precompiling for 36 choices 2025-12-04T09:41:23.9466656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9466701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9466763Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9466866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9467224Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9467285Z graph_break [] 2025-12-04T09:41:23.9467338Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9467411Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9467454Z Autotune Choices Stats: 2025-12-04T09:41:23.9467826Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3351", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006200000178068876, "best_triton_pos": 0} 2025-12-04T09:41:23.9467872Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9467912Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9467958Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9468198Z triton_mm_3351 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9468454Z triton_mm_3355 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9468700Z triton_mm_3352 0.0063 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9468934Z triton_mm_3353 0.0063 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9469170Z triton_mm_3357 0.0064 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9469403Z triton_mm_3360 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9469641Z triton_mm_3349 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9469876Z triton_mm_3354 0.0066 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9470112Z triton_mm_3348 0.0066 ms 93.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9470347Z triton_mm_3356 0.0066 ms 93.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9470488Z SingleProcess AUTOTUNE benchmarking takes 0.2025 seconds and 0.2849 seconds precompiling for 36 choices 2025-12-04T09:41:23.9470531Z Autotune Choices Stats: 2025-12-04T09:41:23.9470898Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3423", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006839999929070473, "best_triton_pos": 0} 2025-12-04T09:41:23.9470943Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9471002Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9471054Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9471295Z triton_mm_3423 0.0068 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9471529Z triton_mm_3421 0.0072 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9471774Z triton_mm_3425 0.0074 ms 92.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9472020Z triton_mm_3422 0.0077 ms 88.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9472266Z triton_mm_3428 0.0085 ms 80.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9472498Z triton_mm_3426 0.0094 ms 72.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9472728Z triton_mm_3424 0.0096 ms 71.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9473083Z triton_mm_3429 0.0096 ms 71.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9473341Z triton_mm_3427 0.0096 ms 71.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9473575Z triton_mm_3438 0.0120 ms 56.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9473707Z SingleProcess AUTOTUNE benchmarking takes 0.1899 seconds and 0.4829 seconds precompiling for 36 choices 2025-12-04T09:41:23.9473933Z Autotune Choices Stats: 2025-12-04T09:41:23.9474385Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3493", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9474871Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9474990Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9475119Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9475456Z triton_mm_3493 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9475983Z triton_mm_3496 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9476519Z triton_mm_3499 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9477027Z triton_mm_3501 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9477565Z triton_mm_3504 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9478096Z triton_mm_3500 0.0064 ms 92.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9478657Z triton_mm_3498 0.0066 ms 90.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9479183Z triton_mm_3492 0.0066 ms 90.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9479743Z triton_mm_3505 0.0066 ms 89.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9480319Z triton_mm_3503 0.0067 ms 89.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9480733Z SingleProcess AUTOTUNE benchmarking takes 0.2089 seconds and 0.0002 seconds precompiling for 36 choices 2025-12-04T09:41:23.9480975Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9481134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9481268Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9481463Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9481962Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9482391Z graph_break [] 2025-12-04T09:41:23.9482495Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9482656Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9482809Z Autotune Choices Stats: 2025-12-04T09:41:23.9483292Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3568", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006200000178068876, "best_triton_pos": 0} 2025-12-04T09:41:23.9483762Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9483873Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9483987Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9484413Z triton_mm_3568 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9484972Z triton_mm_3571 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9485493Z triton_mm_3573 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9486005Z triton_mm_3567 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9486514Z triton_mm_3569 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9487055Z triton_mm_3564 0.0064 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9487571Z triton_mm_3572 0.0066 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9488093Z triton_mm_3565 0.0067 ms 92.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9488602Z triton_mm_3575 0.0067 ms 92.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9489119Z triton_mm_3576 0.0069 ms 89.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9489524Z SingleProcess AUTOTUNE benchmarking takes 0.2122 seconds and 0.2817 seconds precompiling for 36 choices 2025-12-04T09:41:23.9489729Z Autotune Choices Stats: 2025-12-04T09:41:23.9490166Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3637", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006719999946653843, "best_triton_pos": 0} 2025-12-04T09:41:23.9490613Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9490723Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9490837Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9491163Z triton_mm_3637 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9491679Z triton_mm_3639 0.0068 ms 98.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9492206Z triton_mm_3641 0.0072 ms 92.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9492716Z triton_mm_3644 0.0080 ms 83.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9493338Z triton_mm_3638 0.0081 ms 83.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9493841Z triton_mm_3640 0.0091 ms 73.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9494350Z triton_mm_3645 0.0091 ms 73.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9494857Z triton_mm_3643 0.0092 ms 73.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9495378Z triton_mm_3642 0.0092 ms 73.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9495903Z triton_mm_3647 0.0123 ms 54.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9496305Z SingleProcess AUTOTUNE benchmarking takes 0.1970 seconds and 0.4724 seconds precompiling for 36 choices 2025-12-04T09:41:23.9496511Z Autotune Choices Stats: 2025-12-04T09:41:23.9496952Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3713", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9497400Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9497510Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9497624Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9497947Z triton_mm_3713 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9498461Z triton_mm_3711 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9498975Z triton_mm_3709 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9499485Z triton_mm_3717 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9499988Z triton_mm_3712 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9500518Z triton_mm_3715 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9501025Z triton_mm_3720 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9501571Z triton_mm_3708 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9502077Z triton_mm_3716 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9502580Z triton_mm_3719 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9503095Z SingleProcess AUTOTUNE benchmarking takes 0.2031 seconds and 0.3213 seconds precompiling for 36 choices 2025-12-04T09:41:23.9503356Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9503515Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9503646Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9503841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9504332Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9504758Z graph_break [] 2025-12-04T09:41:23.9504862Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9505019Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9505171Z Autotune Choices Stats: 2025-12-04T09:41:23.9505607Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3783", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006120000034570694, "best_triton_pos": 0} 2025-12-04T09:41:23.9506050Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9506159Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9506271Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9506592Z triton_mm_3783 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9507103Z triton_mm_3788 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9507614Z triton_mm_3785 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9508123Z triton_mm_3787 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9508647Z triton_mm_3789 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9509151Z triton_mm_3781 0.0063 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9509691Z triton_mm_3793 0.0063 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9510200Z triton_mm_3791 0.0064 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9510709Z triton_mm_3792 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9511215Z triton_mm_3784 0.0065 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9511630Z SingleProcess AUTOTUNE benchmarking takes 0.2107 seconds and 0.2680 seconds precompiling for 36 choices 2025-12-04T09:41:23.9511834Z Autotune Choices Stats: 2025-12-04T09:41:23.9512270Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3853", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.0069599999114871025, "best_triton_pos": 0} 2025-12-04T09:41:23.9512719Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9512827Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9512967Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9513286Z triton_mm_3853 0.0070 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9513800Z triton_mm_3855 0.0070 ms 98.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9514307Z triton_mm_3857 0.0073 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9514815Z triton_mm_3854 0.0081 ms 85.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9515315Z triton_mm_3860 0.0086 ms 80.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9515819Z triton_mm_3858 0.0088 ms 78.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9516342Z triton_mm_3861 0.0092 ms 76.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9516848Z triton_mm_3856 0.0095 ms 73.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9517350Z triton_mm_3859 0.0095 ms 73.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9517882Z triton_mm_3870 0.0125 ms 55.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9518291Z SingleProcess AUTOTUNE benchmarking takes 0.1958 seconds and 0.4526 seconds precompiling for 36 choices 2025-12-04T09:41:23.9518497Z Autotune Choices Stats: 2025-12-04T09:41:23.9518938Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_3933", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9519385Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9519515Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9519629Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9519955Z triton_mm_3933 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9520469Z triton_mm_3925 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9520984Z triton_mm_3927 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9521496Z triton_mm_3929 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9522003Z triton_mm_3928 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9522510Z triton_mm_3932 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9523052Z triton_mm_3931 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9523563Z triton_mm_3930 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9524076Z triton_mm_3936 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9524603Z triton_mm_3924 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9525006Z SingleProcess AUTOTUNE benchmarking takes 0.2062 seconds and 0.3379 seconds precompiling for 36 choices 2025-12-04T09:41:23.9525245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9525405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9525540Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9525773Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9526272Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9526701Z graph_break [] 2025-12-04T09:41:23.9526805Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9526961Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9527116Z Autotune Choices Stats: 2025-12-04T09:41:23.9527552Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4005", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9528011Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9528123Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9528242Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9528563Z triton_mm_4005 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9529075Z triton_mm_4000 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9529589Z triton_mm_3997 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9530101Z triton_mm_3999 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9530609Z triton_mm_4001 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9531115Z triton_mm_4003 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9531621Z triton_mm_4008 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9532136Z triton_mm_4002 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9532652Z triton_mm_3996 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9533236Z triton_mm_4004 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9533637Z SingleProcess AUTOTUNE benchmarking takes 0.1833 seconds and 0.2743 seconds precompiling for 36 choices 2025-12-04T09:41:23.9533842Z Autotune Choices Stats: 2025-12-04T09:41:23.9534307Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4069", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006680000107735395, "best_triton_pos": 0} 2025-12-04T09:41:23.9534756Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9534866Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9534978Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9535297Z triton_mm_4069 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9535812Z triton_mm_4071 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9536340Z triton_mm_4073 0.0070 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9536846Z triton_mm_4070 0.0080 ms 83.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9537348Z triton_mm_4076 0.0080 ms 83.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9537855Z triton_mm_4077 0.0088 ms 75.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9538359Z triton_mm_4072 0.0090 ms 73.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9538863Z triton_mm_4074 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9539370Z triton_mm_4075 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9539877Z triton_mm_4086 0.0122 ms 54.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9540282Z SingleProcess AUTOTUNE benchmarking takes 0.1894 seconds and 0.4555 seconds precompiling for 36 choices 2025-12-04T09:41:23.9540486Z Autotune Choices Stats: 2025-12-04T09:41:23.9540921Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4143", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005880000069737434, "best_triton_pos": 0} 2025-12-04T09:41:23.9541391Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9541501Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9541615Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9541961Z triton_mm_4143 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9542473Z triton_mm_4141 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9543271Z triton_mm_4145 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9543781Z triton_mm_4149 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9544290Z triton_mm_4147 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9544810Z triton_mm_4144 0.0060 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9545317Z triton_mm_4148 0.0063 ms 93.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9545824Z triton_mm_4152 0.0064 ms 92.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9546334Z triton_mm_4140 0.0064 ms 91.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9546837Z triton_mm_4146 0.0064 ms 91.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9547237Z SingleProcess AUTOTUNE benchmarking takes 0.1966 seconds and 0.3411 seconds precompiling for 36 choices 2025-12-04T09:41:23.9547475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9547632Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9547762Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9547955Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9548444Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9548866Z graph_break [] 2025-12-04T09:41:23.9548969Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9549140Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9549292Z Autotune Choices Stats: 2025-12-04T09:41:23.9549732Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4215", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006000000052154064, "best_triton_pos": 0} 2025-12-04T09:41:23.9550185Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9550298Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9550409Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9550759Z triton_mm_4215 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9551270Z triton_mm_4217 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9551782Z triton_mm_4221 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9552291Z triton_mm_4219 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9552806Z triton_mm_4213 0.0061 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9553403Z triton_mm_4224 0.0063 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9553911Z triton_mm_4216 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9554420Z triton_mm_4220 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9554926Z triton_mm_4223 0.0064 ms 93.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9555439Z triton_mm_4225 0.0064 ms 93.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9555843Z SingleProcess AUTOTUNE benchmarking takes 0.2062 seconds and 0.2733 seconds precompiling for 36 choices 2025-12-04T09:41:23.9556048Z Autotune Choices Stats: 2025-12-04T09:41:23.9556479Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4285", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006560000125318766, "best_triton_pos": 0} 2025-12-04T09:41:23.9556928Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9557037Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9557149Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9557490Z triton_mm_4285 0.0066 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9558001Z triton_mm_4287 0.0067 ms 97.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9558539Z triton_mm_4289 0.0070 ms 93.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9559050Z triton_mm_4286 0.0077 ms 85.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9559553Z triton_mm_4292 0.0079 ms 82.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9560058Z triton_mm_4288 0.0091 ms 72.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9560563Z triton_mm_4290 0.0091 ms 72.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9561083Z triton_mm_4293 0.0091 ms 72.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9561590Z triton_mm_4291 0.0091 ms 71.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9562095Z triton_mm_4302 0.0121 ms 54.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9562497Z SingleProcess AUTOTUNE benchmarking takes 0.1909 seconds and 0.4674 seconds precompiling for 36 choices 2025-12-04T09:41:23.9562704Z Autotune Choices Stats: 2025-12-04T09:41:23.9563180Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4359", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9563624Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9563734Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9563848Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9564170Z triton_mm_4359 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9564688Z triton_mm_4365 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9565201Z triton_mm_4361 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9565735Z triton_mm_4363 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9566242Z triton_mm_4357 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9566782Z triton_mm_4360 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9567292Z triton_mm_4362 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9567799Z triton_mm_4368 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9568303Z triton_mm_4364 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9568833Z triton_mm_4356 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9569235Z SingleProcess AUTOTUNE benchmarking takes 0.1998 seconds and 0.3336 seconds precompiling for 36 choices 2025-12-04T09:41:23.9569475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9569632Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9569762Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9569958Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9570450Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9570879Z graph_break [] 2025-12-04T09:41:23.9570986Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9571142Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9571294Z Autotune Choices Stats: 2025-12-04T09:41:23.9571729Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4432", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9572175Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9572284Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9572397Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9572714Z triton_mm_4432 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9573274Z triton_mm_4437 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9573802Z triton_mm_4431 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9574313Z triton_mm_4433 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9574848Z triton_mm_4429 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9575358Z triton_mm_4435 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9575866Z triton_mm_4428 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9576375Z triton_mm_4436 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9576882Z triton_mm_4440 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9577408Z triton_mm_4441 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9577811Z SingleProcess AUTOTUNE benchmarking takes 0.1977 seconds and 0.2745 seconds precompiling for 36 choices 2025-12-04T09:41:23.9578013Z Autotune Choices Stats: 2025-12-04T09:41:23.9578444Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4501", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006678999867290258, "best_triton_pos": 0} 2025-12-04T09:41:23.9578892Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9579003Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9579117Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9579437Z triton_mm_4501 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9579957Z triton_mm_4503 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9580471Z triton_mm_4505 0.0068 ms 97.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9580988Z triton_mm_4508 0.0078 ms 85.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9581494Z triton_mm_4502 0.0079 ms 84.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9582015Z triton_mm_4507 0.0090 ms 74.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9582522Z triton_mm_4509 0.0090 ms 73.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9583194Z triton_mm_4506 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9583701Z triton_mm_4504 0.0091 ms 73.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9584210Z triton_mm_4518 0.0120 ms 55.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9584614Z SingleProcess AUTOTUNE benchmarking takes 0.1884 seconds and 0.4531 seconds precompiling for 36 choices 2025-12-04T09:41:23.9584820Z Autotune Choices Stats: 2025-12-04T09:41:23.9585253Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4576", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006039999891072512, "best_triton_pos": 0} 2025-12-04T09:41:23.9585724Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9585835Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9585951Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9586268Z triton_mm_4576 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9586777Z triton_mm_4573 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9587289Z triton_mm_4577 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9587799Z triton_mm_4581 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9588311Z triton_mm_4584 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9588824Z triton_mm_4579 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9589335Z triton_mm_4572 0.0063 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9589845Z triton_mm_4575 0.0063 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9590376Z triton_mm_4578 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9590882Z triton_mm_4585 0.0067 ms 89.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9591312Z SingleProcess AUTOTUNE benchmarking takes 0.2120 seconds and 0.3367 seconds precompiling for 36 choices 2025-12-04T09:41:23.9591552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9591708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9591839Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9592034Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9592522Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9592985Z graph_break [] 2025-12-04T09:41:23.9593090Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9593247Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9593425Z Autotune Choices Stats: 2025-12-04T09:41:23.9593864Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4653", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0061599998734891415, "best_triton_pos": 0} 2025-12-04T09:41:23.9594311Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9594420Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9594533Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9594851Z triton_mm_4653 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9595363Z triton_mm_4648 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9595865Z triton_mm_4651 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9596371Z triton_mm_4645 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9596878Z triton_mm_4655 0.0063 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9597388Z triton_mm_4656 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9597902Z triton_mm_4649 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9598434Z triton_mm_4647 0.0064 ms 95.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9598941Z triton_mm_4650 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9599483Z triton_mm_4652 0.0067 ms 91.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9599884Z SingleProcess AUTOTUNE benchmarking takes 0.2200 seconds and 0.2701 seconds precompiling for 36 choices 2025-12-04T09:41:23.9600090Z Autotune Choices Stats: 2025-12-04T09:41:23.9600522Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4717", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006798999849706888, "best_triton_pos": 0} 2025-12-04T09:41:23.9600965Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9601074Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9601185Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9601528Z triton_mm_4717 0.0068 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9602042Z triton_mm_4719 0.0072 ms 95.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9602556Z triton_mm_4721 0.0074 ms 91.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9603121Z triton_mm_4724 0.0082 ms 83.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9603628Z triton_mm_4718 0.0083 ms 81.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9604132Z triton_mm_4720 0.0092 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9604638Z triton_mm_4722 0.0093 ms 73.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9605142Z triton_mm_4723 0.0093 ms 73.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9605650Z triton_mm_4725 0.0096 ms 70.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9606156Z triton_mm_4726 0.0123 ms 55.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9606578Z SingleProcess AUTOTUNE benchmarking takes 0.1943 seconds and 0.4692 seconds precompiling for 36 choices 2025-12-04T09:41:23.9606783Z Autotune Choices Stats: 2025-12-04T09:41:23.9607215Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4791", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9607692Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9607802Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9607918Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9608240Z triton_mm_4791 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9608752Z triton_mm_4795 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9609257Z triton_mm_4797 0.0061 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9609791Z triton_mm_4789 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9610299Z triton_mm_4793 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9610806Z triton_mm_4799 0.0063 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9611316Z triton_mm_4800 0.0063 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9611826Z triton_mm_4794 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9612329Z triton_mm_4801 0.0065 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9612835Z triton_mm_4796 0.0065 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9613290Z SingleProcess AUTOTUNE benchmarking takes 0.1877 seconds and 0.3342 seconds precompiling for 36 choices 2025-12-04T09:41:23.9613528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9613689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9613817Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9614010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9614500Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9614952Z graph_break [] 2025-12-04T09:41:23.9615057Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9615212Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9615365Z Autotune Choices Stats: 2025-12-04T09:41:23.9615846Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4861", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9616293Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9616404Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9616517Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9616836Z triton_mm_4861 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9617350Z triton_mm_4863 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9617887Z triton_mm_4869 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9618394Z triton_mm_4864 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9618900Z triton_mm_4865 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9619404Z triton_mm_4867 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9619914Z triton_mm_4868 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9620419Z triton_mm_4872 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9620929Z triton_mm_4860 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9621438Z triton_mm_4873 0.0065 ms 92.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9621844Z SingleProcess AUTOTUNE benchmarking takes 0.2093 seconds and 0.2760 seconds precompiling for 36 choices 2025-12-04T09:41:23.9622050Z Autotune Choices Stats: 2025-12-04T09:41:23.9622482Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_4933", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006680000107735395, "best_triton_pos": 0} 2025-12-04T09:41:23.9623092Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9623204Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9623316Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9623634Z triton_mm_4933 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9624212Z triton_mm_4935 0.0068 ms 98.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9624725Z triton_mm_4937 0.0070 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9625235Z triton_mm_4934 0.0080 ms 83.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9625741Z triton_mm_4940 0.0082 ms 81.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9626266Z triton_mm_4936 0.0090 ms 74.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9626771Z triton_mm_4941 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9627280Z triton_mm_4939 0.0091 ms 73.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9627782Z triton_mm_4938 0.0093 ms 71.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9628289Z triton_mm_4950 0.0120 ms 55.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9628690Z SingleProcess AUTOTUNE benchmarking takes 0.2044 seconds and 0.0003 seconds precompiling for 36 choices 2025-12-04T09:41:23.9628895Z Autotune Choices Stats: 2025-12-04T09:41:23.9629330Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5007", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005878999829292297, "best_triton_pos": 0} 2025-12-04T09:41:23.9629772Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9629881Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9629997Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9630321Z triton_mm_5007 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9630834Z triton_mm_5009 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9631363Z triton_mm_5013 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9631870Z triton_mm_5005 0.0060 ms 98.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9632404Z triton_mm_5011 0.0060 ms 98.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9632910Z triton_mm_5008 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9633468Z triton_mm_5012 0.0061 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9633972Z triton_mm_5015 0.0062 ms 94.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9634500Z triton_mm_5004 0.0063 ms 93.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9635009Z triton_mm_5016 0.0063 ms 93.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9635411Z SingleProcess AUTOTUNE benchmarking takes 0.2093 seconds and 0.3166 seconds precompiling for 36 choices 2025-12-04T09:41:23.9635648Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9635807Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9635937Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9636133Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9636622Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9637049Z graph_break [] 2025-12-04T09:41:23.9637153Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9637314Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9637470Z Autotune Choices Stats: 2025-12-04T09:41:23.9637910Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5079", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9638362Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9638474Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9638589Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9638908Z triton_mm_5079 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9639445Z triton_mm_5080 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9639955Z triton_mm_5077 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9640505Z triton_mm_5081 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9641014Z triton_mm_5083 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9641521Z triton_mm_5085 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9642027Z triton_mm_5082 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9642551Z triton_mm_5076 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9643115Z triton_mm_5088 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9643624Z triton_mm_5084 0.0064 ms 92.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9644026Z SingleProcess AUTOTUNE benchmarking takes 0.2156 seconds and 0.2722 seconds precompiling for 36 choices 2025-12-04T09:41:23.9644231Z Autotune Choices Stats: 2025-12-04T09:41:23.9644668Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5151", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.00675999978557229, "best_triton_pos": 0} 2025-12-04T09:41:23.9645115Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9645225Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9645338Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9645655Z triton_mm_5151 0.0068 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9646166Z triton_mm_5149 0.0068 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9646675Z triton_mm_5153 0.0072 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9647181Z triton_mm_5150 0.0080 ms 84.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9647712Z triton_mm_5156 0.0081 ms 83.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9648213Z triton_mm_5155 0.0091 ms 74.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9648763Z triton_mm_5152 0.0091 ms 74.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9649276Z triton_mm_5157 0.0092 ms 73.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9649788Z triton_mm_5154 0.0092 ms 73.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9650301Z triton_mm_5166 0.0122 ms 55.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9650727Z SingleProcess AUTOTUNE benchmarking takes 0.1948 seconds and 0.4583 seconds precompiling for 36 choices 2025-12-04T09:41:23.9650934Z Autotune Choices Stats: 2025-12-04T09:41:23.9651370Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5223", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0061599998734891415, "best_triton_pos": 0} 2025-12-04T09:41:23.9651821Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9651931Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9652044Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9652365Z triton_mm_5223 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9652883Z triton_mm_5229 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9653539Z triton_mm_5221 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9654052Z triton_mm_5225 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9654561Z triton_mm_5226 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9655069Z triton_mm_5233 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9655604Z triton_mm_5224 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9656108Z triton_mm_5227 0.0066 ms 92.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9656652Z triton_mm_5220 0.0068 ms 90.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9657159Z triton_mm_5228 0.0068 ms 90.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9657603Z SingleProcess AUTOTUNE benchmarking takes 0.2086 seconds and 0.3198 seconds precompiling for 36 choices 2025-12-04T09:41:23.9663699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9663910Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9664046Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9664244Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9664749Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9665225Z graph_break [] 2025-12-04T09:41:23.9665334Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9665497Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9665659Z Autotune Choices Stats: 2025-12-04T09:41:23.9666105Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5300", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9666552Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9666665Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9666785Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9667110Z triton_mm_5300 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9667626Z triton_mm_5297 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9668139Z triton_mm_5299 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9668650Z triton_mm_5301 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9669176Z triton_mm_5304 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9669692Z triton_mm_5295 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9670242Z triton_mm_5293 0.0064 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9670749Z triton_mm_5296 0.0065 ms 93.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9671286Z triton_mm_5303 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9671791Z triton_mm_5298 0.0066 ms 91.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9672192Z SingleProcess AUTOTUNE benchmarking takes 0.2196 seconds and 0.2806 seconds precompiling for 36 choices 2025-12-04T09:41:23.9672399Z Autotune Choices Stats: 2025-12-04T09:41:23.9672838Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5365", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006479999981820583, "best_triton_pos": 0} 2025-12-04T09:41:23.9673336Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9673445Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9673557Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9673877Z triton_mm_5365 0.0065 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9674388Z triton_mm_5367 0.0067 ms 97.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9674893Z triton_mm_5369 0.0072 ms 90.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9675400Z triton_mm_5372 0.0078 ms 82.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9675904Z triton_mm_5366 0.0080 ms 81.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9676406Z triton_mm_5368 0.0089 ms 72.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9676912Z triton_mm_5373 0.0090 ms 72.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9677422Z triton_mm_5370 0.0091 ms 71.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9677685Z triton_mm_5371 0.0092 ms 70.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9677919Z triton_mm_5382 0.0122 ms 53.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9678049Z SingleProcess AUTOTUNE benchmarking takes 0.1953 seconds and 0.4731 seconds precompiling for 36 choices 2025-12-04T09:41:23.9678091Z Autotune Choices Stats: 2025-12-04T09:41:23.9678495Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5440", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9678539Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9678582Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9678632Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9678867Z triton_mm_5440 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9679100Z triton_mm_5437 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9679351Z triton_mm_5439 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9679588Z triton_mm_5441 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9679822Z triton_mm_5445 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9680059Z triton_mm_5448 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9680290Z triton_mm_5443 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9680524Z triton_mm_5442 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9680758Z triton_mm_5436 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9680990Z triton_mm_5449 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9681121Z SingleProcess AUTOTUNE benchmarking takes 0.2080 seconds and 0.3329 seconds precompiling for 36 choices 2025-12-04T09:41:23.9681199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9681260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9681320Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9681426Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9681784Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9681828Z graph_break [] 2025-12-04T09:41:23.9681902Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9681979Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9682024Z Autotune Choices Stats: 2025-12-04T09:41:23.9682392Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5509", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9682439Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9682479Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9682529Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9682768Z triton_mm_5509 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9683055Z triton_mm_5517 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9683288Z triton_mm_5513 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9683523Z triton_mm_5511 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9683757Z triton_mm_5512 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9683990Z triton_mm_5515 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9684226Z triton_mm_5520 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9684456Z triton_mm_5519 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9684689Z triton_mm_5516 0.0063 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9684924Z triton_mm_5508 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9685083Z SingleProcess AUTOTUNE benchmarking takes 0.2063 seconds and 0.2735 seconds precompiling for 36 choices 2025-12-04T09:41:23.9685127Z Autotune Choices Stats: 2025-12-04T09:41:23.9685497Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5581", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006440000142902136, "best_triton_pos": 0} 2025-12-04T09:41:23.9685540Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9685581Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9685660Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9685899Z triton_mm_5581 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9686137Z triton_mm_5583 0.0068 ms 94.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9686371Z triton_mm_5585 0.0076 ms 84.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9686602Z triton_mm_5588 0.0083 ms 77.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9686866Z triton_mm_5582 0.0084 ms 77.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9687097Z triton_mm_5587 0.0088 ms 73.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9687332Z triton_mm_5589 0.0091 ms 70.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9687564Z triton_mm_5586 0.0092 ms 69.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9687797Z triton_mm_5584 0.0095 ms 67.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9688032Z triton_mm_5598 0.0121 ms 53.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9688159Z SingleProcess AUTOTUNE benchmarking takes 0.1827 seconds and 0.4659 seconds precompiling for 36 choices 2025-12-04T09:41:23.9688201Z Autotune Choices Stats: 2025-12-04T09:41:23.9688568Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5656", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0060789999552071095, "best_triton_pos": 0} 2025-12-04T09:41:23.9688613Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9688651Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9688716Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9688950Z triton_mm_5656 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9689184Z triton_mm_5655 0.0061 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9689439Z triton_mm_5659 0.0061 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9689674Z triton_mm_5658 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9689912Z triton_mm_5657 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9690146Z triton_mm_5664 0.0062 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9690382Z triton_mm_5653 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9690624Z triton_mm_5663 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9690857Z triton_mm_5661 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9691092Z triton_mm_5665 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9691219Z SingleProcess AUTOTUNE benchmarking takes 0.1883 seconds and 0.3344 seconds precompiling for 36 choices 2025-12-04T09:41:23.9691297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9691340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9691401Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9691504Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9691861Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9691900Z graph_break [] 2025-12-04T09:41:23.9691948Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9692024Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9692065Z Autotune Choices Stats: 2025-12-04T09:41:23.9692436Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5733", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006000000052154064, "best_triton_pos": 0} 2025-12-04T09:41:23.9692490Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9692530Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9692576Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9692814Z triton_mm_5733 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9693121Z triton_mm_5729 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9693353Z triton_mm_5731 0.0062 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9693591Z triton_mm_5727 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9693826Z triton_mm_5732 0.0062 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9694063Z triton_mm_5736 0.0062 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9694320Z triton_mm_5724 0.0063 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9694553Z triton_mm_5725 0.0064 ms 93.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9694784Z triton_mm_5737 0.0064 ms 93.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9695014Z triton_mm_5728 0.0065 ms 92.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9695143Z SingleProcess AUTOTUNE benchmarking takes 0.2133 seconds and 0.2811 seconds precompiling for 36 choices 2025-12-04T09:41:23.9695184Z Autotune Choices Stats: 2025-12-04T09:41:23.9695551Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5799", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006719999946653843, "best_triton_pos": 0} 2025-12-04T09:41:23.9695593Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9695633Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9695678Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9695917Z triton_mm_5799 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9696150Z triton_mm_5797 0.0068 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9696406Z triton_mm_5801 0.0076 ms 88.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9696639Z triton_mm_5804 0.0082 ms 81.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9696890Z triton_mm_5798 0.0085 ms 78.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9697123Z triton_mm_5802 0.0090 ms 75.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9697355Z triton_mm_5803 0.0093 ms 72.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9697589Z triton_mm_5805 0.0095 ms 70.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9697823Z triton_mm_5800 0.0096 ms 70.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9698069Z triton_mm_5814 0.0124 ms 54.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9698197Z SingleProcess AUTOTUNE benchmarking takes 0.1954 seconds and 0.4724 seconds precompiling for 36 choices 2025-12-04T09:41:23.9698238Z Autotune Choices Stats: 2025-12-04T09:41:23.9698604Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5872", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0061599998734891415, "best_triton_pos": 0} 2025-12-04T09:41:23.9698648Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9698690Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9698740Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9698972Z triton_mm_5872 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9699206Z triton_mm_5875 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9699440Z triton_mm_5871 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9699680Z triton_mm_5877 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9699913Z triton_mm_5869 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9700159Z triton_mm_5873 0.0066 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9700393Z triton_mm_5868 0.0068 ms 91.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9700656Z triton_mm_5880 0.0068 ms 90.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9700888Z triton_mm_5876 0.0070 ms 88.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9701120Z triton_mm_5879 0.0070 ms 88.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9701248Z SingleProcess AUTOTUNE benchmarking takes 0.2019 seconds and 0.3310 seconds precompiling for 36 choices 2025-12-04T09:41:23.9701323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9701377Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9701438Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9701540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9701892Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9701931Z graph_break [] 2025-12-04T09:41:23.9701980Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9702053Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9702095Z Autotune Choices Stats: 2025-12-04T09:41:23.9702463Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_5949", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005998999811708927, "best_triton_pos": 0} 2025-12-04T09:41:23.9702508Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9702547Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9702597Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9702834Z triton_mm_5949 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9703176Z triton_mm_5941 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9703412Z triton_mm_5943 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9703649Z triton_mm_5945 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9703910Z triton_mm_5947 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9704142Z triton_mm_5944 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9704408Z triton_mm_5948 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9704646Z triton_mm_5952 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9704877Z triton_mm_5946 0.0064 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9705111Z triton_mm_5940 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9705261Z SingleProcess AUTOTUNE benchmarking takes 0.2079 seconds and 0.2751 seconds precompiling for 36 choices 2025-12-04T09:41:23.9705305Z Autotune Choices Stats: 2025-12-04T09:41:23.9705673Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6015", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006440000142902136, "best_triton_pos": 0} 2025-12-04T09:41:23.9705719Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9705759Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9705805Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9706045Z triton_mm_6015 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9706283Z triton_mm_6013 0.0066 ms 97.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9706518Z triton_mm_6017 0.0072 ms 90.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9706754Z triton_mm_6020 0.0078 ms 82.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9706990Z triton_mm_6014 0.0079 ms 81.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9707227Z triton_mm_6016 0.0087 ms 74.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9707460Z triton_mm_6021 0.0091 ms 70.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9707711Z triton_mm_6018 0.0092 ms 70.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9707941Z triton_mm_6019 0.0092 ms 70.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9708193Z triton_mm_6022 0.0123 ms 52.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9708320Z SingleProcess AUTOTUNE benchmarking takes 0.1942 seconds and 0.4733 seconds precompiling for 36 choices 2025-12-04T09:41:23.9708364Z Autotune Choices Stats: 2025-12-04T09:41:23.9708732Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6093", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005880000069737434, "best_triton_pos": 0} 2025-12-04T09:41:23.9708773Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9708814Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9708863Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9709115Z triton_mm_6093 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9709348Z triton_mm_6089 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9709586Z triton_mm_6087 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9709822Z triton_mm_6085 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9710058Z triton_mm_6088 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9710291Z triton_mm_6092 0.0060 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9710522Z triton_mm_6091 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9710756Z triton_mm_6096 0.0064 ms 92.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9710991Z triton_mm_6084 0.0064 ms 91.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9711225Z triton_mm_6097 0.0065 ms 90.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9711365Z SingleProcess AUTOTUNE benchmarking takes 0.2138 seconds and 0.3281 seconds precompiling for 36 choices 2025-12-04T09:41:23.9711439Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9711483Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9711541Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9711643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9713186Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9713230Z graph_break [] 2025-12-04T09:41:23.9713277Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9713354Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9713394Z Autotune Choices Stats: 2025-12-04T09:41:23.9713763Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6164", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8", "best_time": 0.006120000034570694, "best_triton_pos": 0} 2025-12-04T09:41:23.9713829Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9713871Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9713917Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9714155Z triton_mm_6164 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9714388Z triton_mm_6160 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9714619Z triton_mm_6165 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9714856Z triton_mm_6159 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9715089Z triton_mm_6169 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9715322Z triton_mm_6161 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9715556Z triton_mm_6157 0.0066 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9715792Z triton_mm_6162 0.0066 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9716024Z triton_mm_6163 0.0066 ms 92.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9716277Z triton_mm_6156 0.0068 ms 90.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9716405Z SingleProcess AUTOTUNE benchmarking takes 0.2107 seconds and 0.2739 seconds precompiling for 36 choices 2025-12-04T09:41:23.9716446Z Autotune Choices Stats: 2025-12-04T09:41:23.9716852Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6229", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006839999929070473, "best_triton_pos": 0} 2025-12-04T09:41:23.9716894Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9716935Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9716980Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9717218Z triton_mm_6229 0.0068 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9717450Z triton_mm_6231 0.0072 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9717696Z triton_mm_6233 0.0075 ms 91.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9717927Z triton_mm_6230 0.0083 ms 82.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9718158Z triton_mm_6236 0.0086 ms 79.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9718388Z triton_mm_6235 0.0094 ms 72.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9718622Z triton_mm_6237 0.0094 ms 72.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9718856Z triton_mm_6232 0.0094 ms 72.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9719088Z triton_mm_6234 0.0096 ms 71.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9719316Z triton_mm_6239 0.0123 ms 55.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9719446Z SingleProcess AUTOTUNE benchmarking takes 0.1944 seconds and 0.4477 seconds precompiling for 36 choices 2025-12-04T09:41:23.9719487Z Autotune Choices Stats: 2025-12-04T09:41:23.9719856Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6305", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.0060800001956522465, "best_triton_pos": 0} 2025-12-04T09:41:23.9719910Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9719951Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9719999Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9720236Z triton_mm_6305 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9720487Z triton_mm_6309 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9720719Z triton_mm_6306 0.0062 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9720955Z triton_mm_6301 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9721185Z triton_mm_6303 0.0063 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9721434Z triton_mm_6312 0.0064 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9721663Z triton_mm_6304 0.0065 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9721896Z triton_mm_6313 0.0066 ms 92.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9722125Z triton_mm_6307 0.0066 ms 91.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9722357Z triton_mm_6311 0.0067 ms 91.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9722485Z SingleProcess AUTOTUNE benchmarking takes 0.2104 seconds and 0.3404 seconds precompiling for 36 choices 2025-12-04T09:41:23.9722559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9722603Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9722660Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9722762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9723153Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9723191Z graph_break [] 2025-12-04T09:41:23.9723239Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9723313Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9723379Z Autotune Choices Stats: 2025-12-04T09:41:23.9723741Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6379", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006200000178068876, "best_triton_pos": 0} 2025-12-04T09:41:23.9723784Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9723822Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9723867Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9724138Z triton_mm_6379 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9724374Z triton_mm_6372 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9724607Z triton_mm_6375 0.0063 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9724840Z triton_mm_6377 0.0063 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9725096Z triton_mm_6383 0.0063 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9725326Z triton_mm_6376 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9725562Z triton_mm_6381 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9725795Z triton_mm_6373 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9726029Z triton_mm_6380 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9726262Z triton_mm_6384 0.0069 ms 89.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9726390Z SingleProcess AUTOTUNE benchmarking takes 0.2127 seconds and 0.2782 seconds precompiling for 36 choices 2025-12-04T09:41:23.9726431Z Autotune Choices Stats: 2025-12-04T09:41:23.9726800Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6447", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006440000142902136, "best_triton_pos": 0} 2025-12-04T09:41:23.9726845Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9726884Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9726929Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9727167Z triton_mm_6447 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9727413Z triton_mm_6445 0.0071 ms 90.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9727646Z triton_mm_6449 0.0076 ms 84.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9727898Z triton_mm_6446 0.0082 ms 78.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9728130Z triton_mm_6452 0.0083 ms 77.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9728358Z triton_mm_6451 0.0089 ms 72.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9728587Z triton_mm_6450 0.0094 ms 68.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9728833Z triton_mm_6453 0.0094 ms 68.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9729063Z triton_mm_6448 0.0097 ms 66.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9729293Z triton_mm_6455 0.0124 ms 51.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9729420Z SingleProcess AUTOTUNE benchmarking takes 0.8930 seconds and 0.4728 seconds precompiling for 36 choices 2025-12-04T09:41:23.9729463Z Autotune Choices Stats: 2025-12-04T09:41:23.9729831Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6521", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.006118999794125557, "best_triton_pos": 0} 2025-12-04T09:41:23.9729874Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9729913Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9729960Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9730198Z triton_mm_6521 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9730429Z triton_mm_6523 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9730667Z triton_mm_6517 0.0062 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9730917Z triton_mm_6525 0.0064 ms 96.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9731151Z triton_mm_6519 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9731386Z triton_mm_6528 0.0064 ms 95.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9731639Z triton_mm_6522 0.0065 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9731872Z triton_mm_6524 0.0065 ms 94.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9732104Z triton_mm_6529 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9732336Z triton_mm_6520 0.0066 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9732475Z SingleProcess AUTOTUNE benchmarking takes 0.2207 seconds and 0.3263 seconds precompiling for 36 choices 2025-12-04T09:41:23.9732550Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9732594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9732652Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9732754Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9733137Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9733176Z graph_break [] 2025-12-04T09:41:23.9733224Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9733300Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9733340Z Autotune Choices Stats: 2025-12-04T09:41:23.9733706Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6589", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005998999811708927, "best_triton_pos": 0} 2025-12-04T09:41:23.9733749Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9733788Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9733833Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9734070Z triton_mm_6589 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9734309Z triton_mm_6600 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9734544Z triton_mm_6591 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9734808Z triton_mm_6597 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9735040Z triton_mm_6592 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9735308Z triton_mm_6593 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9735540Z triton_mm_6595 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9735774Z triton_mm_6588 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9736005Z triton_mm_6594 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9736255Z triton_mm_6596 0.0065 ms 92.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9736384Z SingleProcess AUTOTUNE benchmarking takes 0.2096 seconds and 0.2776 seconds precompiling for 36 choices 2025-12-04T09:41:23.9736425Z Autotune Choices Stats: 2025-12-04T09:41:23.9736796Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6661", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006680000107735395, "best_triton_pos": 0} 2025-12-04T09:41:23.9736839Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9736878Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9736926Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9737163Z triton_mm_6661 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9737400Z triton_mm_6663 0.0067 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9737633Z triton_mm_6665 0.0072 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9737865Z triton_mm_6662 0.0080 ms 83.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9738096Z triton_mm_6668 0.0080 ms 83.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9738342Z triton_mm_6666 0.0087 ms 76.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9738574Z triton_mm_6667 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9738824Z triton_mm_6664 0.0091 ms 73.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9739058Z triton_mm_6669 0.0092 ms 72.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9739292Z triton_mm_6678 0.0123 ms 54.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9739420Z SingleProcess AUTOTUNE benchmarking takes 0.1950 seconds and 0.4693 seconds precompiling for 36 choices 2025-12-04T09:41:23.9739462Z Autotune Choices Stats: 2025-12-04T09:41:23.9739829Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6733", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9739882Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9739920Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9739970Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9740205Z triton_mm_6733 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9740439Z triton_mm_6741 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9740676Z triton_mm_6737 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9740911Z triton_mm_6735 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9741143Z triton_mm_6736 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9741373Z triton_mm_6739 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9741609Z triton_mm_6732 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9741842Z triton_mm_6740 0.0063 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9742086Z triton_mm_6744 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9742318Z triton_mm_6738 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9742445Z SingleProcess AUTOTUNE benchmarking takes 0.1976 seconds and 0.3334 seconds precompiling for 36 choices 2025-12-04T09:41:23.9742540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9742584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9742643Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9742743Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9743150Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9743188Z graph_break [] 2025-12-04T09:41:23.9743236Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9743310Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9743351Z Autotune Choices Stats: 2025-12-04T09:41:23.9743747Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6809", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.006240000016987324, "best_triton_pos": 0} 2025-12-04T09:41:23.9743791Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9743829Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9743876Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9744113Z triton_mm_6809 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9744343Z triton_mm_6808 0.0063 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9744582Z triton_mm_6805 0.0063 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9744815Z triton_mm_6813 0.0063 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9745047Z triton_mm_6807 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9745280Z triton_mm_6816 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9745512Z triton_mm_6804 0.0065 ms 95.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9745759Z triton_mm_6812 0.0066 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9745989Z triton_mm_6811 0.0067 ms 93.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9746244Z triton_mm_6815 0.0067 ms 93.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9746372Z SingleProcess AUTOTUNE benchmarking takes 0.2128 seconds and 0.4080 seconds precompiling for 36 choices 2025-12-04T09:41:23.9746414Z Autotune Choices Stats: 2025-12-04T09:41:23.9746785Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6877", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006798999849706888, "best_triton_pos": 0} 2025-12-04T09:41:23.9746828Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9746868Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9746913Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9747151Z triton_mm_6877 0.0068 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9747394Z triton_mm_6879 0.0070 ms 96.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9747629Z triton_mm_6881 0.0073 ms 92.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9747858Z triton_mm_6878 0.0082 ms 83.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9748090Z triton_mm_6884 0.0084 ms 80.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9748321Z triton_mm_6883 0.0090 ms 75.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9748553Z triton_mm_6882 0.0093 ms 73.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9748785Z triton_mm_6880 0.0096 ms 70.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9749018Z triton_mm_6885 0.0097 ms 70.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9749251Z triton_mm_6894 0.0124 ms 54.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9749389Z SingleProcess AUTOTUNE benchmarking takes 0.1966 seconds and 0.6244 seconds precompiling for 36 choices 2025-12-04T09:41:23.9749430Z Autotune Choices Stats: 2025-12-04T09:41:23.9749796Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_6957", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006120000034570694, "best_triton_pos": 0} 2025-12-04T09:41:23.9749838Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9749877Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9749942Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9750180Z triton_mm_6957 0.0061 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9750414Z triton_mm_6951 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9750650Z triton_mm_6953 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9750884Z triton_mm_6949 0.0062 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9751124Z triton_mm_6952 0.0063 ms 97.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9751357Z triton_mm_6954 0.0065 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9751587Z triton_mm_6956 0.0065 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9751820Z triton_mm_6955 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9752052Z triton_mm_6959 0.0067 ms 91.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9752286Z triton_mm_6948 0.0069 ms 89.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9752415Z SingleProcess AUTOTUNE benchmarking takes 0.2090 seconds and 0.3228 seconds precompiling for 36 choices 2025-12-04T09:41:23.9752490Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9752533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9752591Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9752696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9753092Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9753147Z graph_break [] 2025-12-04T09:41:23.9753195Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9753270Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9753311Z Autotune Choices Stats: 2025-12-04T09:41:23.9753702Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7024", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9753746Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9753784Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9753831Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9754067Z triton_mm_7024 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9754301Z triton_mm_7025 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9754536Z triton_mm_7021 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9754786Z triton_mm_7023 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9755020Z triton_mm_7027 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9755254Z triton_mm_7029 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9755491Z triton_mm_7032 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9755723Z triton_mm_7020 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9755956Z triton_mm_7028 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9756188Z triton_mm_7033 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9756318Z SingleProcess AUTOTUNE benchmarking takes 0.2062 seconds and 0.3633 seconds precompiling for 36 choices 2025-12-04T09:41:23.9756361Z Autotune Choices Stats: 2025-12-04T09:41:23.9756732Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7095", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006639999803155661, "best_triton_pos": 0} 2025-12-04T09:41:23.9756787Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9756826Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9756873Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9757108Z triton_mm_7095 0.0066 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9757363Z triton_mm_7093 0.0068 ms 97.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9757598Z triton_mm_7097 0.0072 ms 92.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9757829Z triton_mm_7094 0.0080 ms 83.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9758059Z triton_mm_7100 0.0080 ms 83.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9758290Z triton_mm_7101 0.0091 ms 73.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9758535Z triton_mm_7096 0.0091 ms 72.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9758766Z triton_mm_7099 0.0091 ms 72.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9758997Z triton_mm_7098 0.0092 ms 72.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9759231Z triton_mm_7110 0.0123 ms 54.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9759359Z SingleProcess AUTOTUNE benchmarking takes 0.1945 seconds and 0.4897 seconds precompiling for 36 choices 2025-12-04T09:41:23.9759400Z Autotune Choices Stats: 2025-12-04T09:41:23.9759768Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7173", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919000133872032, "best_triton_pos": 0} 2025-12-04T09:41:23.9759812Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9759850Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9759899Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9760138Z triton_mm_7173 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9760376Z triton_mm_7165 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9760625Z triton_mm_7167 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9760857Z triton_mm_7169 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9761112Z triton_mm_7168 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9761342Z triton_mm_7171 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9761574Z triton_mm_7170 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9761805Z triton_mm_7175 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9762048Z triton_mm_7172 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9762283Z triton_mm_7176 0.0063 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9762411Z SingleProcess AUTOTUNE benchmarking takes 0.2183 seconds and 0.3468 seconds precompiling for 36 choices 2025-12-04T09:41:23.9762486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9762528Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9762587Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9762688Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9763073Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9763112Z graph_break [] 2025-12-04T09:41:23.9763161Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9763236Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9763276Z Autotune Choices Stats: 2025-12-04T09:41:23.9763644Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7239", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9763686Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9763726Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9763773Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9764012Z triton_mm_7239 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9764274Z triton_mm_7237 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9764509Z triton_mm_7240 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9764778Z triton_mm_7241 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9765013Z triton_mm_7245 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9765247Z triton_mm_7243 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9765476Z triton_mm_7244 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9765711Z triton_mm_7248 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9765959Z triton_mm_7242 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9766193Z triton_mm_7249 0.0064 ms 92.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9766322Z SingleProcess AUTOTUNE benchmarking takes 0.1906 seconds and 0.2070 seconds precompiling for 36 choices 2025-12-04T09:41:23.9766363Z Autotune Choices Stats: 2025-12-04T09:41:23.9766736Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7311", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006320000160485506, "best_triton_pos": 0} 2025-12-04T09:41:23.9766778Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9766817Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9766862Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9767100Z triton_mm_7311 0.0063 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9767331Z triton_mm_7309 0.0066 ms 95.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9767565Z triton_mm_7313 0.0070 ms 90.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9767795Z triton_mm_7310 0.0075 ms 84.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9768039Z triton_mm_7316 0.0080 ms 78.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9768270Z triton_mm_7315 0.0090 ms 70.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9768524Z triton_mm_7312 0.0090 ms 70.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9768758Z triton_mm_7317 0.0090 ms 70.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9768989Z triton_mm_7314 0.0091 ms 69.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9769220Z triton_mm_7326 0.0120 ms 52.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9769362Z SingleProcess AUTOTUNE benchmarking takes 0.1795 seconds and 0.4671 seconds precompiling for 36 choices 2025-12-04T09:41:23.9769403Z Autotune Choices Stats: 2025-12-04T09:41:23.9769773Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7385", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4", "best_time": 0.005880000069737434, "best_triton_pos": 0} 2025-12-04T09:41:23.9769815Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9769855Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9769903Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9770140Z triton_mm_7385 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9770380Z triton_mm_7389 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9770613Z triton_mm_7381 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9770846Z triton_mm_7383 0.0059 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9771075Z triton_mm_7384 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9771309Z triton_mm_7387 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9771540Z triton_mm_7388 0.0060 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9771785Z triton_mm_7386 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9772019Z triton_mm_7392 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9772284Z triton_mm_7393 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9772413Z SingleProcess AUTOTUNE benchmarking takes 0.1833 seconds and 0.3438 seconds precompiling for 36 choices 2025-12-04T09:41:23.9772488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9772532Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9772590Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9772693Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9773102Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9773168Z graph_break [] 2025-12-04T09:41:23.9773217Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9773291Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9773332Z Autotune Choices Stats: 2025-12-04T09:41:23.9773702Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7461", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.00595899997279048, "best_triton_pos": 0} 2025-12-04T09:41:23.9773749Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9773790Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9773839Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9774080Z triton_mm_7461 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9774323Z triton_mm_7455 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9774564Z triton_mm_7457 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9774801Z triton_mm_7459 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9775039Z triton_mm_7453 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9775271Z triton_mm_7456 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9775525Z triton_mm_7460 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9775759Z triton_mm_7464 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9776023Z triton_mm_7458 0.0062 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9776260Z triton_mm_7465 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9776388Z SingleProcess AUTOTUNE benchmarking takes 0.1844 seconds and 0.2832 seconds precompiling for 36 choices 2025-12-04T09:41:23.9776431Z Autotune Choices Stats: 2025-12-04T09:41:23.9776799Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7525", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006560000125318766, "best_triton_pos": 0} 2025-12-04T09:41:23.9776856Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9776897Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9776945Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9777181Z triton_mm_7525 0.0066 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9777417Z triton_mm_7527 0.0066 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9777652Z triton_mm_7529 0.0072 ms 91.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9777885Z triton_mm_7526 0.0076 ms 86.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9778119Z triton_mm_7532 0.0081 ms 81.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9778351Z triton_mm_7528 0.0090 ms 72.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9778586Z triton_mm_7533 0.0090 ms 72.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9778820Z triton_mm_7530 0.0091 ms 72.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9779051Z triton_mm_7531 0.0092 ms 71.6% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9779296Z triton_mm_7534 0.0123 ms 53.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9779424Z SingleProcess AUTOTUNE benchmarking takes 0.1803 seconds and 0.4699 seconds precompiling for 36 choices 2025-12-04T09:41:23.9779465Z Autotune Choices Stats: 2025-12-04T09:41:23.9779853Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7599", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0061599998734891415, "best_triton_pos": 0} 2025-12-04T09:41:23.9779900Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9779943Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9779990Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9780229Z triton_mm_7599 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9780466Z triton_mm_7608 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9780717Z triton_mm_7597 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9780949Z triton_mm_7603 0.0062 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9781182Z triton_mm_7607 0.0063 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9781415Z triton_mm_7605 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9781653Z triton_mm_7601 0.0064 ms 96.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9781885Z triton_mm_7600 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9782119Z triton_mm_7609 0.0066 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9782357Z triton_mm_7596 0.0066 ms 93.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9782486Z SingleProcess AUTOTUNE benchmarking takes 0.2108 seconds and 0.3323 seconds precompiling for 36 choices 2025-12-04T09:41:23.9782562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9782605Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9782674Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9782778Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9783271Z inductor [('triton_bundler_save_kernel', 64), ('generated_module_cache_hit', 35), ('benchmarking.InductorBenchmarker.benchmark', 7), ('benchmarking.InductorBenchmarker.benchmark_gpu', 7), ('async_compile_cache_miss', 3), ('fxgraph_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9783310Z graph_break [] 2025-12-04T09:41:23.9783357Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9783435Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9783509Z Autotune Choices Stats: 2025-12-04T09:41:23.9783880Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7669", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:41:23.9783923Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9783967Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9784014Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9784253Z triton_mm_7669 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9784510Z triton_mm_7671 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9784748Z triton_mm_7673 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9784987Z triton_mm_7677 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9785219Z triton_mm_7675 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9785452Z triton_mm_7672 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9785682Z triton_mm_7676 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9785919Z triton_mm_7680 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9786152Z triton_mm_7668 0.0064 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9786383Z triton_mm_7674 0.0064 ms 93.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9786513Z SingleProcess AUTOTUNE benchmarking takes 0.1970 seconds and 0.2949 seconds precompiling for 36 choices 2025-12-04T09:41:23.9786579Z Autotune Choices Stats: 2025-12-04T09:41:23.9786948Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7743", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.0063599999994039536, "best_triton_pos": 0} 2025-12-04T09:41:23.9786988Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9787029Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9787074Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9787331Z triton_mm_7743 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9787566Z triton_mm_7741 0.0065 ms 98.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9787799Z triton_mm_7745 0.0072 ms 88.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9788030Z triton_mm_7742 0.0079 ms 80.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9788274Z triton_mm_7748 0.0080 ms 79.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9788506Z triton_mm_7744 0.0090 ms 70.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9788738Z triton_mm_7746 0.0090 ms 70.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9788967Z triton_mm_7747 0.0090 ms 70.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9789203Z triton_mm_7749 0.0090 ms 70.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9789436Z triton_mm_7758 0.0122 ms 52.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9789568Z SingleProcess AUTOTUNE benchmarking takes 0.1905 seconds and 0.4616 seconds precompiling for 36 choices 2025-12-04T09:41:23.9789608Z Autotune Choices Stats: 2025-12-04T09:41:23.9789977Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7815", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:41:23.9790020Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9790060Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9790110Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9790346Z triton_mm_7815 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9790596Z triton_mm_7813 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9790827Z triton_mm_7816 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9791080Z triton_mm_7817 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9791315Z triton_mm_7821 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9791547Z triton_mm_7819 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9791778Z triton_mm_7823 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9792020Z triton_mm_7818 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9792252Z triton_mm_7820 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9792489Z triton_mm_7824 0.0063 ms 93.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9792615Z SingleProcess AUTOTUNE benchmarking takes 0.1967 seconds and 0.3432 seconds precompiling for 36 choices 2025-12-04T09:41:23.9792691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:41:23.9792734Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:41:23.9792793Z stats [('calls_captured', 2), ('unique_graphs', 1)] 2025-12-04T09:41:23.9792893Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:41:23.9793442Z inductor [('triton_bundler_save_kernel', 400), ('benchmarking.InductorBenchmarker.benchmark_gpu', 47), ('async_compile_cache_miss', 42), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_miss', 35), ('benchmarking.InductorBenchmarker.benchmark', 11), ('fxgraph_cache_miss', 1), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:41:23.9793480Z graph_break [] 2025-12-04T09:41:23.9793531Z aten_mm_info [('aten.mm_256_256_256', 1)] 2025-12-04T09:41:23.9793604Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:41:23.9793647Z Autotune Choices Stats: 2025-12-04T09:41:23.9794015Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7888", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.006200000178068876, "best_triton_pos": 0} 2025-12-04T09:41:23.9794074Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9794114Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9794160Z dtypes: torch.float16, torch.float16 2025-12-04T09:41:23.9794396Z triton_mm_7888 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9794657Z triton_mm_7891 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9794893Z triton_mm_7893 0.0062 ms 99.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9795128Z triton_mm_7887 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9795365Z triton_mm_7896 0.0064 ms 96.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9795600Z triton_mm_7889 0.0065 ms 95.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9795844Z triton_mm_7890 0.0066 ms 94.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9796078Z triton_mm_7892 0.0066 ms 93.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9796311Z triton_mm_7885 0.0066 ms 93.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9796549Z triton_mm_7884 0.0067 ms 92.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9796678Z SingleProcess AUTOTUNE benchmarking takes 0.2108 seconds and 0.2794 seconds precompiling for 36 choices 2025-12-04T09:41:23.9796721Z Autotune Choices Stats: 2025-12-04T09:41:23.9797090Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7957", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.006440000142902136, "best_triton_pos": 0} 2025-12-04T09:41:23.9797131Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9797171Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9797216Z dtypes: torch.float32, torch.float32 2025-12-04T09:41:23.9797455Z triton_mm_7957 0.0064 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9797688Z triton_mm_7959 0.0068 ms 95.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9797935Z triton_mm_7961 0.0074 ms 87.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9798167Z triton_mm_7964 0.0082 ms 78.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9798421Z triton_mm_7958 0.0084 ms 76.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=16, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:41:23.9798657Z triton_mm_7965 0.0092 ms 70.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9798888Z triton_mm_7960 0.0094 ms 68.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9799120Z triton_mm_7962 0.0094 ms 68.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9799479Z triton_mm_7963 0.0095 ms 67.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9799711Z triton_mm_7967 0.0123 ms 52.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9799841Z SingleProcess AUTOTUNE benchmarking takes 0.1951 seconds and 0.4735 seconds precompiling for 36 choices 2025-12-04T09:41:23.9799883Z Autotune Choices Stats: 2025-12-04T09:41:23.9800250Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_8028", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1", "best_time": 0.006240000016987324, "best_triton_pos": 0} 2025-12-04T09:41:23.9800294Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:41:23.9800334Z strides: [256, 1], [256, 1] 2025-12-04T09:41:23.9800382Z dtypes: torch.bfloat16, torch.bfloat16 2025-12-04T09:41:23.9800621Z triton_mm_8028 0.0062 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=16, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=8, num_stages=2, num_warps=1 2025-12-04T09:41:23.9800854Z triton_mm_8034 0.0065 ms 95.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9801086Z triton_mm_8041 0.0068 ms 91.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9801322Z triton_mm_8029 0.0068 ms 91.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:41:23.9801554Z triton_mm_8031 0.0068 ms 91.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9801799Z triton_mm_8035 0.0068 ms 91.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9802029Z triton_mm_8032 0.0069 ms 90.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9802287Z triton_mm_8040 0.0069 ms 90.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9802521Z triton_mm_8036 0.0070 ms 89.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:41:23.9802756Z triton_mm_8037 0.0070 ms 89.2% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:41:23.9802884Z SingleProcess AUTOTUNE benchmarking takes 0.2307 seconds and 0.3384 seconds precompiling for 36 choices 2025-12-04T09:41:23.9803161Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_pattern_matcher/inductor.test_pattern_matcher-0b9817369f625712.xml - 2025-12-04T09:41:23.9803239Z =========================== short test summary info ============================ 2025-12-04T09:41:23.9803451Z FAILED [5.2916s] inductor/test_pattern_matcher.py::TestPatternMatcher::test_mixed_mm_exhaustive_dtypes - RuntimeError: Expected to find ".to(" but did not find it 2025-12-04T09:41:23.9803492Z Searched string: 2025-12-04T09:41:23.9803554Z acc = tl.zeros((BLOCK_M, BLOCK_N), dtype=ACC_TYPE) 2025-12-04T09:41:23.9803558Z 2025-12-04T09:41:23.9803614Z for k_idx in range(0, tl.cdiv(K, BLOCK_K)): 2025-12-04T09:41:23.9803617Z 2025-12-04T09:41:23.9803678Z a_k_idx_vals = offs_k[None, :] + (k_idx * BLOCK_K) 2025-12-04T09:41:23.9803735Z b_k_idx_vals = offs_k[:, None] + (k_idx * BLOCK_K) 2025-12-04T09:41:23.9803737Z 2025-12-04T09:41:23.9803781Z idx_m = offs_a_m[:, None] 2025-12-04T09:41:23.9803823Z idx_n = a_k_idx_vals 2025-12-04T09:41:23.9803870Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9803914Z a = tl.load(A + (xindex)) 2025-12-04T09:41:23.9803916Z 2025-12-04T09:41:23.9803957Z idx_m = b_k_idx_vals 2025-12-04T09:41:23.9803999Z idx_n = offs_b_n[None, :] 2025-12-04T09:41:23.9804042Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9804082Z b = tl.load(B + (xindex)) 2025-12-04T09:41:23.9804085Z 2025-12-04T09:41:23.9804087Z 2025-12-04T09:41:23.9804162Z acc += tl.dot(a, b, allow_tf32=ALLOW_TF32, out_dtype=ACC_TYPE) 2025-12-04T09:41:23.9804164Z 2025-12-04T09:41:23.9804166Z 2025-12-04T09:41:23.9804220Z # rematerialize rm and rn to save registers 2025-12-04T09:41:23.9804275Z rm = pid_m * BLOCK_M + tl.arange(0, BLOCK_M) 2025-12-04T09:41:23.9804326Z rn = pid_n * BLOCK_N + tl.arange(0, BLOCK_N) 2025-12-04T09:41:23.9804366Z idx_m = rm[:, None] 2025-12-04T09:41:23.9804405Z idx_n = rn[None, :] 2025-12-04T09:41:23.9804452Z mask = (idx_m < M) & (idx_n < N) 2025-12-04T09:41:23.9804455Z 2025-12-04T09:41:23.9804498Z # inductor generates a suffix 2025-12-04T09:41:23.9804543Z xindex = idx_n + 256*idx_m 2025-12-04T09:41:23.9804632Z tl.store(out_ptr0 + (tl.broadcast_to(xindex, [BLOCK_M, BLOCK_N])), acc, mask) 2025-12-04T09:41:23.9804673Z ''', device_str='cuda') 2025-12-04T09:41:23.9804675Z 2025-12-04T09:41:23.9804677Z 2025-12-04T09:41:23.9804738Z async_compile.wait(globals()) 2025-12-04T09:41:23.9804777Z del async_compile 2025-12-04T09:41:23.9804779Z 2025-12-04T09:41:23.9804816Z class Runner: 2025-12-04T09:41:23.9804868Z def __init__(self, partitions): 2025-12-04T09:41:23.9804916Z self.partitions = partitions 2025-12-04T09:41:23.9804918Z 2025-12-04T09:41:23.9804970Z def recursively_apply_fns(self, fns): 2025-12-04T09:41:23.9805011Z new_callables = [] 2025-12-04T09:41:23.9805067Z for fn, c in zip(fns, self.partitions): 2025-12-04T09:41:23.9805116Z new_callables.append(fn(c)) 2025-12-04T09:41:23.9805165Z self.partitions = new_callables 2025-12-04T09:41:23.9805167Z 2025-12-04T09:41:23.9805237Z def call(self, args): 2025-12-04T09:41:23.9805279Z arg0_1, arg1_1 = args 2025-12-04T09:41:23.9805318Z args.clear() 2025-12-04T09:41:23.9805376Z assert_size_stride(arg0_1, (256, 256), (256, 1)) 2025-12-04T09:41:23.9805436Z assert_size_stride(arg1_1, (256, 256), (256, 1)) 2025-12-04T09:41:23.9805485Z with torch.cuda._DeviceGuard(0): 2025-12-04T09:41:23.9805529Z torch.cuda.set_device(0) 2025-12-04T09:41:23.9805602Z buf0 = empty_strided_cuda((256, 256), (256, 1), torch.bfloat16) 2025-12-04T09:41:23.9805696Z # Topologically Sorted Source Nodes: [to], Original ATen: [aten._to_copy] 2025-12-04T09:41:23.9805740Z stream0 = get_raw_stream(0) 2025-12-04T09:41:23.9805820Z triton_poi_fused__to_copy_0.run(arg0_1, buf0, 65536, stream=stream0) 2025-12-04T09:41:23.9805859Z del arg0_1 2025-12-04T09:41:23.9805943Z buf1 = empty_strided_cuda((256, 256), (256, 1), torch.bfloat16) 2025-12-04T09:41:23.9806048Z # Topologically Sorted Source Nodes: [to, mm], Original ATen: [aten._to_copy, aten.mm] 2025-12-04T09:41:23.9806093Z stream0 = get_raw_stream(0) 2025-12-04T09:41:23.9806186Z triton_tem_fused__to_copy_mm_1.run(arg1_1, buf0, buf1, 256, 1, 1, stream=stream0) 2025-12-04T09:41:23.9806226Z del arg1_1 2025-12-04T09:41:23.9806263Z del buf0 2025-12-04T09:41:23.9806302Z return (buf1, ) 2025-12-04T09:41:23.9806305Z 2025-12-04T09:41:23.9806350Z runner = Runner(partitions=[]) 2025-12-04T09:41:23.9806390Z call = runner.call 2025-12-04T09:41:23.9806463Z recursively_apply_fns = runner.recursively_apply_fns 2025-12-04T09:41:23.9806465Z 2025-12-04T09:41:23.9806467Z 2025-12-04T09:41:23.9806529Z def benchmark_compiled_module(times=10, repeat=10): 2025-12-04T09:41:23.9806587Z from torch._dynamo.testing import rand_strided 2025-12-04T09:41:23.9806654Z from torch._inductor.utils import print_performance 2025-12-04T09:41:23.9806741Z arg0_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.int8) 2025-12-04T09:41:23.9806826Z arg1_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.bfloat16) 2025-12-04T09:41:23.9806871Z fn = lambda: call([arg0_1, arg1_1]) 2025-12-04T09:41:23.9806943Z return print_performance(fn, times=times, repeat=repeat) 2025-12-04T09:41:23.9806946Z 2025-12-04T09:41:23.9806948Z 2025-12-04T09:41:23.9806991Z if __name__ == "__main__": 2025-12-04T09:41:23.9807076Z from torch._inductor.wrapper_benchmark import compiled_module_main 2025-12-04T09:41:23.9807144Z compiled_module_main('None', benchmark_compiled_module) 2025-12-04T09:41:23.9807184Z From CHECK: .to( 2025-12-04T09:41:23.9807186Z 2025-12-04T09:41:23.9807187Z 2025-12-04T09:41:23.9807264Z To execute this test, run the following from the base repo dir: 2025-12-04T09:41:23.9807422Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_pattern_matcher.py TestPatternMatcher.test_mixed_mm_exhaustive_dtypes 2025-12-04T09:41:23.9807425Z 2025-12-04T09:41:23.9807517Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:41:23.9807593Z ============ 1 failed, 199 passed, 50 skipped in 555.31s (0:09:15) ============= 2025-12-04T09:41:23.9807595Z 2025-12-04T09:41:23.9807774Z FINISHED PRINTING LOG FILE of inductor/test_pattern_matcher 1/1 (test/test-reports/inductor.test_pattern_matcher_1.1_cd2f695dc21e99ed_.log) 2025-12-04T09:41:23.9807789Z 2025-12-04T09:41:23.9807909Z Finished inductor/test_pattern_matcher 1/1 ... [2025-12-04 09:41:23.889220][2222455.44891217], took 9.46min 2025-12-04T09:41:23.9808150Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:41:23.9854337Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:41:23.9883434Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:41:23.9884695Z Uploading artifacts took 0.00 seconds 2025-12-04T09:41:23.9884781Z inductor/test_pattern_matcher 1/1 failed! 2025-12-04T09:41:23.9884923Z Running dynamo/test_dynamic_shapes 1/2 ... [2025-12-04 09:41:23.986317][2222455.546017628] 2025-12-04T09:41:23.9884988Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:41:23.9885413Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_dynamic_shapes.py', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:41:23.986582] 2025-12-04T09:41:33.2175775Z 2025-12-04T09:41:33.2176498Z dynamo/test_dynamic_shapes 1/2 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_dynamic_shapes_1.2_094de0920dfa87c5_.log 2025-12-04T09:41:33.2176824Z Running 0 items in this shard: 2025-12-04T09:41:33.2177399Z 2025-12-04T09:41:33.2177538Z Finished dynamo/test_dynamic_shapes 1/2 ... [2025-12-04 09:41:33.215334][2222464.775036734], took 0.15min 2025-12-04T09:41:33.2177952Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:41:33.3108219Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:41:33.3122173Z Running inductor/test_group_batch_fusion 1/1 ... [2025-12-04 09:41:33.312077][2222464.871776147] 2025-12-04T09:41:33.3123321Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:41:33.3124424Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_group_batch_fusion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:41:33.312335] 2025-12-04T09:41:39.2364447Z 2025-12-04T09:41:39.2366001Z inductor/test_group_batch_fusion 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_group_batch_fusion_1.1_3bf31c0340418015_.log 2025-12-04T09:41:39.2366344Z Running 0 items in this shard: 2025-12-04T09:41:39.2366424Z 2025-12-04T09:41:39.2366563Z Finished inductor/test_group_batch_fusion 1/1 ... [2025-12-04 09:41:39.229671][2222470.789374198], took 0.10min 2025-12-04T09:41:39.2366983Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:41:39.3298402Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:41:39.3310636Z Running dynamo/test_logging 1/1 ... [2025-12-04 09:41:39.330866][2222470.890566728] 2025-12-04T09:41:39.3310887Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:41:39.3313775Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_logging.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:41:39.331209] 2025-12-04T09:41:45.4801112Z 2025-12-04T09:41:45.4801845Z dynamo/test_logging 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_logging_1.1_388eb2c91a48968b_.log 2025-12-04T09:41:45.4802506Z Running 0 items in this shard: 2025-12-04T09:41:45.4802587Z 2025-12-04T09:41:45.4802702Z Finished dynamo/test_logging 1/1 ... [2025-12-04 09:41:45.479886][2222477.039589615], took 0.10min 2025-12-04T09:41:45.4804370Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:41:45.5767699Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:41:45.5782832Z Running inductor/test_cuda_repro 1/1 ... [2025-12-04 09:41:45.578160][2222477.137860352] 2025-12-04T09:41:45.5783845Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:41:45.5786657Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_cuda_repro.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:41:45.578468] 2025-12-04T09:45:51.5971125Z 2025-12-04T09:45:51.5983591Z PRINTING LOG FILE of inductor/test_cuda_repro 1/1 (test/test-reports/inductor.test_cuda_repro_1.1_d9bb6d59b17d8538_.log) 2025-12-04T09:45:51.5984686Z Test results will be stored in test-reports/python-pytest/inductor.test_cuda_repro/inductor.test_cuda_repro-b0344b87bda3722c.xml 2025-12-04T09:45:51.5985383Z ============================= test session starts ============================== 2025-12-04T09:45:51.5985922Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:45:51.5991689Z cachedir: .pytest_cache 2025-12-04T09:45:51.5992178Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:45:51.5992642Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:45:51.5992882Z configfile: pytest.ini 2025-12-04T09:45:51.5993387Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:45:51.5993846Z collecting ... collected 96 items 2025-12-04T09:45:51.5994104Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:45:51.6025670Z Running 200 items in this shard: test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent, test/inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.6049799Z 2025-12-04T09:45:51.6049942Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [3.2807s] [ 0%] 2025-12-04T09:45:51.6050326Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.1813s] [ 1%] 2025-12-04T09:45:51.6050629Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.3171s] [ 1%] 2025-12-04T09:45:51.6050914Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.2162s] [ 2%] 2025-12-04T09:45:51.6051241Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7413s] [ 2%] 2025-12-04T09:45:51.6051568Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7635s] [ 2%] 2025-12-04T09:45:51.6051887Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.0285s] [ 2%] 2025-12-04T09:45:51.6052215Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7783s] [ 2%] 2025-12-04T09:45:51.6052560Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7295s] [ 2%] 2025-12-04T09:45:51.6052879Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5841s] [ 2%] 2025-12-04T09:45:51.6053271Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5626s] [ 2%] 2025-12-04T09:45:51.6053601Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.8330s] [ 2%] 2025-12-04T09:45:51.6053928Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5557s] [ 2%] 2025-12-04T09:45:51.6054271Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5767s] [ 2%] 2025-12-04T09:45:51.6054595Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5726s] [ 2%] 2025-12-04T09:45:51.6054920Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.9067s] [ 2%] 2025-12-04T09:45:51.6055237Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5638s] [ 2%] 2025-12-04T09:45:51.6055552Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5751s] [ 2%] 2025-12-04T09:45:51.6055872Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5655s] [ 2%] 2025-12-04T09:45:51.6056192Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5825s] [ 2%] 2025-12-04T09:45:51.6056510Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.1467s] [ 2%] 2025-12-04T09:45:51.6056826Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5603s] [ 2%] 2025-12-04T09:45:51.6057146Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5970s] [ 2%] 2025-12-04T09:45:51.6057465Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5563s] [ 2%] 2025-12-04T09:45:51.6057778Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5886s] [ 2%] 2025-12-04T09:45:51.6058121Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5768s] [ 2%] 2025-12-04T09:45:51.6058433Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.9619s] [ 2%] 2025-12-04T09:45:51.6058750Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5898s] [ 2%] 2025-12-04T09:45:51.6059063Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6061s] [ 2%] 2025-12-04T09:45:51.6059386Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5938s] [ 2%] 2025-12-04T09:45:51.6059756Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5621s] [ 2%] 2025-12-04T09:45:51.6060113Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.0289s] [ 2%] 2025-12-04T09:45:51.6060433Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6159s] [ 2%] 2025-12-04T09:45:51.6060748Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6005s] [ 2%] 2025-12-04T09:45:51.6061062Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5778s] [ 2%] 2025-12-04T09:45:51.6061378Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5897s] [ 2%] 2025-12-04T09:45:51.6061720Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5584s] [ 2%] 2025-12-04T09:45:51.6062067Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.1813s] [ 2%] 2025-12-04T09:45:51.6062383Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5776s] [ 2%] 2025-12-04T09:45:51.6062700Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5944s] [ 2%] 2025-12-04T09:45:51.6063051Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5680s] [ 2%] 2025-12-04T09:45:51.6063366Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5882s] [ 2%] 2025-12-04T09:45:51.6063683Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5862s] [ 2%] 2025-12-04T09:45:51.6064002Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.1633s] [ 2%] 2025-12-04T09:45:51.6064319Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6786s] [ 2%] 2025-12-04T09:45:51.6064644Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7157s] [ 2%] 2025-12-04T09:45:51.6064963Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6680s] [ 2%] 2025-12-04T09:45:51.6065285Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.7425s] [ 2%] 2025-12-04T09:45:51.6065608Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6840s] [ 2%] 2025-12-04T09:45:51.6065928Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [2.1408s] [ 2%] 2025-12-04T09:45:51.6066243Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.5893s] [ 2%] 2025-12-04T09:45:51.6066568Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6550s] [ 2%] 2025-12-04T09:45:51.6066889Z inductor/test_cuda_repro.py::CudaReproTests::test_emulate_precision_casts_mean_ratio_chain PASSED [1.6167s] [ 2%] 2025-12-04T09:45:51.6067219Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8778s] [ 2%] 2025-12-04T09:45:51.6067601Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.5206s] [ 2%] 2025-12-04T09:45:51.6067945Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8443s] [ 2%] 2025-12-04T09:45:51.6068293Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7981s] [ 2%] 2025-12-04T09:45:51.6068636Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [5.4313s] [ 2%] 2025-12-04T09:45:51.6069042Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8298s] [ 2%] 2025-12-04T09:45:51.6069382Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8259s] [ 2%] 2025-12-04T09:45:51.6069738Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.4375s] [ 2%] 2025-12-04T09:45:51.6070082Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.6453s] [ 2%] 2025-12-04T09:45:51.6070415Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.1509s] [ 2%] 2025-12-04T09:45:51.6070753Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.6576s] [ 2%] 2025-12-04T09:45:51.6071109Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.4417s] [ 2%] 2025-12-04T09:45:51.6071451Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7880s] [ 2%] 2025-12-04T09:45:51.6071827Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.6329s] [ 2%] 2025-12-04T09:45:51.6072181Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.6487s] [ 2%] 2025-12-04T09:45:51.6072516Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8190s] [ 2%] 2025-12-04T09:45:51.6072860Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.6503s] [ 2%] 2025-12-04T09:45:51.6073237Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7971s] [ 2%] 2025-12-04T09:45:51.6073596Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.5821s] [ 2%] 2025-12-04T09:45:51.6073935Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.6104s] [ 2%] 2025-12-04T09:45:51.6074269Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7781s] [ 2%] 2025-12-04T09:45:51.6074608Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.7009s] [ 2%] 2025-12-04T09:45:51.6074939Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.5635s] [ 2%] 2025-12-04T09:45:51.6075283Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7846s] [ 2%] 2025-12-04T09:45:51.6075626Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7655s] [ 2%] 2025-12-04T09:45:51.6075958Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.4861s] [ 2%] 2025-12-04T09:45:51.6076287Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7929s] [ 2%] 2025-12-04T09:45:51.6076645Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7875s] [ 2%] 2025-12-04T09:45:51.6076969Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.5761s] [ 2%] 2025-12-04T09:45:51.6077296Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.8216s] [ 2%] 2025-12-04T09:45:51.6077622Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7679s] [ 2%] 2025-12-04T09:45:51.6077947Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.5569s] [ 2%] 2025-12-04T09:45:51.6078317Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7854s] [ 2%] 2025-12-04T09:45:51.6078646Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.7819s] [ 2%] 2025-12-04T09:45:51.6078974Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.5691s] [ 2%] 2025-12-04T09:45:51.6079301Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7885s] [ 2%] 2025-12-04T09:45:51.6079626Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7838s] [ 2%] 2025-12-04T09:45:51.6079951Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.6151s] [ 2%] 2025-12-04T09:45:51.6080303Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7815s] [ 2%] 2025-12-04T09:45:51.6080628Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7683s] [ 2%] 2025-12-04T09:45:51.6080962Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.9974s] [ 2%] 2025-12-04T09:45:51.6081286Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [2.8393s] [ 2%] 2025-12-04T09:45:51.6081614Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7960s] [ 2%] 2025-12-04T09:45:51.6081938Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [3.5544s] [ 2%] 2025-12-04T09:45:51.6082263Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7584s] [ 2%] 2025-12-04T09:45:51.6082591Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7773s] [ 2%] 2025-12-04T09:45:51.6082915Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [4.6979s] [ 2%] 2025-12-04T09:45:51.6083373Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7819s] [ 2%] 2025-12-04T09:45:51.6083742Z inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile FAILED [1.7742s] [ 2%] 2025-12-04T09:45:51.6084048Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1633s] [ 2%] 2025-12-04T09:45:51.6084332Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1447s] [ 2%] 2025-12-04T09:45:51.6084626Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1454s] [ 2%] 2025-12-04T09:45:51.6084925Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1441s] [ 2%] 2025-12-04T09:45:51.6085198Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1450s] [ 2%] 2025-12-04T09:45:51.6085471Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1442s] [ 2%] 2025-12-04T09:45:51.6085741Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1491s] [ 2%] 2025-12-04T09:45:51.6086032Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1450s] [ 2%] 2025-12-04T09:45:51.6086302Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1454s] [ 2%] 2025-12-04T09:45:51.6086562Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1473s] [ 2%] 2025-12-04T09:45:51.6086817Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1452s] [ 2%] 2025-12-04T09:45:51.6087080Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1457s] [ 2%] 2025-12-04T09:45:51.6087374Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1450s] [ 2%] 2025-12-04T09:45:51.6087632Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1472s] [ 2%] 2025-12-04T09:45:51.6087886Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1426s] [ 2%] 2025-12-04T09:45:51.6088145Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1452s] [ 2%] 2025-12-04T09:45:51.6088400Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1485s] [ 2%] 2025-12-04T09:45:51.6088660Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1468s] [ 2%] 2025-12-04T09:45:51.6088914Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1460s] [ 2%] 2025-12-04T09:45:51.6089168Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1494s] [ 2%] 2025-12-04T09:45:51.6089472Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1443s] [ 2%] 2025-12-04T09:45:51.6089762Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1439s] [ 2%] 2025-12-04T09:45:51.6090044Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1407s] [ 2%] 2025-12-04T09:45:51.6090323Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1423s] [ 2%] 2025-12-04T09:45:51.6090579Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1433s] [ 2%] 2025-12-04T09:45:51.6090838Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1429s] [ 2%] 2025-12-04T09:45:51.6091094Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1493s] [ 2%] 2025-12-04T09:45:51.6091350Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1467s] [ 2%] 2025-12-04T09:45:51.6091633Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1446s] [ 2%] 2025-12-04T09:45:51.6091892Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1430s] [ 2%] 2025-12-04T09:45:51.6092150Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1425s] [ 2%] 2025-12-04T09:45:51.6092408Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1417s] [ 2%] 2025-12-04T09:45:51.6092671Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1416s] [ 2%] 2025-12-04T09:45:51.6092983Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [1.4032s] [ 2%] 2025-12-04T09:45:51.6093251Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1461s] [ 2%] 2025-12-04T09:45:51.6093519Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1605s] [ 2%] 2025-12-04T09:45:51.6093781Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1457s] [ 2%] 2025-12-04T09:45:51.6094038Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1529s] [ 2%] 2025-12-04T09:45:51.6094298Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1516s] [ 2%] 2025-12-04T09:45:51.6094553Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1498s] [ 2%] 2025-12-04T09:45:51.6094831Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1553s] [ 2%] 2025-12-04T09:45:51.6095129Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1490s] [ 2%] 2025-12-04T09:45:51.6095395Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1499s] [ 2%] 2025-12-04T09:45:51.6095653Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1490s] [ 2%] 2025-12-04T09:45:51.6095910Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1591s] [ 2%] 2025-12-04T09:45:51.6096201Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1555s] [ 2%] 2025-12-04T09:45:51.6096471Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1474s] [ 2%] 2025-12-04T09:45:51.6096738Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1461s] [ 2%] 2025-12-04T09:45:51.6096996Z inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load FAILED [0.1498s] [ 2%] 2025-12-04T09:45:51.6097276Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0778s] [ 2%] 2025-12-04T09:45:51.6097576Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0786s] [ 2%] 2025-12-04T09:45:51.6097895Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0763s] [ 2%] 2025-12-04T09:45:51.6098189Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0787s] [ 2%] 2025-12-04T09:45:51.6098504Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0811s] [ 2%] 2025-12-04T09:45:51.6098798Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0781s] [ 2%] 2025-12-04T09:45:51.6099115Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0758s] [ 2%] 2025-12-04T09:45:51.6099408Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0791s] [ 2%] 2025-12-04T09:45:51.6099706Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0776s] [ 2%] 2025-12-04T09:45:51.6100000Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0761s] [ 2%] 2025-12-04T09:45:51.6100311Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0779s] [ 2%] 2025-12-04T09:45:51.6100620Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0781s] [ 2%] 2025-12-04T09:45:51.6100932Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0755s] [ 2%] 2025-12-04T09:45:51.6101237Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0786s] [ 2%] 2025-12-04T09:45:51.6101545Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0769s] [ 2%] 2025-12-04T09:45:51.6101849Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0775s] [ 2%] 2025-12-04T09:45:51.6102151Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0782s] [ 2%] 2025-12-04T09:45:51.6102453Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0825s] [ 2%] 2025-12-04T09:45:51.6102765Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0772s] [ 2%] 2025-12-04T09:45:51.6103137Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0771s] [ 2%] 2025-12-04T09:45:51.6103441Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0810s] [ 2%] 2025-12-04T09:45:51.6103777Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0779s] [ 2%] 2025-12-04T09:45:51.6104078Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0797s] [ 2%] 2025-12-04T09:45:51.6104377Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0845s] [ 2%] 2025-12-04T09:45:51.6104678Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0785s] [ 2%] 2025-12-04T09:45:51.6104982Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0779s] [ 2%] 2025-12-04T09:45:51.6105314Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0788s] [ 2%] 2025-12-04T09:45:51.6105612Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0779s] [ 2%] 2025-12-04T09:45:51.6105915Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0794s] [ 2%] 2025-12-04T09:45:51.6106214Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0792s] [ 2%] 2025-12-04T09:45:51.6106515Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0805s] [ 2%] 2025-12-04T09:45:51.6106813Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0773s] [ 2%] 2025-12-04T09:45:51.6107112Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0804s] [ 2%] 2025-12-04T09:45:51.6107443Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0771s] [ 2%] 2025-12-04T09:45:51.6107743Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0809s] [ 2%] 2025-12-04T09:45:51.6108040Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0793s] [ 2%] 2025-12-04T09:45:51.6108342Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0812s] [ 2%] 2025-12-04T09:45:51.6108642Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0834s] [ 2%] 2025-12-04T09:45:51.6108939Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0841s] [ 2%] 2025-12-04T09:45:51.6109242Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0772s] [ 2%] 2025-12-04T09:45:51.6109546Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0779s] [ 2%] 2025-12-04T09:45:51.6109845Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0811s] [ 2%] 2025-12-04T09:45:51.6110147Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0831s] [ 2%] 2025-12-04T09:45:51.6110455Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0784s] [ 2%] 2025-12-04T09:45:51.6110751Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0760s] [ 2%] 2025-12-04T09:45:51.6111041Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0798s] [ 2%] 2025-12-04T09:45:51.6111331Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0784s] [ 2%] 2025-12-04T09:45:51.6111623Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0785s] [ 2%] 2025-12-04T09:45:51.6111923Z inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent FAILED [0.0861s] [ 2%] 2025-12-04T09:45:51.6112090Z 2025-12-04T09:45:51.6112149Z =================================== FAILURES =================================== 2025-12-04T09:45:51.6112339Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6112540Z Traceback (most recent call last): 2025-12-04T09:45:51.6112801Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6113153Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6113385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6113622Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6113765Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6114041Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6114325Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6114489Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6114585Z 2025-12-04T09:45:51.6114642Z Mismatched elements: 6283264 / 44040192 (14.3%) 2025-12-04T09:45:51.6114821Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6115035Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6115160Z 2025-12-04T09:45:51.6115206Z The failure occurred for item [0] 2025-12-04T09:45:51.6115288Z 2025-12-04T09:45:51.6115362Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6115643Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6115875Z 2025-12-04T09:45:51.6115970Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6116174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6116337Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6116472Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6116672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6117048Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6117352Z graph_break [] 2025-12-04T09:45:51.6117492Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.6117654Z Unexpected success 2025-12-04T09:45:51.6117790Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6117948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6118078Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.6118270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6118667Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6119002Z graph_break [] 2025-12-04T09:45:51.6119148Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.6119331Z Traceback (most recent call last): 2025-12-04T09:45:51.6119567Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.6119818Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.6120078Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.6120341Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.6120536Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.6120760Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.6120961Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.6121158Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.6121301Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.6121391Z 2025-12-04T09:45:51.6121464Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6121725Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.6121919Z 2025-12-04T09:45:51.6122039Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6122238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6122398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6122528Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.6122723Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6123107Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6123376Z graph_break [] 2025-12-04T09:45:51.6123524Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6123699Z Traceback (most recent call last): 2025-12-04T09:45:51.6123948Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6124233Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6124451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6124687Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6124826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6125076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6125346Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6125509Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6125596Z 2025-12-04T09:45:51.6125652Z Mismatched elements: 37748736 / 44040192 (85.7%) 2025-12-04T09:45:51.6125831Z Greatest absolute difference: nan at index (0, 8, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6126047Z Greatest relative difference: nan at index (0, 8, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6126173Z 2025-12-04T09:45:51.6126221Z The failure occurred for item [0] 2025-12-04T09:45:51.6126297Z 2025-12-04T09:45:51.6126371Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6126648Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6126857Z 2025-12-04T09:45:51.6126946Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6127141Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6127294Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6127427Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6127620Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6127989Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6128287Z graph_break [] 2025-12-04T09:45:51.6128417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6128588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6128721Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6128915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6129278Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6129576Z graph_break [] 2025-12-04T09:45:51.6129727Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6129909Z Traceback (most recent call last): 2025-12-04T09:45:51.6130190Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6130442Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6130663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6130897Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6131042Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6131282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6131549Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6131710Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6131799Z 2025-12-04T09:45:51.6131856Z Mismatched elements: 6283264 / 44040192 (14.3%) 2025-12-04T09:45:51.6132054Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6132268Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6132392Z 2025-12-04T09:45:51.6132441Z The failure occurred for item [0] 2025-12-04T09:45:51.6132520Z 2025-12-04T09:45:51.6132598Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6132876Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6133136Z 2025-12-04T09:45:51.6133226Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6133423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6133579Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6133714Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6133909Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6134273Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6134576Z graph_break [] 2025-12-04T09:45:51.6134707Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6134861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6134992Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6135184Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6135548Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6135850Z graph_break [] 2025-12-04T09:45:51.6135982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6136141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6136270Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6136461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6136851Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6137150Z graph_break [] 2025-12-04T09:45:51.6137299Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6137477Z Traceback (most recent call last): 2025-12-04T09:45:51.6137728Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6137982Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6138243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6138479Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6138619Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6138861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6139129Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6139291Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6139379Z 2025-12-04T09:45:51.6139437Z Mismatched elements: 6291456 / 44040192 (14.3%) 2025-12-04T09:45:51.6139617Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6139830Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6139969Z 2025-12-04T09:45:51.6140022Z The failure occurred for item [0] 2025-12-04T09:45:51.6140099Z 2025-12-04T09:45:51.6140175Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6140453Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6140661Z 2025-12-04T09:45:51.6140748Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6140945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6141102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6141237Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6141431Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6141794Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6142095Z graph_break [] 2025-12-04T09:45:51.6142228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6142382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6142513Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6142703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6143142Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6143439Z graph_break [] 2025-12-04T09:45:51.6143566Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6143721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6143854Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6144045Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6144404Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6144723Z graph_break [] 2025-12-04T09:45:51.6144854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6145010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6145139Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6145328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6145719Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6146019Z graph_break [] 2025-12-04T09:45:51.6146168Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6146348Z Traceback (most recent call last): 2025-12-04T09:45:51.6146596Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6146849Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6147068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6147315Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6147457Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6147697Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6147990Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6204135Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6204261Z 2025-12-04T09:45:51.6204320Z Mismatched elements: 22020096 / 44040192 (50.0%) 2025-12-04T09:45:51.6204506Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6204728Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6204858Z 2025-12-04T09:45:51.6204905Z The failure occurred for item [0] 2025-12-04T09:45:51.6204986Z 2025-12-04T09:45:51.6205062Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6205348Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6205558Z 2025-12-04T09:45:51.6205649Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6205859Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6206021Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6206154Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6206349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6206722Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6207023Z graph_break [] 2025-12-04T09:45:51.6207156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6207310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6207439Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6207632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6208003Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6208300Z graph_break [] 2025-12-04T09:45:51.6208429Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6208708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6208836Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6209026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6209386Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6209685Z graph_break [] 2025-12-04T09:45:51.6209814Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6210006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6210135Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6210325Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6210684Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6210981Z graph_break [] 2025-12-04T09:45:51.6211107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6211261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6211388Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6211579Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6211956Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6212253Z graph_break [] 2025-12-04T09:45:51.6212401Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6212584Z Traceback (most recent call last): 2025-12-04T09:45:51.6212843Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6213143Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6213372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6213608Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6213747Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6213995Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6214265Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6214428Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6214516Z 2025-12-04T09:45:51.6214569Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6214749Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6214964Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6215090Z 2025-12-04T09:45:51.6215138Z The failure occurred for item [0] 2025-12-04T09:45:51.6215214Z 2025-12-04T09:45:51.6215288Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6215566Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6215779Z 2025-12-04T09:45:51.6215868Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6216069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6216222Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6216353Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6216565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6216929Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6217225Z graph_break [] 2025-12-04T09:45:51.6217354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6217506Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6217634Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6217861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6218223Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6218527Z graph_break [] 2025-12-04T09:45:51.6218655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6218807Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6218935Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6219125Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6219485Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6219823Z graph_break [] 2025-12-04T09:45:51.6219956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6220109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6220235Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6220424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6220786Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6221084Z graph_break [] 2025-12-04T09:45:51.6221210Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6221363Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6221492Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6221683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6222046Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6222348Z graph_break [] 2025-12-04T09:45:51.6222477Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6222630Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6222757Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6222992Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6223406Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6223764Z graph_break [] 2025-12-04T09:45:51.6223912Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6224090Z Traceback (most recent call last): 2025-12-04T09:45:51.6224341Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6224614Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6224834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6225066Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6225208Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6225447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6225711Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6225870Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6225990Z 2025-12-04T09:45:51.6226041Z Mismatched elements: 56832 / 44040192 (0.1%) 2025-12-04T09:45:51.6226214Z Greatest absolute difference: nan at index (0, 0, 20, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6226429Z Greatest relative difference: nan at index (0, 0, 20, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6226557Z 2025-12-04T09:45:51.6226602Z The failure occurred for item [0] 2025-12-04T09:45:51.6226682Z 2025-12-04T09:45:51.6226754Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6227029Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6227233Z 2025-12-04T09:45:51.6227319Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6227515Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6227703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6227837Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6228030Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6228396Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6228698Z graph_break [] 2025-12-04T09:45:51.6228826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6228979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6229107Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6229299Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6229659Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6229957Z graph_break [] 2025-12-04T09:45:51.6230084Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6230238Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6230366Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6230553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6230911Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6231206Z graph_break [] 2025-12-04T09:45:51.6231332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6231486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6231614Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6231805Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6232166Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6232477Z graph_break [] 2025-12-04T09:45:51.6232603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6232757Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6232884Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6233113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6233509Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6233809Z graph_break [] 2025-12-04T09:45:51.6233935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6234088Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6234218Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6234408Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6234816Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6235168Z graph_break [] 2025-12-04T09:45:51.6235295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6235468Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6235599Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6235788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6236147Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6236448Z graph_break [] 2025-12-04T09:45:51.6236595Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6236773Z Traceback (most recent call last): 2025-12-04T09:45:51.6237022Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6237275Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6237495Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6237732Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6237871Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6238111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6238377Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6238537Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6238626Z 2025-12-04T09:45:51.6238680Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6238860Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6239073Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6239199Z 2025-12-04T09:45:51.6239245Z The failure occurred for item [0] 2025-12-04T09:45:51.6239325Z 2025-12-04T09:45:51.6239398Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6239676Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6239883Z 2025-12-04T09:45:51.6239969Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6240191Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6240344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6240477Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6240683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6241050Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6241364Z graph_break [] 2025-12-04T09:45:51.6241522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6241686Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6241822Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6242020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6242393Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6242701Z graph_break [] 2025-12-04T09:45:51.6242832Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6243041Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6243178Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6243377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6243773Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6244083Z graph_break [] 2025-12-04T09:45:51.6244222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6244383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6244514Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6244711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6245083Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6245390Z graph_break [] 2025-12-04T09:45:51.6245532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6245694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6245835Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6246029Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6246404Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6246711Z graph_break [] 2025-12-04T09:45:51.6246849Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6247010Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6247145Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6247341Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6247762Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6248109Z graph_break [] 2025-12-04T09:45:51.6248269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6248421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6248549Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6248741Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6249100Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6249396Z graph_break [] 2025-12-04T09:45:51.6249573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6249726Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6249853Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6250044Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6250411Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6250710Z graph_break [] 2025-12-04T09:45:51.6250862Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6251045Z Traceback (most recent call last): 2025-12-04T09:45:51.6251302Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6251573Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6251802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6252040Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6252185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6252433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6252705Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6252869Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6253007Z 2025-12-04T09:45:51.6253060Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6253236Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6253452Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6253580Z 2025-12-04T09:45:51.6253628Z The failure occurred for item [0] 2025-12-04T09:45:51.6253708Z 2025-12-04T09:45:51.6253783Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6254063Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6254273Z 2025-12-04T09:45:51.6254365Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6254564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6254721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6254850Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6255041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6255407Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6255715Z graph_break [] 2025-12-04T09:45:51.6255847Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6256004Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6256137Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6256362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6256729Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6257028Z graph_break [] 2025-12-04T09:45:51.6257160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6257318Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6257452Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6257675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6258035Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6258337Z graph_break [] 2025-12-04T09:45:51.6258464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6258616Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6258744Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6258933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6259296Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6259618Z graph_break [] 2025-12-04T09:45:51.6259750Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6259913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6260047Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6260243Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6260613Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6260915Z graph_break [] 2025-12-04T09:45:51.6261041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6261193Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6261324Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6261529Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6261941Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6262293Z graph_break [] 2025-12-04T09:45:51.6262425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6262584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6262717Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6262908Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6263313Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6263617Z graph_break [] 2025-12-04T09:45:51.6263748Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6263904Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6264037Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6264254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6264615Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6264912Z graph_break [] 2025-12-04T09:45:51.6265039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6265201Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6265335Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6265558Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6265965Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6266318Z graph_break [] 2025-12-04T09:45:51.6266466Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6266643Z Traceback (most recent call last): 2025-12-04T09:45:51.6266894Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6267153Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6267377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6267633Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6267777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6268023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6268297Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6268461Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6268552Z 2025-12-04T09:45:51.6268602Z Mismatched elements: 2048 / 43739136 (0.0%) 2025-12-04T09:45:51.6268783Z Greatest absolute difference: nan at index (0, 24, 1760, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6269008Z Greatest relative difference: nan at index (0, 24, 1760, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6269138Z 2025-12-04T09:45:51.6269185Z The failure occurred for item [0] 2025-12-04T09:45:51.6269266Z 2025-12-04T09:45:51.6269340Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6269627Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6269835Z 2025-12-04T09:45:51.6269925Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6270128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6270289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6270425Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6270621Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6270988Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6271289Z graph_break [] 2025-12-04T09:45:51.6271423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6271580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6271712Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6271906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6272284Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6272586Z graph_break [] 2025-12-04T09:45:51.6272717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6272874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6273046Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6273239Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6273642Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6273943Z graph_break [] 2025-12-04T09:45:51.6274076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6274235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6274367Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6274559Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6274925Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6275226Z graph_break [] 2025-12-04T09:45:51.6275357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6275538Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6275672Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6275864Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6276226Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6276527Z graph_break [] 2025-12-04T09:45:51.6276660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6276815Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6276945Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6277136Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6277557Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6277910Z graph_break [] 2025-12-04T09:45:51.6278047Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6278205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6278344Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6278540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6278907Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6279212Z graph_break [] 2025-12-04T09:45:51.6279350Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6279511Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6279646Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6279844Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6280239Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6280544Z graph_break [] 2025-12-04T09:45:51.6280680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6280841Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6280981Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6281180Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6281634Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6281992Z graph_break [] 2025-12-04T09:45:51.6282123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6282279Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6282413Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6282607Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6283068Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6283436Z graph_break [] 2025-12-04T09:45:51.6283594Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6283778Z Traceback (most recent call last): 2025-12-04T09:45:51.6284034Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6284294Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6284520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6284759Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6284907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6285152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6285429Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6285597Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6285689Z 2025-12-04T09:45:51.6285748Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6285934Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6286159Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6286288Z 2025-12-04T09:45:51.6286342Z The failure occurred for item [0] 2025-12-04T09:45:51.6286424Z 2025-12-04T09:45:51.6286506Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6286789Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6286997Z 2025-12-04T09:45:51.6287091Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6287295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6287461Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6287597Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6287795Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6288163Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6288495Z graph_break [] 2025-12-04T09:45:51.6288631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6288793Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6288928Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6289124Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6289524Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6289828Z graph_break [] 2025-12-04T09:45:51.6289960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6290121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6290254Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6290449Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6290810Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6291117Z graph_break [] 2025-12-04T09:45:51.6291252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6291412Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6291563Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6291768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6292135Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6292440Z graph_break [] 2025-12-04T09:45:51.6292573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6292732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6292868Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6293106Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6293471Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6293782Z graph_break [] 2025-12-04T09:45:51.6293918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6294077Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6294213Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6294413Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6294827Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6295179Z graph_break [] 2025-12-04T09:45:51.6295312Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6295479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6295613Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6295811Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6296177Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6296504Z graph_break [] 2025-12-04T09:45:51.6296638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6296797Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6296932Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6297132Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6297498Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6297840Z graph_break [] 2025-12-04T09:45:51.6297976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6298142Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6298277Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6298474Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6298891Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6299247Z graph_break [] 2025-12-04T09:45:51.6299380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6299539Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6299694Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6299895Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6300303Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6300654Z graph_break [] 2025-12-04T09:45:51.6300788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6300953Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6301093Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6301288Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6301707Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6302062Z graph_break [] 2025-12-04T09:45:51.6302218Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6302404Z Traceback (most recent call last): 2025-12-04T09:45:51.6302661Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6302924Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6303206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6303444Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6303587Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6303837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6304116Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6304283Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6304378Z 2025-12-04T09:45:51.6304431Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6304638Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6304863Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6304998Z 2025-12-04T09:45:51.6305046Z The failure occurred for item [0] 2025-12-04T09:45:51.6305129Z 2025-12-04T09:45:51.6305205Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6305489Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6305700Z 2025-12-04T09:45:51.6305790Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6306027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6306186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6306325Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6306521Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6306888Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6307190Z graph_break [] 2025-12-04T09:45:51.6307323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6307480Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6307613Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6307829Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6308199Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6308501Z graph_break [] 2025-12-04T09:45:51.6308632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6308789Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6308924Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6309118Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6309482Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6309788Z graph_break [] 2025-12-04T09:45:51.6309922Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6310080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6310212Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6310406Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6310773Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6311068Z graph_break [] 2025-12-04T09:45:51.6311196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6311352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6311480Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6311669Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6312031Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6312326Z graph_break [] 2025-12-04T09:45:51.6312491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6312645Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6312773Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6313023Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6313432Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6313776Z graph_break [] 2025-12-04T09:45:51.6313941Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6314094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6314225Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6314418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6314780Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6315078Z graph_break [] 2025-12-04T09:45:51.6315206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6315359Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6315488Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6315695Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6316065Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6316363Z graph_break [] 2025-12-04T09:45:51.6316491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6316644Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6316778Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6316967Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6317378Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6317731Z graph_break [] 2025-12-04T09:45:51.6317862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6318016Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6318143Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6318334Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6318749Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6319094Z graph_break [] 2025-12-04T09:45:51.6319221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6319375Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6319503Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6319698Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6320105Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6320473Z graph_break [] 2025-12-04T09:45:51.6320606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6320763Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6320893Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6321082Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6321523Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6321885Z graph_break [] 2025-12-04T09:45:51.6322226Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6322443Z Traceback (most recent call last): 2025-12-04T09:45:51.6322742Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6323103Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6323364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6323628Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6323826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6324099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6324439Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6324646Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6324748Z 2025-12-04T09:45:51.6324833Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6325064Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6325313Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6325451Z 2025-12-04T09:45:51.6325524Z The failure occurred for item [0] 2025-12-04T09:45:51.6325625Z 2025-12-04T09:45:51.6325733Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6326044Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6326264Z 2025-12-04T09:45:51.6326383Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6326633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6326828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6327008Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6327237Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6327644Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6327999Z graph_break [] 2025-12-04T09:45:51.6328167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6328365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6328534Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6328768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6329178Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6329516Z graph_break [] 2025-12-04T09:45:51.6329673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6329909Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6330071Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6330303Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6330706Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6331036Z graph_break [] 2025-12-04T09:45:51.6331214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6331436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6331593Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6331843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6332234Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6332574Z graph_break [] 2025-12-04T09:45:51.6332744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6332971Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6333161Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6333387Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6333805Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6334174Z graph_break [] 2025-12-04T09:45:51.6334340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6334534Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6334704Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6334933Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6335392Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6335782Z graph_break [] 2025-12-04T09:45:51.6335939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6336151Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6336319Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6336555Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6336959Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6339510Z graph_break [] 2025-12-04T09:45:51.6339692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6339884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6340055Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6340299Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6340705Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6341047Z graph_break [] 2025-12-04T09:45:51.6341220Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6341431Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6341615Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6341836Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6342285Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6342681Z graph_break [] 2025-12-04T09:45:51.6342885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6343134Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6343294Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6343516Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6343975Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6344348Z graph_break [] 2025-12-04T09:45:51.6344520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6344711Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6344876Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6345115Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6345584Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6345957Z graph_break [] 2025-12-04T09:45:51.6346142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6346345Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6346512Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6346747Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6347188Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6347582Z graph_break [] 2025-12-04T09:45:51.6347747Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6347929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6348111Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6348336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6348737Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6349079Z graph_break [] 2025-12-04T09:45:51.6349261Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6349486Z Traceback (most recent call last): 2025-12-04T09:45:51.6349766Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6350048Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6350326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6350598Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6350809Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6351086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6351388Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6351605Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6351716Z 2025-12-04T09:45:51.6351781Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6351993Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6352260Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6352443Z 2025-12-04T09:45:51.6352506Z The failure occurred for item [0] 2025-12-04T09:45:51.6352601Z 2025-12-04T09:45:51.6352700Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6353057Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6353293Z 2025-12-04T09:45:51.6353399Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6353497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6353570Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6353641Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6353770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6354031Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6354103Z graph_break [] 2025-12-04T09:45:51.6354193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6354265Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6354336Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6354459Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6354692Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6354768Z graph_break [] 2025-12-04T09:45:51.6354852Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6354922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6354993Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6355109Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6355379Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6355436Z graph_break [] 2025-12-04T09:45:51.6355532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6355584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6355661Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6355778Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6356041Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6356090Z graph_break [] 2025-12-04T09:45:51.6356188Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6356244Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6356352Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6356477Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6356729Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6356776Z graph_break [] 2025-12-04T09:45:51.6356876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6356926Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6357062Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6357170Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6357466Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6357529Z graph_break [] 2025-12-04T09:45:51.6357614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6357695Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6357763Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6357887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6358125Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6358201Z graph_break [] 2025-12-04T09:45:51.6358296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6358368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6358437Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6358560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6358795Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6358861Z graph_break [] 2025-12-04T09:45:51.6358952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6359020Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6359092Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6359218Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6359527Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6359582Z graph_break [] 2025-12-04T09:45:51.6359678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6359735Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6359817Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6359921Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6360244Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6360294Z graph_break [] 2025-12-04T09:45:51.6360398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6360464Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6360533Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6400330Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6400681Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6400724Z graph_break [] 2025-12-04T09:45:51.6400828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6401065Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6401132Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6401237Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6401524Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6401564Z graph_break [] 2025-12-04T09:45:51.6401645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6401688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6401751Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6401848Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6402127Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6402164Z graph_break [] 2025-12-04T09:45:51.6402241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6402283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6402342Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6402438Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6402667Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6402705Z graph_break [] 2025-12-04T09:45:51.6402804Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6402855Z Traceback (most recent call last): 2025-12-04T09:45:51.6403091Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6403143Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6403297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6403362Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6403410Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6403574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6403650Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6403707Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6403710Z 2025-12-04T09:45:51.6403769Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6403867Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6403956Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6403959Z 2025-12-04T09:45:51.6404048Z The failure occurred for item [0] 2025-12-04T09:45:51.6404050Z 2025-12-04T09:45:51.6404125Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6404301Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6404303Z 2025-12-04T09:45:51.6404392Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6404469Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6404512Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6404577Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6404711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6404943Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6404984Z graph_break [] 2025-12-04T09:45:51.6405058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6405102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6405161Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6405265Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6405490Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6405571Z graph_break [] 2025-12-04T09:45:51.6405646Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6405690Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6405747Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6405846Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6406069Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6406108Z graph_break [] 2025-12-04T09:45:51.6406179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6406223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6406281Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6406382Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6406605Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6406645Z graph_break [] 2025-12-04T09:45:51.6406718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6406760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6406817Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6406915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6407139Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6407178Z graph_break [] 2025-12-04T09:45:51.6407252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6407294Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6407354Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6407466Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6407745Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6407781Z graph_break [] 2025-12-04T09:45:51.6407855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6407896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6407956Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6408075Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6408300Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6408338Z graph_break [] 2025-12-04T09:45:51.6408412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6408455Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6408514Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6408610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6408838Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6408909Z graph_break [] 2025-12-04T09:45:51.6408984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6409027Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6409084Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6409182Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6409453Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6409492Z graph_break [] 2025-12-04T09:45:51.6409565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6409608Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6409665Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6409766Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6410038Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6410079Z graph_break [] 2025-12-04T09:45:51.6410150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6410194Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6410250Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6410350Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6410619Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6410659Z graph_break [] 2025-12-04T09:45:51.6410731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6410773Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6410846Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6410943Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6411213Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6411251Z graph_break [] 2025-12-04T09:45:51.6411325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6411367Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6411446Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6411543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6411770Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6411808Z graph_break [] 2025-12-04T09:45:51.6411881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6411922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6411980Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6412075Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6412299Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6412351Z graph_break [] 2025-12-04T09:45:51.6412424Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6412466Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6412525Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6412620Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6412893Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6412966Z graph_break [] 2025-12-04T09:45:51.6413061Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6413111Z Traceback (most recent call last): 2025-12-04T09:45:51.6413285Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6413337Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6413481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6413545Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6413592Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6413756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6413829Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6413884Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6413887Z 2025-12-04T09:45:51.6413943Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6414039Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6414126Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6414128Z 2025-12-04T09:45:51.6414176Z The failure occurred for item [0] 2025-12-04T09:45:51.6414215Z 2025-12-04T09:45:51.6414291Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6414463Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6414465Z 2025-12-04T09:45:51.6414553Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6414625Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6414673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6414731Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6414865Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6415093Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6415135Z graph_break [] 2025-12-04T09:45:51.6415208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6415250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6415308Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6415405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6415627Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6415682Z graph_break [] 2025-12-04T09:45:51.6415757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6415801Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6415858Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6415958Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6416181Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6416220Z graph_break [] 2025-12-04T09:45:51.6416292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6416335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6416394Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6416498Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6416724Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6416761Z graph_break [] 2025-12-04T09:45:51.6416837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6416879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6416937Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6417033Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6417260Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6417297Z graph_break [] 2025-12-04T09:45:51.6417372Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6417413Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6417470Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6417565Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6417858Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6417896Z graph_break [] 2025-12-04T09:45:51.6417970Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6418010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6418069Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6418196Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6418421Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6418459Z graph_break [] 2025-12-04T09:45:51.6418533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6418575Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6418631Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6418729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6418953Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6419007Z graph_break [] 2025-12-04T09:45:51.6419083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6419126Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6419184Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6419281Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6419551Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6419589Z graph_break [] 2025-12-04T09:45:51.6419662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6419704Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6419760Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6419860Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6420130Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6420169Z graph_break [] 2025-12-04T09:45:51.6420241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6420283Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6420339Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6420436Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6420708Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6420746Z graph_break [] 2025-12-04T09:45:51.6420819Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6420860Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6420918Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6421026Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6421296Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6421332Z graph_break [] 2025-12-04T09:45:51.6421405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6421448Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6421528Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6421625Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6421852Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6421889Z graph_break [] 2025-12-04T09:45:51.6421965Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6422006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6422064Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6422159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6422384Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6422434Z graph_break [] 2025-12-04T09:45:51.6422506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6422548Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6422605Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6422702Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6423010Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6423048Z graph_break [] 2025-12-04T09:45:51.6423120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6423166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6423224Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6423321Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6423544Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6423583Z graph_break [] 2025-12-04T09:45:51.6423675Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6423724Z Traceback (most recent call last): 2025-12-04T09:45:51.6423894Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6423945Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6424087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6424150Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6424198Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6424358Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6424463Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6424518Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6424520Z 2025-12-04T09:45:51.6424577Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6424667Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6424755Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6424757Z 2025-12-04T09:45:51.6424803Z The failure occurred for item [0] 2025-12-04T09:45:51.6424805Z 2025-12-04T09:45:51.6424882Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6425081Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6425083Z 2025-12-04T09:45:51.6425171Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6425246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6425290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6425348Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6425450Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6425677Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6425740Z graph_break [] 2025-12-04T09:45:51.6425815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6425858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6425916Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6426014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6426240Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6426276Z graph_break [] 2025-12-04T09:45:51.6426349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6426390Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6426448Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6426545Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6426773Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6426810Z graph_break [] 2025-12-04T09:45:51.6426885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6426927Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6426985Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6427081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6427305Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6427342Z graph_break [] 2025-12-04T09:45:51.6427418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6427459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6427518Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6427613Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6427852Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6427888Z graph_break [] 2025-12-04T09:45:51.6427962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6428003Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6428063Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6428160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6428455Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6428495Z graph_break [] 2025-12-04T09:45:51.6428569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6428612Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6428670Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6428768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6428990Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6429038Z graph_break [] 2025-12-04T09:45:51.6429111Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6429156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6429213Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6429310Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6429533Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6429572Z graph_break [] 2025-12-04T09:45:51.6429645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6429688Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6429744Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6429842Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6430114Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6430152Z graph_break [] 2025-12-04T09:45:51.6430226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6430267Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6430325Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6430421Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6430692Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6430730Z graph_break [] 2025-12-04T09:45:51.6430804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6430845Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6430902Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6430998Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6431281Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6431319Z graph_break [] 2025-12-04T09:45:51.6431392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6431434Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6431493Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6431625Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6431902Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6431941Z graph_break [] 2025-12-04T09:45:51.6432013Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6432056Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6432111Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6432220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6432448Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6432507Z graph_break [] 2025-12-04T09:45:51.6432582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6432629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6432687Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6432789Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6433049Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6433092Z graph_break [] 2025-12-04T09:45:51.6433167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6433215Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6433273Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6433377Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6433652Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6433696Z graph_break [] 2025-12-04T09:45:51.6433771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6433816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6433874Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6433975Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6434203Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6434245Z graph_break [] 2025-12-04T09:45:51.6434326Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6434368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6434431Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6434562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6434792Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6434830Z graph_break [] 2025-12-04T09:45:51.6434929Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6434977Z Traceback (most recent call last): 2025-12-04T09:45:51.6435185Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6435238Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6435384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6435444Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6435496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6435655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6435730Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6435784Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6435786Z 2025-12-04T09:45:51.6435845Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6435939Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6436052Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6436055Z 2025-12-04T09:45:51.6436104Z The failure occurred for item [0] 2025-12-04T09:45:51.6436106Z 2025-12-04T09:45:51.6436182Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6436356Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6436360Z 2025-12-04T09:45:51.6436447Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6436527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6436569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6436633Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6436733Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6436967Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6437005Z graph_break [] 2025-12-04T09:45:51.6437083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6437127Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6437188Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6437285Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6437514Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6437554Z graph_break [] 2025-12-04T09:45:51.6437630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6437673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6437734Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6437834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6438060Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6438116Z graph_break [] 2025-12-04T09:45:51.6438190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6438236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6438296Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6438396Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6438640Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6438684Z graph_break [] 2025-12-04T09:45:51.6438759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6438805Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6438863Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6438962Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6439185Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6439227Z graph_break [] 2025-12-04T09:45:51.6439301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6439360Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6439420Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6439521Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6439792Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6439837Z graph_break [] 2025-12-04T09:45:51.6439915Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6439959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6440020Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6440116Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6440346Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6440383Z graph_break [] 2025-12-04T09:45:51.6440460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6440503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6440565Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6440662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6440887Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6440925Z graph_break [] 2025-12-04T09:45:51.6441002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6441046Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6441109Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6441206Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6441479Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6441530Z graph_break [] 2025-12-04T09:45:51.6441609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6441650Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6441712Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6441808Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6442110Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6442153Z graph_break [] 2025-12-04T09:45:51.6442228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6442274Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6442331Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6442432Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6442703Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6442758Z graph_break [] 2025-12-04T09:45:51.6442833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6442878Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6442991Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6443093Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6443366Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6443408Z graph_break [] 2025-12-04T09:45:51.6443481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6443527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6443584Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6443686Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6443915Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6443954Z graph_break [] 2025-12-04T09:45:51.6444034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6444076Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6444137Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6444235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6444464Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6444503Z graph_break [] 2025-12-04T09:45:51.6444581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6444623Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6444684Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6444781Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6445095Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6445133Z graph_break [] 2025-12-04T09:45:51.6445210Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6445253Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6445317Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6445414Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6445667Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6445706Z graph_break [] 2025-12-04T09:45:51.6445785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6445826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6445886Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6445986Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6446212Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6446272Z graph_break [] 2025-12-04T09:45:51.6446348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6446395Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6446452Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6446555Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6446827Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6446870Z graph_break [] 2025-12-04T09:45:51.6446965Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6447016Z Traceback (most recent call last): 2025-12-04T09:45:51.6447187Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6447241Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6447383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6447447Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6447496Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6447659Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6447733Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6447792Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6447794Z 2025-12-04T09:45:51.6447851Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6447946Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6448038Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6448040Z 2025-12-04T09:45:51.6448088Z The failure occurred for item [0] 2025-12-04T09:45:51.6448090Z 2025-12-04T09:45:51.6448173Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6448347Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6448363Z 2025-12-04T09:45:51.6448455Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6448530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6448578Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6448637Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6448742Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6448990Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6449033Z graph_break [] 2025-12-04T09:45:51.6449108Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6449156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6449217Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6449320Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6449544Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6449587Z graph_break [] 2025-12-04T09:45:51.6449665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6449720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6449783Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6449881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6450109Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6450149Z graph_break [] 2025-12-04T09:45:51.6450229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6450272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6450335Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6450433Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6450663Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6450702Z graph_break [] 2025-12-04T09:45:51.6450778Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6450821Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6450885Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6450981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6451207Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6451245Z graph_break [] 2025-12-04T09:45:51.6451325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6451367Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6451429Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6451530Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6451806Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6451861Z graph_break [] 2025-12-04T09:45:51.6451939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6451986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6452044Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6452147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6452402Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6452445Z graph_break [] 2025-12-04T09:45:51.6452521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6452568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6452627Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6452731Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6452998Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6453042Z graph_break [] 2025-12-04T09:45:51.6453116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6453188Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6453246Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6453351Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6453625Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6453666Z graph_break [] 2025-12-04T09:45:51.6453743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6453786Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6453848Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6453946Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6454224Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6454264Z graph_break [] 2025-12-04T09:45:51.6454342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6454385Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6454448Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6454545Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6454818Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6454855Z graph_break [] 2025-12-04T09:45:51.6454933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6454977Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6455041Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6455138Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6455410Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6455468Z graph_break [] 2025-12-04T09:45:51.6455544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6455588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6455649Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6455750Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6456007Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6456047Z graph_break [] 2025-12-04T09:45:51.6456121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6456168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6456227Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6456327Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6456553Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6456593Z graph_break [] 2025-12-04T09:45:51.6456691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6456739Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6456797Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6456899Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6457172Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6457214Z graph_break [] 2025-12-04T09:45:51.6457288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6457333Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6457390Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6457494Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6457725Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6457765Z graph_break [] 2025-12-04T09:45:51.6457842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6457885Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6457948Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6458046Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6458274Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6458313Z graph_break [] 2025-12-04T09:45:51.6458393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6458438Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6458502Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6458598Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6458893Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6458932Z graph_break [] 2025-12-04T09:45:51.6459011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6459053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6459115Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6459212Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6459465Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6459505Z graph_break [] 2025-12-04T09:45:51.6459603Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6459651Z Traceback (most recent call last): 2025-12-04T09:45:51.6459827Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6459880Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6460023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6460087Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6460148Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6460308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6460381Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6460437Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6460440Z 2025-12-04T09:45:51.6460496Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6460590Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6460677Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6460679Z 2025-12-04T09:45:51.6460727Z The failure occurred for item [0] 2025-12-04T09:45:51.6460729Z 2025-12-04T09:45:51.6460804Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6460979Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6460982Z 2025-12-04T09:45:51.6461072Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6461148Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6461189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6461250Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6461348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6461574Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6461615Z graph_break [] 2025-12-04T09:45:51.6461687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6461730Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6461788Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6461890Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6462114Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6462166Z graph_break [] 2025-12-04T09:45:51.6462238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6462283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6462341Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6462440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6462670Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6462732Z graph_break [] 2025-12-04T09:45:51.6462806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6462851Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6462909Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6463052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6463274Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6463313Z graph_break [] 2025-12-04T09:45:51.6463385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6463429Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6463503Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6463604Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6463831Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6463870Z graph_break [] 2025-12-04T09:45:51.6463944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6463985Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6464045Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6464142Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6464422Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6464465Z graph_break [] 2025-12-04T09:45:51.6464543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6464587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6464651Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6464751Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6464980Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6465019Z graph_break [] 2025-12-04T09:45:51.6465097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6465138Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6465201Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6465304Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6465532Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6465595Z graph_break [] 2025-12-04T09:45:51.6465669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6465717Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6465775Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6465877Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6466180Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6466225Z graph_break [] 2025-12-04T09:45:51.6466299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6466346Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6466404Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6466507Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6466786Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6466829Z graph_break [] 2025-12-04T09:45:51.6466903Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6466963Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6467023Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6467125Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6467395Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6467440Z graph_break [] 2025-12-04T09:45:51.6467519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6467561Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6467622Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6467719Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6467996Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6468035Z graph_break [] 2025-12-04T09:45:51.6468113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6468157Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6468220Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6468318Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6468550Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6468591Z graph_break [] 2025-12-04T09:45:51.6468670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6468713Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6468777Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6468875Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6469104Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6469159Z graph_break [] 2025-12-04T09:45:51.6469237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6469279Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6469341Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6469440Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6469752Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6469797Z graph_break [] 2025-12-04T09:45:51.6469871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6469919Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6469978Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6470079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6470303Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6470346Z graph_break [] 2025-12-04T09:45:51.6470419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6470476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6470534Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6470631Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6470860Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6470899Z graph_break [] 2025-12-04T09:45:51.6470970Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6471012Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6471067Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6471164Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6471438Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6471477Z graph_break [] 2025-12-04T09:45:51.6471551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6471594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6471651Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6471747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6471972Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6472008Z graph_break [] 2025-12-04T09:45:51.6472081Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6472124Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6472184Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6472279Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6472506Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6472554Z graph_break [] 2025-12-04T09:45:51.6472655Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6472703Z Traceback (most recent call last): 2025-12-04T09:45:51.6472880Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6472964Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6473147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6473209Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6473262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6473421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6473500Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6473554Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6473560Z 2025-12-04T09:45:51.6473613Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6473710Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6473801Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6473803Z 2025-12-04T09:45:51.6473869Z The failure occurred for item [0] 2025-12-04T09:45:51.6473871Z 2025-12-04T09:45:51.6473949Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6474123Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6474125Z 2025-12-04T09:45:51.6474214Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6474292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6474335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6474399Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6474500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6474728Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6474768Z graph_break [] 2025-12-04T09:45:51.6474850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6474892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6474953Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6475052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6475277Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6475315Z graph_break [] 2025-12-04T09:45:51.6475387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6475431Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6475487Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6475590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6475815Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6475878Z graph_break [] 2025-12-04T09:45:51.6475952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6475998Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6476056Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6476157Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6476379Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6476419Z graph_break [] 2025-12-04T09:45:51.6476515Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6476558Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6476616Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6476715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6476941Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6476982Z graph_break [] 2025-12-04T09:45:51.6477056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6477102Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6477160Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6477274Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6477552Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6477592Z graph_break [] 2025-12-04T09:45:51.6477669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6477711Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6477773Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6477870Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6478097Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6478135Z graph_break [] 2025-12-04T09:45:51.6478213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6478254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6478315Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6478412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6478639Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6478677Z graph_break [] 2025-12-04T09:45:51.6478755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6478797Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6478858Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6478956Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6479232Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6479286Z graph_break [] 2025-12-04T09:45:51.6479358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6479404Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6479461Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6479560Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6479830Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6479889Z graph_break [] 2025-12-04T09:45:51.6479962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6480004Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6480061Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6480160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6480431Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6480477Z graph_break [] 2025-12-04T09:45:51.6480549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6480597Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6480669Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6480772Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6481048Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6481092Z graph_break [] 2025-12-04T09:45:51.6481166Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6481212Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6481273Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6481370Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6481602Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6481641Z graph_break [] 2025-12-04T09:45:51.6481715Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6481756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6481817Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6481912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6482136Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6482172Z graph_break [] 2025-12-04T09:45:51.6482246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6482288Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6482350Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6482449Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6482724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6482776Z graph_break [] 2025-12-04T09:45:51.6482854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6482896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6483006Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6483105Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6483377Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6483422Z graph_break [] 2025-12-04T09:45:51.6483495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6483541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6483600Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6483697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6483920Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6483959Z graph_break [] 2025-12-04T09:45:51.6484032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6484090Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6484147Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6484249Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6484519Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6484563Z graph_break [] 2025-12-04T09:45:51.6484636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6484684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6484742Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6484842Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6485071Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6485110Z graph_break [] 2025-12-04T09:45:51.6485183Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6485225Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6485282Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6485382Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6485608Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6485647Z graph_break [] 2025-12-04T09:45:51.6485724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6485767Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6485830Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6485926Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6486197Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6486262Z graph_break [] 2025-12-04T09:45:51.6486357Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6486403Z Traceback (most recent call last): 2025-12-04T09:45:51.6486574Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6486623Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6486768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6486847Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6486898Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6487058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6487136Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6487192Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6487194Z 2025-12-04T09:45:51.6487253Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6487347Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6487436Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6487438Z 2025-12-04T09:45:51.6487490Z The failure occurred for item [0] 2025-12-04T09:45:51.6487502Z 2025-12-04T09:45:51.6487579Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6487756Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6487758Z 2025-12-04T09:45:51.6487846Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6487924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6487969Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6488031Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6488131Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6488358Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6488397Z graph_break [] 2025-12-04T09:45:51.6488477Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6488521Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6488583Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6488682Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6488911Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6488952Z graph_break [] 2025-12-04T09:45:51.6489026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6489073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6489130Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6489233Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6489463Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6489507Z graph_break [] 2025-12-04T09:45:51.6489594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6489641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6489699Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6489800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6490025Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6490068Z graph_break [] 2025-12-04T09:45:51.6490165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6490212Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6490269Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6490372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6490601Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6490644Z graph_break [] 2025-12-04T09:45:51.6490719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6490765Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6490823Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6490924Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6491220Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6491260Z graph_break [] 2025-12-04T09:45:51.6491339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6491381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6491444Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6491542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6491768Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6491808Z graph_break [] 2025-12-04T09:45:51.6491886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6491928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6491990Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6492090Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6492320Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6492358Z graph_break [] 2025-12-04T09:45:51.6492436Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6492478Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6492540Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6492638Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6492919Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6493018Z graph_break [] 2025-12-04T09:45:51.6493094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6493141Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6493199Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6493299Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6493571Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6493614Z graph_break [] 2025-12-04T09:45:51.6493724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6493770Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6493828Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6493931Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6494199Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6494241Z graph_break [] 2025-12-04T09:45:51.6494314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6494359Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6494435Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6494537Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6494807Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6494851Z graph_break [] 2025-12-04T09:45:51.6494925Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6494970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6495027Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6495127Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6495357Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6495399Z graph_break [] 2025-12-04T09:45:51.6495476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6495520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6495584Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6495683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6495909Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6495947Z graph_break [] 2025-12-04T09:45:51.6496023Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6496064Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6496126Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6496226Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6496501Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6496576Z graph_break [] 2025-12-04T09:45:51.6496657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6496698Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6496755Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6496851Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6497102Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6497141Z graph_break [] 2025-12-04T09:45:51.6497213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6497255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6497311Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6497409Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6497634Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6497671Z graph_break [] 2025-12-04T09:45:51.6497744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6497786Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6497853Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6497952Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6498223Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6498262Z graph_break [] 2025-12-04T09:45:51.6498334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6498378Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6498434Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6498532Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6498758Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6498797Z graph_break [] 2025-12-04T09:45:51.6498869Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6498911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6498968Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6499065Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6499289Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6499326Z graph_break [] 2025-12-04T09:45:51.6499399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6499439Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6499498Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6499594Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6499867Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6499919Z graph_break [] 2025-12-04T09:45:51.6499993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6500034Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6500091Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6500186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6500434Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6500472Z graph_break [] 2025-12-04T09:45:51.6500567Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6500613Z Traceback (most recent call last): 2025-12-04T09:45:51.6500784Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6500832Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6500975Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6501034Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6501081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6501238Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6501323Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6501377Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6501380Z 2025-12-04T09:45:51.6501434Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6501524Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6501613Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6501615Z 2025-12-04T09:45:51.6501662Z The failure occurred for item [0] 2025-12-04T09:45:51.6501664Z 2025-12-04T09:45:51.6501739Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6501907Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6501909Z 2025-12-04T09:45:51.6501994Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6502070Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6502111Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6502170Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6502269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6502495Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6502533Z graph_break [] 2025-12-04T09:45:51.6502605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6502648Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6502704Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6502802Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6503074Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6503113Z graph_break [] 2025-12-04T09:45:51.6503185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6503249Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6503305Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6503402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6503623Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6503663Z graph_break [] 2025-12-04T09:45:51.6503736Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6503813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6503870Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6503968Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6504191Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6504231Z graph_break [] 2025-12-04T09:45:51.6504303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6504345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6504401Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6504500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6504745Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6504783Z graph_break [] 2025-12-04T09:45:51.6504857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6504899Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6504956Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6505052Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6505323Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6505360Z graph_break [] 2025-12-04T09:45:51.6505434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6505476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6505534Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6505631Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6505856Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6505893Z graph_break [] 2025-12-04T09:45:51.6505966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6506006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6506063Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6506160Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6506389Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6506426Z graph_break [] 2025-12-04T09:45:51.6506500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6506555Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6506613Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6506709Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6506984Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6507023Z graph_break [] 2025-12-04T09:45:51.6507115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6507158Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6507214Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6507310Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6507581Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6507619Z graph_break [] 2025-12-04T09:45:51.6507690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6507732Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6507788Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6507884Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6508178Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6508218Z graph_break [] 2025-12-04T09:45:51.6508290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6508332Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6508390Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6508490Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6508766Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6508805Z graph_break [] 2025-12-04T09:45:51.6508880Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6508921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6508979Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6509076Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6509302Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6509339Z graph_break [] 2025-12-04T09:45:51.6509412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6509453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6509511Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6509609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6509831Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6509882Z graph_break [] 2025-12-04T09:45:51.6509956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6509996Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6510054Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6510150Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6510422Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6510485Z graph_break [] 2025-12-04T09:45:51.6510558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6510600Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6510656Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6510755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6510985Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6511023Z graph_break [] 2025-12-04T09:45:51.6511095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6511137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6511194Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6511304Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6511528Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6511567Z graph_break [] 2025-12-04T09:45:51.6511639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6511683Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6511738Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6511836Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6512105Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6512145Z graph_break [] 2025-12-04T09:45:51.6512219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6512263Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6512321Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6512421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6512648Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6512685Z graph_break [] 2025-12-04T09:45:51.6512759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6512799Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6512860Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6513000Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6513223Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6513283Z graph_break [] 2025-12-04T09:45:51.6513357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6513397Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6513455Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6513552Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6513825Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6513893Z graph_break [] 2025-12-04T09:45:51.6513967Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6514008Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6514065Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6514161Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6514384Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6514420Z graph_break [] 2025-12-04T09:45:51.6514496Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6514539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6514610Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6514709Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6514932Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6514970Z graph_break [] 2025-12-04T09:45:51.6515063Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6515111Z Traceback (most recent call last): 2025-12-04T09:45:51.6515280Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6515330Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6515470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6515532Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6515580Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6515739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6515811Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6515866Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6515870Z 2025-12-04T09:45:51.6515920Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6516015Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6516103Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6516105Z 2025-12-04T09:45:51.6516154Z The failure occurred for item [0] 2025-12-04T09:45:51.6516156Z 2025-12-04T09:45:51.6516231Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6516402Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6516404Z 2025-12-04T09:45:51.6516492Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6516565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6516622Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6516679Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6516782Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6517006Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6517047Z graph_break [] 2025-12-04T09:45:51.6517118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6517183Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6517240Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6517339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6517564Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6517603Z graph_break [] 2025-12-04T09:45:51.6517675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6517719Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6517775Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6517873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6518108Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6518147Z graph_break [] 2025-12-04T09:45:51.6518221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6518263Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6518320Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6518417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6518639Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6518676Z graph_break [] 2025-12-04T09:45:51.6518750Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6518792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6518851Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6518947Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6519170Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6519208Z graph_break [] 2025-12-04T09:45:51.6519282Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6519322Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6519380Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6519475Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6519747Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6519784Z graph_break [] 2025-12-04T09:45:51.6519857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6519916Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6519974Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6520069Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6520292Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6520331Z graph_break [] 2025-12-04T09:45:51.6520402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6520448Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6520556Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6520656Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6520880Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6520919Z graph_break [] 2025-12-04T09:45:51.6520991Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6521034Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6521089Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6521186Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6521458Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6521509Z graph_break [] 2025-12-04T09:45:51.6521580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6521624Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6521679Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6521777Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6522049Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6522088Z graph_break [] 2025-12-04T09:45:51.6522162Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6522204Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6522262Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6522358Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6522633Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6522671Z graph_break [] 2025-12-04T09:45:51.6522744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6522785Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6522842Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6522979Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6523251Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6523307Z graph_break [] 2025-12-04T09:45:51.6523381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6523422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6523480Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6523575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6523803Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6523840Z graph_break [] 2025-12-04T09:45:51.6523945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6523986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6524044Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6524142Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6524365Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6524402Z graph_break [] 2025-12-04T09:45:51.6524475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6524520Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6524576Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6524672Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6524964Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6525003Z graph_break [] 2025-12-04T09:45:51.6525076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6525118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6525174Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6525270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6525493Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6525534Z graph_break [] 2025-12-04T09:45:51.6525608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6525652Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6525708Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6525805Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6526027Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6526066Z graph_break [] 2025-12-04T09:45:51.6526139Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6526179Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6526236Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6526331Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6526608Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6526658Z graph_break [] 2025-12-04T09:45:51.6526732Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6526773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6526834Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6526929Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6527153Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6527191Z graph_break [] 2025-12-04T09:45:51.6527286Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6527327Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6527385Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6527480Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6527704Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6527740Z graph_break [] 2025-12-04T09:45:51.6531726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6531789Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6531856Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6531997Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6532280Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6532322Z graph_break [] 2025-12-04T09:45:51.6532396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6532439Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6532495Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6532593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6532820Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6532860Z graph_break [] 2025-12-04T09:45:51.6532982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6533027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6533082Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6533179Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6533402Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6533441Z graph_break [] 2025-12-04T09:45:51.6533513Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6536027Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6536093Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6536197Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6536471Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6536541Z graph_break [] 2025-12-04T09:45:51.6536635Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6536685Z Traceback (most recent call last): 2025-12-04T09:45:51.6536861Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6536912Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6537101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6537168Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6537236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6537401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6537475Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6537532Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6537536Z 2025-12-04T09:45:51.6537592Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6537684Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6537773Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6537775Z 2025-12-04T09:45:51.6537820Z The failure occurred for item [0] 2025-12-04T09:45:51.6537822Z 2025-12-04T09:45:51.6537898Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6538091Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6538093Z 2025-12-04T09:45:51.6538183Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6538259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6538306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6538364Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6538465Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6538689Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6538730Z graph_break [] 2025-12-04T09:45:51.6538802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6538847Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6538906Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6539004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6539230Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6539270Z graph_break [] 2025-12-04T09:45:51.6539344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6539385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6539442Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6539634Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6539862Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6539900Z graph_break [] 2025-12-04T09:45:51.6539974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6540030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6540087Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6540183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6540407Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6540444Z graph_break [] 2025-12-04T09:45:51.6540518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6540559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6540630Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6540726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6540949Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6540987Z graph_break [] 2025-12-04T09:45:51.6541061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6541102Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6541162Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6541259Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6541537Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6541588Z graph_break [] 2025-12-04T09:45:51.6541660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6541704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6541760Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6541857Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6542082Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6542122Z graph_break [] 2025-12-04T09:45:51.6542194Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6542237Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6542294Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6542391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6542616Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6542654Z graph_break [] 2025-12-04T09:45:51.6542729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6542771Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6542827Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6543407Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6543680Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6543719Z graph_break [] 2025-12-04T09:45:51.6543794Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6543861Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6543918Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6544013Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6544284Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6544321Z graph_break [] 2025-12-04T09:45:51.6544394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6544453Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6544511Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6544607Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6544885Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6544922Z graph_break [] 2025-12-04T09:45:51.6544996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6545036Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6545094Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6545189Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6545478Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6545517Z graph_break [] 2025-12-04T09:45:51.6545591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6545633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6545689Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6545791Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6546022Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6546061Z graph_break [] 2025-12-04T09:45:51.6546134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6546176Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6546234Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6546331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6546554Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6546594Z graph_break [] 2025-12-04T09:45:51.6546665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6546708Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6546776Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6546874Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6547144Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6547182Z graph_break [] 2025-12-04T09:45:51.6547268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6547310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6547365Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6547462Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6547686Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6547724Z graph_break [] 2025-12-04T09:45:51.6547812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6547853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6547909Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6548004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6548230Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6548266Z graph_break [] 2025-12-04T09:45:51.6548339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6548380Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6548439Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6548534Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6548818Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6548855Z graph_break [] 2025-12-04T09:45:51.6548929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6548970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6549027Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6549123Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6549353Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6549390Z graph_break [] 2025-12-04T09:45:51.6549465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6549506Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6549562Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6549659Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6549886Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6549923Z graph_break [] 2025-12-04T09:45:51.6549995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6550037Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6550104Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6550202Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6550473Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6550527Z graph_break [] 2025-12-04T09:45:51.6550600Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6550643Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6550700Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6550797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6551023Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6551062Z graph_break [] 2025-12-04T09:45:51.6551146Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6551189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6551244Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6551341Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6551563Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6551599Z graph_break [] 2025-12-04T09:45:51.6551672Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6551712Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6551771Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6551867Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6552162Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6552199Z graph_break [] 2025-12-04T09:45:51.6552275Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6552315Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6552372Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6552468Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6552696Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6552733Z graph_break [] 2025-12-04T09:45:51.6552829Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6552877Z Traceback (most recent call last): 2025-12-04T09:45:51.6553092Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6553142Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6553286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6553346Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6553394Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6553574Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6553650Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6553705Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6553710Z 2025-12-04T09:45:51.6553764Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6553857Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6553944Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6553971Z 2025-12-04T09:45:51.6554019Z The failure occurred for item [0] 2025-12-04T09:45:51.6554021Z 2025-12-04T09:45:51.6554096Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6554266Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6554269Z 2025-12-04T09:45:51.6554354Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6554430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6554473Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6554551Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6554650Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6554873Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6554913Z graph_break [] 2025-12-04T09:45:51.6554986Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6555027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6555085Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6555183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6555407Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6555464Z graph_break [] 2025-12-04T09:45:51.6555536Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6555578Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6555635Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6555732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6555959Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6555998Z graph_break [] 2025-12-04T09:45:51.6556071Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6556114Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6556171Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6556270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6556492Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6556531Z graph_break [] 2025-12-04T09:45:51.6556603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6556645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6556700Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6556797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6557036Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6557075Z graph_break [] 2025-12-04T09:45:51.6557149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6557191Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6557262Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6557357Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6557630Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6557666Z graph_break [] 2025-12-04T09:45:51.6557742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6557786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6557853Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6557950Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6558173Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6558210Z graph_break [] 2025-12-04T09:45:51.6558284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6558325Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6558383Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6558479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6558704Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6558753Z graph_break [] 2025-12-04T09:45:51.6558827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6558868Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6558926Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6559022Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6559296Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6559335Z graph_break [] 2025-12-04T09:45:51.6559408Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6559450Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6559507Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6559604Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6559878Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6559918Z graph_break [] 2025-12-04T09:45:51.6559989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6560031Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6560086Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6560197Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6560468Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6560507Z graph_break [] 2025-12-04T09:45:51.6560579Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6560636Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6560691Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6560791Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6561060Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6561096Z graph_break [] 2025-12-04T09:45:51.6561171Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6561222Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6561280Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6561375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6561601Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6561637Z graph_break [] 2025-12-04T09:45:51.6561712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6561752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6561809Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6561906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6562145Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6562182Z graph_break [] 2025-12-04T09:45:51.6562256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6562301Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6562358Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6562453Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6562724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6562761Z graph_break [] 2025-12-04T09:45:51.6562835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6562876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6562972Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6563071Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6563295Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6563333Z graph_break [] 2025-12-04T09:45:51.6563405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6563446Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6563526Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6563624Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6563851Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6563889Z graph_break [] 2025-12-04T09:45:51.6563961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6564021Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6564078Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6564175Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6564445Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6564483Z graph_break [] 2025-12-04T09:45:51.6564581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6564625Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6564681Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6564777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6565001Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6565038Z graph_break [] 2025-12-04T09:45:51.6565112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6565152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6565210Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6565308Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6565549Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6565586Z graph_break [] 2025-12-04T09:45:51.6565661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6565702Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6565759Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6565855Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6566126Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6566171Z graph_break [] 2025-12-04T09:45:51.6566249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6566294Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6566355Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6566452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6566680Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6566718Z graph_break [] 2025-12-04T09:45:51.6566793Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6566837Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6566909Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6567009Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6567234Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6567275Z graph_break [] 2025-12-04T09:45:51.6567348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6567405Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6567463Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6567562Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6567842Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6567883Z graph_break [] 2025-12-04T09:45:51.6567966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6568011Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6568068Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6568168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6568394Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6568435Z graph_break [] 2025-12-04T09:45:51.6568509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6568553Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6568612Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6568711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6568953Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6568993Z graph_break [] 2025-12-04T09:45:51.6569091Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6569139Z Traceback (most recent call last): 2025-12-04T09:45:51.6569312Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6569361Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6569507Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6569570Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6569620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6569782Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6569858Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6569911Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6569915Z 2025-12-04T09:45:51.6569969Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6570062Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6570154Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6570156Z 2025-12-04T09:45:51.6570203Z The failure occurred for item [0] 2025-12-04T09:45:51.6570205Z 2025-12-04T09:45:51.6570286Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6570466Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6570470Z 2025-12-04T09:45:51.6570560Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6570637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6570680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6570754Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6570853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6571080Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6571117Z graph_break [] 2025-12-04T09:45:51.6571194Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6571236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6571298Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6571405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6571634Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6571672Z graph_break [] 2025-12-04T09:45:51.6571749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6571789Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6571847Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6571943Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6572168Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6572218Z graph_break [] 2025-12-04T09:45:51.6572292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6572333Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6572390Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6572487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6572711Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6572748Z graph_break [] 2025-12-04T09:45:51.6572820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6572862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6572919Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6573057Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6573281Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6573319Z graph_break [] 2025-12-04T09:45:51.6573391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6573433Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6573489Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6573586Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6573885Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6573925Z graph_break [] 2025-12-04T09:45:51.6574000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6574044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6574100Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6574216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6574439Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6574476Z graph_break [] 2025-12-04T09:45:51.6574549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6574592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6574649Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6574762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6574986Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6575024Z graph_break [] 2025-12-04T09:45:51.6575097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6575139Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6575197Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6575291Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6575564Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6575616Z graph_break [] 2025-12-04T09:45:51.6575690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6575730Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6575791Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6575888Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6576163Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6576200Z graph_break [] 2025-12-04T09:45:51.6576274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6576315Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6576374Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6576469Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6576738Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6576777Z graph_break [] 2025-12-04T09:45:51.6576848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6576889Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6576946Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6577056Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6577327Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6577366Z graph_break [] 2025-12-04T09:45:51.6577437Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6577503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6577559Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6577656Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6577882Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6577922Z graph_break [] 2025-12-04T09:45:51.6577993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6578036Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6578102Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6578200Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6578421Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6578462Z graph_break [] 2025-12-04T09:45:51.6578538Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6578579Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6578636Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6578732Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6579005Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6579053Z graph_break [] 2025-12-04T09:45:51.6579126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6579168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6579225Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6579320Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6579545Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6579582Z graph_break [] 2025-12-04T09:45:51.6579657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6579699Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6579757Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6579852Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6580076Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6580113Z graph_break [] 2025-12-04T09:45:51.6580186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6580227Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6580284Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6580391Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6580665Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6580704Z graph_break [] 2025-12-04T09:45:51.6580775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6580830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6580886Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6580982Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6581205Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6581242Z graph_break [] 2025-12-04T09:45:51.6581314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6581370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6581426Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6581523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6581751Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6581793Z graph_break [] 2025-12-04T09:45:51.6581865Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6581908Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6581964Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6582063Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6582348Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6582387Z graph_break [] 2025-12-04T09:45:51.6582460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6582502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6582560Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6582655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6582880Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6582918Z graph_break [] 2025-12-04T09:45:51.6583039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6583083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6583141Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6583235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6583457Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6583494Z graph_break [] 2025-12-04T09:45:51.6583569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6583610Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6583668Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6583787Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6584062Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6584100Z graph_break [] 2025-12-04T09:45:51.6584174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6584231Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6584289Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6584384Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6584614Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6584652Z graph_break [] 2025-12-04T09:45:51.6584726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6584783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6584839Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6584936Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6585161Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6585199Z graph_break [] 2025-12-04T09:45:51.6585270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6585312Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6585368Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6585466Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6585758Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6585796Z graph_break [] 2025-12-04T09:45:51.6585890Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6585939Z Traceback (most recent call last): 2025-12-04T09:45:51.6586114Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6586164Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6586304Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6586366Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6586411Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6586571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6586644Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6586697Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6586700Z 2025-12-04T09:45:51.6586756Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6586845Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6586933Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6586935Z 2025-12-04T09:45:51.6586981Z The failure occurred for item [0] 2025-12-04T09:45:51.6586983Z 2025-12-04T09:45:51.6587060Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6587240Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6587243Z 2025-12-04T09:45:51.6587332Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6587404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6587449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6587522Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6587622Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6587848Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6587887Z graph_break [] 2025-12-04T09:45:51.6587960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6588002Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6588059Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6588167Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6588392Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6588430Z graph_break [] 2025-12-04T09:45:51.6588503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6588546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6588603Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6588699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6588925Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6588977Z graph_break [] 2025-12-04T09:45:51.6589050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6589091Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6589149Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6589246Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6589469Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6589504Z graph_break [] 2025-12-04T09:45:51.6589578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6589619Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6589679Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6589780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6590006Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6590044Z graph_break [] 2025-12-04T09:45:51.6590116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6590158Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6590214Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6590311Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6590603Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6590644Z graph_break [] 2025-12-04T09:45:51.6590717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6590758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6590814Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6590924Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6591145Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6591183Z graph_break [] 2025-12-04T09:45:51.6591255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6591297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6591354Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6591463Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6591690Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6591729Z graph_break [] 2025-12-04T09:45:51.6591801Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6591844Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6591900Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6591996Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6592271Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6592317Z graph_break [] 2025-12-04T09:45:51.6592390Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6592431Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6592488Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6592584Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6592855Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6592891Z graph_break [] 2025-12-04T09:45:51.6593005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6593048Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6593105Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6593203Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6593473Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6593511Z graph_break [] 2025-12-04T09:45:51.6593587Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6593627Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6593685Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6593818Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6594092Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6594133Z graph_break [] 2025-12-04T09:45:51.6594205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6594264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6594321Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6594417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6594642Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6594681Z graph_break [] 2025-12-04T09:45:51.6594753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6594796Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6594866Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6594965Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6595186Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6595225Z graph_break [] 2025-12-04T09:45:51.6595297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6595339Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6595395Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6595493Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6595768Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6595821Z graph_break [] 2025-12-04T09:45:51.6595893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6595936Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6595993Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6596088Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6596313Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6596350Z graph_break [] 2025-12-04T09:45:51.6596424Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6596466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6596524Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6596619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6596841Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6596878Z graph_break [] 2025-12-04T09:45:51.6596953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6596994Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6597051Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6597160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6597434Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6597472Z graph_break [] 2025-12-04T09:45:51.6597558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6597613Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6597673Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6597772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6598003Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6598046Z graph_break [] 2025-12-04T09:45:51.6598119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6598166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6598235Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6598337Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6598559Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6598601Z graph_break [] 2025-12-04T09:45:51.6598675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6598720Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6598778Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6598880Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6599167Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6599208Z graph_break [] 2025-12-04T09:45:51.6599282Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6599328Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6599385Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6599484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6599710Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6599751Z graph_break [] 2025-12-04T09:45:51.6599824Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6599871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6599927Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6600026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6600252Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6600290Z graph_break [] 2025-12-04T09:45:51.6600367Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6600408Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6600467Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6600577Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6600856Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6600895Z graph_break [] 2025-12-04T09:45:51.6600973Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6601027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6601086Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6601183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6601410Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6601448Z graph_break [] 2025-12-04T09:45:51.6601526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6601579Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6601639Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6601739Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6601966Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6602008Z graph_break [] 2025-12-04T09:45:51.6602082Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6602129Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6602186Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6602286Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6602579Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6602621Z graph_break [] 2025-12-04T09:45:51.6602695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6602740Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6602797Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6602896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6603166Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6603207Z graph_break [] 2025-12-04T09:45:51.6603304Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6603355Z Traceback (most recent call last): 2025-12-04T09:45:51.6603527Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6603579Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6603724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6603787Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6603833Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6603996Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6604084Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6604141Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6604144Z 2025-12-04T09:45:51.6604202Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6604293Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6604383Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6604385Z 2025-12-04T09:45:51.6604432Z The failure occurred for item [0] 2025-12-04T09:45:51.6604456Z 2025-12-04T09:45:51.6604536Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6604707Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6604710Z 2025-12-04T09:45:51.6604800Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6604876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6604920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6604979Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6605094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6605319Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6605359Z graph_break [] 2025-12-04T09:45:51.6605433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6605478Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6605536Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6605636Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6605871Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6605926Z graph_break [] 2025-12-04T09:45:51.6606002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6606044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6606105Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6606202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6606432Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6606469Z graph_break [] 2025-12-04T09:45:51.6606545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6606589Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6606649Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6606747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6606973Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6607011Z graph_break [] 2025-12-04T09:45:51.6607085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6607129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6607190Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6607286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6607524Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6607564Z graph_break [] 2025-12-04T09:45:51.6607640Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6607682Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6607741Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6607840Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6608127Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6608168Z graph_break [] 2025-12-04T09:45:51.6608241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6608286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6608343Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6608454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6608679Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6608719Z graph_break [] 2025-12-04T09:45:51.6608792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6608837Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6608893Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6608995Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6609220Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6609272Z graph_break [] 2025-12-04T09:45:51.6609345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6609390Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6609448Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6609547Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6609824Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6609862Z graph_break [] 2025-12-04T09:45:51.6609940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6609981Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6610042Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6610140Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6610412Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6610450Z graph_break [] 2025-12-04T09:45:51.6610525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6610567Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6610627Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6610722Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6611004Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6611043Z graph_break [] 2025-12-04T09:45:51.6611118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6611160Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6611230Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6611327Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6611601Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6611641Z graph_break [] 2025-12-04T09:45:51.6611716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6611762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6611832Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6611931Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6612156Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6612197Z graph_break [] 2025-12-04T09:45:51.6612269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6612314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6612374Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6612475Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6612701Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6612754Z graph_break [] 2025-12-04T09:45:51.6612827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6612872Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6612966Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6613064Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6613334Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6613378Z graph_break [] 2025-12-04T09:45:51.6613451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6613499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6613557Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6613658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6613888Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6613927Z graph_break [] 2025-12-04T09:45:51.6614006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6614048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6614108Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6614222Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6614449Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6614487Z graph_break [] 2025-12-04T09:45:51.6614562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6614604Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6614683Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6614779Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6615054Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6615093Z graph_break [] 2025-12-04T09:45:51.6615170Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6615214Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6615300Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6615398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6615630Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6615673Z graph_break [] 2025-12-04T09:45:51.6615746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6615790Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6615847Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6615948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6616173Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6616230Z graph_break [] 2025-12-04T09:45:51.6616302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6616348Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6616405Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6616505Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6616777Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6616818Z graph_break [] 2025-12-04T09:45:51.6616891Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6616938Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6616996Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6617096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6617319Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6617361Z graph_break [] 2025-12-04T09:45:51.6617434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6617479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6617536Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6617646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6617879Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6617917Z graph_break [] 2025-12-04T09:45:51.6617995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6618049Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6618110Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6618206Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6618479Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6618516Z graph_break [] 2025-12-04T09:45:51.6618594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6618647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6618708Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6618803Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6619029Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6619068Z graph_break [] 2025-12-04T09:45:51.6619143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6619184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6619244Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6619342Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6619583Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6619621Z graph_break [] 2025-12-04T09:45:51.6619696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6619741Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6619798Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6619897Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6620177Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6620217Z graph_break [] 2025-12-04T09:45:51.6620291Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6620336Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6620393Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6620491Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6620717Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6620755Z graph_break [] 2025-12-04T09:45:51.6620827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6620869Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6620924Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6621031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6621256Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6621295Z graph_break [] 2025-12-04T09:45:51.6621388Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6621447Z Traceback (most recent call last): 2025-12-04T09:45:51.6621620Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6621669Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6621811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6621870Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6621918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6622087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6622162Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6622215Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6622217Z 2025-12-04T09:45:51.6622269Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6622362Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6622453Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6622455Z 2025-12-04T09:45:51.6622500Z The failure occurred for item [0] 2025-12-04T09:45:51.6622501Z 2025-12-04T09:45:51.6622577Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6622747Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6622760Z 2025-12-04T09:45:51.6622849Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6622922Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6623022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6623079Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6623180Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6623403Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6623441Z graph_break [] 2025-12-04T09:45:51.6623518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6623560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6623619Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6623718Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6623942Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6623979Z graph_break [] 2025-12-04T09:45:51.6624053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6624095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6624152Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6624247Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6624489Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6624527Z graph_break [] 2025-12-04T09:45:51.6624602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6624643Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6624701Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6624795Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6625037Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6625075Z graph_break [] 2025-12-04T09:45:51.6625149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6625190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6625248Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6625345Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6625586Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6625627Z graph_break [] 2025-12-04T09:45:51.6625699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6625742Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6625798Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6625894Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6626166Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6626220Z graph_break [] 2025-12-04T09:45:51.6626292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6626335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6626390Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6626486Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6626711Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6626749Z graph_break [] 2025-12-04T09:45:51.6626821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6626864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6626919Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6627022Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6627246Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6627285Z graph_break [] 2025-12-04T09:45:51.6627357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6627399Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6627456Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6627552Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6627835Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6627873Z graph_break [] 2025-12-04T09:45:51.6627946Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6627987Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6628045Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6628159Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6628429Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6628465Z graph_break [] 2025-12-04T09:45:51.6628539Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6628584Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6628642Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6628750Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6629028Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6629066Z graph_break [] 2025-12-04T09:45:51.6629144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6629187Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6629248Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6629344Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6629616Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6629665Z graph_break [] 2025-12-04T09:45:51.6629737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6629779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6629837Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6629935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6630159Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6630199Z graph_break [] 2025-12-04T09:45:51.6630271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6630314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6630370Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6630467Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6630689Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6630728Z graph_break [] 2025-12-04T09:45:51.6630800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6630842Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6630897Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6630996Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6631282Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6631322Z graph_break [] 2025-12-04T09:45:51.6631395Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6631435Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6631508Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6631606Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6631831Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6631868Z graph_break [] 2025-12-04T09:45:51.6631942Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6631983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6632051Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6632147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6632371Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6632408Z graph_break [] 2025-12-04T09:45:51.6632481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6632522Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6632579Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6632674Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6632997Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6633051Z graph_break [] 2025-12-04T09:45:51.6633126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6633169Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6633228Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6633324Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6633552Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6633591Z graph_break [] 2025-12-04T09:45:51.6633665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6633711Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6633768Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6633868Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6634090Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6634129Z graph_break [] 2025-12-04T09:45:51.6634201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6634245Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6634300Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6634410Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6634682Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6634724Z graph_break [] 2025-12-04T09:45:51.6634796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6634857Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6634912Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6635010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6635232Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6635477Z graph_break [] 2025-12-04T09:45:51.6635553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6635594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6635674Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6635770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6635995Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6636035Z graph_break [] 2025-12-04T09:45:51.6636109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6636151Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6636208Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6636304Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6636578Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6636627Z graph_break [] 2025-12-04T09:45:51.6636701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6636743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6636801Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6636896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6637124Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6637161Z graph_break [] 2025-12-04T09:45:51.6637238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6637279Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6637339Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6637434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6637659Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6637698Z graph_break [] 2025-12-04T09:45:51.6637770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6637814Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6637870Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6637980Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6638251Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6638290Z graph_break [] 2025-12-04T09:45:51.6638362Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6638418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6638473Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6638570Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6638792Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6638831Z graph_break [] 2025-12-04T09:45:51.6638903Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6638947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6639014Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6639114Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6639339Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6639380Z graph_break [] 2025-12-04T09:45:51.6639453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6639494Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6639552Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6639648Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6639920Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6639970Z graph_break [] 2025-12-04T09:45:51.6640065Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6640113Z Traceback (most recent call last): 2025-12-04T09:45:51.6640286Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6640334Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6640476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6640535Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6640583Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6640743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6640817Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6640871Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6640873Z 2025-12-04T09:45:51.6640931Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6641021Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6641109Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6641111Z 2025-12-04T09:45:51.6641156Z The failure occurred for item [0] 2025-12-04T09:45:51.6641159Z 2025-12-04T09:45:51.6641235Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6641421Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6641424Z 2025-12-04T09:45:51.6641510Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6641585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6641627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6641686Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6641798Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6642026Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6642065Z graph_break [] 2025-12-04T09:45:51.6642139Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6642180Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6642238Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6642347Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6642571Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6642608Z graph_break [] 2025-12-04T09:45:51.6642683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6642723Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6642781Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6642877Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6643142Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6643198Z graph_break [] 2025-12-04T09:45:51.6643273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6643315Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6643373Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6643472Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6643697Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6643735Z graph_break [] 2025-12-04T09:45:51.6643807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6643849Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6643909Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6644008Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6644231Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6644271Z graph_break [] 2025-12-04T09:45:51.6644343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6644385Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6644441Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6644538Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6644822Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6644863Z graph_break [] 2025-12-04T09:45:51.6644938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6644982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6645040Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6645137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6645376Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6645413Z graph_break [] 2025-12-04T09:45:51.6645486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6645527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6645586Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6645683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6645922Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6645959Z graph_break [] 2025-12-04T09:45:51.6646033Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6646073Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6646130Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6646226Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6646503Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6646551Z graph_break [] 2025-12-04T09:45:51.6646627Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6646668Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6646726Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6646823Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6647097Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6647137Z graph_break [] 2025-12-04T09:45:51.6647211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6647253Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6647309Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6647409Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6647679Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6647717Z graph_break [] 2025-12-04T09:45:51.6647789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6647831Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6647889Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6647986Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6648275Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6648314Z graph_break [] 2025-12-04T09:45:51.6648387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6648429Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6648497Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6648595Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6648819Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6648857Z graph_break [] 2025-12-04T09:45:51.6648932Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6648973Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6649032Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6649139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6649366Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6649403Z graph_break [] 2025-12-04T09:45:51.6649478Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6649519Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6649576Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6649672Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6649947Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6649994Z graph_break [] 2025-12-04T09:45:51.6650068Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6650108Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6650167Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6650263Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6650488Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6650525Z graph_break [] 2025-12-04T09:45:51.6650599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6650642Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6650701Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6650797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6651026Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6651065Z graph_break [] 2025-12-04T09:45:51.6651138Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6651180Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6651236Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6651332Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6651617Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6651656Z graph_break [] 2025-12-04T09:45:51.6651728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6651769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6651840Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6651938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6652160Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6652198Z graph_break [] 2025-12-04T09:45:51.6652271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6652314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6652385Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6652483Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6652704Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6652743Z graph_break [] 2025-12-04T09:45:51.6652817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6652858Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6652916Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6653055Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6653330Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6653392Z graph_break [] 2025-12-04T09:45:51.6653467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6653508Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6653566Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6653662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6653888Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6653924Z graph_break [] 2025-12-04T09:45:51.6654000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6654042Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6654100Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6654195Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6654419Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6654456Z graph_break [] 2025-12-04T09:45:51.6654531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6654571Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6654628Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6654736Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6655013Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6655052Z graph_break [] 2025-12-04T09:45:51.6655126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6655186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6655242Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6655339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6655565Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6655604Z graph_break [] 2025-12-04T09:45:51.6655676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6655720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6655790Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6655889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6656117Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6656157Z graph_break [] 2025-12-04T09:45:51.6656230Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6656272Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6656328Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6656427Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6656698Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6656747Z graph_break [] 2025-12-04T09:45:51.6656820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6656862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6656921Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6657017Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6657243Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6657279Z graph_break [] 2025-12-04T09:45:51.6657353Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6657394Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6657452Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6657548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6657772Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6657808Z graph_break [] 2025-12-04T09:45:51.6657882Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6657922Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6657980Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6658085Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6658358Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6658395Z graph_break [] 2025-12-04T09:45:51.6658470Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6658523Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6658581Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6658676Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6658903Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6658943Z graph_break [] 2025-12-04T09:45:51.6659038Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6659086Z Traceback (most recent call last): 2025-12-04T09:45:51.6659268Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6659320Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6659458Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6659520Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6659566Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6659724Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6659796Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6659853Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6659857Z 2025-12-04T09:45:51.6659923Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6660015Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6660101Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6660103Z 2025-12-04T09:45:51.6660149Z The failure occurred for item [0] 2025-12-04T09:45:51.6660152Z 2025-12-04T09:45:51.6660226Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6660395Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6660397Z 2025-12-04T09:45:51.6660484Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6660556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6671732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6671837Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6671964Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6672219Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6672264Z graph_break [] 2025-12-04T09:45:51.6672345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6672394Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6672457Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6672561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6672850Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6672891Z graph_break [] 2025-12-04T09:45:51.6673003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6673048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6673108Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6673209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6673459Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6673498Z graph_break [] 2025-12-04T09:45:51.6673572Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6673617Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6673676Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6673779Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6674019Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6674058Z graph_break [] 2025-12-04T09:45:51.6674133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6674174Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6674234Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6674331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6674560Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6674613Z graph_break [] 2025-12-04T09:45:51.6674690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6674732Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6674791Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6674888Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6675168Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6675206Z graph_break [] 2025-12-04T09:45:51.6675281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6675325Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6675385Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6675482Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6675708Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6675747Z graph_break [] 2025-12-04T09:45:51.6675828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6675871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6675930Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6676029Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6676268Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6676307Z graph_break [] 2025-12-04T09:45:51.6676383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6676424Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6676482Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6676582Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6676870Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6676912Z graph_break [] 2025-12-04T09:45:51.6676985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6677029Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6677086Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6677196Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6677470Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6677510Z graph_break [] 2025-12-04T09:45:51.6677583Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6677625Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6677682Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6677779Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6678051Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6678101Z graph_break [] 2025-12-04T09:45:51.6678176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6678217Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6678275Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6678377Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6678649Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6678686Z graph_break [] 2025-12-04T09:45:51.6678761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6678803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6678862Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6678959Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6679187Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6679225Z graph_break [] 2025-12-04T09:45:51.6679301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6679342Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6679401Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6679498Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6679737Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6679777Z graph_break [] 2025-12-04T09:45:51.6679850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6679898Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6679955Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6680068Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6680340Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6680379Z graph_break [] 2025-12-04T09:45:51.6680453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6680496Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6701175Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6701288Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6701523Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6701561Z graph_break [] 2025-12-04T09:45:51.6701635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6701683Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6701740Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6701840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6702073Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6702128Z graph_break [] 2025-12-04T09:45:51.6702201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6702243Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6702300Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6702396Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6702680Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6702717Z graph_break [] 2025-12-04T09:45:51.6702790Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6702831Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6702889Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6703037Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6703264Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6703300Z graph_break [] 2025-12-04T09:45:51.6703373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6703413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6703469Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6703584Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6703809Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6703845Z graph_break [] 2025-12-04T09:45:51.6703918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6703957Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6704028Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6704123Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6704395Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6704431Z graph_break [] 2025-12-04T09:45:51.6704503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6704545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6704626Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6704722Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6704945Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6704982Z graph_break [] 2025-12-04T09:45:51.6705066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6705108Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6705163Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6705261Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6705484Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6705536Z graph_break [] 2025-12-04T09:45:51.6705608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6705649Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6705706Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6705803Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6706075Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6706111Z graph_break [] 2025-12-04T09:45:51.6706183Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6706226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6706282Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6706377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6706599Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6706636Z graph_break [] 2025-12-04T09:45:51.6706708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6706747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6706804Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6706912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6707139Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6707176Z graph_break [] 2025-12-04T09:45:51.6707249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6707288Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6707358Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6707453Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6707724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6707760Z graph_break [] 2025-12-04T09:45:51.6707833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6707875Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6707944Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6708039Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6708260Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6708298Z graph_break [] 2025-12-04T09:45:51.6708369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6708410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6708465Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6708562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6708791Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6708840Z graph_break [] 2025-12-04T09:45:51.6708912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6708953Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6709010Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6709106Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6709377Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6709414Z graph_break [] 2025-12-04T09:45:51.6709485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6709527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6709582Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6709683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6709906Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6709944Z graph_break [] 2025-12-04T09:45:51.6710016Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6710058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6710114Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6710222Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6710446Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6710485Z graph_break [] 2025-12-04T09:45:51.6710580Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6710641Z Traceback (most recent call last): 2025-12-04T09:45:51.6710817Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6710869Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6711014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6711077Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6711124Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6711286Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6711374Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6711428Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6711432Z 2025-12-04T09:45:51.6711484Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6711580Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6711669Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6711672Z 2025-12-04T09:45:51.6711717Z The failure occurred for item [0] 2025-12-04T09:45:51.6711719Z 2025-12-04T09:45:51.6711797Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6711969Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6711972Z 2025-12-04T09:45:51.6712077Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6712151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6712194Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6712253Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6712354Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6712580Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6712618Z graph_break [] 2025-12-04T09:45:51.6712690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6712732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6712790Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6712889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6713154Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6713191Z graph_break [] 2025-12-04T09:45:51.6713265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6713305Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6713365Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6713461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6713701Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6713738Z graph_break [] 2025-12-04T09:45:51.6713813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6713853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6713910Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6714005Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6714247Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6714283Z graph_break [] 2025-12-04T09:45:51.6714359Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6714398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6714456Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6714552Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6714793Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6714831Z graph_break [] 2025-12-04T09:45:51.6714906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6714948Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6715004Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6715100Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6715373Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6715427Z graph_break [] 2025-12-04T09:45:51.6715500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6715542Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6715597Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6715695Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6715919Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6715956Z graph_break [] 2025-12-04T09:45:51.6716028Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6716070Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6716126Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6716223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6716446Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6716484Z graph_break [] 2025-12-04T09:45:51.6716556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6716598Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6716654Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6716751Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6717038Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6717075Z graph_break [] 2025-12-04T09:45:51.6717150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6717191Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6717248Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6717343Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6717634Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6717670Z graph_break [] 2025-12-04T09:45:51.6717743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6717784Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6717841Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6717949Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6718222Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6718259Z graph_break [] 2025-12-04T09:45:51.6718332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6718372Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6718430Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6718525Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6718802Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6720359Z graph_break [] 2025-12-04T09:45:51.6720432Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6720474Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6720530Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6720630Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6720854Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6720894Z graph_break [] 2025-12-04T09:45:51.6720966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6721007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6721064Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6721163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6721385Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6721423Z graph_break [] 2025-12-04T09:45:51.6721495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6721537Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6721593Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6721690Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6724394Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6724434Z graph_break [] 2025-12-04T09:45:51.6724506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6724550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6724629Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6724725Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6724953Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6724988Z graph_break [] 2025-12-04T09:45:51.6725064Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6725105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6725164Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6725274Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6725500Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6725537Z graph_break [] 2025-12-04T09:45:51.6725610Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6725650Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6725709Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6725804Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6726078Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6726130Z graph_break [] 2025-12-04T09:45:51.6726203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6726243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6726303Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6726399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6726624Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6726663Z graph_break [] 2025-12-04T09:45:51.6726736Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6726778Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6726834Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6726932Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6727153Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6727191Z graph_break [] 2025-12-04T09:45:51.6727263Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6727305Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6727360Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6727457Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6727745Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6727784Z graph_break [] 2025-12-04T09:45:51.6727855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6727898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6727966Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6728063Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6728286Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6728324Z graph_break [] 2025-12-04T09:45:51.6728396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6728439Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6728495Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6728602Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6728828Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6728866Z graph_break [] 2025-12-04T09:45:51.6728939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6728981Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6729040Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6729136Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6729410Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6729458Z graph_break [] 2025-12-04T09:45:51.6729533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6729574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6729633Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6729728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6729953Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6729991Z graph_break [] 2025-12-04T09:45:51.6730065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6730106Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6730165Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6730262Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6730485Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6730523Z graph_break [] 2025-12-04T09:45:51.6730595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6730637Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6730693Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6730790Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6731073Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6731114Z graph_break [] 2025-12-04T09:45:51.6731185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6731227Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6731294Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6731391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6731614Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6731652Z graph_break [] 2025-12-04T09:45:51.6731725Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6731768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6731834Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6731933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6732155Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6732194Z graph_break [] 2025-12-04T09:45:51.6732266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6732308Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6732364Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6732462Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6732738Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6732789Z graph_break [] 2025-12-04T09:45:51.6732864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6732906Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6733004Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6733099Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6733323Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6733359Z graph_break [] 2025-12-04T09:45:51.6733433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6733474Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6733533Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6733628Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6733857Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6733894Z graph_break [] 2025-12-04T09:45:51.6733968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6734008Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6734065Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6734182Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6734458Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6734496Z graph_break [] 2025-12-04T09:45:51.6734590Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6734653Z Traceback (most recent call last): 2025-12-04T09:45:51.6734827Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6734877Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6735018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6735080Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6735126Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6735287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6735379Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6735435Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6735437Z 2025-12-04T09:45:51.6735492Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6735584Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6735669Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6735671Z 2025-12-04T09:45:51.6735717Z The failure occurred for item [0] 2025-12-04T09:45:51.6735719Z 2025-12-04T09:45:51.6735791Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6735961Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6735964Z 2025-12-04T09:45:51.6736066Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6736140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6736190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6736249Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6736352Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6736582Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6736624Z graph_break [] 2025-12-04T09:45:51.6736698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6736745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6736803Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6736905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6737128Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6737172Z graph_break [] 2025-12-04T09:45:51.6737246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6737290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6737348Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6737448Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6737698Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6737743Z graph_break [] 2025-12-04T09:45:51.6737817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6737861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6737920Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6738023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6738265Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6738304Z graph_break [] 2025-12-04T09:45:51.6738380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6738422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6738485Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6738582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6738822Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6738860Z graph_break [] 2025-12-04T09:45:51.6738938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6738980Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6739040Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6739137Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6739412Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6739460Z graph_break [] 2025-12-04T09:45:51.6739538Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6739580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6739643Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6739739Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6739969Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6740007Z graph_break [] 2025-12-04T09:45:51.6740084Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6740126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6740187Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6740287Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6740512Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6740552Z graph_break [] 2025-12-04T09:45:51.6740628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6740673Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6740730Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6740828Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6741111Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6741154Z graph_break [] 2025-12-04T09:45:51.6741228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6741273Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6741330Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6741429Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6741715Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6741756Z graph_break [] 2025-12-04T09:45:51.6741828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6741877Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6741934Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6742043Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6742318Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6742356Z graph_break [] 2025-12-04T09:45:51.6742433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6742475Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6742534Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6742631Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6742907Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6743000Z graph_break [] 2025-12-04T09:45:51.6743076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6743118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6743179Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6743277Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6743505Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6743544Z graph_break [] 2025-12-04T09:45:51.6743621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6743664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6743724Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6743822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6744048Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6744092Z graph_break [] 2025-12-04T09:45:51.6744164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6744211Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6744270Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6744369Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6744656Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6744698Z graph_break [] 2025-12-04T09:45:51.6744771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6744816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6744887Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6744988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6745210Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6745251Z graph_break [] 2025-12-04T09:45:51.6745343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6745388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6745446Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6745564Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6745788Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6745829Z graph_break [] 2025-12-04T09:45:51.6745903Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6745947Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6746007Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6746107Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6746384Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6746449Z graph_break [] 2025-12-04T09:45:51.6746528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6746571Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6746633Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6746731Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6746962Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6747000Z graph_break [] 2025-12-04T09:45:51.6747076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6747118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6747179Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6747277Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6747503Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6747541Z graph_break [] 2025-12-04T09:45:51.6747618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6747659Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6747719Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6747816Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6748102Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6748143Z graph_break [] 2025-12-04T09:45:51.6748217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6748261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6748331Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6748431Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6748655Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6748696Z graph_break [] 2025-12-04T09:45:51.6748771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6748817Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6748874Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6748991Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6749215Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6749257Z graph_break [] 2025-12-04T09:45:51.6749330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6749378Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6749436Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6749536Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6749810Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6749860Z graph_break [] 2025-12-04T09:45:51.6749933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6749979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6750037Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6750136Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6750362Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6750399Z graph_break [] 2025-12-04T09:45:51.6750475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6750518Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6750578Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6750675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6750904Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6750942Z graph_break [] 2025-12-04T09:45:51.6751017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6751058Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6751118Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6751214Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6751500Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6751540Z graph_break [] 2025-12-04T09:45:51.6751617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6751659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6751731Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6751828Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6752056Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6752094Z graph_break [] 2025-12-04T09:45:51.6752172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6752217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6752284Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6752384Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6752608Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6752650Z graph_break [] 2025-12-04T09:45:51.6752726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6752772Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6752829Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6752968Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6753241Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6753300Z graph_break [] 2025-12-04T09:45:51.6753373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6753418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6753476Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6753579Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6753802Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6753844Z graph_break [] 2025-12-04T09:45:51.6753919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6753967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6754025Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6754124Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6754351Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6754390Z graph_break [] 2025-12-04T09:45:51.6754467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6754509Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6754570Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6754682Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6754964Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6755004Z graph_break [] 2025-12-04T09:45:51.6755080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6755139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6755200Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6755296Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6755523Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6755561Z graph_break [] 2025-12-04T09:45:51.6755658Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6755707Z Traceback (most recent call last): 2025-12-04T09:45:51.6755898Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6755948Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6756095Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6756157Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6756207Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6756365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6756442Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6756499Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6756502Z 2025-12-04T09:45:51.6756558Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6756666Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6756754Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6756756Z 2025-12-04T09:45:51.6756805Z The failure occurred for item [0] 2025-12-04T09:45:51.6756807Z 2025-12-04T09:45:51.6756883Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6757060Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6757062Z 2025-12-04T09:45:51.6757150Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6757226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6757270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6757333Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6757433Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6757661Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6757701Z graph_break [] 2025-12-04T09:45:51.6757777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6757821Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6757882Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6757978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6758219Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6758263Z graph_break [] 2025-12-04T09:45:51.6758340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6758385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6758442Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6758542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6758776Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6758818Z graph_break [] 2025-12-04T09:45:51.6758891Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6758939Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6758997Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6759099Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6759344Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6759387Z graph_break [] 2025-12-04T09:45:51.6759461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6759504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6759559Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6759656Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6759884Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6759933Z graph_break [] 2025-12-04T09:45:51.6760009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6760050Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6760107Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6760202Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6760481Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6760518Z graph_break [] 2025-12-04T09:45:51.6760592Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6760634Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6760692Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6760788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6761018Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6761055Z graph_break [] 2025-12-04T09:45:51.6761130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6761171Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6761228Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6761323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6761556Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6761594Z graph_break [] 2025-12-04T09:45:51.6761669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6761710Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6761768Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6761865Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6762151Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6762190Z graph_break [] 2025-12-04T09:45:51.6762262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6762305Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6762362Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6762460Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6762743Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6762783Z graph_break [] 2025-12-04T09:45:51.6762856Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6762898Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6763033Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6763130Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6763401Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6763457Z graph_break [] 2025-12-04T09:45:51.6763529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6763572Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6763628Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6763727Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6763997Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6764034Z graph_break [] 2025-12-04T09:45:51.6764110Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6764151Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6764210Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6764308Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6764534Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6764571Z graph_break [] 2025-12-04T09:45:51.6764644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6764684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6764743Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6764838Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6765083Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6765123Z graph_break [] 2025-12-04T09:45:51.6765196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6765236Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6765294Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6765406Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6765678Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6765714Z graph_break [] 2025-12-04T09:45:51.6765787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6765829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6765890Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6766000Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6766224Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6766264Z graph_break [] 2025-12-04T09:45:51.6766336Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6766379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6766434Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6766534Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6766758Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6766808Z graph_break [] 2025-12-04T09:45:51.6766882Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6766924Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6766979Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6767079Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6767348Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6767389Z graph_break [] 2025-12-04T09:45:51.6767461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6767504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6767560Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6767658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6767880Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6767918Z graph_break [] 2025-12-04T09:45:51.6767993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6768040Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6768101Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6768199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6768437Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6768477Z graph_break [] 2025-12-04T09:45:51.6768556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6768599Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6768671Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6768768Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6769049Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6769087Z graph_break [] 2025-12-04T09:45:51.6769164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6769207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6769277Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6769374Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6769600Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6769639Z graph_break [] 2025-12-04T09:45:51.6769715Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6769757Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6769817Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6769914Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6770142Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6770196Z graph_break [] 2025-12-04T09:45:51.6770270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6770316Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6770374Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6770477Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6770751Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6770792Z graph_break [] 2025-12-04T09:45:51.6770868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6770914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6770972Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6771072Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6771296Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6771338Z graph_break [] 2025-12-04T09:45:51.6771412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6771457Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6771514Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6771629Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6771856Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6771897Z graph_break [] 2025-12-04T09:45:51.6771978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6772021Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6772103Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6772200Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6772476Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6772513Z graph_break [] 2025-12-04T09:45:51.6772591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6772634Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6772707Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6772804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6773087Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6773127Z graph_break [] 2025-12-04T09:45:51.6773203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6773244Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6773304Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6773401Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6773629Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6773682Z graph_break [] 2025-12-04T09:45:51.6773758Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6773800Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6773861Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6773956Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6774228Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6774267Z graph_break [] 2025-12-04T09:45:51.6774342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6774386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6774442Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6774541Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6774764Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6774802Z graph_break [] 2025-12-04T09:45:51.6774875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6774918Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6774975Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6775085Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6775310Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6775349Z graph_break [] 2025-12-04T09:45:51.6775422Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6775465Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6775536Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6775634Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6775905Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6775944Z graph_break [] 2025-12-04T09:45:51.6776019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6776060Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6776132Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6776229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6776454Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6776492Z graph_break [] 2025-12-04T09:45:51.6776567Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6776608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6776666Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6776763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6776995Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6777041Z graph_break [] 2025-12-04T09:45:51.6777136Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6777183Z Traceback (most recent call last): 2025-12-04T09:45:51.6777357Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6777405Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6777552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6777612Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6777663Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6777821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6777898Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6777951Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6777958Z 2025-12-04T09:45:51.6778009Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6778105Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6778195Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6778197Z 2025-12-04T09:45:51.6778245Z The failure occurred for item [0] 2025-12-04T09:45:51.6778247Z 2025-12-04T09:45:51.6778321Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6778502Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6778504Z 2025-12-04T09:45:51.6778591Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6778667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6778709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6778768Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6778867Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6779108Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6779145Z graph_break [] 2025-12-04T09:45:51.6779219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6779262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6779321Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6779418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6779662Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6779702Z graph_break [] 2025-12-04T09:45:51.6779775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6779818Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6779874Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6779973Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6780199Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6780248Z graph_break [] 2025-12-04T09:45:51.6780321Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6780365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6780421Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6780522Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6780747Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6780786Z graph_break [] 2025-12-04T09:45:51.6780859Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6780903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6780960Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6781059Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6781285Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6781325Z graph_break [] 2025-12-04T09:45:51.6781399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6781441Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6781497Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6781594Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6781878Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6781916Z graph_break [] 2025-12-04T09:45:51.6781990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6782031Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6782090Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6782185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6782421Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6782458Z graph_break [] 2025-12-04T09:45:51.6782531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6782573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6782632Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6782728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6783012Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6783049Z graph_break [] 2025-12-04T09:45:51.6783125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6783165Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6783224Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6783319Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6783597Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6783648Z graph_break [] 2025-12-04T09:45:51.6783720Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6783764Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6783820Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6783920Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6784194Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6784231Z graph_break [] 2025-12-04T09:45:51.6784303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6784347Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6784403Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6784507Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6784776Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6784817Z graph_break [] 2025-12-04T09:45:51.6784890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6784933Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6784988Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6785091Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6785384Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6785423Z graph_break [] 2025-12-04T09:45:51.6785496Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6785537Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6785596Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6785705Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6785931Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6785967Z graph_break [] 2025-12-04T09:45:51.6786041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6786082Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6786143Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6786250Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6786476Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6786513Z graph_break [] 2025-12-04T09:45:51.6786588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6786631Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6786689Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6786785Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6787064Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6787112Z graph_break [] 2025-12-04T09:45:51.6787188Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6787230Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6787288Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6787385Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6787608Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6787646Z graph_break [] 2025-12-04T09:45:51.6787719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6787761Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6787818Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6787918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6788139Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6788180Z graph_break [] 2025-12-04T09:45:51.6788252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6788296Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6788352Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6788449Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6788729Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6788770Z graph_break [] 2025-12-04T09:45:51.6788844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6788888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6788958Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6789057Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6789279Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6789318Z graph_break [] 2025-12-04T09:45:51.6789392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6789434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6789491Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6789600Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6789825Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6789862Z graph_break [] 2025-12-04T09:45:51.6789936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6789976Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6790035Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6790130Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6790404Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6790452Z graph_break [] 2025-12-04T09:45:51.6790527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6790567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6790627Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6790723Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6790952Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6790988Z graph_break [] 2025-12-04T09:45:51.6791063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6791104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6791163Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6791260Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6791486Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6791525Z graph_break [] 2025-12-04T09:45:51.6791597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6791639Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6791695Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6791793Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6792091Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6792136Z graph_break [] 2025-12-04T09:45:51.6792208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6792250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6792319Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6792416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6792639Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6792677Z graph_break [] 2025-12-04T09:45:51.6792751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6792795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6792852Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6793018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6793243Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6793282Z graph_break [] 2025-12-04T09:45:51.6793354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6793398Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6793455Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6793552Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6793826Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6793876Z graph_break [] 2025-12-04T09:45:51.6793951Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6793992Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6794053Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6794149Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6794373Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6794409Z graph_break [] 2025-12-04T09:45:51.6794485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6794527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6794585Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6794681Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6794908Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6794947Z graph_break [] 2025-12-04T09:45:51.6795021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6795061Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6795120Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6795215Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6795504Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6795544Z graph_break [] 2025-12-04T09:45:51.6795616Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6795658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6795732Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6797526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6797749Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6797787Z graph_break [] 2025-12-04T09:45:51.6797863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6797907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6797988Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6798087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6798311Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6798351Z graph_break [] 2025-12-04T09:45:51.6798423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6798465Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6798521Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6798623Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6798896Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6798951Z graph_break [] 2025-12-04T09:45:51.6799026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6799072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6799130Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6799225Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6799450Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6799486Z graph_break [] 2025-12-04T09:45:51.6799563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6799604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6799663Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6799762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6799987Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6800025Z graph_break [] 2025-12-04T09:45:51.6800099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6800140Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6800206Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6800318Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6800598Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6800635Z graph_break [] 2025-12-04T09:45:51.6800731Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6800790Z Traceback (most recent call last): 2025-12-04T09:45:51.6800963Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6801012Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6801155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6801216Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6801263Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6801422Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6801506Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6801563Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6801565Z 2025-12-04T09:45:51.6801619Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6801711Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6801798Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6801800Z 2025-12-04T09:45:51.6801847Z The failure occurred for item [0] 2025-12-04T09:45:51.6801849Z 2025-12-04T09:45:51.6801924Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6802095Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6802097Z 2025-12-04T09:45:51.6802193Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6802270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6802312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6802372Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6802471Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6802703Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6802741Z graph_break [] 2025-12-04T09:45:51.6802813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6802857Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6802914Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6803051Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6803276Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6803315Z graph_break [] 2025-12-04T09:45:51.6803387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6803430Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6803486Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6803584Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6803825Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6803866Z graph_break [] 2025-12-04T09:45:51.6803939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6803981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6804040Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6804137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6804379Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6804417Z graph_break [] 2025-12-04T09:45:51.6804489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6804531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6804589Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6804686Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6804932Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6804971Z graph_break [] 2025-12-04T09:45:51.6805046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6805087Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6805144Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6805240Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6805513Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6805564Z graph_break [] 2025-12-04T09:45:51.6805638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6805679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6805736Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6805832Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6806058Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6806094Z graph_break [] 2025-12-04T09:45:51.6806169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6806210Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6806268Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6806366Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6806598Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6806634Z graph_break [] 2025-12-04T09:45:51.6806709Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6806750Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6806808Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6806905Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6807193Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6807233Z graph_break [] 2025-12-04T09:45:51.6807307Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6807349Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6807405Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6807502Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6807791Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6807829Z graph_break [] 2025-12-04T09:45:51.6807900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6807944Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6808000Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6808108Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6808380Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6808420Z graph_break [] 2025-12-04T09:45:51.6808494Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6808536Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6808592Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6808691Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6808964Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6809011Z graph_break [] 2025-12-04T09:45:51.6809085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6809126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6809184Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6809279Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6809505Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6809540Z graph_break [] 2025-12-04T09:45:51.6809614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6809655Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6809713Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6809809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6810035Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6810072Z graph_break [] 2025-12-04T09:45:51.6810146Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6810186Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6810244Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6810339Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6810626Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6810665Z graph_break [] 2025-12-04T09:45:51.6810737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6810779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6810856Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6810954Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6811178Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6811215Z graph_break [] 2025-12-04T09:45:51.6811288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6811332Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6811389Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6811497Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6811721Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6811759Z graph_break [] 2025-12-04T09:45:51.6811831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6811876Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6811931Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6812028Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6812299Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6812348Z graph_break [] 2025-12-04T09:45:51.6812420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6812462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6812521Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6812619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6812850Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6812886Z graph_break [] 2025-12-04T09:45:51.6813006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6813048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6813105Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6813202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6813426Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6813463Z graph_break [] 2025-12-04T09:45:51.6813537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6813579Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6813636Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6813731Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6814019Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6814057Z graph_break [] 2025-12-04T09:45:51.6814130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6814171Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6814247Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6814343Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6814572Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6814610Z graph_break [] 2025-12-04T09:45:51.6814683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6814725Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6814798Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6814896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6815117Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6815155Z graph_break [] 2025-12-04T09:45:51.6815227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6815269Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6815325Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6815421Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6815692Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6815745Z graph_break [] 2025-12-04T09:45:51.6815816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6815858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6815915Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6816012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6816235Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6816275Z graph_break [] 2025-12-04T09:45:51.6816349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6816394Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6816452Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6816552Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6816777Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6816814Z graph_break [] 2025-12-04T09:45:51.6816890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6816933Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6816991Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6817097Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6817370Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6817408Z graph_break [] 2025-12-04T09:45:51.6817484Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6817541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6817598Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6817694Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6817919Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6817956Z graph_break [] 2025-12-04T09:45:51.6818032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6818074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6818145Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6818242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6818472Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6818511Z graph_break [] 2025-12-04T09:45:51.6818584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6818627Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6818683Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6818781Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6819054Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6819105Z graph_break [] 2025-12-04T09:45:51.6819177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6819221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6819277Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6819375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6819596Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6819635Z graph_break [] 2025-12-04T09:45:51.6819708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6819751Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6819808Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6819906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6820127Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6820168Z graph_break [] 2025-12-04T09:45:51.6820239Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6820282Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6820338Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6820444Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6820721Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6820759Z graph_break [] 2025-12-04T09:45:51.6820833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6820888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6820945Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6821041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6821265Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6821301Z graph_break [] 2025-12-04T09:45:51.6821376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6821418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6821488Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6821585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6821809Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6821845Z graph_break [] 2025-12-04T09:45:51.6821920Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6821961Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6822021Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6822117Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6822397Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6822453Z graph_break [] 2025-12-04T09:45:51.6822526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6822569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6822625Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6822722Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6823011Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6823051Z graph_break [] 2025-12-04T09:45:51.6823144Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6826737Z Traceback (most recent call last): 2025-12-04T09:45:51.6826929Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6826982Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6827131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6827196Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6827241Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6827404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6827478Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6827583Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6827587Z 2025-12-04T09:45:51.6827645Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6827738Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6828011Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6828014Z 2025-12-04T09:45:51.6828060Z The failure occurred for item [0] 2025-12-04T09:45:51.6828080Z 2025-12-04T09:45:51.6828158Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6828329Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6828331Z 2025-12-04T09:45:51.6828419Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6828492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6828539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6828597Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6828715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6828941Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6828982Z graph_break [] 2025-12-04T09:45:51.6829055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6829098Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6829155Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6829252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6829477Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6829533Z graph_break [] 2025-12-04T09:45:51.6829609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6829650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6829707Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6829804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6830031Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6830068Z graph_break [] 2025-12-04T09:45:51.6830142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6830182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6830241Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6830339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6830568Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6830606Z graph_break [] 2025-12-04T09:45:51.6830680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6830720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6830778Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6830874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6831112Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6831151Z graph_break [] 2025-12-04T09:45:51.6831226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6831268Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6831325Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6831421Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6831706Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6831744Z graph_break [] 2025-12-04T09:45:51.6831816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6831860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6831916Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6832015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6832251Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6832290Z graph_break [] 2025-12-04T09:45:51.6832364Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6832406Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6832462Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6832559Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6832781Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6832833Z graph_break [] 2025-12-04T09:45:51.6832906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6832996Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6833053Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6833150Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6833424Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6833460Z graph_break [] 2025-12-04T09:45:51.6833533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6833574Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6833632Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6833729Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6834001Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6834039Z graph_break [] 2025-12-04T09:45:51.6834112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6834152Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6834209Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6834305Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6834597Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6834637Z graph_break [] 2025-12-04T09:45:51.6834710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6834751Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6834808Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6834921Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6835191Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6835230Z graph_break [] 2025-12-04T09:45:51.6835302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6835345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6835400Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6835512Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6835737Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6835775Z graph_break [] 2025-12-04T09:45:51.6835847Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6835888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6835944Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6836042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6836270Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6836322Z graph_break [] 2025-12-04T09:45:51.6836394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6836437Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6836492Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6836591Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6836862Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6836900Z graph_break [] 2025-12-04T09:45:51.6836972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6837015Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6837071Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6837169Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6837392Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6837429Z graph_break [] 2025-12-04T09:45:51.6837502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6837542Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6837599Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6837696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6837931Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6837969Z graph_break [] 2025-12-04T09:45:51.6838042Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6838082Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6838153Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6838249Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6838523Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6838560Z graph_break [] 2025-12-04T09:45:51.6838635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6838676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6838744Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6838840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6839063Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6839101Z graph_break [] 2025-12-04T09:45:51.6839173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6839214Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6839270Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6839369Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6839591Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6839645Z graph_break [] 2025-12-04T09:45:51.6839717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6839759Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6839816Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6839914Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6840190Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6840228Z graph_break [] 2025-12-04T09:45:51.6840301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6840344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6840400Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6840497Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6840718Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6840758Z graph_break [] 2025-12-04T09:45:51.6840829Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6840871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6840927Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6841033Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6841257Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6841295Z graph_break [] 2025-12-04T09:45:51.6841368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6841408Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6841477Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6841575Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6841848Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6841885Z graph_break [] 2025-12-04T09:45:51.6841959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6842000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6842069Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6842166Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6842391Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6842428Z graph_break [] 2025-12-04T09:45:51.6842502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6842542Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6842604Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6842702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6842975Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6843030Z graph_break [] 2025-12-04T09:45:51.6843104Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6843147Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6843203Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6843301Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6843571Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6843610Z graph_break [] 2025-12-04T09:45:51.6843682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6843725Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6843781Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6843878Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6844104Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6844143Z graph_break [] 2025-12-04T09:45:51.6844215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6844261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6844320Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6844431Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6844657Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6844695Z graph_break [] 2025-12-04T09:45:51.6844768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6844811Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6844883Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6844980Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6845251Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6845288Z graph_break [] 2025-12-04T09:45:51.6845361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6845402Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6845474Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6845572Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6845795Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6845832Z graph_break [] 2025-12-04T09:45:51.6845905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6845946Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6846004Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6846103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6846331Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6846378Z graph_break [] 2025-12-04T09:45:51.6846453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6846495Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6846553Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6846647Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6846919Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6846956Z graph_break [] 2025-12-04T09:45:51.6847030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6847075Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6847131Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6847228Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6847450Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6847489Z graph_break [] 2025-12-04T09:45:51.6847561Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6847602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6847658Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6847765Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6847991Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6848029Z graph_break [] 2025-12-04T09:45:51.6848101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6848155Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6848211Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6848307Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6848578Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6848616Z graph_break [] 2025-12-04T09:45:51.6848687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6848741Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6848798Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6848895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6849120Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6849156Z graph_break [] 2025-12-04T09:45:51.6849230Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6849270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6849327Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6849424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6849659Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6849695Z graph_break [] 2025-12-04T09:45:51.6849790Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6849839Z Traceback (most recent call last): 2025-12-04T09:45:51.6850014Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6850062Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6850211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6850272Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6850321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6850481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6850558Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6850611Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6850613Z 2025-12-04T09:45:51.6850667Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6850760Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6850850Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6850852Z 2025-12-04T09:45:51.6850898Z The failure occurred for item [0] 2025-12-04T09:45:51.6850902Z 2025-12-04T09:45:51.6850979Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6851176Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6851179Z 2025-12-04T09:45:51.6851267Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6851342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6851384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6851444Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6851555Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6851780Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6851816Z graph_break [] 2025-12-04T09:45:51.6851889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6851932Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6851991Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6852107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6852338Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6852377Z graph_break [] 2025-12-04T09:45:51.6852451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6852493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6852551Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6852647Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6852873Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6852921Z graph_break [] 2025-12-04T09:45:51.6853034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6853076Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6853133Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6853231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6853456Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6853495Z graph_break [] 2025-12-04T09:45:51.6853567Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6853609Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6853666Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6853764Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6853987Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6854027Z graph_break [] 2025-12-04T09:45:51.6854102Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6854144Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6854200Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6854298Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6854597Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6854639Z graph_break [] 2025-12-04T09:45:51.6854712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6854756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6854815Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6854910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6855154Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6855192Z graph_break [] 2025-12-04T09:45:51.6855268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6855309Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6855369Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6855467Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6855707Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6855745Z graph_break [] 2025-12-04T09:45:51.6855821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6855861Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6855919Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6856014Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6856293Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6856345Z graph_break [] 2025-12-04T09:45:51.6856421Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6856463Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6856524Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6856619Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6856892Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6856929Z graph_break [] 2025-12-04T09:45:51.6857003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6857047Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6857103Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6857204Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6857474Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6857514Z graph_break [] 2025-12-04T09:45:51.6857585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6857628Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6857685Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6857784Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6858068Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6858110Z graph_break [] 2025-12-04T09:45:51.6858182Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6858224Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6858304Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6858404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6858632Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6858672Z graph_break [] 2025-12-04T09:45:51.6858749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6858791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6858853Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6858961Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6859195Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6859234Z graph_break [] 2025-12-04T09:45:51.6859311Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6859353Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6859414Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6859511Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6859787Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6859836Z graph_break [] 2025-12-04T09:45:51.6859912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6859953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6860018Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6860115Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6860348Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6860386Z graph_break [] 2025-12-04T09:45:51.6860462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6860505Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6860565Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6860664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6860888Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6860931Z graph_break [] 2025-12-04T09:45:51.6861005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6861049Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6861106Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6861205Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6861490Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6861532Z graph_break [] 2025-12-04T09:45:51.6861606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6861650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6861721Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6861822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6862047Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6862086Z graph_break [] 2025-12-04T09:45:51.6862162Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6862208Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6862276Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6862377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6862600Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6862642Z graph_break [] 2025-12-04T09:45:51.6862717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6862759Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6862819Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6862915Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6863239Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6863292Z graph_break [] 2025-12-04T09:45:51.6863369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6863411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6863472Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6863568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6863797Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6863834Z graph_break [] 2025-12-04T09:45:51.6863911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6863953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6864013Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6864109Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6864335Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6864371Z graph_break [] 2025-12-04T09:45:51.6864444Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6864485Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6864542Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6864654Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6864927Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6864966Z graph_break [] 2025-12-04T09:45:51.6865037Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6865116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6865172Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6865268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6865490Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6865531Z graph_break [] 2025-12-04T09:45:51.6865603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6865646Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6865716Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6865813Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6866035Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6866074Z graph_break [] 2025-12-04T09:45:51.6866147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6866192Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6866248Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6866347Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6866617Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6866666Z graph_break [] 2025-12-04T09:45:51.6866739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6866781Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6866839Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6866934Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6867159Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6867195Z graph_break [] 2025-12-04T09:45:51.6867269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6867313Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6867372Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6867468Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6867692Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6867729Z graph_break [] 2025-12-04T09:45:51.6867802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6867843Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6867902Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6868007Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6868285Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6868322Z graph_break [] 2025-12-04T09:45:51.6868396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6868448Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6868508Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6868603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6868825Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6868863Z graph_break [] 2025-12-04T09:45:51.6868935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6868979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6869046Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6869144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6869365Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6869404Z graph_break [] 2025-12-04T09:45:51.6869476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6869520Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6869577Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6869675Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6869945Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6869999Z graph_break [] 2025-12-04T09:45:51.6870072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6870118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6870173Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6870270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6870494Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6870534Z graph_break [] 2025-12-04T09:45:51.6870607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6870650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6870708Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6870803Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6871028Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6871067Z graph_break [] 2025-12-04T09:45:51.6871140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6871181Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6871238Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6871348Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6871623Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6871660Z graph_break [] 2025-12-04T09:45:51.6871735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6871787Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6871845Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6871940Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6872172Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6872209Z graph_break [] 2025-12-04T09:45:51.6872284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6872326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6872394Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6872490Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6872712Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6872750Z graph_break [] 2025-12-04T09:45:51.6872822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6872864Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6872920Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6873065Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6873354Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6873393Z graph_break [] 2025-12-04T09:45:51.6873487Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6873535Z Traceback (most recent call last): 2025-12-04T09:45:51.6873707Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6873756Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6873898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6873960Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6874006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6874171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6874244Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6874301Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6874303Z 2025-12-04T09:45:51.6874357Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6874453Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6874540Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6874544Z 2025-12-04T09:45:51.6874588Z The failure occurred for item [0] 2025-12-04T09:45:51.6874590Z 2025-12-04T09:45:51.6874667Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6874855Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6874858Z 2025-12-04T09:45:51.6874948Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6875021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6875066Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6875123Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6875238Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6875461Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6875499Z graph_break [] 2025-12-04T09:45:51.6875571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6875615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6875671Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6875785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6876009Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6876049Z graph_break [] 2025-12-04T09:45:51.6876122Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6876165Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6876221Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6876319Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6876545Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6876592Z graph_break [] 2025-12-04T09:45:51.6876667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6876708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6876766Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6876862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6877085Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6877121Z graph_break [] 2025-12-04T09:45:51.6877195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6877236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6877294Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6877391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6877615Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6877654Z graph_break [] 2025-12-04T09:45:51.6877728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6877771Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6877831Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6877925Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6878226Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6878267Z graph_break [] 2025-12-04T09:45:51.6878341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6878384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6878441Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6878550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6878773Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6878811Z graph_break [] 2025-12-04T09:45:51.6878884Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6878928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6878988Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6879096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6879319Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6879358Z graph_break [] 2025-12-04T09:45:51.6879429Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6879471Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6879527Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6879623Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6879895Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6879944Z graph_break [] 2025-12-04T09:45:51.6880017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6880060Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6880116Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6880214Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6880486Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6880523Z graph_break [] 2025-12-04T09:45:51.6880598Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6880638Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6880696Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6880792Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6881064Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6881102Z graph_break [] 2025-12-04T09:45:51.6881177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6881218Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6881276Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6881371Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6881651Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6881689Z graph_break [] 2025-12-04T09:45:51.6881763Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6881803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6881874Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6881970Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6882206Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6882245Z graph_break [] 2025-12-04T09:45:51.6882319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6882362Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6882430Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6882527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6882749Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6882788Z graph_break [] 2025-12-04T09:45:51.6882860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6882902Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6882998Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6883098Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6883368Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6883424Z graph_break [] 2025-12-04T09:45:51.6883496Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6883540Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6883596Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6883692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6883916Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6883954Z graph_break [] 2025-12-04T09:45:51.6884028Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6884071Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6884128Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6884225Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6884449Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6884487Z graph_break [] 2025-12-04T09:45:51.6884562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6884602Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6884660Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6884771Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6885044Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6885082Z graph_break [] 2025-12-04T09:45:51.6885156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6885211Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6885269Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6885364Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6885588Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6885624Z graph_break [] 2025-12-04T09:45:51.6885699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6885740Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6885816Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6885913Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6886143Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6886182Z graph_break [] 2025-12-04T09:45:51.6886254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6886296Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6886354Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6886452Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6886724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6886773Z graph_break [] 2025-12-04T09:45:51.6886845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6886889Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6886945Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6887043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6887266Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6887306Z graph_break [] 2025-12-04T09:45:51.6887378Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6887421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6887478Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6887576Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6887799Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6887841Z graph_break [] 2025-12-04T09:45:51.6887914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6887956Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6888012Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6888122Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6888396Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6888434Z graph_break [] 2025-12-04T09:45:51.6888508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6888560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6888618Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6888714Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6888938Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6888975Z graph_break [] 2025-12-04T09:45:51.6889049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6889090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6889160Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6889256Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6889478Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6889517Z graph_break [] 2025-12-04T09:45:51.6889590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6889630Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6889697Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6889795Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6890075Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6890134Z graph_break [] 2025-12-04T09:45:51.6890208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6890255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6890312Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6890414Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6890637Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6890680Z graph_break [] 2025-12-04T09:45:51.6890753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6890800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6890861Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6890960Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6891183Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6891224Z graph_break [] 2025-12-04T09:45:51.6891297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6891342Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6891399Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6891511Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6891787Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6891827Z graph_break [] 2025-12-04T09:45:51.6891902Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6891956Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6892014Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6892114Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6892341Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6892378Z graph_break [] 2025-12-04T09:45:51.6892454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6892509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6892569Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6892665Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6892893Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6892980Z graph_break [] 2025-12-04T09:45:51.6893056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6893098Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6893158Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6893255Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6893550Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6893589Z graph_break [] 2025-12-04T09:45:51.6893665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6893709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6893770Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6893866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6894098Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6894139Z graph_break [] 2025-12-04T09:45:51.6894214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6894262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6894319Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6894418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6894643Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6894684Z graph_break [] 2025-12-04T09:45:51.6894757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6894802Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6894859Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6894975Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6895249Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6895289Z graph_break [] 2025-12-04T09:45:51.6895362Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6895421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6895479Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6895577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6895802Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6895844Z graph_break [] 2025-12-04T09:45:51.6895919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6895978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6896036Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6896135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6896362Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6896399Z graph_break [] 2025-12-04T09:45:51.6896475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6896516Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6896577Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6896676Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6896962Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6897000Z graph_break [] 2025-12-04T09:45:51.6897078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6897120Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6897182Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6897278Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6897507Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6897544Z graph_break [] 2025-12-04T09:45:51.6897643Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6897691Z Traceback (most recent call last): 2025-12-04T09:45:51.6897867Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6897916Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6898065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6898127Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6898177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6898340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6898423Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6898482Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6898485Z 2025-12-04T09:45:51.6898541Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6898636Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6898723Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6898725Z 2025-12-04T09:45:51.6898786Z The failure occurred for item [0] 2025-12-04T09:45:51.6898788Z 2025-12-04T09:45:51.6898865Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6899036Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6899039Z 2025-12-04T09:45:51.6899125Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6899203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6899247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6899308Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6899419Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6899650Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6899688Z graph_break [] 2025-12-04T09:45:51.6899765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6899810Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6899868Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6899969Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6900198Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6900252Z graph_break [] 2025-12-04T09:45:51.6900326Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6900370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6900428Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6900529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6900750Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6900791Z graph_break [] 2025-12-04T09:45:51.6900864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6900909Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6900966Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6901068Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6901292Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6901333Z graph_break [] 2025-12-04T09:45:51.6901406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6901451Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6901508Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6901608Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6901844Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6901885Z graph_break [] 2025-12-04T09:45:51.6901962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6902005Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6902067Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6902179Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6902458Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6902496Z graph_break [] 2025-12-04T09:45:51.6902571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6902614Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6902674Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6902790Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6903061Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6903099Z graph_break [] 2025-12-04T09:45:51.6903175Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6903217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6903276Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6903374Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6903603Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6903657Z graph_break [] 2025-12-04T09:45:51.6903734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6903775Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6903834Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6903932Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6904211Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6904251Z graph_break [] 2025-12-04T09:45:51.6904324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6904368Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6904426Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6904526Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6904799Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6904842Z graph_break [] 2025-12-04T09:45:51.6904916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6904961Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6905017Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6905118Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6905415Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6905457Z graph_break [] 2025-12-04T09:45:51.6905530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6905577Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6905652Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6905752Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6906027Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6906065Z graph_break [] 2025-12-04T09:45:51.6906145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6906190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6906264Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6906361Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6906589Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6906628Z graph_break [] 2025-12-04T09:45:51.6906705Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6906747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6906806Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6906904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6907132Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6907180Z graph_break [] 2025-12-04T09:45:51.6907256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6907298Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6907358Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6907454Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6907729Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6907771Z graph_break [] 2025-12-04T09:45:51.6907845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6907891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6907949Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6908049Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6908278Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6908320Z graph_break [] 2025-12-04T09:45:51.6908393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6908438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6908495Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6908605Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6908830Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6908872Z graph_break [] 2025-12-04T09:45:51.6908946Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6909001Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6909057Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6909157Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6909426Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6909468Z graph_break [] 2025-12-04T09:45:51.6909542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6909588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6909657Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6909756Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6909982Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6910021Z graph_break [] 2025-12-04T09:45:51.6910098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6910140Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6910200Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6910299Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6910530Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6910580Z graph_break [] 2025-12-04T09:45:51.6910656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6910698Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6910758Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6910854Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6911129Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6911167Z graph_break [] 2025-12-04T09:45:51.6911243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6911288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6911350Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6911446Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6911674Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6911712Z graph_break [] 2025-12-04T09:45:51.6911788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6911832Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6911890Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6911998Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6912228Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6912269Z graph_break [] 2025-12-04T09:45:51.6912342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6912398Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6912455Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6912555Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6912826Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6912868Z graph_break [] 2025-12-04T09:45:51.6912973Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6913035Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6913092Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6913188Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6913409Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6913449Z graph_break [] 2025-12-04T09:45:51.6913521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6913563Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6913621Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6913721Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6913961Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6913997Z graph_break [] 2025-12-04T09:45:51.6914072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6914114Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6914172Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6914268Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6914542Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6914578Z graph_break [] 2025-12-04T09:45:51.6914653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6914694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6914752Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6914847Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6915072Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6915110Z graph_break [] 2025-12-04T09:45:51.6915184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6915224Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6915282Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6915394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6915621Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6915660Z graph_break [] 2025-12-04T09:45:51.6915735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6916456Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6916514Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6916612Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6916892Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6916931Z graph_break [] 2025-12-04T09:45:51.6917004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6917058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6917115Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6917213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6917437Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6917474Z graph_break [] 2025-12-04T09:45:51.6917546Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6917588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6917643Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6917741Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6917977Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6918017Z graph_break [] 2025-12-04T09:45:51.6918089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6918133Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6918189Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6918285Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6918556Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6918593Z graph_break [] 2025-12-04T09:45:51.6918667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6918709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6918766Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6918862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6919090Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6919126Z graph_break [] 2025-12-04T09:45:51.6919199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6919239Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6919296Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6919401Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6919627Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6919663Z graph_break [] 2025-12-04T09:45:51.6919737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6919790Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6919849Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6919944Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6920217Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6920254Z graph_break [] 2025-12-04T09:45:51.6920328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6920382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6920440Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6920538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6920765Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6920803Z graph_break [] 2025-12-04T09:45:51.6920875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6920917Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6920974Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6921072Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6921310Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6921348Z graph_break [] 2025-12-04T09:45:51.6921420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6921463Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6921519Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6921616Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6921890Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6921929Z graph_break [] 2025-12-04T09:45:51.6922003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6922052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6922109Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6922207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6922432Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6922470Z graph_break [] 2025-12-04T09:45:51.6922544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6922585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6922657Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6922755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6923051Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6923088Z graph_break [] 2025-12-04T09:45:51.6923183Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6923254Z Traceback (most recent call last): 2025-12-04T09:45:51.6923426Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6923474Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6923620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6923680Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6923727Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6923899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6923975Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6924028Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6924032Z 2025-12-04T09:45:51.6924086Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.6924178Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6924268Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6924270Z 2025-12-04T09:45:51.6924315Z The failure occurred for item [0] 2025-12-04T09:45:51.6924318Z 2025-12-04T09:45:51.6924393Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6924565Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6924587Z 2025-12-04T09:45:51.6924675Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6924749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6924791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6924850Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6924951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6925177Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6925213Z graph_break [] 2025-12-04T09:45:51.6925288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6925329Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6925391Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6925487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6925710Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6925747Z graph_break [] 2025-12-04T09:45:51.6925822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6925863Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6925921Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6926018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6926258Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6926299Z graph_break [] 2025-12-04T09:45:51.6926371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6926414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6926471Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6926582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6926805Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6926845Z graph_break [] 2025-12-04T09:45:51.6926916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6926959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6927017Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6927127Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6927350Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6927389Z graph_break [] 2025-12-04T09:45:51.6927461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6927503Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6927559Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6927656Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6927928Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6927977Z graph_break [] 2025-12-04T09:45:51.6928049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6928092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6928148Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6928245Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6928471Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6928508Z graph_break [] 2025-12-04T09:45:51.6928581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6928623Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6928681Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6928777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6929004Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6929042Z graph_break [] 2025-12-04T09:45:51.6929116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6929157Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6929215Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6929309Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6929600Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6929639Z graph_break [] 2025-12-04T09:45:51.6929713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6929753Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6929810Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6929918Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6930190Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6930227Z graph_break [] 2025-12-04T09:45:51.6930300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6930344Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6930401Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6930513Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6930784Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6930824Z graph_break [] 2025-12-04T09:45:51.6930896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6930938Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6930994Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6931094Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6931368Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6931419Z graph_break [] 2025-12-04T09:45:51.6931492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6931536Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6931592Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6931689Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6931914Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6931953Z graph_break [] 2025-12-04T09:45:51.6932026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6932069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6932127Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6932223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6932452Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6932489Z graph_break [] 2025-12-04T09:45:51.6932563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6932603Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6932661Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6932765Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6933085Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6933122Z graph_break [] 2025-12-04T09:45:51.6933196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6933256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6933315Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6933410Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6933634Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6933671Z graph_break [] 2025-12-04T09:45:51.6933744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6933786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6933857Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6933956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6934180Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6934220Z graph_break [] 2025-12-04T09:45:51.6934292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6934334Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6934390Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6934487Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6934761Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6934814Z graph_break [] 2025-12-04T09:45:51.6934886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6934930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6934986Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6935083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6935305Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6935343Z graph_break [] 2025-12-04T09:45:51.6935415Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6935459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6935515Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6935613Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6935836Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6935875Z graph_break [] 2025-12-04T09:45:51.6935947Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6935990Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6936048Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6936161Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6936440Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6936477Z graph_break [] 2025-12-04T09:45:51.6936551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6936606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6936664Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6936759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6936983Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6937020Z graph_break [] 2025-12-04T09:45:51.6937093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6937135Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6937202Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6937297Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6937519Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6937556Z graph_break [] 2025-12-04T09:45:51.6937630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6937670Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6937728Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6937825Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6938110Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6938148Z graph_break [] 2025-12-04T09:45:51.6938221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6938265Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6938320Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6938418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6938641Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6938680Z graph_break [] 2025-12-04T09:45:51.6938751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6938795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6938851Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6938947Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6939168Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6939207Z graph_break [] 2025-12-04T09:45:51.6939278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6939321Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6939376Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6939483Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6939757Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6939795Z graph_break [] 2025-12-04T09:45:51.6939871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6939925Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6939983Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6940078Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6940307Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6940344Z graph_break [] 2025-12-04T09:45:51.6940419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6940471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6940531Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6940627Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6940853Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6940890Z graph_break [] 2025-12-04T09:45:51.6940964Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6941005Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6941063Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6941159Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6941448Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6941485Z graph_break [] 2025-12-04T09:45:51.6941560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6941601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6941658Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6941755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6941982Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6942020Z graph_break [] 2025-12-04T09:45:51.6942093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6942136Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6942192Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6942289Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6942512Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6942552Z graph_break [] 2025-12-04T09:45:51.6942623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6942666Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6942722Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6942830Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6943146Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6943185Z graph_break [] 2025-12-04T09:45:51.6943257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6943320Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6943376Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6943473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6943696Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6943736Z graph_break [] 2025-12-04T09:45:51.6943809Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6943864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6943920Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6944018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6944244Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6944282Z graph_break [] 2025-12-04T09:45:51.6944355Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6944396Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6944453Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6944549Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6944837Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6944875Z graph_break [] 2025-12-04T09:45:51.6944949Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6944990Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6945047Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6945142Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6945367Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6945404Z graph_break [] 2025-12-04T09:45:51.6945479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6945520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6945580Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6945675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6945901Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6945941Z graph_break [] 2025-12-04T09:45:51.6946013Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6946055Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6946129Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6946227Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6946501Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6946539Z graph_break [] 2025-12-04T09:45:51.6946623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6946665Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6946721Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6946819Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6947044Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6947084Z graph_break [] 2025-12-04T09:45:51.6947166Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6947211Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6947267Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6947364Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6947588Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6947627Z graph_break [] 2025-12-04T09:45:51.6947699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6947743Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6947800Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6947897Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6948185Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6948222Z graph_break [] 2025-12-04T09:45:51.6948319Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6948365Z Traceback (most recent call last): 2025-12-04T09:45:51.6948537Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6948585Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6948730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6948791Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6948839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6948999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6949074Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6949127Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6949130Z 2025-12-04T09:45:51.6949187Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.6949278Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6949367Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6949370Z 2025-12-04T09:45:51.6949414Z The failure occurred for item [0] 2025-12-04T09:45:51.6949416Z 2025-12-04T09:45:51.6949505Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6949677Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6949680Z 2025-12-04T09:45:51.6949768Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6949842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6949884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6949955Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6950054Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6950284Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6950321Z graph_break [] 2025-12-04T09:45:51.6950396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6950438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6950496Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6950603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6950829Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6950867Z graph_break [] 2025-12-04T09:45:51.6950942Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6950983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6951041Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6951137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6951363Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6951414Z graph_break [] 2025-12-04T09:45:51.6951486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6951530Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6951589Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6951686Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6951908Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6951945Z graph_break [] 2025-12-04T09:45:51.6952018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6952061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6952118Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6952217Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6952441Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6952480Z graph_break [] 2025-12-04T09:45:51.6952552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6952596Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6952652Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6952748Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6953081Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6953120Z graph_break [] 2025-12-04T09:45:51.6953192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6953234Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6955669Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6955770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6955998Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6956036Z graph_break [] 2025-12-04T09:45:51.6956113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6956153Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6956213Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6956339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6956566Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6956604Z graph_break [] 2025-12-04T09:45:51.6956678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6956719Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6956777Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6956872Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6957150Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6957206Z graph_break [] 2025-12-04T09:45:51.6957280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6957320Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6957379Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6957475Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6957746Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6957782Z graph_break [] 2025-12-04T09:45:51.6957858Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6957902Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6957961Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6958059Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6958328Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6958367Z graph_break [] 2025-12-04T09:45:51.6958439Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6958481Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6958537Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6958646Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6958922Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6958960Z graph_break [] 2025-12-04T09:45:51.6959032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6959089Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6959144Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6959242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6959467Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6959505Z graph_break [] 2025-12-04T09:45:51.6959577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6959638Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6959695Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6959792Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6960018Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6960055Z graph_break [] 2025-12-04T09:45:51.6960128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6960169Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6960228Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6960326Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6960616Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6960652Z graph_break [] 2025-12-04T09:45:51.6960726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6960767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6960827Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6960922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6961147Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6961183Z graph_break [] 2025-12-04T09:45:51.6961258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6961299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6961357Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6961451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6961676Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6961712Z graph_break [] 2025-12-04T09:45:51.6961786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6961828Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6961884Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6962005Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6962280Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6962317Z graph_break [] 2025-12-04T09:45:51.6962389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6962445Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6962500Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6962600Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6962824Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6962862Z graph_break [] 2025-12-04T09:45:51.6962984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6963042Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6963100Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6963197Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6963420Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6963458Z graph_break [] 2025-12-04T09:45:51.6963530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6963574Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6963630Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6963729Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6964022Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6964060Z graph_break [] 2025-12-04T09:45:51.6964134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6964175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6964233Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6964328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6964557Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6964593Z graph_break [] 2025-12-04T09:45:51.6964668Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6964709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6964767Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6964862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6965087Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6965124Z graph_break [] 2025-12-04T09:45:51.6965198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6965238Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6965297Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6965412Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6965687Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6965723Z graph_break [] 2025-12-04T09:45:51.6965817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6965859Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6965915Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6966011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6966233Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6966271Z graph_break [] 2025-12-04T09:45:51.6966346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6966398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6966454Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6966554Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6966780Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6966818Z graph_break [] 2025-12-04T09:45:51.6966890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6966931Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6966988Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6967086Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6967369Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6967407Z graph_break [] 2025-12-04T09:45:51.6967481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6967523Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6967579Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6967675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6967900Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6967938Z graph_break [] 2025-12-04T09:45:51.6968013Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6968053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6968110Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6968205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6968434Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6968470Z graph_break [] 2025-12-04T09:45:51.6968544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6968585Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6968654Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6968750Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6969023Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6969059Z graph_break [] 2025-12-04T09:45:51.6969150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6969190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6969248Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6969343Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6969569Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6969607Z graph_break [] 2025-12-04T09:45:51.6969696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6969738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6969795Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6969892Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6970116Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6970154Z graph_break [] 2025-12-04T09:45:51.6970226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6970268Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6970324Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6970424Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6970709Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6970747Z graph_break [] 2025-12-04T09:45:51.6970820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6970862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6970917Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6971014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6971236Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6971275Z graph_break [] 2025-12-04T09:45:51.6971348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6971390Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6971446Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6971543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6971766Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6971804Z graph_break [] 2025-12-04T09:45:51.6971877Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6971917Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6971985Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6972081Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6972358Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6972411Z graph_break [] 2025-12-04T09:45:51.6972486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6972526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6972583Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6972678Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6972904Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6973061Z graph_break [] 2025-12-04T09:45:51.6973158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6973199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6973256Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6973351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6973576Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6973612Z graph_break [] 2025-12-04T09:45:51.6973686Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6973727Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6973786Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6973881Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6974171Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6974210Z graph_break [] 2025-12-04T09:45:51.6974282Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6974324Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6974380Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6974481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6974707Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6974746Z graph_break [] 2025-12-04T09:45:51.6974819Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6974861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6974916Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6975013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6975235Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6975275Z graph_break [] 2025-12-04T09:45:51.6975346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6975388Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6975462Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6975560Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6975830Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6975893Z graph_break [] 2025-12-04T09:45:51.6975966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6976007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6976064Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6976159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6976389Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6976426Z graph_break [] 2025-12-04T09:45:51.6976532Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.6976579Z Traceback (most recent call last): 2025-12-04T09:45:51.6976754Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6976803Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.6976948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.6977007Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.6977055Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.6977214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.6977288Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.6977353Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.6977357Z 2025-12-04T09:45:51.6977413Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.6977503Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.6977591Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.6977595Z 2025-12-04T09:45:51.6977640Z The failure occurred for item [0] 2025-12-04T09:45:51.6977643Z 2025-12-04T09:45:51.6977718Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.6977890Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.6977892Z 2025-12-04T09:45:51.6977978Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.6978053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6978095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6978155Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6978253Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6978479Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6978516Z graph_break [] 2025-12-04T09:45:51.6978590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6978630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6978688Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6978796Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6979022Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6979060Z graph_break [] 2025-12-04T09:45:51.6979133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6979174Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6979245Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6979341Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6979565Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6979603Z graph_break [] 2025-12-04T09:45:51.6979676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6979719Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6979787Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6979885Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6980105Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6980144Z graph_break [] 2025-12-04T09:45:51.6980216Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6980258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6980313Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6980410Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6980640Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6980692Z graph_break [] 2025-12-04T09:45:51.6980764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6980806Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6980863Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6980960Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6981231Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6981270Z graph_break [] 2025-12-04T09:45:51.6981343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6981386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6981444Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6981540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6981763Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6981800Z graph_break [] 2025-12-04T09:45:51.6981875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6981915Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6981972Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6982092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6982317Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6982355Z graph_break [] 2025-12-04T09:45:51.6982430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6982471Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6982542Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6982638Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6982910Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6982988Z graph_break [] 2025-12-04T09:45:51.6983065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6983109Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6983182Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6983279Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6983549Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6983589Z graph_break [] 2025-12-04T09:45:51.6983661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6983703Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6983758Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6983856Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6984141Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6984179Z graph_break [] 2025-12-04T09:45:51.6984251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6984294Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6984349Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6984448Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6984724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6984763Z graph_break [] 2025-12-04T09:45:51.6984836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6984879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6984935Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6985032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6985255Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6985293Z graph_break [] 2025-12-04T09:45:51.6985366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6985406Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6985463Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6985582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6985808Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6985844Z graph_break [] 2025-12-04T09:45:51.6985918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6985977Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6986035Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6986130Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6986407Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6986445Z graph_break [] 2025-12-04T09:45:51.6986532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6986573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6986631Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6986726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6986953Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6986989Z graph_break [] 2025-12-04T09:45:51.6987062Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6987102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6987170Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6987268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6987509Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6987550Z graph_break [] 2025-12-04T09:45:51.6987625Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6987672Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6987729Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6987828Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6988102Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6988143Z graph_break [] 2025-12-04T09:45:51.6988217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6988262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6988319Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6988419Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6988650Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6988690Z graph_break [] 2025-12-04T09:45:51.6988764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6988809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6988878Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6988978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6989203Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6989244Z graph_break [] 2025-12-04T09:45:51.6989320Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6989375Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6989436Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6989533Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6989807Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6989847Z graph_break [] 2025-12-04T09:45:51.6989933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6989976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6990036Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6990132Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6990360Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6990398Z graph_break [] 2025-12-04T09:45:51.6990474Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6990516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6990577Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6990672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6990911Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6990949Z graph_break [] 2025-12-04T09:45:51.6991026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6991068Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6991130Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6991227Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6991499Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6991542Z graph_break [] 2025-12-04T09:45:51.6991617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6991661Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6991718Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6991816Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6992042Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6992082Z graph_break [] 2025-12-04T09:45:51.6992156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6992201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6992269Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6992373Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6992604Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6992646Z graph_break [] 2025-12-04T09:45:51.6992735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6992780Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6992837Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6992990Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6993263Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6993304Z graph_break [] 2025-12-04T09:45:51.6993393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6993435Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6993494Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6993590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6993819Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6993856Z graph_break [] 2025-12-04T09:45:51.6993931Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6993972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6994035Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6994131Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6994381Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6994420Z graph_break [] 2025-12-04T09:45:51.6994497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6994538Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6994597Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6994694Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6994969Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6995007Z graph_break [] 2025-12-04T09:45:51.6995083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6995126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6995187Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6995285Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6995511Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6995552Z graph_break [] 2025-12-04T09:45:51.6995626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6995672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6995744Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6995846Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6996070Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6996111Z graph_break [] 2025-12-04T09:45:51.6996203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6996249Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6996307Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6996406Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6996687Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6996728Z graph_break [] 2025-12-04T09:45:51.6996811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6996858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6996915Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6997015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6997240Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6997281Z graph_break [] 2025-12-04T09:45:51.6997354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6997400Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6997460Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6997568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6997795Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6997833Z graph_break [] 2025-12-04T09:45:51.6997909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6997951Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6998011Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6998107Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.6998384Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.6998423Z graph_break [] 2025-12-04T09:45:51.6998500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6998541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6998602Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6998700Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6998928Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6998966Z graph_break [] 2025-12-04T09:45:51.6999042Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6999094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.6999155Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.6999255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.6999481Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.6999536Z graph_break [] 2025-12-04T09:45:51.6999610Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.6999654Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.6999711Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.6999812Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7000084Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7000126Z graph_break [] 2025-12-04T09:45:51.7000208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7000254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7000312Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7000416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7000645Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7000685Z graph_break [] 2025-12-04T09:45:51.7000758Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7000803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7000860Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7000970Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7001193Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7001233Z graph_break [] 2025-12-04T09:45:51.7001306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7001349Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7001406Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7001505Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7001778Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7001818Z graph_break [] 2025-12-04T09:45:51.7001893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7001934Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7001994Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7002091Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7002317Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7002356Z graph_break [] 2025-12-04T09:45:51.7002433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7002485Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7002547Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7002645Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7002869Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7002918Z graph_break [] 2025-12-04T09:45:51.7003071Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7003119Z Traceback (most recent call last): 2025-12-04T09:45:51.7003294Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7003344Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7003490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7003554Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7003621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7003785Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7003859Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7003917Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7003919Z 2025-12-04T09:45:51.7003971Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.7004067Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7004157Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7004159Z 2025-12-04T09:45:51.7004208Z The failure occurred for item [0] 2025-12-04T09:45:51.7004210Z 2025-12-04T09:45:51.7004288Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7004477Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7004479Z 2025-12-04T09:45:51.7004567Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7004645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7004689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7004750Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7004850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7005077Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7005119Z graph_break [] 2025-12-04T09:45:51.7005192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7005240Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7005299Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7005400Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7005623Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7005665Z graph_break [] 2025-12-04T09:45:51.7005738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7005783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7005840Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7005956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7006180Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7006222Z graph_break [] 2025-12-04T09:45:51.7006296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7006340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7006417Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7006516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7006743Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7006783Z graph_break [] 2025-12-04T09:45:51.7006857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7006903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7006978Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7007079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7007303Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7007342Z graph_break [] 2025-12-04T09:45:51.7007419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7007460Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7007520Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7007617Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7007892Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7007940Z graph_break [] 2025-12-04T09:45:51.7008015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7008057Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7008117Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7008212Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7008437Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7008475Z graph_break [] 2025-12-04T09:45:51.7008551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7008594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7008655Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7008752Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7008977Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7009016Z graph_break [] 2025-12-04T09:45:51.7009092Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7009133Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7009192Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7009299Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7009574Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7009615Z graph_break [] 2025-12-04T09:45:51.7009688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7009744Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7009800Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7009900Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7010170Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7010212Z graph_break [] 2025-12-04T09:45:51.7010285Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7010340Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7010397Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7010494Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7010769Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7010811Z graph_break [] 2025-12-04T09:45:51.7010883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7010927Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7010983Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7011081Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7011366Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7011402Z graph_break [] 2025-12-04T09:45:51.7011476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7011517Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7011575Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7011670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7011895Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7011932Z graph_break [] 2025-12-04T09:45:51.7012007Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7012047Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7012104Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7012199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7012425Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7012461Z graph_break [] 2025-12-04T09:45:51.7012536Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7012576Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7012644Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7012741Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7013061Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7013101Z graph_break [] 2025-12-04T09:45:51.7013192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7013235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7013292Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7013393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7013617Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7013656Z graph_break [] 2025-12-04T09:45:51.7013741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7013784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7013839Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7013936Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7014158Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7014195Z graph_break [] 2025-12-04T09:45:51.7014267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7014308Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7014366Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7014463Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7014755Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7014795Z graph_break [] 2025-12-04T09:45:51.7014868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7014912Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7014968Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7015065Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7015291Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7015329Z graph_break [] 2025-12-04T09:45:51.7015403Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7015444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7015501Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7015596Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7015821Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7015857Z graph_break [] 2025-12-04T09:45:51.7015930Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7015970Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7016065Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7016160Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7016445Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7016494Z graph_break [] 2025-12-04T09:45:51.7016569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7016610Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7016668Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7016763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7016988Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7017026Z graph_break [] 2025-12-04T09:45:51.7017112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7017155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7017211Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7017307Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7017531Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7017570Z graph_break [] 2025-12-04T09:45:51.7017641Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7017683Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7017742Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7017840Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7018126Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7018165Z graph_break [] 2025-12-04T09:45:51.7018237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7018280Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7018336Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7018432Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7018661Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7018699Z graph_break [] 2025-12-04T09:45:51.7018772Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7018823Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7018881Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7018980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7019209Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7019247Z graph_break [] 2025-12-04T09:45:51.7019324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7019368Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7019439Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7019537Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7019812Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7019873Z graph_break [] 2025-12-04T09:45:51.7019948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7019990Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7020050Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7020148Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7020375Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7020414Z graph_break [] 2025-12-04T09:45:51.7020501Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7020543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7020605Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7020701Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7020931Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7020970Z graph_break [] 2025-12-04T09:45:51.7021046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7021091Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7021149Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7021258Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7021529Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7021571Z graph_break [] 2025-12-04T09:45:51.7021644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7021689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7021746Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7021844Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7022068Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7022111Z graph_break [] 2025-12-04T09:45:51.7022186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7022231Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7022288Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7022388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7022617Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7022656Z graph_break [] 2025-12-04T09:45:51.7022730Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7022786Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7022845Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7022984Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7023260Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7023320Z graph_break [] 2025-12-04T09:45:51.7023396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7023438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7023498Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7023595Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7023824Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7023862Z graph_break [] 2025-12-04T09:45:51.7023953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7023995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7024054Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7024151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7024378Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7024416Z graph_break [] 2025-12-04T09:45:51.7024493Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7024535Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7024593Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7024705Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7024980Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7025019Z graph_break [] 2025-12-04T09:45:51.7025091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7025132Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7025188Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7025285Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7025511Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7025550Z graph_break [] 2025-12-04T09:45:51.7025623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7025665Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7025721Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7025818Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7026039Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7026078Z graph_break [] 2025-12-04T09:45:51.7026149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7026205Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7026262Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7026361Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7026636Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7026685Z graph_break [] 2025-12-04T09:45:51.7026758Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7026800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7026857Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7026953Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7027177Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7027224Z graph_break [] 2025-12-04T09:45:51.7027300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7027340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7027398Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7027495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7027717Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7027753Z graph_break [] 2025-12-04T09:45:51.7027827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7027870Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7027927Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7028035Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7028308Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7028346Z graph_break [] 2025-12-04T09:45:51.7028421Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7028462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7028520Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7028615Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7028843Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7028881Z graph_break [] 2025-12-04T09:45:51.7028955Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7028997Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7029053Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7029151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7029372Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7029410Z graph_break [] 2025-12-04T09:45:51.7029481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7029535Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7029592Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7029692Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7029963Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7030024Z graph_break [] 2025-12-04T09:45:51.7030117Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7030168Z Traceback (most recent call last): 2025-12-04T09:45:51.7030338Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7030388Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7030533Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7030596Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7030655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7030817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7030891Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7030947Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7030949Z 2025-12-04T09:45:51.7031005Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.7031095Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7031183Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7031185Z 2025-12-04T09:45:51.7031230Z The failure occurred for item [0] 2025-12-04T09:45:51.7031232Z 2025-12-04T09:45:51.7031308Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7031489Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7031491Z 2025-12-04T09:45:51.7031578Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7031651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7031696Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7031753Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7031853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7032077Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7032115Z graph_break [] 2025-12-04T09:45:51.7032189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7032232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7032289Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7032387Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7032616Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7032654Z graph_break [] 2025-12-04T09:45:51.7032728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7032768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7032828Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7033007Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7033234Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7033271Z graph_break [] 2025-12-04T09:45:51.7033344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7033410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7033468Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7033566Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7033789Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7033827Z graph_break [] 2025-12-04T09:45:51.7033900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7033942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7034017Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7034113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7034335Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7034372Z graph_break [] 2025-12-04T09:45:51.7034445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7034488Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7034546Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7034646Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7034941Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7034982Z graph_break [] 2025-12-04T09:45:51.7035056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7035100Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7035155Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7035252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7035474Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7035512Z graph_break [] 2025-12-04T09:45:51.7035584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7035629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7035684Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7035781Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7036002Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7036042Z graph_break [] 2025-12-04T09:45:51.7036113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7036155Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7036211Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7036320Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7036598Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7036637Z graph_break [] 2025-12-04T09:45:51.7036711Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7036763Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7036820Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7036916Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7037188Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7037225Z graph_break [] 2025-12-04T09:45:51.7037309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7037350Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7037407Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7037502Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7037773Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7037810Z graph_break [] 2025-12-04T09:45:51.7037883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7037923Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7037981Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7038076Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7038360Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7038397Z graph_break [] 2025-12-04T09:45:51.7038471Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7038512Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7038570Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7038667Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7038892Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7038932Z graph_break [] 2025-12-04T09:45:51.7039005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7039047Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7039102Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7039199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7039423Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7039461Z graph_break [] 2025-12-04T09:45:51.7039533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7039576Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7039642Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7039740Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7040009Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7040060Z graph_break [] 2025-12-04T09:45:51.7040133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7040175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7040231Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7040328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7040558Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7040595Z graph_break [] 2025-12-04T09:45:51.7040680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7040721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7040778Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7040873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7041098Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7041134Z graph_break [] 2025-12-04T09:45:51.7041208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7041249Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7041307Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7041415Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7041686Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7041723Z graph_break [] 2025-12-04T09:45:51.7041797Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7041837Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7041894Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7041989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7042216Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7042252Z graph_break [] 2025-12-04T09:45:51.7042327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7042368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7042425Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7042524Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7042749Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7042787Z graph_break [] 2025-12-04T09:45:51.7042859Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7042911Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7043008Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7043107Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7043378Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7043440Z graph_break [] 2025-12-04T09:45:51.7043512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7043554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7043609Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7043708Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7043932Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7043971Z graph_break [] 2025-12-04T09:45:51.7044058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7044101Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7044157Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7044255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7044480Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7044518Z graph_break [] 2025-12-04T09:45:51.7044591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7044633Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7044690Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7044817Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7045093Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7045130Z graph_break [] 2025-12-04T09:45:51.7045204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7045244Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7045302Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7045397Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7045622Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7045660Z graph_break [] 2025-12-04T09:45:51.7045733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7045774Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7045832Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7045927Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7046150Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7046186Z graph_break [] 2025-12-04T09:45:51.7046262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7046320Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7046380Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7046480Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7046753Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7046804Z graph_break [] 2025-12-04T09:45:51.7046878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7046920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7046975Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7047072Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7047295Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7047348Z graph_break [] 2025-12-04T09:45:51.7047421Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7047463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7047519Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7047617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7047840Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7047878Z graph_break [] 2025-12-04T09:45:51.7047950Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7047994Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7048050Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7048162Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7048436Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7048475Z graph_break [] 2025-12-04T09:45:51.7048548Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7048588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7048645Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7048740Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7048965Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7049003Z graph_break [] 2025-12-04T09:45:51.7049077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7049118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7049176Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7049272Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7049495Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7049531Z graph_break [] 2025-12-04T09:45:51.7049604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7049654Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7049712Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7049810Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7050083Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7050133Z graph_break [] 2025-12-04T09:45:51.7050211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7050252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7050309Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7050405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7050634Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7050683Z graph_break [] 2025-12-04T09:45:51.7050756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7050798Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7050854Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7050951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7051173Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7051211Z graph_break [] 2025-12-04T09:45:51.7051283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7051325Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7051391Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7051489Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7051759Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7051798Z graph_break [] 2025-12-04T09:45:51.7051869Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7051912Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7051967Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7052064Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7052291Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7052330Z graph_break [] 2025-12-04T09:45:51.7052404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7052444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7052501Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7052597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7052819Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7052855Z graph_break [] 2025-12-04T09:45:51.7052992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7053033Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7053091Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7053187Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7053458Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7053514Z graph_break [] 2025-12-04T09:45:51.7053588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7053628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7053685Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7053780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7054022Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7054059Z graph_break [] 2025-12-04T09:45:51.7054133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7054173Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7054231Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7054326Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7054552Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7054589Z graph_break [] 2025-12-04T09:45:51.7054661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7054703Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7054777Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7054875Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7055147Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7055185Z graph_break [] 2025-12-04T09:45:51.7055257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7055299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7055355Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7055452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7055675Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7055713Z graph_break [] 2025-12-04T09:45:51.7055785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7055827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7055884Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7055981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7056207Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7056245Z graph_break [] 2025-12-04T09:45:51.7056329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7056371Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7056429Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7056525Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7056796Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7056845Z graph_break [] 2025-12-04T09:45:51.7056918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7056960Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7057016Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7057113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7057354Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7057392Z graph_break [] 2025-12-04T09:45:51.7057486Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7057532Z Traceback (most recent call last): 2025-12-04T09:45:51.7057706Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7057754Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7057897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7057958Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7058005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7058164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7058252Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7058306Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7058310Z 2025-12-04T09:45:51.7058364Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.7058455Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7058543Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7058545Z 2025-12-04T09:45:51.7058591Z The failure occurred for item [0] 2025-12-04T09:45:51.7058592Z 2025-12-04T09:45:51.7058669Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7058839Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7058842Z 2025-12-04T09:45:51.7058928Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7059003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7059045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7059104Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7059201Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7059427Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7059463Z graph_break [] 2025-12-04T09:45:51.7059537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7059577Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7059647Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7059745Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7059971Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7060009Z graph_break [] 2025-12-04T09:45:51.7060093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7060135Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7060191Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7060289Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7060519Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7060557Z graph_break [] 2025-12-04T09:45:51.7060630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7060682Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7060739Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7060836Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7061061Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7061098Z graph_break [] 2025-12-04T09:45:51.7061171Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7061213Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7061269Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7061367Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7061601Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7061640Z graph_break [] 2025-12-04T09:45:51.7061711Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7061755Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7061811Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7061908Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7062181Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7062218Z graph_break [] 2025-12-04T09:45:51.7062293Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7062334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7062391Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7062488Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7062713Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7062749Z graph_break [] 2025-12-04T09:45:51.7062822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7062862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7062980Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7063077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7063303Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7063340Z graph_break [] 2025-12-04T09:45:51.7063413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7063476Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7063534Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7063629Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7063902Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7063941Z graph_break [] 2025-12-04T09:45:51.7064030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7064073Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7064129Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7064226Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7064503Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7064541Z graph_break [] 2025-12-04T09:45:51.7064612Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7064654Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7064710Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7064823Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7065093Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7065132Z graph_break [] 2025-12-04T09:45:51.7065204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7065247Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7065303Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7065400Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7065671Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7065711Z graph_break [] 2025-12-04T09:45:51.7065783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7065827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7065883Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7065984Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7066212Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7066248Z graph_break [] 2025-12-04T09:45:51.7066322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7066379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7066440Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7066537Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7066761Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7066809Z graph_break [] 2025-12-04T09:45:51.7066883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7066923Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7066980Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7067075Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7067347Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7067395Z graph_break [] 2025-12-04T09:45:51.7067469Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7067510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7067567Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7067664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7067892Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7067930Z graph_break [] 2025-12-04T09:45:51.7068002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7068045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7068101Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7068210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7068437Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7068476Z graph_break [] 2025-12-04T09:45:51.7068547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7068589Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7068645Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7068741Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7069011Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7069051Z graph_break [] 2025-12-04T09:45:51.7069123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7069166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7069222Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7069322Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7069544Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7069581Z graph_break [] 2025-12-04T09:45:51.7069666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7069709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7069768Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7069866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7070093Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7070149Z graph_break [] 2025-12-04T09:45:51.7070222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7070263Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7070320Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7070416Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7070701Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7070739Z graph_break [] 2025-12-04T09:45:51.7070812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7070853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7070910Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7071006Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7071229Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7071265Z graph_break [] 2025-12-04T09:45:51.7071339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7071380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7071448Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7071544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7071768Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7071807Z graph_break [] 2025-12-04T09:45:51.7071880Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7071922Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7071978Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7072077Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7072351Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7072389Z graph_break [] 2025-12-04T09:45:51.7072460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7072502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7072558Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7072655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7072877Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7072916Z graph_break [] 2025-12-04T09:45:51.7073040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7073083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7073141Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7073240Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7073462Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7073517Z graph_break [] 2025-12-04T09:45:51.7073590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7073633Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7073689Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7073788Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7074080Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7074118Z graph_break [] 2025-12-04T09:45:51.7074192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7074233Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7074291Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7074386Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7074613Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7074649Z graph_break [] 2025-12-04T09:45:51.7074723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7074763Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7074837Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7074932Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7075158Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7075195Z graph_break [] 2025-12-04T09:45:51.7075269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7075309Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7075367Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7075462Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7075735Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7075774Z graph_break [] 2025-12-04T09:45:51.7075846Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7075888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7075945Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7076043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7076272Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7076311Z graph_break [] 2025-12-04T09:45:51.7076399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7076442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7076498Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7076597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7076819Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7076868Z graph_break [] 2025-12-04T09:45:51.7076940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7076982Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7077039Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7077137Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7077418Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7077458Z graph_break [] 2025-12-04T09:45:51.7077530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7077574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7077632Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7077729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7077952Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7077988Z graph_break [] 2025-12-04T09:45:51.7078063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7078114Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7078172Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7078268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7078494Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7078531Z graph_break [] 2025-12-04T09:45:51.7078604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7078645Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7078702Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7078797Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7079070Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7079107Z graph_break [] 2025-12-04T09:45:51.7079182Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7079223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7079284Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7079379Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7079604Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7079641Z graph_break [] 2025-12-04T09:45:51.7079726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7079769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7079826Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7079922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7080143Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7080194Z graph_break [] 2025-12-04T09:45:51.7080265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7080309Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7080366Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7080463Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7080749Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7080788Z graph_break [] 2025-12-04T09:45:51.7080860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7080903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7080961Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7081058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7081286Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7081324Z graph_break [] 2025-12-04T09:45:51.7083901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7083978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7084038Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7084142Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7084366Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7084404Z graph_break [] 2025-12-04T09:45:51.7084480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7084520Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7084578Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7084674Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7084950Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7084988Z graph_break [] 2025-12-04T09:45:51.7085062Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7085104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7085162Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7085256Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7085481Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7085517Z graph_break [] 2025-12-04T09:45:51.7085629Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7085674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7085733Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7085829Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7086054Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7086110Z graph_break [] 2025-12-04T09:45:51.7086184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7086225Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7086282Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7086380Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7086666Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7086706Z graph_break [] 2025-12-04T09:45:51.7086779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7086822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7086878Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7086978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7087201Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7087241Z graph_break [] 2025-12-04T09:45:51.7087313Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7087366Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7087422Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7087519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7087747Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7087786Z graph_break [] 2025-12-04T09:45:51.7087880Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7087928Z Traceback (most recent call last): 2025-12-04T09:45:51.7088102Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2612, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7088153Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7088297Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7088361Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7088409Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7088568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7088643Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7088698Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7088700Z 2025-12-04T09:45:51.7088753Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.7088845Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7088935Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7088949Z 2025-12-04T09:45:51.7088996Z The failure occurred for item [0] 2025-12-04T09:45:51.7088999Z 2025-12-04T09:45:51.7089077Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7089248Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7089250Z 2025-12-04T09:45:51.7089338Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7089424Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7089467Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7089526Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7089626Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7089858Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7089898Z graph_break [] 2025-12-04T09:45:51.7089982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7090024Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7090082Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7090178Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7090403Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7090439Z graph_break [] 2025-12-04T09:45:51.7090512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7090552Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7090611Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7090707Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7090946Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7090982Z graph_break [] 2025-12-04T09:45:51.7091056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7091096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7091154Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7091249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7091474Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7091511Z graph_break [] 2025-12-04T09:45:51.7091586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7091626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7091684Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7091784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7092008Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7092046Z graph_break [] 2025-12-04T09:45:51.7092118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7092159Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7092228Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7092326Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7092598Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7092636Z graph_break [] 2025-12-04T09:45:51.7092721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7092762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7092819Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7092915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7093183Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7093222Z graph_break [] 2025-12-04T09:45:51.7093313Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7093356Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7093412Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7093508Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7093734Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7093771Z graph_break [] 2025-12-04T09:45:51.7093843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7093885Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7093942Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7094039Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7094328Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7094365Z graph_break [] 2025-12-04T09:45:51.7094438Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7094479Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7094538Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7094632Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7094904Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7094941Z graph_break [] 2025-12-04T09:45:51.7095015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7095055Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7095113Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7095207Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7095483Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7095519Z graph_break [] 2025-12-04T09:45:51.7095593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7095649Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7095708Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7095807Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7096077Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7096132Z graph_break [] 2025-12-04T09:45:51.7096204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7096246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7096302Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7096398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7096623Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7096671Z graph_break [] 2025-12-04T09:45:51.7096743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7096785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7096841Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7096938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7097160Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7097198Z graph_break [] 2025-12-04T09:45:51.7097271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7097313Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7097390Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7097490Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7097764Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7097804Z graph_break [] 2025-12-04T09:45:51.7097876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7097917Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7097974Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7098070Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7098296Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7098333Z graph_break [] 2025-12-04T09:45:51.7098406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7098446Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7098505Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7098601Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7098826Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7098862Z graph_break [] 2025-12-04T09:45:51.7098945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7098986Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7099045Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7099141Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7099415Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7099466Z graph_break [] 2025-12-04T09:45:51.7099540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7099586Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7099644Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7099740Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7099977Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7100018Z graph_break [] 2025-12-04T09:45:51.7100090Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7100133Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7100188Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7100286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7100507Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7100545Z graph_break [] 2025-12-04T09:45:51.7100617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7100659Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7100726Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7100824Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7101094Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7101133Z graph_break [] 2025-12-04T09:45:51.7101206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7101248Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7101304Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7101402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7101627Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7101666Z graph_break [] 2025-12-04T09:45:51.7101739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7101780Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7101838Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7101934Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7102158Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7102194Z graph_break [] 2025-12-04T09:45:51.7102281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7102322Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7102381Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7102477Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7102746Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7102794Z graph_break [] 2025-12-04T09:45:51.7102867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7102907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7103004Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7103100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7103353Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7103391Z graph_break [] 2025-12-04T09:45:51.7103464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7103504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7103564Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7103659Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7103885Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7103923Z graph_break [] 2025-12-04T09:45:51.7103995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7104037Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7104110Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7104207Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7104479Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7104518Z graph_break [] 2025-12-04T09:45:51.7104589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7104631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7104687Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7104784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7105007Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7105046Z graph_break [] 2025-12-04T09:45:51.7105119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7105162Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7105219Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7105317Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7105539Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7105577Z graph_break [] 2025-12-04T09:45:51.7105670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7105714Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7105772Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7105867Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7106137Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7106192Z graph_break [] 2025-12-04T09:45:51.7106265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7106305Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7106364Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7106461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7106697Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7106734Z graph_break [] 2025-12-04T09:45:51.7106807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7106848Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7106907Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7107003Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7107233Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7107268Z graph_break [] 2025-12-04T09:45:51.7107343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7107395Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7107454Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7107549Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7107821Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7107859Z graph_break [] 2025-12-04T09:45:51.7107931Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7107973Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7108029Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7108126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7108348Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7108386Z graph_break [] 2025-12-04T09:45:51.7108458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7108499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7108555Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7108652Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7108876Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7108914Z graph_break [] 2025-12-04T09:45:51.7108996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7109040Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7109097Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7109196Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7109467Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7109519Z graph_break [] 2025-12-04T09:45:51.7109593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7109634Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7109692Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7109788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7110031Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7110069Z graph_break [] 2025-12-04T09:45:51.7110142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7110183Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7110240Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7110335Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7110559Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7110595Z graph_break [] 2025-12-04T09:45:51.7110670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7110721Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7110778Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7110873Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7111150Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7111186Z graph_break [] 2025-12-04T09:45:51.7111261Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7111301Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7111358Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7111457Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7111682Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7111721Z graph_break [] 2025-12-04T09:45:51.7111793Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7111836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7111891Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7111987Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7112208Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7112257Z graph_break [] 2025-12-04T09:45:51.7112330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7112373Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7112430Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7112527Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7112797Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7112849Z graph_break [] 2025-12-04T09:45:51.7112921Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7112998Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7113054Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7113153Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7113397Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7113436Z graph_break [] 2025-12-04T09:45:51.7113508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7113551Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7113607Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7113704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7113926Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7113964Z graph_break [] 2025-12-04T09:45:51.7114038Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7114094Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7114155Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7114250Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7114522Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7114559Z graph_break [] 2025-12-04T09:45:51.7114633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7114673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7114730Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7114826Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7115055Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7115091Z graph_break [] 2025-12-04T09:45:51.7115173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7115216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7115277Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7115375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7115601Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7115659Z graph_break [] 2025-12-04T09:45:51.7115733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7115779Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7115838Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7115937Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7116210Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7116268Z graph_break [] 2025-12-04T09:45:51.7116363Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7116414Z Traceback (most recent call last): 2025-12-04T09:45:51.7116590Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7116643Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7116799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7116864Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7116911Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7117076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7117151Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7117209Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7117212Z 2025-12-04T09:45:51.7117267Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.7117360Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7117450Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7117454Z 2025-12-04T09:45:51.7117512Z The failure occurred for item [0] 2025-12-04T09:45:51.7117514Z 2025-12-04T09:45:51.7117596Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7117766Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7117768Z 2025-12-04T09:45:51.7117860Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7117935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7117981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7118040Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7118144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7118374Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7118415Z graph_break [] 2025-12-04T09:45:51.7118489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7118534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7118592Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7118696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7118923Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7118963Z graph_break [] 2025-12-04T09:45:51.7119036Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7119092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7119150Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7119252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7119478Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7119528Z graph_break [] 2025-12-04T09:45:51.7119604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7119646Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7119706Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7119803Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7120030Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7120068Z graph_break [] 2025-12-04T09:45:51.7120156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7120199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7120261Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7120357Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7120582Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7120620Z graph_break [] 2025-12-04T09:45:51.7120694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7120738Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7120795Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7120902Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7121178Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7121217Z graph_break [] 2025-12-04T09:45:51.7121289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7121331Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7121387Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7121484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7121707Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7121746Z graph_break [] 2025-12-04T09:45:51.7121818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7121860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7121915Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7122013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7122234Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7122272Z graph_break [] 2025-12-04T09:45:51.7122342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7122395Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7122452Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7122551Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7122820Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7122880Z graph_break [] 2025-12-04T09:45:51.7123007Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7123050Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7123110Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7123207Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7123496Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7123534Z graph_break [] 2025-12-04T09:45:51.7123607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7123648Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7123705Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7123802Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7124075Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7124112Z graph_break [] 2025-12-04T09:45:51.7124186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7124241Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7124298Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7124394Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7124663Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7124700Z graph_break [] 2025-12-04T09:45:51.7124773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7124814Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7124871Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7124967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7125197Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7125237Z graph_break [] 2025-12-04T09:45:51.7125309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7125351Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7125408Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7125505Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7125728Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7125765Z graph_break [] 2025-12-04T09:45:51.7125853Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7125897Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7125954Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7126050Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7126320Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7126376Z graph_break [] 2025-12-04T09:45:51.7126448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7126491Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7126546Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7126645Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7126880Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7126920Z graph_break [] 2025-12-04T09:45:51.7126994Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7127037Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7127094Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7127192Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7127418Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7127454Z graph_break [] 2025-12-04T09:45:51.7127528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7127581Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7127641Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7127736Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7128005Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7128042Z graph_break [] 2025-12-04T09:45:51.7128115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7128155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7128212Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7128307Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7128531Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7128568Z graph_break [] 2025-12-04T09:45:51.7128641Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7128683Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7128740Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7128835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7129062Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7129100Z graph_break [] 2025-12-04T09:45:51.7129185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7129228Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7129286Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7129383Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7129654Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7129706Z graph_break [] 2025-12-04T09:45:51.7129777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7129820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7129875Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7129972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7130206Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7130244Z graph_break [] 2025-12-04T09:45:51.7130316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7130359Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7130415Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7130511Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7130732Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7130771Z graph_break [] 2025-12-04T09:45:51.7130844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7130902Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7130962Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7131062Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7131332Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7131369Z graph_break [] 2025-12-04T09:45:51.7131442Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7131482Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7131539Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7131635Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7131860Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7131896Z graph_break [] 2025-12-04T09:45:51.7131969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7132010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7132067Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7132163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7132387Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7132433Z graph_break [] 2025-12-04T09:45:51.7132508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7132549Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7132608Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7132705Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7133007Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7133064Z graph_break [] 2025-12-04T09:45:51.7133136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7133178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7133234Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7133332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7133571Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7133609Z graph_break [] 2025-12-04T09:45:51.7133681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7133724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7133779Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7133875Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7134097Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7134136Z graph_break [] 2025-12-04T09:45:51.7134209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7134266Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7134323Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7134420Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7134689Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7134728Z graph_break [] 2025-12-04T09:45:51.7134800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7134843Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7134898Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7134996Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7135224Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7135260Z graph_break [] 2025-12-04T09:45:51.7135335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7135377Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7135434Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7135529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7135753Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7135808Z graph_break [] 2025-12-04T09:45:51.7135883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7135924Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7135983Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7136078Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7136351Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7136400Z graph_break [] 2025-12-04T09:45:51.7136473Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7136514Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7136571Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7136669Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7136910Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7136947Z graph_break [] 2025-12-04T09:45:51.7137020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7137065Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7137121Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7137217Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7137440Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7137478Z graph_break [] 2025-12-04T09:45:51.7137549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7137604Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7137661Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7137758Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7138026Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7138064Z graph_break [] 2025-12-04T09:45:51.7138136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7138177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7138233Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7138330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7138555Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7138593Z graph_break [] 2025-12-04T09:45:51.7138666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7138709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7138766Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7138863Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7139097Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7139135Z graph_break [] 2025-12-04T09:45:51.7139211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7139252Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7139310Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7139405Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7139678Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7139727Z graph_break [] 2025-12-04T09:45:51.7139801Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7139841Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7139899Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7139995Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7140232Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7140268Z graph_break [] 2025-12-04T09:45:51.7140342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7140383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7140441Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7140536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7140765Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7140800Z graph_break [] 2025-12-04T09:45:51.7140886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7140931Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7140987Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7141084Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7141356Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7141394Z graph_break [] 2025-12-04T09:45:51.7141465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7141507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7141564Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7141661Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7141884Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7141921Z graph_break [] 2025-12-04T09:45:51.7141993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7142036Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7142092Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7142188Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7142420Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7142458Z graph_break [] 2025-12-04T09:45:51.7142532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7142575Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7142632Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7142732Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7143056Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7143093Z graph_break [] 2025-12-04T09:45:51.7143166Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7143207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7143265Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7143360Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7143599Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7143635Z graph_break [] 2025-12-04T09:45:51.7143710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7143750Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7143808Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7143905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7144128Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7144164Z graph_break [] 2025-12-04T09:45:51.7144251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7144292Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7144351Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7144446Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7144721Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7144757Z graph_break [] 2025-12-04T09:45:51.7144830Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7144872Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7144929Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7145025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7145249Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7145286Z graph_break [] 2025-12-04T09:45:51.7145381Z _____ CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile _____ 2025-12-04T09:45:51.7145429Z Traceback (most recent call last): 2025-12-04T09:45:51.7145601Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2599, in test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7145650Z self.assertEqual(actual, correct) 2025-12-04T09:45:51.7145793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:45:51.7145871Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:45:51.7145918Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:45:51.7146080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:45:51.7146152Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:45:51.7146207Z AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.7146225Z 2025-12-04T09:45:51.7146279Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.7146376Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.7146467Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.7146469Z 2025-12-04T09:45:51.7146517Z The failure occurred for item [0] 2025-12-04T09:45:51.7146519Z 2025-12-04T09:45:51.7146596Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7146769Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.7146772Z 2025-12-04T09:45:51.7146873Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7146948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7146995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7147056Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7147159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7147384Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7147426Z graph_break [] 2025-12-04T09:45:51.7147500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7147543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7147618Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7147718Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7147943Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7147984Z graph_break [] 2025-12-04T09:45:51.7148057Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7148100Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7148158Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7148258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7148482Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7148524Z graph_break [] 2025-12-04T09:45:51.7148599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7148641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7148702Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7148803Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7149033Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7149070Z graph_break [] 2025-12-04T09:45:51.7149158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7149201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7149263Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7149359Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7149587Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7149636Z graph_break [] 2025-12-04T09:45:51.7149712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7149753Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7149813Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7149908Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7150196Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7150236Z graph_break [] 2025-12-04T09:45:51.7150312Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7150353Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7150412Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7150509Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7150735Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7150775Z graph_break [] 2025-12-04T09:45:51.7150850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7150895Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7150963Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7151062Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7151285Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7151326Z graph_break [] 2025-12-04T09:45:51.7151398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7151443Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7151500Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7151598Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7151871Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7151911Z graph_break [] 2025-12-04T09:45:51.7151984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7152029Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7152087Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7152186Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7152456Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7152496Z graph_break [] 2025-12-04T09:45:51.7152582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7152625Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7152685Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7152781Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7153106Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7153161Z graph_break [] 2025-12-04T09:45:51.7153236Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7153280Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7153340Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7153437Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7153724Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7153763Z graph_break [] 2025-12-04T09:45:51.7153840Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7153883Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7153941Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7154036Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7154262Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7154300Z graph_break [] 2025-12-04T09:45:51.7154375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7154433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7154496Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7154595Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7154824Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7154866Z graph_break [] 2025-12-04T09:45:51.7154940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7154985Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7155042Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7155141Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7155416Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7155456Z graph_break [] 2025-12-04T09:45:51.7155529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7155574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7155631Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7155730Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7155969Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7156012Z graph_break [] 2025-12-04T09:45:51.7156084Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7156131Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7156188Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7156287Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7156512Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7156564Z graph_break [] 2025-12-04T09:45:51.7156639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7156682Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7156742Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7156841Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7157129Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7157168Z graph_break [] 2025-12-04T09:45:51.7157243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7157288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7157348Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7157444Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7157671Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7157708Z graph_break [] 2025-12-04T09:45:51.7157785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7157839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7157898Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7157994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7158221Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7158261Z graph_break [] 2025-12-04T09:45:51.7158338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7158381Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7158441Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7158539Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7158814Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7158855Z graph_break [] 2025-12-04T09:45:51.7158928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7158973Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7159030Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7159129Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7159365Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7159408Z graph_break [] 2025-12-04T09:45:51.7159482Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7159527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7159585Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7159683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7159917Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7159956Z graph_break [] 2025-12-04T09:45:51.7160029Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7160072Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7160129Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7160229Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7160519Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7160559Z graph_break [] 2025-12-04T09:45:51.7160634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7160676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7160737Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7160834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7161063Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7161100Z graph_break [] 2025-12-04T09:45:51.7161187Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7161232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7161294Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7161391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7161618Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7161656Z graph_break [] 2025-12-04T09:45:51.7161731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7161772Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7161831Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7161927Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7162202Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7162239Z graph_break [] 2025-12-04T09:45:51.7162318Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7162360Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7162420Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7162517Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7162758Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7162800Z graph_break [] 2025-12-04T09:45:51.7162876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7162922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7163020Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7163119Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7163362Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7163402Z graph_break [] 2025-12-04T09:45:51.7163475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7163518Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7163575Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7163677Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7163963Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7164005Z graph_break [] 2025-12-04T09:45:51.7164078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7164121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7164178Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7164278Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7164505Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7164563Z graph_break [] 2025-12-04T09:45:51.7164638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7164680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7164741Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7164841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7165072Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7165109Z graph_break [] 2025-12-04T09:45:51.7165185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7165228Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7165288Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7165384Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7165660Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7165697Z graph_break [] 2025-12-04T09:45:51.7165775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7165816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7165875Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7165971Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7166211Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7166250Z graph_break [] 2025-12-04T09:45:51.7166327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7166370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7166430Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7166527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7166764Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7166805Z graph_break [] 2025-12-04T09:45:51.7166879Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7166925Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7166985Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7167085Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7167367Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7167408Z graph_break [] 2025-12-04T09:45:51.7167482Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7167526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7167583Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7167682Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7167908Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7167960Z graph_break [] 2025-12-04T09:45:51.7168034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7168078Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7168135Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7168234Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7168459Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7168498Z graph_break [] 2025-12-04T09:45:51.7168573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7168614Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7168674Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7168771Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7169054Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7169092Z graph_break [] 2025-12-04T09:45:51.7169167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7169212Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7169272Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7169369Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7169604Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7169641Z graph_break [] 2025-12-04T09:45:51.7169716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7169757Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7169816Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7169910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7170147Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7170183Z graph_break [] 2025-12-04T09:45:51.7170257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7170298Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7170357Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7170452Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7170737Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7170777Z graph_break [] 2025-12-04T09:45:51.7170850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7170892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7170948Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7171048Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7171270Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7171319Z graph_break [] 2025-12-04T09:45:51.7171394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7171436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7171492Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7171590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7171812Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7171850Z graph_break [] 2025-12-04T09:45:51.7171922Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7171964Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7172020Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7172118Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7172392Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7172431Z graph_break [] 2025-12-04T09:45:51.7172504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7172545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7172602Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7172701Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7172989Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7173026Z graph_break [] 2025-12-04T09:45:51.7173102Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7173142Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7173199Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7173294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7173540Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7173576Z graph_break [] 2025-12-04T09:45:51.7173650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7173691Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:45:51.7173749Z stats [('calls_captured', 72), ('unique_graphs', 2)] 2025-12-04T09:45:51.7173846Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:45:51.7174136Z inductor [('triton_bundler_save_kernel', 72), ('async_compile_cache_miss', 18), ('extern_calls', 18), ('async_compile_cache_hit', 9), ('pattern_matcher_count', 8), ('pattern_matcher_nodes', 8), ('fxgraph_cache_miss', 2), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7174174Z graph_break [] 2025-12-04T09:45:51.7174247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7174288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7174346Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7174441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7174665Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7174715Z graph_break [] 2025-12-04T09:45:51.7174789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7174831Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7174887Z stats [('calls_captured', 36), ('unique_graphs', 1)] 2025-12-04T09:45:51.7174983Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7175207Z inductor [('triton_bundler_save_kernel', 32), ('extern_calls', 9), ('async_compile_cache_miss', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_hit', 4), ('fxgraph_cache_miss', 1)] 2025-12-04T09:45:51.7175244Z graph_break [] 2025-12-04T09:45:51.7175327Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7175369Z Unexpected success 2025-12-04T09:45:51.7175442Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7175485Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7175543Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7175640Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7175891Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7175930Z graph_break [] 2025-12-04T09:45:51.7176004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7176046Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7176101Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7176210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7176461Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7176500Z graph_break [] 2025-12-04T09:45:51.7176583Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7176633Z Unexpected success 2025-12-04T09:45:51.7176708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7176749Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7176807Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7176904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7177153Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7177190Z graph_break [] 2025-12-04T09:45:51.7177277Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7177318Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7177375Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7177470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7177719Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7177756Z graph_break [] 2025-12-04T09:45:51.7177828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7177874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7177933Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7178041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7178290Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7178327Z graph_break [] 2025-12-04T09:45:51.7178410Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7178447Z Unexpected success 2025-12-04T09:45:51.7178521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7178562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7178621Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7178719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7178968Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7179006Z graph_break [] 2025-12-04T09:45:51.7179078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7179121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7179176Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7179273Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7179519Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7179566Z graph_break [] 2025-12-04T09:45:51.7179639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7179683Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7179739Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7179837Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7180085Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7180137Z graph_break [] 2025-12-04T09:45:51.7180209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7180252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7180308Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7180406Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7180668Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7180705Z graph_break [] 2025-12-04T09:45:51.7180788Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7180826Z Unexpected success 2025-12-04T09:45:51.7180899Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7180940Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7180997Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7181092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7181342Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7181390Z graph_break [] 2025-12-04T09:45:51.7181462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7181503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7181561Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7181658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7181907Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7181943Z graph_break [] 2025-12-04T09:45:51.7182017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7182057Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7182116Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7182213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7182463Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7182501Z graph_break [] 2025-12-04T09:45:51.7182577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7182618Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7182674Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7182771Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7183070Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7183110Z graph_break [] 2025-12-04T09:45:51.7183181Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7183224Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7183280Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7183391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7183638Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7183676Z graph_break [] 2025-12-04T09:45:51.7183757Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7183796Z Unexpected success 2025-12-04T09:45:51.7183868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7183930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7183987Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7184086Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7184335Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7184373Z graph_break [] 2025-12-04T09:45:51.7184445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7184487Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7184546Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7184644Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7184910Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7184946Z graph_break [] 2025-12-04T09:45:51.7185020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7185061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7185118Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7185213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7185462Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7185499Z graph_break [] 2025-12-04T09:45:51.7185575Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7185616Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7185673Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7185770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7186019Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7186054Z graph_break [] 2025-12-04T09:45:51.7186128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7186168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7186249Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7186345Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7186601Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7186638Z graph_break [] 2025-12-04T09:45:51.7186723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7186765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7186821Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7186918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7187167Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7187206Z graph_break [] 2025-12-04T09:45:51.7187300Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7187339Z Unexpected success 2025-12-04T09:45:51.7187411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7187455Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7187512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7187610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7187858Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7187897Z graph_break [] 2025-12-04T09:45:51.7187969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7188023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7188080Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7188177Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7188423Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7188461Z graph_break [] 2025-12-04T09:45:51.7188533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7188575Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7188631Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7188730Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7188978Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7189016Z graph_break [] 2025-12-04T09:45:51.7189089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7189131Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7189189Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7189284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7189533Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7189579Z graph_break [] 2025-12-04T09:45:51.7189653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7189695Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7189754Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7189850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7190100Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7190147Z graph_break [] 2025-12-04T09:45:51.7190221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7190262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7190319Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7190416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7190683Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7190721Z graph_break [] 2025-12-04T09:45:51.7190792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7190835Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7190891Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7190988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7191234Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7191272Z graph_break [] 2025-12-04T09:45:51.7191353Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7191402Z Unexpected success 2025-12-04T09:45:51.7191475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7191517Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7191574Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7191672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7191918Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7191956Z graph_break [] 2025-12-04T09:45:51.7192027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7192070Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7192126Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7192225Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7192474Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7192513Z graph_break [] 2025-12-04T09:45:51.7192586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7192626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7192683Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7192779Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7193081Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7193120Z graph_break [] 2025-12-04T09:45:51.7193193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7193234Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7193293Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7193406Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7193655Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7193692Z graph_break [] 2025-12-04T09:45:51.7193765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7193805Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7193865Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7193974Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7194222Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7194259Z graph_break [] 2025-12-04T09:45:51.7194332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7194373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7194431Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7194526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7194775Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7194827Z graph_break [] 2025-12-04T09:45:51.7194901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7194942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7195000Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7195096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7195342Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7195380Z graph_break [] 2025-12-04T09:45:51.7195452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7195495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7195552Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7195649Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7195894Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7195933Z graph_break [] 2025-12-04T09:45:51.7196014Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7196053Z Unexpected success 2025-12-04T09:45:51.7196124Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7196166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7196233Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7196334Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7196589Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7196628Z graph_break [] 2025-12-04T09:45:51.7196712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7196753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7196810Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7196906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7197153Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7197190Z graph_break [] 2025-12-04T09:45:51.7197275Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7197316Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7197375Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7197470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7197718Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7197754Z graph_break [] 2025-12-04T09:45:51.7197827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7197867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7197925Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7198038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7198286Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7198323Z graph_break [] 2025-12-04T09:45:51.7198396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7198436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7198493Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7198591Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7198839Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7198877Z graph_break [] 2025-12-04T09:45:51.7198949Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7198990Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7199046Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7199144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7199390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7199428Z graph_break [] 2025-12-04T09:45:51.7199500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7199552Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7199609Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7199707Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7199957Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7200006Z graph_break [] 2025-12-04T09:45:51.7200078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7200120Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7200176Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7200273Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7200529Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7200566Z graph_break [] 2025-12-04T09:45:51.7200654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7200697Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7200754Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7200850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7201096Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7201132Z graph_break [] 2025-12-04T09:45:51.7201214Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7201252Z Unexpected success 2025-12-04T09:45:51.7201325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7201377Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7201436Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7201534Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7201782Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7201819Z graph_break [] 2025-12-04T09:45:51.7201893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7201934Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7201991Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7202088Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7202342Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7202380Z graph_break [] 2025-12-04T09:45:51.7202451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7202495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7202551Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7202648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7202907Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7202980Z graph_break [] 2025-12-04T09:45:51.7203053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7203096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7203153Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7203251Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7203517Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7203555Z graph_break [] 2025-12-04T09:45:51.7203626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7203668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7203724Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7203824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7204088Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7204127Z graph_break [] 2025-12-04T09:45:51.7204199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7204242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7204299Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7204397Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7204649Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7204699Z graph_break [] 2025-12-04T09:45:51.7204774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7204815Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7204873Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7204969Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7205220Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7205256Z graph_break [] 2025-12-04T09:45:51.7205328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7205369Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7205427Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7205523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7205772Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7205808Z graph_break [] 2025-12-04T09:45:51.7205883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7205923Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7205981Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7206077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7206346Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7206385Z graph_break [] 2025-12-04T09:45:51.7206457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7206500Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7206556Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7206652Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7206911Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7206949Z graph_break [] 2025-12-04T09:45:51.7207029Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7207067Z Unexpected success 2025-12-04T09:45:51.7207139Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7207182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7207247Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7207345Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7207591Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7207629Z graph_break [] 2025-12-04T09:45:51.7207700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7207743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7207799Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7207898Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7208146Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7208195Z graph_break [] 2025-12-04T09:45:51.7208267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7208309Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7208366Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7208464Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7208714Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7208751Z graph_break [] 2025-12-04T09:45:51.7208823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7208865Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7211170Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7211268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7211517Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7211554Z graph_break [] 2025-12-04T09:45:51.7211628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7211668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7211725Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7211836Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7212086Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7212123Z graph_break [] 2025-12-04T09:45:51.7212195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7212248Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7212305Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7212400Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7212651Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7212690Z graph_break [] 2025-12-04T09:45:51.7212761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7212803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7212877Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7213011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7213260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7213298Z graph_break [] 2025-12-04T09:45:51.7213369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7213410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7213466Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7213566Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7213833Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7213869Z graph_break [] 2025-12-04T09:45:51.7213940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7213982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7214038Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7214135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7214388Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7214425Z graph_break [] 2025-12-04T09:45:51.7214497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7214539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7214595Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7214691Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7214943Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7214979Z graph_break [] 2025-12-04T09:45:51.7215052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7215092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7215148Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7215259Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7215509Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7215545Z graph_break [] 2025-12-04T09:45:51.7215626Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7215682Z Unexpected success 2025-12-04T09:45:51.7215755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7215797Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7215853Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7215949Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7216212Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7216249Z graph_break [] 2025-12-04T09:45:51.7216323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7216364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7216420Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7216516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7216764Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7216800Z graph_break [] 2025-12-04T09:45:51.7216873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7216914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7216981Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7217079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7217325Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7217364Z graph_break [] 2025-12-04T09:45:51.7217434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7217475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7217531Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7217627Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7217877Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7217915Z graph_break [] 2025-12-04T09:45:51.7217986Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7218028Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7218085Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7218181Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7218435Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7218471Z graph_break [] 2025-12-04T09:45:51.7218556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7218598Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7218656Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7218751Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7218999Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7219047Z graph_break [] 2025-12-04T09:45:51.7219120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7219160Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7219216Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7219313Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7219573Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7219610Z graph_break [] 2025-12-04T09:45:51.7219682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7219722Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7219779Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7219874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7220121Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7220158Z graph_break [] 2025-12-04T09:45:51.7220231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7220281Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7220340Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7220436Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7220686Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7220723Z graph_break [] 2025-12-04T09:45:51.7220795Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7220836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7220891Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7220988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7221234Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7221271Z graph_break [] 2025-12-04T09:45:51.7221342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7221384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7221440Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7221535Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7221783Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7221832Z graph_break [] 2025-12-04T09:45:51.7221904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7221947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7222003Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7222100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7222352Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7222402Z graph_break [] 2025-12-04T09:45:51.7222484Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7222520Z Unexpected success 2025-12-04T09:45:51.7222592Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7222633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7222690Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7222807Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7223110Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7223146Z graph_break [] 2025-12-04T09:45:51.7223219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7223258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7223315Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7223409Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7223658Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7223714Z graph_break [] 2025-12-04T09:45:51.7223786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7223826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7223883Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7223979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7224230Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7224265Z graph_break [] 2025-12-04T09:45:51.7224338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7224379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7224437Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7224533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7224781Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7224818Z graph_break [] 2025-12-04T09:45:51.7224889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7224931Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7224986Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7225082Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7225344Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7225382Z graph_break [] 2025-12-04T09:45:51.7225452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7225493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7225549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7225670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7225916Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7225953Z graph_break [] 2025-12-04T09:45:51.7226024Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7226065Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7226121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7226231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7226480Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7226517Z graph_break [] 2025-12-04T09:45:51.7226589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7226629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7226685Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7226780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7227030Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7227077Z graph_break [] 2025-12-04T09:45:51.7227149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7227189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7227246Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7227341Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7227588Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7227623Z graph_break [] 2025-12-04T09:45:51.7227696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7227736Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7227793Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7227888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7228138Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7228174Z graph_break [] 2025-12-04T09:45:51.7228247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7228288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7228344Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7228451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7228699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7228736Z graph_break [] 2025-12-04T09:45:51.7228807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7228848Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7228916Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7229012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7229260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7229297Z graph_break [] 2025-12-04T09:45:51.7229369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7229411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7229479Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7229575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7229820Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7229859Z graph_break [] 2025-12-04T09:45:51.7229940Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7229978Z Unexpected success 2025-12-04T09:45:51.7230050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7230092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7230148Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7230262Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7230510Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7230546Z graph_break [] 2025-12-04T09:45:51.7230618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7230658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7230714Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7230810Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7231060Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7231097Z graph_break [] 2025-12-04T09:45:51.7231169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7231209Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7231265Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7231359Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7231609Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7231645Z graph_break [] 2025-12-04T09:45:51.7231717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7231767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7231825Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7231922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7232175Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7232224Z graph_break [] 2025-12-04T09:45:51.7232295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7232336Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7232391Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7232488Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7232736Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7232784Z graph_break [] 2025-12-04T09:45:51.7232856Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7232897Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7232994Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7233091Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7233337Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7233373Z graph_break [] 2025-12-04T09:45:51.7233444Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7233485Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7233557Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7233654Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7233900Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7233937Z graph_break [] 2025-12-04T09:45:51.7234009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7234049Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7234105Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7234200Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7234448Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7234484Z graph_break [] 2025-12-04T09:45:51.7234556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7234596Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7234652Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7234747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7234994Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7235030Z graph_break [] 2025-12-04T09:45:51.7235123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7235163Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7235221Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7235317Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7235564Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7235615Z graph_break [] 2025-12-04T09:45:51.7235687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7235727Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7235783Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7235878Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7236148Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7236187Z graph_break [] 2025-12-04T09:45:51.7236258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7236298Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7236356Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7236452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7236699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7236735Z graph_break [] 2025-12-04T09:45:51.7236807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7236861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7236918Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7237014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7237260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7237298Z graph_break [] 2025-12-04T09:45:51.7237369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7237409Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7237465Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7237561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7237811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7237848Z graph_break [] 2025-12-04T09:45:51.7237929Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7237967Z Unexpected success 2025-12-04T09:45:51.7238039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7238080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7238136Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7238231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7238497Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7238535Z graph_break [] 2025-12-04T09:45:51.7238608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7238648Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7238704Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7238800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7239058Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7239093Z graph_break [] 2025-12-04T09:45:51.7239165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7239205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7239263Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7239358Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7239617Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7239654Z graph_break [] 2025-12-04T09:45:51.7239727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7239767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7239823Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7239924Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7240176Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7240223Z graph_break [] 2025-12-04T09:45:51.7240295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7240336Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7240391Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7240487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7240734Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7240770Z graph_break [] 2025-12-04T09:45:51.7240840Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7240881Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7240937Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7241034Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7241280Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7241318Z graph_break [] 2025-12-04T09:45:51.7241389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7241429Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7241485Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7241582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7241843Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7241882Z graph_break [] 2025-12-04T09:45:51.7241953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7241994Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7242050Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7242158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7242409Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7242446Z graph_break [] 2025-12-04T09:45:51.7242523Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7242564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7242624Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7242732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7243013Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7243051Z graph_break [] 2025-12-04T09:45:51.7243126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7243168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7243228Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7243323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7243575Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7243628Z graph_break [] 2025-12-04T09:45:51.7243704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7243745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7243804Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7243901Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7244152Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7244193Z graph_break [] 2025-12-04T09:45:51.7244266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7244309Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7244368Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7244468Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7244717Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7244759Z graph_break [] 2025-12-04T09:45:51.7244831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7244874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7244931Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7245028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7245291Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7245331Z graph_break [] 2025-12-04T09:45:51.7245404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7245447Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7245518Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7245617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7245872Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7245911Z graph_break [] 2025-12-04T09:45:51.7245987Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7246029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7246101Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7246198Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7246448Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7246485Z graph_break [] 2025-12-04T09:45:51.7246569Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7246607Z Unexpected success 2025-12-04T09:45:51.7246681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7246724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7246783Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7246879Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7247140Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7247177Z graph_break [] 2025-12-04T09:45:51.7247253Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7247294Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7247354Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7247450Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7247701Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7247738Z graph_break [] 2025-12-04T09:45:51.7247814Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7247855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7247915Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7248012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7248263Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7248302Z graph_break [] 2025-12-04T09:45:51.7248374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7248418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7248485Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7248585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7248832Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7248886Z graph_break [] 2025-12-04T09:45:51.7248959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7249000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7249057Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7249155Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7249405Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7249445Z graph_break [] 2025-12-04T09:45:51.7249527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7249573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7249630Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7249728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7249979Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7250018Z graph_break [] 2025-12-04T09:45:51.7250093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7250134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7250193Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7250308Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7250557Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7250595Z graph_break [] 2025-12-04T09:45:51.7250671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7250712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7250770Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7250865Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7251119Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7251157Z graph_break [] 2025-12-04T09:45:51.7251233Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7251276Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7251335Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7251432Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7251681Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7251717Z graph_break [] 2025-12-04T09:45:51.7251803Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7251845Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7251905Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7252003Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7252251Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7252301Z graph_break [] 2025-12-04T09:45:51.7252373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7252416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7252473Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7252571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7252821Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7252875Z graph_break [] 2025-12-04T09:45:51.7252987Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7253031Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7253088Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7253186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7253434Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7253473Z graph_break [] 2025-12-04T09:45:51.7253545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7253589Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7253660Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7253759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7254014Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7254052Z graph_break [] 2025-12-04T09:45:51.7254126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7254167Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7254227Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7254323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7254574Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7254612Z graph_break [] 2025-12-04T09:45:51.7254687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7254727Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7254788Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7254884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7255136Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7255172Z graph_break [] 2025-12-04T09:45:51.7256516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7256567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7256626Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7256723Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7256973Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7257029Z graph_break [] 2025-12-04T09:45:51.7257114Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7257152Z Unexpected success 2025-12-04T09:45:51.7257227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7257270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7257328Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7257427Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7257689Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7257729Z graph_break [] 2025-12-04T09:45:51.7257802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7257846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7257903Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7258001Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7258249Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7258301Z graph_break [] 2025-12-04T09:45:51.7258374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7258416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7258472Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7258571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7258821Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7258858Z graph_break [] 2025-12-04T09:45:51.7258930Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7258973Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7259030Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7259129Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7259380Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7259418Z graph_break [] 2025-12-04T09:45:51.7259492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7259533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7259593Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7259689Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7259949Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7259987Z graph_break [] 2025-12-04T09:45:51.7260061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7260103Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7260163Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7260260Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7260518Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7260555Z graph_break [] 2025-12-04T09:45:51.7260628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7260670Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7260729Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7260838Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7261091Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7261131Z graph_break [] 2025-12-04T09:45:51.7261203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7261245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7261302Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7261404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7261653Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7261703Z graph_break [] 2025-12-04T09:45:51.7261775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7261818Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7261874Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7261973Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7262220Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7262259Z graph_break [] 2025-12-04T09:45:51.7262331Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7262373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7262431Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7262529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7262774Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7262814Z graph_break [] 2025-12-04T09:45:51.7262886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7262964Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7263021Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7263121Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7263390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7263429Z graph_break [] 2025-12-04T09:45:51.7263504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7263545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7263604Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7263712Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7263963Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7264000Z graph_break [] 2025-12-04T09:45:51.7264076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7264117Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7264177Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7264295Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7264544Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7264581Z graph_break [] 2025-12-04T09:45:51.7264656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7264696Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7264754Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7264850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7265109Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7265165Z graph_break [] 2025-12-04T09:45:51.7265238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7265281Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7265338Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7265436Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7265684Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7265722Z graph_break [] 2025-12-04T09:45:51.7265795Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7265839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7265896Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7265994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7266241Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7266281Z graph_break [] 2025-12-04T09:45:51.7266353Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7266397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7266453Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7266563Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7266811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7266849Z graph_break [] 2025-12-04T09:45:51.7266929Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7266968Z Unexpected success 2025-12-04T09:45:51.7267052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7267094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7267151Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7267247Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7267496Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7267533Z graph_break [] 2025-12-04T09:45:51.7267618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7267658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7267716Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7267811Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7268060Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7268095Z graph_break [] 2025-12-04T09:45:51.7268167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7268207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7268264Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7268369Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7268618Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7268654Z graph_break [] 2025-12-04T09:45:51.7268726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7268766Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7268825Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7268920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7269174Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7269212Z graph_break [] 2025-12-04T09:45:51.7269284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7269326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7269382Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7269477Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7269724Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7269762Z graph_break [] 2025-12-04T09:45:51.7269832Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7269884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7269940Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7270039Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7270286Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7270336Z graph_break [] 2025-12-04T09:45:51.7270407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7270449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7270504Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7270601Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7270851Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7270899Z graph_break [] 2025-12-04T09:45:51.7270972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7271012Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7271069Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7271166Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7271413Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7271449Z graph_break [] 2025-12-04T09:45:51.7271521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7271562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7271629Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7271727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7271976Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7272013Z graph_break [] 2025-12-04T09:45:51.7272086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7272126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7272183Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7272278Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7272527Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7272565Z graph_break [] 2025-12-04T09:45:51.7272638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7272678Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7272735Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7272832Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7273123Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7273160Z graph_break [] 2025-12-04T09:45:51.7273249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7273291Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7273348Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7273445Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7273692Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7273745Z graph_break [] 2025-12-04T09:45:51.7273817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7273858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7273914Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7274010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7274275Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7274313Z graph_break [] 2025-12-04T09:45:51.7274385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7274426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7274483Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7274579Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7274830Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7274867Z graph_break [] 2025-12-04T09:45:51.7274941Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7274995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7275051Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7275149Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7275402Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7275440Z graph_break [] 2025-12-04T09:45:51.7275516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7275558Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7275620Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7275719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7275973Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7276011Z graph_break [] 2025-12-04T09:45:51.7276088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7276129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7276191Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7276287Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7276538Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7276575Z graph_break [] 2025-12-04T09:45:51.7276662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7276706Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7276766Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7276863Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7277116Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7277175Z graph_break [] 2025-12-04T09:45:51.7277257Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7277299Z Unexpected success 2025-12-04T09:45:51.7277373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7277418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7277476Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7277575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7277839Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7277883Z graph_break [] 2025-12-04T09:45:51.7277955Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7277999Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7278056Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7278154Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7278405Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7278456Z graph_break [] 2025-12-04T09:45:51.7278529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7278574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7278631Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7278731Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7278987Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7279024Z graph_break [] 2025-12-04T09:45:51.7279099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7279142Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7279202Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7279300Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7279549Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7279588Z graph_break [] 2025-12-04T09:45:51.7279662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7279704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7279765Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7279860Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7280122Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7280163Z graph_break [] 2025-12-04T09:45:51.7280238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7280280Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7280339Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7280446Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7280696Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7280734Z graph_break [] 2025-12-04T09:45:51.7280809Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7280853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7280911Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7281018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7281266Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7281305Z graph_break [] 2025-12-04T09:45:51.7281376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7281418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7281473Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7281570Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7281817Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7281866Z graph_break [] 2025-12-04T09:45:51.7281937Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7281979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7282036Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7282136Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7282382Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7282420Z graph_break [] 2025-12-04T09:45:51.7282492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7282535Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7282592Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7282690Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7282989Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7283026Z graph_break [] 2025-12-04T09:45:51.7283101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7283142Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7283202Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7283299Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7283568Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7283607Z graph_break [] 2025-12-04T09:45:51.7283682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7283723Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7283796Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7283892Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7284142Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7284179Z graph_break [] 2025-12-04T09:45:51.7284253Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7284295Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7284353Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7284466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7284715Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7284754Z graph_break [] 2025-12-04T09:45:51.7284828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7284871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7284928Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7285028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7285277Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7285329Z graph_break [] 2025-12-04T09:45:51.7285402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7285444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7285502Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7285599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7285847Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7285887Z graph_break [] 2025-12-04T09:45:51.7285962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7286005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7286062Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7286158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7286404Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7286445Z graph_break [] 2025-12-04T09:45:51.7286518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7286562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7286619Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7286726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7286983Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7287021Z graph_break [] 2025-12-04T09:45:51.7287095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7287148Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7287206Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7287302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7287550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7287587Z graph_break [] 2025-12-04T09:45:51.7287661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7287703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7287770Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7287866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7288114Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7288151Z graph_break [] 2025-12-04T09:45:51.7288234Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7288272Z Unexpected success 2025-12-04T09:45:51.7288345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7288387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7288446Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7288553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7288805Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7288844Z graph_break [] 2025-12-04T09:45:51.7288916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7288960Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7289017Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7289114Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7289363Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7289402Z graph_break [] 2025-12-04T09:45:51.7289474Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7289517Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7289573Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7289671Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7289918Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7289957Z graph_break [] 2025-12-04T09:45:51.7290030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7290091Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7290148Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7290249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7290496Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7290546Z graph_break [] 2025-12-04T09:45:51.7290617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7290661Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7290717Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7290817Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7291071Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7291119Z graph_break [] 2025-12-04T09:45:51.7291193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7291234Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7291293Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7291393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7291642Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7291679Z graph_break [] 2025-12-04T09:45:51.7291754Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7291795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7291863Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7291959Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7292207Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7292245Z graph_break [] 2025-12-04T09:45:51.7292321Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7292361Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7292419Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7292515Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7292768Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7292806Z graph_break [] 2025-12-04T09:45:51.7292878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7292921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7293018Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7293116Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7293369Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7293409Z graph_break [] 2025-12-04T09:45:51.7293505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7293549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7293606Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7293705Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7293960Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7294013Z graph_break [] 2025-12-04T09:45:51.7294085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7294127Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7294183Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7294282Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7294542Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7294584Z graph_break [] 2025-12-04T09:45:51.7294656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7294698Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7294757Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7294853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7295105Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7295141Z graph_break [] 2025-12-04T09:45:51.7295217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7295273Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7295332Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7295427Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7295676Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7295713Z graph_break [] 2025-12-04T09:45:51.7295786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7295827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7295884Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7295980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7296229Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7296266Z graph_break [] 2025-12-04T09:45:51.7296339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7296380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7296438Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7296533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7296782Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7296832Z graph_break [] 2025-12-04T09:45:51.7296905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7296948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7297006Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7297103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7297351Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7297401Z graph_break [] 2025-12-04T09:45:51.7297473Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7297514Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7297571Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7297668Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7297925Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7297964Z graph_break [] 2025-12-04T09:45:51.7298037Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7298080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7298137Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7298235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7298485Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7298523Z graph_break [] 2025-12-04T09:45:51.7298596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7298647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7298706Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7298802Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7299053Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7299091Z graph_break [] 2025-12-04T09:45:51.7299165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7299206Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7299265Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7299361Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7299611Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7299647Z graph_break [] 2025-12-04T09:45:51.7299730Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7299768Z Unexpected success 2025-12-04T09:45:51.7299842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7299885Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7299942Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7300037Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7300298Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7300337Z graph_break [] 2025-12-04T09:45:51.7300411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7300452Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7300509Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7300616Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7300869Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7300907Z graph_break [] 2025-12-04T09:45:51.7300979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7301022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7301080Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7301189Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7301435Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7301474Z graph_break [] 2025-12-04T09:45:51.7301545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7301587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7301643Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7301739Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7301989Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7302047Z graph_break [] 2025-12-04T09:45:51.7302118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7302161Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7302219Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7302315Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7302563Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7302601Z graph_break [] 2025-12-04T09:45:51.7302676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7302718Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7302776Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7302873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7303169Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7303207Z graph_break [] 2025-12-04T09:45:51.7303281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7303321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7303380Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7303475Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7303740Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7303778Z graph_break [] 2025-12-04T09:45:51.7303851Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7303891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7303967Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7304062Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7304310Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7304347Z graph_break [] 2025-12-04T09:45:51.7304422Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7304463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7304535Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7304633Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7304886Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7304925Z graph_break [] 2025-12-04T09:45:51.7304996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7305039Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7305095Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7305193Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7305441Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7305492Z graph_break [] 2025-12-04T09:45:51.7305563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7305607Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7305663Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7305759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7306006Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7306045Z graph_break [] 2025-12-04T09:45:51.7306118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7306162Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7306219Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7306316Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7306565Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7306603Z graph_break [] 2025-12-04T09:45:51.7306676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7306717Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7306780Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7306887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7307139Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7307176Z graph_break [] 2025-12-04T09:45:51.7307249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7307302Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7307360Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7307455Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7307703Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7307740Z graph_break [] 2025-12-04T09:45:51.7307813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7307864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7307923Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7308018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7308268Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7308305Z graph_break [] 2025-12-04T09:45:51.7308379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7308421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7308477Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7308575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7308838Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7308876Z graph_break [] 2025-12-04T09:45:51.7308948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7308991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7309047Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7309144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7309390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7309428Z graph_break [] 2025-12-04T09:45:51.7309501Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7309544Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7309600Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7309697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7309944Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7309982Z graph_break [] 2025-12-04T09:45:51.7310053Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7310095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7310163Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7310261Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7310511Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7310547Z graph_break [] 2025-12-04T09:45:51.7310634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7310676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7310734Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7310830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7311083Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7311120Z graph_break [] 2025-12-04T09:45:51.7311204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7311245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7311302Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7311397Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7311645Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7311681Z graph_break [] 2025-12-04T09:45:51.7311763Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7311801Z Unexpected success 2025-12-04T09:45:51.7311874Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7311916Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7311986Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7312083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7312332Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7312370Z graph_break [] 2025-12-04T09:45:51.7312441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7312483Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7312540Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7312637Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7312886Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7312925Z graph_break [] 2025-12-04T09:45:51.7313041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7313083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7313141Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7313238Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7313486Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7313524Z graph_break [] 2025-12-04T09:45:51.7313611Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7313655Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7313712Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7313809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7314056Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7314112Z graph_break [] 2025-12-04T09:45:51.7314183Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7314226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7314282Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7314380Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7314656Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7314694Z graph_break [] 2025-12-04T09:45:51.7314768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7314809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7314868Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7314963Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7315214Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7315251Z graph_break [] 2025-12-04T09:45:51.7315324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7315379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7315438Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7315534Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7315781Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7315819Z graph_break [] 2025-12-04T09:45:51.7315892Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7315933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7315991Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7316087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7316337Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7316375Z graph_break [] 2025-12-04T09:45:51.7316448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7316492Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7316549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7316646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7316905Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7316943Z graph_break [] 2025-12-04T09:45:51.7317015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7317059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7317116Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7317213Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7317461Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7317512Z graph_break [] 2025-12-04T09:45:51.7317584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7317626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7317682Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7317780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7318037Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7318077Z graph_break [] 2025-12-04T09:45:51.7318148Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7318191Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7318247Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7318344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7318596Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7318632Z graph_break [] 2025-12-04T09:45:51.7318717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7318758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7318816Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7318912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7319162Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7319198Z graph_break [] 2025-12-04T09:45:51.7319271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7319311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7319370Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7319466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7319715Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7319751Z graph_break [] 2025-12-04T09:45:51.7319825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7319866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7319924Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7320019Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7320282Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7320321Z graph_break [] 2025-12-04T09:45:51.7320394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7320436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7320493Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7320591Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7320848Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7320886Z graph_break [] 2025-12-04T09:45:51.7320958Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7320999Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7321056Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7321156Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7321413Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7321451Z graph_break [] 2025-12-04T09:45:51.7321524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7321567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7321622Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7321719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7321966Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7322014Z graph_break [] 2025-12-04T09:45:51.7322088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7322129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7322186Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7322281Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7322534Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7322572Z graph_break [] 2025-12-04T09:45:51.7322647Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7322689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7322750Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7322847Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7323131Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7323168Z graph_break [] 2025-12-04T09:45:51.7323242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7323282Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7323341Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7323437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7323707Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7323745Z graph_break [] 2025-12-04T09:45:51.7323820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7323861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7323918Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7324014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7324278Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7324315Z graph_break [] 2025-12-04T09:45:51.7324397Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7324437Z Unexpected success 2025-12-04T09:45:51.7324510Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7324554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7324624Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7324722Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7324969Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7325008Z graph_break [] 2025-12-04T09:45:51.7325079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7325121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7325177Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7325274Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7325535Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7325573Z graph_break [] 2025-12-04T09:45:51.7325644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7325688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7325744Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7325841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7326088Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7326127Z graph_break [] 2025-12-04T09:45:51.7326200Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7326243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7326301Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7326399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7326650Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7326687Z graph_break [] 2025-12-04T09:45:51.7326761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7326802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7326860Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7326965Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7327214Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7327251Z graph_break [] 2025-12-04T09:45:51.7327324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7327385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7327443Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7327538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7327786Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7327822Z graph_break [] 2025-12-04T09:45:51.7327896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7327947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7328006Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7328101Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7328354Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7328391Z graph_break [] 2025-12-04T09:45:51.7328467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7328509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7328566Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7328663Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7328921Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7328959Z graph_break [] 2025-12-04T09:45:51.7329030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7329073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7329132Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7329229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7329475Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7329515Z graph_break [] 2025-12-04T09:45:51.7329588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7329631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7329687Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7329785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7330035Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7330071Z graph_break [] 2025-12-04T09:45:51.7330143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7330184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7330251Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7330350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7330602Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7330641Z graph_break [] 2025-12-04T09:45:51.7330726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7330768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7330826Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7330921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7331170Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7331207Z graph_break [] 2025-12-04T09:45:51.7331290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7331331Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7331389Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7331484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7331732Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7331770Z graph_break [] 2025-12-04T09:45:51.7331843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7331884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7331943Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7332050Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7332300Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7332340Z graph_break [] 2025-12-04T09:45:51.7332412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7332455Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7332512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7332610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7332859Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7332897Z graph_break [] 2025-12-04T09:45:51.7333005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7333048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7333104Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7333200Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7333447Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7333486Z graph_break [] 2025-12-04T09:45:51.7333557Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7333620Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7333677Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7333777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7334026Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7334079Z graph_break [] 2025-12-04T09:45:51.7334153Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7334194Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7334253Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7334352Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7334606Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7334656Z graph_break [] 2025-12-04T09:45:51.7334729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7334770Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7334829Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7334926Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7335175Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7335212Z graph_break [] 2025-12-04T09:45:51.7335285Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7335327Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7335399Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7335496Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7335747Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7335784Z graph_break [] 2025-12-04T09:45:51.7335857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7335899Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7335956Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7336052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7336305Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7336344Z graph_break [] 2025-12-04T09:45:51.7336416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7336458Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7336514Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7336611Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7336858Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7336895Z graph_break [] 2025-12-04T09:45:51.7336978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7337021Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7337079Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7337176Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7337422Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7337473Z graph_break [] 2025-12-04T09:45:51.7337553Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7337593Z Unexpected success 2025-12-04T09:45:51.7337665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7337707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7337764Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7337860Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7338124Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7338162Z graph_break [] 2025-12-04T09:45:51.7340497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7340543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7340603Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7340702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7340957Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7341010Z graph_break [] 2025-12-04T09:45:51.7341086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7341127Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7341185Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7341280Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7341529Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7341565Z graph_break [] 2025-12-04T09:45:51.7341638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7341679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7341739Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7341834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7342084Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7342121Z graph_break [] 2025-12-04T09:45:51.7342194Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7342236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7342292Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7342389Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7342665Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7342707Z graph_break [] 2025-12-04T09:45:51.7342781Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7342824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7342880Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7343013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7343280Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7343318Z graph_break [] 2025-12-04T09:45:51.7343389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7343430Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7343489Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7343590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7343850Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7343890Z graph_break [] 2025-12-04T09:45:51.7343961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7344004Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7344060Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7344157Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7344408Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7344464Z graph_break [] 2025-12-04T09:45:51.7344540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7344581Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7344639Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7344737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7344987Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7345023Z graph_break [] 2025-12-04T09:45:51.7345095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7345137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7345194Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7345292Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7345540Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7345578Z graph_break [] 2025-12-04T09:45:51.7345650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7345691Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7345749Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7345844Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7346108Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7346148Z graph_break [] 2025-12-04T09:45:51.7346220Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7346261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7346318Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7346428Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7346675Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7346714Z graph_break [] 2025-12-04T09:45:51.7346785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7346827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7346883Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7346992Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7347239Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7347278Z graph_break [] 2025-12-04T09:45:51.7347349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7347391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7347448Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7347544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7347790Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7347841Z graph_break [] 2025-12-04T09:45:51.7347912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7347954Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7348010Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7348107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7348354Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7348390Z graph_break [] 2025-12-04T09:45:51.7348464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7348505Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7348564Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7348660Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7348908Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7348945Z graph_break [] 2025-12-04T09:45:51.7349019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7349059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7349116Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7349212Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7349473Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7349511Z graph_break [] 2025-12-04T09:45:51.7349584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7349624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7349694Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7349790Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7350040Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7350077Z graph_break [] 2025-12-04T09:45:51.7350150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7350193Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7350249Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7350358Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7350611Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7350649Z graph_break [] 2025-12-04T09:45:51.7350721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7350763Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7350818Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7350920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7351169Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7351220Z graph_break [] 2025-12-04T09:45:51.7351292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7351335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7351392Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7351489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7351735Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7351773Z graph_break [] 2025-12-04T09:45:51.7351845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7351888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7351945Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7352042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7352293Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7352330Z graph_break [] 2025-12-04T09:45:51.7352403Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7352443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7352501Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7352608Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7352856Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7352893Z graph_break [] 2025-12-04T09:45:51.7353002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7353063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7353121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7353216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7353465Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7353502Z graph_break [] 2025-12-04T09:45:51.7353585Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7353624Z Unexpected success 2025-12-04T09:45:51.7353713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7353755Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7353813Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7353911Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7354160Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7354198Z graph_break [] 2025-12-04T09:45:51.7354270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7354312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7354369Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7354492Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7354742Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7354781Z graph_break [] 2025-12-04T09:45:51.7354854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7354896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7354952Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7355049Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7355297Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7355336Z graph_break [] 2025-12-04T09:45:51.7355408Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7355450Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7355506Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7355605Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7355852Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7355890Z graph_break [] 2025-12-04T09:45:51.7355963Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7356017Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7356076Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7356173Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7356429Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7356482Z graph_break [] 2025-12-04T09:45:51.7356557Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7356598Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7356656Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7356752Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7357004Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7357051Z graph_break [] 2025-12-04T09:45:51.7357125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7357165Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7357223Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7357319Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7357567Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7357603Z graph_break [] 2025-12-04T09:45:51.7357676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7357717Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7357787Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7357884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7358133Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7358172Z graph_break [] 2025-12-04T09:45:51.7358244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7358286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7358343Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7358441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7358691Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7358731Z graph_break [] 2025-12-04T09:45:51.7358804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7358845Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7358903Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7358999Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7359245Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7359286Z graph_break [] 2025-12-04T09:45:51.7359368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7359412Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7359468Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7359567Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7359812Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7359863Z graph_break [] 2025-12-04T09:45:51.7359936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7359976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7360035Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7360132Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7360396Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7360435Z graph_break [] 2025-12-04T09:45:51.7360508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7360549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7360607Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7360703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7360951Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7360988Z graph_break [] 2025-12-04T09:45:51.7361062Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7361114Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7361173Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7361267Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7361515Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7361552Z graph_break [] 2025-12-04T09:45:51.7361626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7361666Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7361724Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7361820Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7362069Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7362108Z graph_break [] 2025-12-04T09:45:51.7362179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7362223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7362279Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7362376Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7362623Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7362671Z graph_break [] 2025-12-04T09:45:51.7362744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7362787Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7362844Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7362976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7363222Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7363282Z graph_break [] 2025-12-04T09:45:51.7363354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7363397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7363454Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7363552Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7363814Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7363853Z graph_break [] 2025-12-04T09:45:51.7363926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7363967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7364025Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7364121Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7364376Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7364414Z graph_break [] 2025-12-04T09:45:51.7364487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7364544Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7364602Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7364698Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7364945Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7364982Z graph_break [] 2025-12-04T09:45:51.7365056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7365096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7365154Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7365250Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7365499Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7365535Z graph_break [] 2025-12-04T09:45:51.7365609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7365651Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7365708Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7365804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7366064Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7366103Z graph_break [] 2025-12-04T09:45:51.7366178Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7366221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7366278Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7366377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7366643Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7366681Z graph_break [] 2025-12-04T09:45:51.7366753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7366795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7366854Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7366951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7367219Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7367258Z graph_break [] 2025-12-04T09:45:51.7367331Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7367374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7367429Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7367527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7367776Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7367824Z graph_break [] 2025-12-04T09:45:51.7367908Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7367946Z Unexpected success 2025-12-04T09:45:51.7368020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7368061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7368121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7368218Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7368472Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7368508Z graph_break [] 2025-12-04T09:45:51.7368582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7368624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7368684Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7368779Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7369028Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7369067Z graph_break [] 2025-12-04T09:45:51.7369141Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7369182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7369240Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7369335Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7369597Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7369637Z graph_break [] 2025-12-04T09:45:51.7369708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7369750Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7369821Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7369918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7370169Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7370206Z graph_break [] 2025-12-04T09:45:51.7370279Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7370322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7370391Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7370488Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7370736Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7370775Z graph_break [] 2025-12-04T09:45:51.7370847Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7370889Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7370945Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7371043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7371290Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7371340Z graph_break [] 2025-12-04T09:45:51.7371412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7371455Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7371511Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7371608Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7371856Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7371893Z graph_break [] 2025-12-04T09:45:51.7371967Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7372017Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7372085Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7372186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7372443Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7372482Z graph_break [] 2025-12-04T09:45:51.7372558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7372599Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7372660Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7372768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7373072Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7373110Z graph_break [] 2025-12-04T09:45:51.7373186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7373248Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7373308Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7373404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7373656Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7373696Z graph_break [] 2025-12-04T09:45:51.7373769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7373829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7373887Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7373986Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7374239Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7374280Z graph_break [] 2025-12-04T09:45:51.7374353Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7374399Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7374456Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7374558Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7374822Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7374862Z graph_break [] 2025-12-04T09:45:51.7374935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7374981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7375039Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7375139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7375389Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7375429Z graph_break [] 2025-12-04T09:45:51.7375502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7375547Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7375605Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7375704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7375959Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7375999Z graph_break [] 2025-12-04T09:45:51.7376075Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7376118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7376197Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7376294Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7376547Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7376585Z graph_break [] 2025-12-04T09:45:51.7376673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7376716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7376775Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7376872Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7377126Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7377164Z graph_break [] 2025-12-04T09:45:51.7377251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7377293Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7377353Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7377450Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7377701Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7377743Z graph_break [] 2025-12-04T09:45:51.7377817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7377861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7377918Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7378017Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7378276Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7378313Z graph_break [] 2025-12-04T09:45:51.7378386Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7378428Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7378485Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7378582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7378829Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7378868Z graph_break [] 2025-12-04T09:45:51.7378940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7378982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7379040Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7379137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7379383Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7379422Z graph_break [] 2025-12-04T09:45:51.7379493Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7379535Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7379602Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7379700Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7379957Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7380014Z graph_break [] 2025-12-04T09:45:51.7380089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7380129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7380188Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7380284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7380535Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7380573Z graph_break [] 2025-12-04T09:45:51.7380658Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7380700Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7380758Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7380853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7381103Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7381139Z graph_break [] 2025-12-04T09:45:51.7381212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7381254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7381315Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7381424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7381671Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7381710Z graph_break [] 2025-12-04T09:45:51.7381782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7381824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7381880Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7381979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7382228Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7382268Z graph_break [] 2025-12-04T09:45:51.7382339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7382383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7382439Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7382537Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7382785Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7382823Z graph_break [] 2025-12-04T09:45:51.7382916Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7383000Z Unexpected success 2025-12-04T09:45:51.7383072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7383116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7383173Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7383270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7383517Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7383579Z graph_break [] 2025-12-04T09:45:51.7383653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7383694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7383751Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7383849Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7384118Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7384155Z graph_break [] 2025-12-04T09:45:51.7384228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7384270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7384330Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7384425Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7384672Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7384708Z graph_break [] 2025-12-04T09:45:51.7384799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7384840Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7384898Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7384994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7385243Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7385279Z graph_break [] 2025-12-04T09:45:51.7385352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7385392Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7385451Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7385547Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7385801Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7385839Z graph_break [] 2025-12-04T09:45:51.7385914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7385958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7386015Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7386112Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7386375Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7386414Z graph_break [] 2025-12-04T09:45:51.7386487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7386529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7386585Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7386683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7386940Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7386978Z graph_break [] 2025-12-04T09:45:51.7387051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7387094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7387152Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7387249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7387508Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7387547Z graph_break [] 2025-12-04T09:45:51.7387621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7387663Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7387721Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7387816Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7388071Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7388119Z graph_break [] 2025-12-04T09:45:51.7388195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7388238Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7388296Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7388391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7388641Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7388677Z graph_break [] 2025-12-04T09:45:51.7388750Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7388791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7388852Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7388948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7389201Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7389238Z graph_break [] 2025-12-04T09:45:51.7389312Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7389352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7389410Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7389505Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7389771Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7389811Z graph_break [] 2025-12-04T09:45:51.7389884Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7389926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7389984Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7390080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7390340Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7390379Z graph_break [] 2025-12-04T09:45:51.7390452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7390495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7390552Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7390660Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7390906Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7390946Z graph_break [] 2025-12-04T09:45:51.7391019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7391061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7391118Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7391216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7391464Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7391515Z graph_break [] 2025-12-04T09:45:51.7391588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7391628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7391687Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7391784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7392036Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7392073Z graph_break [] 2025-12-04T09:45:51.7392146Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7392187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7392247Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7392343Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7392593Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7392633Z graph_break [] 2025-12-04T09:45:51.7392708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7392748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7392807Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7392902Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7393410Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7393450Z graph_break [] 2025-12-04T09:45:51.7393524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7393564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7393625Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7393737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7393990Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7394027Z graph_break [] 2025-12-04T09:45:51.7394101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7394143Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7394204Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7394324Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7394571Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7394610Z graph_break [] 2025-12-04T09:45:51.7394681Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7394723Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7394780Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7394876Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7395127Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7395184Z graph_break [] 2025-12-04T09:45:51.7395257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7395299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7395357Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7395454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7395701Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7395738Z graph_break [] 2025-12-04T09:45:51.7395811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7395853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7395910Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7396008Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7396258Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7396295Z graph_break [] 2025-12-04T09:45:51.7396369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7396410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7396469Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7396575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7396828Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7396867Z graph_break [] 2025-12-04T09:45:51.7396941Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7396981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7397052Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7397147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7397398Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7397435Z graph_break [] 2025-12-04T09:45:51.7397509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7397553Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7397621Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7397718Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7397971Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7398010Z graph_break [] 2025-12-04T09:45:51.7398083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7398124Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7398183Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7398281Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7398531Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7398579Z graph_break [] 2025-12-04T09:45:51.7398661Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7398701Z Unexpected success 2025-12-04T09:45:51.7398774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7398817Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7398873Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7398969Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7399215Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7399254Z graph_break [] 2025-12-04T09:45:51.7399328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7399371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7399427Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7399523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7399775Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7399811Z graph_break [] 2025-12-04T09:45:51.7399885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7399935Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7399994Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7400091Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7400340Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7400389Z graph_break [] 2025-12-04T09:45:51.7400463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7400503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7400561Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7400657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7400906Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7400960Z graph_break [] 2025-12-04T09:45:51.7401034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7401075Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7401135Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7401232Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7401480Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7401518Z graph_break [] 2025-12-04T09:45:51.7401589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7401633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7401700Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7401798Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7402048Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7402087Z graph_break [] 2025-12-04T09:45:51.7402158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7402200Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7402257Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7402354Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7402601Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7402640Z graph_break [] 2025-12-04T09:45:51.7402714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7402756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7402813Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7402910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7403203Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7403241Z graph_break [] 2025-12-04T09:45:51.7403329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7403372Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7403430Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7403527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7403776Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7403830Z graph_break [] 2025-12-04T09:45:51.7403904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7403945Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7404012Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7404109Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7404390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7404430Z graph_break [] 2025-12-04T09:45:51.7404506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7404548Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7404609Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7404705Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7404957Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7404995Z graph_break [] 2025-12-04T09:45:51.7405071Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7405141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7405202Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7405299Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7405550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7405591Z graph_break [] 2025-12-04T09:45:51.7405663Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7405707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7405767Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7405871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7406124Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7406168Z graph_break [] 2025-12-04T09:45:51.7406241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7406287Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7406347Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7406447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7406697Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7406738Z graph_break [] 2025-12-04T09:45:51.7406825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7406874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7406932Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7407030Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7407277Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7407333Z graph_break [] 2025-12-04T09:45:51.7407409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7407453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7407512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7407609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7407875Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7407915Z graph_break [] 2025-12-04T09:45:51.7407993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7408035Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7408097Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7408193Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7408444Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7408484Z graph_break [] 2025-12-04T09:45:51.7408558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7408614Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7408674Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7408772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7409024Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7409062Z graph_break [] 2025-12-04T09:45:51.7409137Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7409179Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7409239Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7409336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7409594Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7409634Z graph_break [] 2025-12-04T09:45:51.7409707Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7409753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7409810Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7409910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7410170Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7410210Z graph_break [] 2025-12-04T09:45:51.7410284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7410330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7410389Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7410487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7410733Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7410783Z graph_break [] 2025-12-04T09:45:51.7410857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7410901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7410958Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7411059Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7411320Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7411361Z graph_break [] 2025-12-04T09:45:51.7411437Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7411479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7411539Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7411636Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7411888Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7411926Z graph_break [] 2025-12-04T09:45:51.7412014Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7412058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7412117Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7412214Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7412466Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7412506Z graph_break [] 2025-12-04T09:45:51.7412584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7412626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7412688Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7412784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7413106Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7413143Z graph_break [] 2025-12-04T09:45:51.7413220Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7413262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7413325Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7413422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7413699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7413742Z graph_break [] 2025-12-04T09:45:51.7413815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7413861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7413919Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7414020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7414284Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7414325Z graph_break [] 2025-12-04T09:45:51.7414399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7414445Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7414504Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7414603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7414863Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7414904Z graph_break [] 2025-12-04T09:45:51.7414989Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7415032Z Unexpected success 2025-12-04T09:45:51.7415107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7415151Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7415209Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7415309Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7415560Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7415614Z graph_break [] 2025-12-04T09:45:51.7415691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7415734Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7415796Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7415893Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7416148Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7416186Z graph_break [] 2025-12-04T09:45:51.7416262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7416304Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7416365Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7416462Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7416714Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7416752Z graph_break [] 2025-12-04T09:45:51.7416827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7416870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7416929Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7417036Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7417286Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7417325Z graph_break [] 2025-12-04T09:45:51.7417400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7417453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7417513Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7417611Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7417864Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7417906Z graph_break [] 2025-12-04T09:45:51.7417979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7418024Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7418104Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7418205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7418452Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7418492Z graph_break [] 2025-12-04T09:45:51.7418564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7418608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7418665Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7418764Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7419022Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7419062Z graph_break [] 2025-12-04T09:45:51.7419134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7419181Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7419239Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7419340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7419590Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7419628Z graph_break [] 2025-12-04T09:45:51.7419705Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7419749Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7419808Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7419904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7420154Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7420192Z graph_break [] 2025-12-04T09:45:51.7420271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7420313Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7420375Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7420485Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7420739Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7420777Z graph_break [] 2025-12-04T09:45:51.7420855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7420911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7420972Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7421068Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7421320Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7421358Z graph_break [] 2025-12-04T09:45:51.7421435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7421490Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7421549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7421649Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7421902Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7421942Z graph_break [] 2025-12-04T09:45:51.7422016Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7422061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7422122Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7422224Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7422487Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7422528Z graph_break [] 2025-12-04T09:45:51.7422603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7422648Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7422707Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7422806Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7423098Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7423139Z graph_break [] 2025-12-04T09:45:51.7423214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7423258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7423315Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7423414Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7423669Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7423706Z graph_break [] 2025-12-04T09:45:51.7423782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7423824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7423911Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7424008Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7424264Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7424301Z graph_break [] 2025-12-04T09:45:51.7424398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7424440Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7424500Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7424598Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7424854Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7424892Z graph_break [] 2025-12-04T09:45:51.7424982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7425025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7425085Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7425182Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7425432Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7425473Z graph_break [] 2025-12-04T09:45:51.7425546Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7425591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7425648Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7425766Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7426021Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7426062Z graph_break [] 2025-12-04T09:45:51.7426134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7426178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7426237Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7426335Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7426583Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7426623Z graph_break [] 2025-12-04T09:45:51.7426696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7426740Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7426797Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7426896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7427144Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7427185Z graph_break [] 2025-12-04T09:45:51.7427257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7427314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7427375Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7427474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7427723Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7427770Z graph_break [] 2025-12-04T09:45:51.7427844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7427884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7427941Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7428037Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7428287Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7428336Z graph_break [] 2025-12-04T09:45:51.7428411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7428452Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7428510Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7428607Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7428857Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7428893Z graph_break [] 2025-12-04T09:45:51.7428970Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7429011Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7429081Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7429179Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7429429Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7429468Z graph_break [] 2025-12-04T09:45:51.7429540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7429581Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7429638Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7429737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7429992Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7430031Z graph_break [] 2025-12-04T09:45:51.7430102Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7430144Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7430201Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7430300Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7430545Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7430583Z graph_break [] 2025-12-04T09:45:51.7430666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7430709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7430767Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7430865Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7431111Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7431172Z graph_break [] 2025-12-04T09:45:51.7431244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7431286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7431342Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7431440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7431707Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7431745Z graph_break [] 2025-12-04T09:45:51.7431831Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7431868Z Unexpected success 2025-12-04T09:45:51.7431944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7431985Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7432045Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7432140Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7432390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7432444Z graph_break [] 2025-12-04T09:45:51.7432520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7432563Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7432621Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7432716Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7433015Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7433054Z graph_break [] 2025-12-04T09:45:51.7433129Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7433170Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7433228Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7433325Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7433575Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7433613Z graph_break [] 2025-12-04T09:45:51.7433687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7433729Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7433785Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7433883Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7434148Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7434189Z graph_break [] 2025-12-04T09:45:51.7434261Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7434304Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7434360Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7434458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7434722Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7434760Z graph_break [] 2025-12-04T09:45:51.7434831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7434874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7434931Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7435030Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7435296Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7435337Z graph_break [] 2025-12-04T09:45:51.7435408Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7435450Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7435508Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7435603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7435857Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7435911Z graph_break [] 2025-12-04T09:45:51.7435987Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7436027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7436090Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7436187Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7436439Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7436475Z graph_break [] 2025-12-04T09:45:51.7436549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7436590Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7436649Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7436747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7436998Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7437035Z graph_break [] 2025-12-04T09:45:51.7437109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7437149Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7437207Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7437303Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7437564Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7437604Z graph_break [] 2025-12-04T09:45:51.7437678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7437720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7437776Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7437887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7438137Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7438175Z graph_break [] 2025-12-04T09:45:51.7438249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7438291Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7438349Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7438456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7438703Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7438742Z graph_break [] 2025-12-04T09:45:51.7438813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7438856Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7438913Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7439010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7439258Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7439307Z graph_break [] 2025-12-04T09:45:51.7439381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7439421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7439479Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7439577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7439830Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7439866Z graph_break [] 2025-12-04T09:45:51.7439940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7439980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7440042Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7440141Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7440388Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7440426Z graph_break [] 2025-12-04T09:45:51.7440500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7440541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7440600Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7440697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7440960Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7441000Z graph_break [] 2025-12-04T09:45:51.7441077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7441117Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7441188Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7441284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7441535Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7441572Z graph_break [] 2025-12-04T09:45:51.7441646Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7441690Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7441780Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7441879Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7442128Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7442167Z graph_break [] 2025-12-04T09:45:51.7442239Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7442281Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7442337Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7442434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7442681Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7442732Z graph_break [] 2025-12-04T09:45:51.7442804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7442846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7442904Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7443036Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7443283Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7443321Z graph_break [] 2025-12-04T09:45:51.7443394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7443438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7443496Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7443592Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7443846Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7443884Z graph_break [] 2025-12-04T09:45:51.7443956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7443997Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7444058Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7444182Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7444432Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7444470Z graph_break [] 2025-12-04T09:45:51.7444543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7444600Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7444658Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7444753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7445003Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7445040Z graph_break [] 2025-12-04T09:45:51.7445115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7445156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7445232Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7445330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7445577Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7445616Z graph_break [] 2025-12-04T09:45:51.7445689Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7445731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7445787Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7445886Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7446152Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7446191Z graph_break [] 2025-12-04T09:45:51.7446264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7446308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7446364Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7446460Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7446710Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7446748Z graph_break [] 2025-12-04T09:45:51.7446820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7446864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7446921Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7447019Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7447269Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7447307Z graph_break [] 2025-12-04T09:45:51.7447379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7447420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7447477Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7447586Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7447843Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7447880Z graph_break [] 2025-12-04T09:45:51.7447953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7448006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7448066Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7448163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7448413Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7448450Z graph_break [] 2025-12-04T09:45:51.7448525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7448576Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7448635Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7448730Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7448980Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7449016Z graph_break [] 2025-12-04T09:45:51.7449101Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7449139Z Unexpected success 2025-12-04T09:45:51.7449212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7449255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7449325Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7449422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7449674Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7449713Z graph_break [] 2025-12-04T09:45:51.7449785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7449827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7449883Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7449981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7450231Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7450270Z graph_break [] 2025-12-04T09:45:51.7450342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7450386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7450443Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7450540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7450789Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7450826Z graph_break [] 2025-12-04T09:45:51.7450909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7450953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7451009Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7451106Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7451353Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7451403Z graph_break [] 2025-12-04T09:45:51.7451476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7451517Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7451575Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7451674Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7451938Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7451976Z graph_break [] 2025-12-04T09:45:51.7452051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7452092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7452151Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7452247Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7452496Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7452533Z graph_break [] 2025-12-04T09:45:51.7452608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7452661Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7452720Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7452815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7453106Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7453145Z graph_break [] 2025-12-04T09:45:51.7453219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7453261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7453317Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7453415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7453666Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7453704Z graph_break [] 2025-12-04T09:45:51.7453777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7453821Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7453878Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7453975Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7454223Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7454287Z graph_break [] 2025-12-04T09:45:51.7454361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7454404Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7454462Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7454559Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7454808Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7454864Z graph_break [] 2025-12-04T09:45:51.7454937Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7454980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7455036Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7455134Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7455396Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7455433Z graph_break [] 2025-12-04T09:45:51.7455507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7455549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7455607Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7455703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7455955Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7455992Z graph_break [] 2025-12-04T09:45:51.7456090Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7456133Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7456193Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7456288Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7456537Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7456575Z graph_break [] 2025-12-04T09:45:51.7456649Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7456690Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7456749Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7456845Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7457096Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7457133Z graph_break [] 2025-12-04T09:45:51.7457205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7457248Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7457304Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7457402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7457664Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7457703Z graph_break [] 2025-12-04T09:45:51.7457775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7457820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7457877Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7457974Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7458236Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7458274Z graph_break [] 2025-12-04T09:45:51.7458345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7458388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7458445Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7458542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7458800Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7458839Z graph_break [] 2025-12-04T09:45:51.7458912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7458955Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7459011Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7459108Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7459358Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7459406Z graph_break [] 2025-12-04T09:45:51.7459479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7459520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7459578Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7459673Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7459922Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7459958Z graph_break [] 2025-12-04T09:45:51.7460031Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7460071Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7460130Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7460225Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7460476Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7460513Z graph_break [] 2025-12-04T09:45:51.7460587Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7460627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7460685Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7460780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7461040Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7461080Z graph_break [] 2025-12-04T09:45:51.7461152Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7461195Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7461251Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7461348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7461611Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7461649Z graph_break [] 2025-12-04T09:45:51.7461721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7461765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7461821Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7461920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7462176Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7462217Z graph_break [] 2025-12-04T09:45:51.7462289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7462332Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7462388Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7462487Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7462734Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7462784Z graph_break [] 2025-12-04T09:45:51.7462857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7462900Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7463008Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7463105Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7463357Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7463393Z graph_break [] 2025-12-04T09:45:51.7463468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7463510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7463569Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7463666Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7463914Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7463951Z graph_break [] 2025-12-04T09:45:51.7464026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7464068Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7464126Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7464221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7464493Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7464532Z graph_break [] 2025-12-04T09:45:51.7464606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7464647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7464706Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7464822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7465070Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7465109Z graph_break [] 2025-12-04T09:45:51.7465182Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7465225Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7465286Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7465403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7465650Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7465690Z graph_break [] 2025-12-04T09:45:51.7465761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7465803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7465860Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7465956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7466213Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7466265Z graph_break [] 2025-12-04T09:45:51.7466337Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7466380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7466436Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7466535Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7466782Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7466820Z graph_break [] 2025-12-04T09:45:51.7466903Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7466941Z Unexpected success 2025-12-04T09:45:51.7467016Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7467058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7467117Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7467212Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7467462Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7467498Z graph_break [] 2025-12-04T09:45:51.7467571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7467612Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7467680Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7470021Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7470279Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7470316Z graph_break [] 2025-12-04T09:45:51.7470428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7470469Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7470530Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7470625Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7470878Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7470915Z graph_break [] 2025-12-04T09:45:51.7471010Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7471051Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7471110Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7471205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7471454Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7471492Z graph_break [] 2025-12-04T09:45:51.7471564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7471606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7471664Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7471762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7472024Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7472063Z graph_break [] 2025-12-04T09:45:51.7472134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7472177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7472233Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7472331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7472587Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7472626Z graph_break [] 2025-12-04T09:45:51.7472700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7472743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7472799Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7472895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7473177Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7473215Z graph_break [] 2025-12-04T09:45:51.7473288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7473350Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7473409Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7473506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7473758Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7473815Z graph_break [] 2025-12-04T09:45:51.7473889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7473930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7473988Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7474085Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7474341Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7474379Z graph_break [] 2025-12-04T09:45:51.7474467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7474509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7474567Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7474665Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7474917Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7474955Z graph_break [] 2025-12-04T09:45:51.7475030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7475071Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7475130Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7475243Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7475491Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7475531Z graph_break [] 2025-12-04T09:45:51.7475603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7475645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7475701Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7475797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7476048Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7476088Z graph_break [] 2025-12-04T09:45:51.7476160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7476202Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7476258Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7476356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7476605Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7476644Z graph_break [] 2025-12-04T09:45:51.7476727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7476770Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7476827Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7476925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7477173Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7477222Z graph_break [] 2025-12-04T09:45:51.7477296Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7477337Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7477394Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7477490Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7477752Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7477789Z graph_break [] 2025-12-04T09:45:51.7477863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7477903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7477963Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7478060Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7478316Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7478353Z graph_break [] 2025-12-04T09:45:51.7478428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7478469Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7478539Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7478638Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7478888Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7478925Z graph_break [] 2025-12-04T09:45:51.7478999Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7479040Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7479098Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7479194Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7479445Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7479484Z graph_break [] 2025-12-04T09:45:51.7479555Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7479597Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7479657Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7479755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7480004Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7480042Z graph_break [] 2025-12-04T09:45:51.7480125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7480170Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7480227Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7480326Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7480578Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7480628Z graph_break [] 2025-12-04T09:45:51.7480700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7480743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7480799Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7480897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7481160Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7481200Z graph_break [] 2025-12-04T09:45:51.7481273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7481314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7481373Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7481469Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7481716Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7481754Z graph_break [] 2025-12-04T09:45:51.7481827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7481879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7481943Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7482038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7482294Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7482332Z graph_break [] 2025-12-04T09:45:51.7482405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7482445Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7482503Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7482601Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7482856Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7482893Z graph_break [] 2025-12-04T09:45:51.7483010Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7483052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7483110Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7483207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7483455Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7483508Z graph_break [] 2025-12-04T09:45:51.7483581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7483625Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7483682Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7483780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7484029Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7484095Z graph_break [] 2025-12-04T09:45:51.7484167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7484209Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7484265Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7484365Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7484626Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7484664Z graph_break [] 2025-12-04T09:45:51.7484737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7484780Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7484837Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7484933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7485182Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7485219Z graph_break [] 2025-12-04T09:45:51.7485325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7485366Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7485424Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7485520Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7485777Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7485814Z graph_break [] 2025-12-04T09:45:51.7485887Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7485927Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7485987Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7486084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7486337Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7486373Z graph_break [] 2025-12-04T09:45:51.7486448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7486491Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7486549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7486644Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7486905Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7486943Z graph_break [] 2025-12-04T09:45:51.7487017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7487061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7487118Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7487215Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7487477Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7487514Z graph_break [] 2025-12-04T09:45:51.7487596Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7487635Z Unexpected success 2025-12-04T09:45:51.7487709Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7487751Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7487808Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7487917Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7488164Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7488202Z graph_break [] 2025-12-04T09:45:51.7488274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7488317Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7488373Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7488470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7488719Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7488770Z graph_break [] 2025-12-04T09:45:51.7488844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7488886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7488943Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7489041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7489291Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7489327Z graph_break [] 2025-12-04T09:45:51.7489402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7489443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7489500Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7489597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7489848Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7489885Z graph_break [] 2025-12-04T09:45:51.7489959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7490000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7490058Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7490166Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7490416Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7490453Z graph_break [] 2025-12-04T09:45:51.7490527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7490567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7490638Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7490734Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7490985Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7491023Z graph_break [] 2025-12-04T09:45:51.7491095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7491138Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7491205Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7491303Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7491550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7491589Z graph_break [] 2025-12-04T09:45:51.7491661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7491703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7491760Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7491857Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7492104Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7492153Z graph_break [] 2025-12-04T09:45:51.7492225Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7492270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7492325Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7492422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7492669Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7492707Z graph_break [] 2025-12-04T09:45:51.7492779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7492822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7492879Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7493013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7493264Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7493301Z graph_break [] 2025-12-04T09:45:51.7493374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7493415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7493472Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7493585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7493838Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7493874Z graph_break [] 2025-12-04T09:45:51.7493947Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7494005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7494062Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7494159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7494408Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7494445Z graph_break [] 2025-12-04T09:45:51.7494520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7494574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7494633Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7494728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7494977Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7495015Z graph_break [] 2025-12-04T09:45:51.7495086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7497094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7497153Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7497252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7497506Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7497545Z graph_break [] 2025-12-04T09:45:51.7497617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7497661Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7497718Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7497815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7498065Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7498134Z graph_break [] 2025-12-04T09:45:51.7498208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7498250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7498308Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7498404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7498654Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7498690Z graph_break [] 2025-12-04T09:45:51.7498763Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7498807Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7498893Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7498992Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7499242Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7499280Z graph_break [] 2025-12-04T09:45:51.7499367Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7499411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7499467Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7499566Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7499820Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7499861Z graph_break [] 2025-12-04T09:45:51.7499944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7499987Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7500043Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7500140Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7500387Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7500425Z graph_break [] 2025-12-04T09:45:51.7500497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7500620Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7500678Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7500775Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7501024Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7501062Z graph_break [] 2025-12-04T09:45:51.7501136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7501176Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7501235Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7501330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7501591Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7501628Z graph_break [] 2025-12-04T09:45:51.7501703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7501744Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7501801Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7501896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7502146Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7502183Z graph_break [] 2025-12-04T09:45:51.7502256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7502309Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7502368Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7502465Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7502714Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7502767Z graph_break [] 2025-12-04T09:45:51.7502839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7502881Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7502987Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7503085Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7503336Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7503375Z graph_break [] 2025-12-04T09:45:51.7503467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7503511Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7503567Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7503667Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7503924Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7503962Z graph_break [] 2025-12-04T09:45:51.7504072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7504116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7504177Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7504276Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7504526Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7504567Z graph_break [] 2025-12-04T09:45:51.7504643Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7504687Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7504746Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7504842Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7505095Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7505135Z graph_break [] 2025-12-04T09:45:51.7505211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7505254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7505315Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7505413Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7505669Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7505712Z graph_break [] 2025-12-04T09:45:51.7505799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7505846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7505903Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7506005Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7506257Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7506319Z graph_break [] 2025-12-04T09:45:51.7506392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7506438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7506496Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7506594Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7506856Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7506898Z graph_break [] 2025-12-04T09:45:51.7506972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7507016Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7507074Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7507176Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7507425Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7507479Z graph_break [] 2025-12-04T09:45:51.7507555Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7507600Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7507658Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7507758Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7508008Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7508048Z graph_break [] 2025-12-04T09:45:51.7508126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7508169Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7508229Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7508326Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7508577Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7508614Z graph_break [] 2025-12-04T09:45:51.7508701Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7508740Z Unexpected success 2025-12-04T09:45:51.7508817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7508859Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7508919Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7509015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7509276Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7509315Z graph_break [] 2025-12-04T09:45:51.7509392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7509434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7509495Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7509593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7509859Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7509901Z graph_break [] 2025-12-04T09:45:51.7509974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7510019Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7510077Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7510176Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7510434Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7510475Z graph_break [] 2025-12-04T09:45:51.7510547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7510591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7510649Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7510749Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7511020Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7511061Z graph_break [] 2025-12-04T09:45:51.7511134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7511179Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7511236Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7511336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7511586Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7511626Z graph_break [] 2025-12-04T09:45:51.7511700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7511746Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7511806Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7511904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7512157Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7512196Z graph_break [] 2025-12-04T09:45:51.7512273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7512315Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7512376Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7512473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7512740Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7512778Z graph_break [] 2025-12-04T09:45:51.7512855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7512897Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7512993Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7513111Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7513359Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7513396Z graph_break [] 2025-12-04T09:45:51.7513472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7513516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7513576Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7513688Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7513944Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7513988Z graph_break [] 2025-12-04T09:45:51.7514061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7514107Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7514167Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7514266Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7514531Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7514573Z graph_break [] 2025-12-04T09:45:51.7514647Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7514693Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7514750Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7514850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7515097Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7515138Z graph_break [] 2025-12-04T09:45:51.7515213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7515259Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7515317Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7515415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7515666Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7515707Z graph_break [] 2025-12-04T09:45:51.7515782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7515824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7515885Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7515981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7516247Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7516287Z graph_break [] 2025-12-04T09:45:51.7516363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7516405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7516466Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7516577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7516827Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7516866Z graph_break [] 2025-12-04T09:45:51.7516943Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7516985Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7517045Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7517151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7517401Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7517440Z graph_break [] 2025-12-04T09:45:51.7517517Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7517558Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7517619Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7517732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7517986Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7518025Z graph_break [] 2025-12-04T09:45:51.7518099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7518142Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7518200Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7518298Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7518546Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7518587Z graph_break [] 2025-12-04T09:45:51.7518661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7518705Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7518763Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7518861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7519111Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7519152Z graph_break [] 2025-12-04T09:45:51.7519227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7519272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7519329Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7519442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7519693Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7519733Z graph_break [] 2025-12-04T09:45:51.7519809Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7519866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7519929Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7520025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7520278Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7520319Z graph_break [] 2025-12-04T09:45:51.7520396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7520438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7520513Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7520610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7520861Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7520899Z graph_break [] 2025-12-04T09:45:51.7520975Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7521017Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7521090Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7521189Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7521442Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7521480Z graph_break [] 2025-12-04T09:45:51.7521556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7521601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7521661Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7521762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7522012Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7522054Z graph_break [] 2025-12-04T09:45:51.7522128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7522173Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7522231Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7522331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7522578Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7522620Z graph_break [] 2025-12-04T09:45:51.7522694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7522739Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7522796Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7522907Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7523199Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7523242Z graph_break [] 2025-12-04T09:45:51.7523314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7523387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7523445Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7523543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7523800Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7523838Z graph_break [] 2025-12-04T09:45:51.7523915Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7523984Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7524046Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7524143Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7524397Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7524435Z graph_break [] 2025-12-04T09:45:51.7524511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7524571Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7524633Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7524729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7524981Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7525018Z graph_break [] 2025-12-04T09:45:51.7525093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7525136Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7525196Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7525291Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7525543Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7525581Z graph_break [] 2025-12-04T09:45:51.7525657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7525698Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7525757Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7525859Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7526112Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7526151Z graph_break [] 2025-12-04T09:45:51.7526223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7526268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7526341Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7526440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7526688Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7526728Z graph_break [] 2025-12-04T09:45:51.7526812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7526856Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7526913Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7527015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7527265Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7527305Z graph_break [] 2025-12-04T09:45:51.7527391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7527434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7527490Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7527587Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7527841Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7527878Z graph_break [] 2025-12-04T09:45:51.7527953Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7528008Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7528068Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7528163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7528413Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7528451Z graph_break [] 2025-12-04T09:45:51.7528533Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7528571Z Unexpected success 2025-12-04T09:45:51.7528644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7528685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7528743Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7528839Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7529087Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7529124Z graph_break [] 2025-12-04T09:45:51.7529197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7529238Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7529297Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7529392Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7529641Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7529692Z graph_break [] 2025-12-04T09:45:51.7529765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7529808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7529867Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7529965Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7530216Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7530266Z graph_break [] 2025-12-04T09:45:51.7530338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7530381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7530437Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7530536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7530795Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7530834Z graph_break [] 2025-12-04T09:45:51.7530905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7530948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7531004Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7531101Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7531347Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7531399Z graph_break [] 2025-12-04T09:45:51.7531472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7531514Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7531571Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7531670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7531926Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7531964Z graph_break [] 2025-12-04T09:45:51.7532037Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7532078Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7532137Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7532234Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7532484Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7532521Z graph_break [] 2025-12-04T09:45:51.7532594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7532636Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7532694Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7532789Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7533105Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7533143Z graph_break [] 2025-12-04T09:45:51.7533217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7533258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7533316Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7533412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7533680Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7533717Z graph_break [] 2025-12-04T09:45:51.7533791Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7533836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7533892Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7533989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7534249Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7534289Z graph_break [] 2025-12-04T09:45:51.7534363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7534406Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7534462Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7534559Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7534808Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7534862Z graph_break [] 2025-12-04T09:45:51.7534936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7534978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7535034Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7535131Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7535382Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7535420Z graph_break [] 2025-12-04T09:45:51.7535491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7535535Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7535592Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7535692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7535956Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7535995Z graph_break [] 2025-12-04T09:45:51.7536073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7536116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7536177Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7536275Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7536539Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7536580Z graph_break [] 2025-12-04T09:45:51.7536658Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7536700Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7536760Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7536856Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7537129Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7537167Z graph_break [] 2025-12-04T09:45:51.7537243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7537286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7537348Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7537443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7537705Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7537748Z graph_break [] 2025-12-04T09:45:51.7537821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7537867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7537925Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7538027Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7538289Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7538331Z graph_break [] 2025-12-04T09:45:51.7538407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7538453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7538511Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7538609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7538859Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7538900Z graph_break [] 2025-12-04T09:45:51.7538972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7539021Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7539079Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7539179Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7539428Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7539470Z graph_break [] 2025-12-04T09:45:51.7539544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7539587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7539647Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7539744Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7540010Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7540049Z graph_break [] 2025-12-04T09:45:51.7540127Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7540168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7540230Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7540339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7540590Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7540628Z graph_break [] 2025-12-04T09:45:51.7540705Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7540748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7540809Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7540917Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7541167Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7541206Z graph_break [] 2025-12-04T09:45:51.7541280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7541322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7541383Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7541479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7541746Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7541785Z graph_break [] 2025-12-04T09:45:51.7541857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7541901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7541957Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7542055Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7542300Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7542339Z graph_break [] 2025-12-04T09:45:51.7542411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7542454Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7542510Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7542607Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7542854Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7542893Z graph_break [] 2025-12-04T09:45:51.7543013Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7543056Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7543112Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7543209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7543474Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7543513Z graph_break [] 2025-12-04T09:45:51.7543586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7543626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7543704Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7543799Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7544051Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7544090Z graph_break [] 2025-12-04T09:45:51.7544165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7544205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7544264Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7544372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7544622Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7544660Z graph_break [] 2025-12-04T09:45:51.7544734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7544775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7544833Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7544945Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7545194Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7545231Z graph_break [] 2025-12-04T09:45:51.7545305Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7545346Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7545405Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7545500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7545748Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7545787Z graph_break [] 2025-12-04T09:45:51.7545860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7545903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7545961Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7546058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7546304Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7546344Z graph_break [] 2025-12-04T09:45:51.7546416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7546458Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7546514Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7546623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7546871Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7546910Z graph_break [] 2025-12-04T09:45:51.7546983Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7547039Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7547095Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7547192Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7547437Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7547477Z graph_break [] 2025-12-04T09:45:51.7547551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7547591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7547663Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7547759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7548009Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7548049Z graph_break [] 2025-12-04T09:45:51.7548122Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7548162Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7548233Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7548330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7548580Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7548616Z graph_break [] 2025-12-04T09:45:51.7548699Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7548737Z Unexpected success 2025-12-04T09:45:51.7548812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7548852Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7548912Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7549009Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7549261Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7549297Z graph_break [] 2025-12-04T09:45:51.7549370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7549411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7549469Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7549567Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7549815Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7549854Z graph_break [] 2025-12-04T09:45:51.7549927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7549992Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7550049Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7550148Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7550397Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7550448Z graph_break [] 2025-12-04T09:45:51.7550522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7550564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7550620Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7550719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7550972Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7551021Z graph_break [] 2025-12-04T09:45:51.7551094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7551136Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7551193Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7551290Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7551538Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7551587Z graph_break [] 2025-12-04T09:45:51.7551661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7551704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7551763Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7551861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7552109Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7552149Z graph_break [] 2025-12-04T09:45:51.7552222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7552263Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7552322Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7552417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7552671Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7552708Z graph_break [] 2025-12-04T09:45:51.7552782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7552823Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7552883Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7553018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7553269Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7553307Z graph_break [] 2025-12-04T09:45:51.7553400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7553443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7553500Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7553599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7553847Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7553901Z graph_break [] 2025-12-04T09:45:51.7553974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7554016Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7554072Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7554171Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7554431Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7554470Z graph_break [] 2025-12-04T09:45:51.7554542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7554583Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7554641Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7554737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7554988Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7555060Z graph_break [] 2025-12-04T09:45:51.7555135Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7555178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7555235Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7555331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7555580Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7555618Z graph_break [] 2025-12-04T09:45:51.7555691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7555733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7555790Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7555888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7556138Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7556174Z graph_break [] 2025-12-04T09:45:51.7556247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7556290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7556347Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7556442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7556692Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7556741Z graph_break [] 2025-12-04T09:45:51.7556816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7556857Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7556916Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7557011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7557261Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7557310Z graph_break [] 2025-12-04T09:45:51.7557385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7557426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7557484Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7557582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7557839Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7557878Z graph_break [] 2025-12-04T09:45:51.7557950Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7557993Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7558049Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7558145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7558392Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7558444Z graph_break [] 2025-12-04T09:45:51.7558516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7558559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7558615Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7558712Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7558968Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7559008Z graph_break [] 2025-12-04T09:45:51.7559079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7559121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7559179Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7559277Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7559526Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7559562Z graph_break [] 2025-12-04T09:45:51.7559635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7559678Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7559735Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7559831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7560091Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7560129Z graph_break [] 2025-12-04T09:45:51.7560203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7560246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7560304Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7560400Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7560661Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7560697Z graph_break [] 2025-12-04T09:45:51.7560771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7560813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7560872Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7560968Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7561228Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7561266Z graph_break [] 2025-12-04T09:45:51.7561338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7561381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7561437Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7561533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7561781Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7561843Z graph_break [] 2025-12-04T09:45:51.7561916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7561959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7562015Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7562113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7562361Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7562400Z graph_break [] 2025-12-04T09:45:51.7562471Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7562514Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7562571Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7562669Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7562923Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7563003Z graph_break [] 2025-12-04T09:45:51.7563077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7563120Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7563176Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7563273Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7563541Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7563579Z graph_break [] 2025-12-04T09:45:51.7563653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7563693Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7563751Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7563847Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7564116Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7564153Z graph_break [] 2025-12-04T09:45:51.7564225Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7564268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7564328Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7564424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7564687Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7564724Z graph_break [] 2025-12-04T09:45:51.7564799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7564840Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7564899Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7564994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7565261Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7565300Z graph_break [] 2025-12-04T09:45:51.7565373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7565415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7565472Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7565569Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7565816Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7565854Z graph_break [] 2025-12-04T09:45:51.7565927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7565972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7566028Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7566126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7566373Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7566412Z graph_break [] 2025-12-04T09:45:51.7566487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7566530Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7566586Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7566684Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7566947Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7566988Z graph_break [] 2025-12-04T09:45:51.7567060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7567102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7567159Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7567270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7567518Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7567554Z graph_break [] 2025-12-04T09:45:51.7567629Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7567677Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7567736Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7567844Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7568094Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7568132Z graph_break [] 2025-12-04T09:45:51.7568205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7568245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7568303Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7568399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7568660Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7568697Z graph_break [] 2025-12-04T09:45:51.7568771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7568812Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7568869Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7568967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7569216Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7569255Z graph_break [] 2025-12-04T09:45:51.7569338Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7569377Z Unexpected success 2025-12-04T09:45:51.7569450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7569492Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7569549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7569645Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7569893Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7569930Z graph_break [] 2025-12-04T09:45:51.7570002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7570045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7570112Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7570209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7570457Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7570495Z graph_break [] 2025-12-04T09:45:51.7570566Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7570621Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7570677Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7570777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7571028Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7571068Z graph_break [] 2025-12-04T09:45:51.7571152Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7571194Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7571251Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7571346Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7571595Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7571631Z graph_break [] 2025-12-04T09:45:51.7571704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7571758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7571816Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7571912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7572162Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7572198Z graph_break [] 2025-12-04T09:45:51.7572272Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7572313Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7572371Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7572466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7572720Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7572757Z graph_break [] 2025-12-04T09:45:51.7572830Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7572871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7572961Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7573058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7573308Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7573346Z graph_break [] 2025-12-04T09:45:51.7573418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7573461Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7573532Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7573632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7573881Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7573937Z graph_break [] 2025-12-04T09:45:51.7574010Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7574052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7574108Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7574206Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7574457Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7574495Z graph_break [] 2025-12-04T09:45:51.7574590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7574633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7574688Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7574786Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7575036Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7575074Z graph_break [] 2025-12-04T09:45:51.7575163Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7575205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7575263Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7575358Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7575607Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7575645Z graph_break [] 2025-12-04T09:45:51.7575719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7575760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7575817Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7575912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7576167Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7576204Z graph_break [] 2025-12-04T09:45:51.7576278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7576319Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7576376Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7576473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7576726Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7576762Z graph_break [] 2025-12-04T09:45:51.7576836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7576888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7576946Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7577044Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7577291Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7577341Z graph_break [] 2025-12-04T09:45:51.7577413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7577456Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7577512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7577609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7577858Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7577906Z graph_break [] 2025-12-04T09:45:51.7577978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7578020Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7578076Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7578174Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7578421Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7578474Z graph_break [] 2025-12-04T09:45:51.7578549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7578592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7578648Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7578746Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7578994Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7579033Z graph_break [] 2025-12-04T09:45:51.7579106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7579146Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7579207Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7579302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7579552Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7579589Z graph_break [] 2025-12-04T09:45:51.7579661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7579702Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7579760Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7579856Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7580105Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7580142Z graph_break [] 2025-12-04T09:45:51.7580227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7580269Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7580327Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7580423Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7580676Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7580726Z graph_break [] 2025-12-04T09:45:51.7580802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7580842Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7580900Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7580998Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7581257Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7581296Z graph_break [] 2025-12-04T09:45:51.7581368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7581410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7581468Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7581565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7581813Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7581862Z graph_break [] 2025-12-04T09:45:51.7581936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7581978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7582035Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7582133Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7582380Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7582419Z graph_break [] 2025-12-04T09:45:51.7582491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7582533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7582590Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7582689Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7582979Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7583016Z graph_break [] 2025-12-04T09:45:51.7583089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7583131Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7583188Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7583283Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7583533Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7583595Z graph_break [] 2025-12-04T09:45:51.7583669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7583710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7583771Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7583866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7584116Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7584169Z graph_break [] 2025-12-04T09:45:51.7584243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7584283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7584343Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7584440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7584716Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7584754Z graph_break [] 2025-12-04T09:45:51.7584827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7584871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7584928Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7585026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7585276Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7585334Z graph_break [] 2025-12-04T09:45:51.7585406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7585449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7585506Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7585604Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7585854Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7585895Z graph_break [] 2025-12-04T09:45:51.7585967Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7586009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7586067Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7586165Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7586414Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7586452Z graph_break [] 2025-12-04T09:45:51.7586525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7586568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7586624Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7586722Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7586983Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7587022Z graph_break [] 2025-12-04T09:45:51.7587095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7587137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7587196Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7587291Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7587561Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7587597Z graph_break [] 2025-12-04T09:45:51.7587670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7587712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7587771Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7587867Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7588128Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7588165Z graph_break [] 2025-12-04T09:45:51.7588240Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7588280Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7588341Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7588436Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7588692Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7588745Z graph_break [] 2025-12-04T09:45:51.7588817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7588860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7588916Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7589013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7589260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7589299Z graph_break [] 2025-12-04T09:45:51.7589370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7589414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7589471Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7589569Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7589816Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7589855Z graph_break [] 2025-12-04T09:45:51.7589929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7589972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7590028Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7590125Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7590387Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7590427Z graph_break [] 2025-12-04T09:45:51.7590509Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7590549Z Unexpected success 2025-12-04T09:45:51.7590621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7590664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7590734Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7590832Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7591081Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7591120Z graph_break [] 2025-12-04T09:45:51.7591193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7591235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7591308Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7591405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7591653Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7591691Z graph_break [] 2025-12-04T09:45:51.7591765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7591805Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7591862Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7591970Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7592219Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7592255Z graph_break [] 2025-12-04T09:45:51.7592329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7592370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7592430Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7592526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7592777Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7592817Z graph_break [] 2025-12-04T09:45:51.7592890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7592970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7593028Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7593125Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7593373Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7593415Z graph_break [] 2025-12-04T09:45:51.7593486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7593529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7593588Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7593715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7593963Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7594001Z graph_break [] 2025-12-04T09:45:51.7594073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7594134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7594190Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7594287Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7594541Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7594580Z graph_break [] 2025-12-04T09:45:51.7594652Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7594707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7594765Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7594861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7595110Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7595151Z graph_break [] 2025-12-04T09:45:51.7595226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7595267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7595349Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7595447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7595697Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7595734Z graph_break [] 2025-12-04T09:45:51.7595808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7595850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7595908Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7596004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7596255Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7596292Z graph_break [] 2025-12-04T09:45:51.7596366Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7596409Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7596469Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7596568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7596818Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7596856Z graph_break [] 2025-12-04T09:45:51.7596928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7596971Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7597039Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7597136Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7597384Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7597423Z graph_break [] 2025-12-04T09:45:51.7597509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7597551Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7597608Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7597704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7597952Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7597991Z graph_break [] 2025-12-04T09:45:51.7598075Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7598118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7598174Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7598271Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7598525Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7598562Z graph_break [] 2025-12-04T09:45:51.7598636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7598689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7598747Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7598843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7599096Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7599133Z graph_break [] 2025-12-04T09:45:51.7599208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7599249Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7602077Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7602177Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7602429Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7602467Z graph_break [] 2025-12-04T09:45:51.7602544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7602585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7602643Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7602739Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7603035Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7603072Z graph_break [] 2025-12-04T09:45:51.7603146Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7603187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7603286Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7603387Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7603637Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7603693Z graph_break [] 2025-12-04T09:45:51.7603766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7603808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7603865Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7603963Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7604217Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7604254Z graph_break [] 2025-12-04T09:45:51.7604341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7604384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7604441Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7604538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7604786Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7604824Z graph_break [] 2025-12-04T09:45:51.7604912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7604957Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7605013Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7605113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7605364Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7605404Z graph_break [] 2025-12-04T09:45:51.7605478Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7605521Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7605581Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7605677Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7605927Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7605965Z graph_break [] 2025-12-04T09:45:51.7606039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7606080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7606138Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7606235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7606483Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7606521Z graph_break [] 2025-12-04T09:45:51.7606606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7606647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7606705Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7606801Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7607051Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7607101Z graph_break [] 2025-12-04T09:45:51.7607177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7607218Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7607276Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7607373Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7607624Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7607676Z graph_break [] 2025-12-04T09:45:51.7607749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7607791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7607848Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7607946Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7608195Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7608246Z graph_break [] 2025-12-04T09:45:51.7608319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7608361Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7608417Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7608515Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7608768Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7608809Z graph_break [] 2025-12-04T09:45:51.7608883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7608926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7608982Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7609082Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7609338Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7609376Z graph_break [] 2025-12-04T09:45:51.7609451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7609492Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7609550Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7609646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7609894Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7609932Z graph_break [] 2025-12-04T09:45:51.7610018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7610059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7610120Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7610216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7610464Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7610514Z graph_break [] 2025-12-04T09:45:51.7610588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7610629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7610687Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7610785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7611049Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7611087Z graph_break [] 2025-12-04T09:45:51.7611162Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7611203Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7611263Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7611359Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7611609Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7611669Z graph_break [] 2025-12-04T09:45:51.7611744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7611787Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7611844Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7611942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7612192Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7612231Z graph_break [] 2025-12-04T09:45:51.7612305Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7612347Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7612405Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7612505Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7612753Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7612791Z graph_break [] 2025-12-04T09:45:51.7612863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7612908Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7613025Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7613128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7613384Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7613450Z graph_break [] 2025-12-04T09:45:51.7613524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7613565Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7613624Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7613720Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7613968Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7614022Z graph_break [] 2025-12-04T09:45:51.7614099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7614140Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7614199Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7614296Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7614568Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7614605Z graph_break [] 2025-12-04T09:45:51.7614680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7614722Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7614782Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7614878Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7615135Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7615218Z graph_break [] 2025-12-04T09:45:51.7615304Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7615343Z Unexpected success 2025-12-04T09:45:51.7615419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7615460Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7615522Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7615620Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7615870Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7615910Z graph_break [] 2025-12-04T09:45:51.7615985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7616029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7616087Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7616185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7616435Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7616475Z graph_break [] 2025-12-04T09:45:51.7616548Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7616592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7616649Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7616748Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7617016Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7617060Z graph_break [] 2025-12-04T09:45:51.7617136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7617180Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7617237Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7617350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7617603Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7617640Z graph_break [] 2025-12-04T09:45:51.7617716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7617758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7617820Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7617929Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7618181Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7618222Z graph_break [] 2025-12-04T09:45:51.7618302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7618344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7618404Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7618518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7618775Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7618813Z graph_break [] 2025-12-04T09:45:51.7618889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7618932Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7618996Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7619094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7619353Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7619394Z graph_break [] 2025-12-04T09:45:51.7619474Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7619520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7619576Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7619677Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7619927Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7619970Z graph_break [] 2025-12-04T09:45:51.7620043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7620091Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7620150Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7620264Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7620513Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7620555Z graph_break [] 2025-12-04T09:45:51.7620629Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7620676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7620748Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7620850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7621103Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7621145Z graph_break [] 2025-12-04T09:45:51.7621222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7621267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7621345Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7621447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7621699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7621738Z graph_break [] 2025-12-04T09:45:51.7621818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7621860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7621920Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7622032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7622285Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7622323Z graph_break [] 2025-12-04T09:45:51.7622401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7622446Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7622512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7622609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7622860Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7622900Z graph_break [] 2025-12-04T09:45:51.7623030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7623073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7623137Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7623236Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7623496Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7623539Z graph_break [] 2025-12-04T09:45:51.7623612Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7623659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7623718Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7623855Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7624114Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7624157Z graph_break [] 2025-12-04T09:45:51.7624233Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7624301Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7624359Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7624460Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7624714Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7624758Z graph_break [] 2025-12-04T09:45:51.7624833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7624895Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7624956Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7625058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7625313Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7625355Z graph_break [] 2025-12-04T09:45:51.7625430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7625477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7625553Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7625657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7625912Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7625951Z graph_break [] 2025-12-04T09:45:51.7626030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7626074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7626137Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7626235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7626489Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7626530Z graph_break [] 2025-12-04T09:45:51.7626610Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7626654Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7626718Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7626817Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7627076Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7627115Z graph_break [] 2025-12-04T09:45:51.7627194Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7627238Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7627318Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7627416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7627670Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7627713Z graph_break [] 2025-12-04T09:45:51.7627802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7627850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7627908Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7628009Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7628263Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7628308Z graph_break [] 2025-12-04T09:45:51.7628412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7628461Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7628521Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7628622Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7628883Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7628925Z graph_break [] 2025-12-04T09:45:51.7629003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7629064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7629124Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7629226Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7629485Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7629529Z graph_break [] 2025-12-04T09:45:51.7629605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7629652Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7629713Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7629815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7630070Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7630110Z graph_break [] 2025-12-04T09:45:51.7630190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7630232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7630299Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7630398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7630655Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7630693Z graph_break [] 2025-12-04T09:45:51.7630770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7630831Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7630894Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7630992Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7631250Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7631304Z graph_break [] 2025-12-04T09:45:51.7631388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7631431Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7631494Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7631593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7631850Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7631892Z graph_break [] 2025-12-04T09:45:51.7631982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7632030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7632091Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7632197Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7632445Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7632490Z graph_break [] 2025-12-04T09:45:51.7632580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7632629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7632688Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7632793Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7633101Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7633145Z graph_break [] 2025-12-04T09:45:51.7633221Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7633271Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7633329Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7633436Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7633691Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7633734Z graph_break [] 2025-12-04T09:45:51.7633812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7633860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7633919Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7634020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7634272Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7634313Z graph_break [] 2025-12-04T09:45:51.7634416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7634459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7634524Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7634623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7634894Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7634957Z graph_break [] 2025-12-04T09:45:51.7635040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7635086Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7635153Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7635259Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7635545Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7635587Z graph_break [] 2025-12-04T09:45:51.7635670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7635716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7635782Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7635884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7636143Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7636211Z graph_break [] 2025-12-04T09:45:51.7636293Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7636346Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7636408Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7636515Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7636767Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7636819Z graph_break [] 2025-12-04T09:45:51.7636896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7636948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7637012Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7637120Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7637378Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7637427Z graph_break [] 2025-12-04T09:45:51.7637505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7637556Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7637618Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7637724Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7637983Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7638033Z graph_break [] 2025-12-04T09:45:51.7638130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7638177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7638245Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7638344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7638602Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7638659Z graph_break [] 2025-12-04T09:45:51.7638755Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7638798Z Unexpected success 2025-12-04T09:45:51.7638883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7638930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7638998Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7639100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7639372Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7639415Z graph_break [] 2025-12-04T09:45:51.7639502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7639549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7639616Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7639716Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7639977Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7640032Z graph_break [] 2025-12-04T09:45:51.7640115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7640161Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7640230Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7640331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7640589Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7640639Z graph_break [] 2025-12-04T09:45:51.7640716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7640769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7640831Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7640934Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7641190Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7641235Z graph_break [] 2025-12-04T09:45:51.7641310Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7641357Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7641416Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7641519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7641790Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7641833Z graph_break [] 2025-12-04T09:45:51.7641909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7641957Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7642015Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7642146Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7642395Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7642437Z graph_break [] 2025-12-04T09:45:51.7642517Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7642561Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7642625Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7642735Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7643027Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7643068Z graph_break [] 2025-12-04T09:45:51.7643147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7643190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7643255Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7643362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7643666Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7643707Z graph_break [] 2025-12-04T09:45:51.7643786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7643829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7643891Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7643993Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7644247Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7644288Z graph_break [] 2025-12-04T09:45:51.7644369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7644413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7644477Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7644579Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7644828Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7644873Z graph_break [] 2025-12-04T09:45:51.7644948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7644995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7645055Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7645156Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7645425Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7645467Z graph_break [] 2025-12-04T09:45:51.7645542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7645588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7645647Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7645772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7646031Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7646076Z graph_break [] 2025-12-04T09:45:51.7646151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7646199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7646257Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7646377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7646632Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7646671Z graph_break [] 2025-12-04T09:45:51.7646752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7646795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7646858Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7646971Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7647225Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7647264Z graph_break [] 2025-12-04T09:45:51.7647343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7647386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7647454Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7647552Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7647806Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7647847Z graph_break [] 2025-12-04T09:45:51.7647927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7647972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7648037Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7648135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7648391Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7648431Z graph_break [] 2025-12-04T09:45:51.7648510Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7648554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7648616Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7648736Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7648986Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7649031Z graph_break [] 2025-12-04T09:45:51.7649109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7649156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7649230Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7649332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7649582Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7649627Z graph_break [] 2025-12-04T09:45:51.7649702Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7649748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7649835Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7649938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7650190Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7650233Z graph_break [] 2025-12-04T09:45:51.7650306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7650354Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7650412Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7650529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7650785Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7650824Z graph_break [] 2025-12-04T09:45:51.7650900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7650945Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7651007Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7651104Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7651355Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7651394Z graph_break [] 2025-12-04T09:45:51.7651475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7651518Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7651581Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7651680Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7651936Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7651978Z graph_break [] 2025-12-04T09:45:51.7652056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7652099Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7652165Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7652276Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7652532Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7652574Z graph_break [] 2025-12-04T09:45:51.7652650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7652714Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7652772Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7652874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7653178Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7653225Z graph_break [] 2025-12-04T09:45:51.7653300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7653370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7653429Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7653530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7653783Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7653824Z graph_break [] 2025-12-04T09:45:51.7653901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7653967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7654027Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7654130Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7654389Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7654431Z graph_break [] 2025-12-04T09:45:51.7654506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7654555Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7654616Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7654719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7654974Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7655013Z graph_break [] 2025-12-04T09:45:51.7655091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7655135Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7655196Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7655292Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7655548Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7655587Z graph_break [] 2025-12-04T09:45:51.7655666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7655709Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7655801Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7655899Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7656159Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7656198Z graph_break [] 2025-12-04T09:45:51.7656303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7656346Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7656410Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7656507Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7656766Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7656809Z graph_break [] 2025-12-04T09:45:51.7656896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7656943Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7657006Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7657107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7657357Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7657401Z graph_break [] 2025-12-04T09:45:51.7657475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7657534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7657595Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7657697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7657951Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7657996Z graph_break [] 2025-12-04T09:45:51.7658072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7658119Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7658177Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7658281Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7658533Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7658576Z graph_break [] 2025-12-04T09:45:51.7658654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7658700Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7658760Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7658861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7659114Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7659154Z graph_break [] 2025-12-04T09:45:51.7659232Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7659289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7659353Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7659452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7659705Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7659759Z graph_break [] 2025-12-04T09:45:51.7659838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7659880Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7659942Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7660041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7660307Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7660349Z graph_break [] 2025-12-04T09:45:51.7660439Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7660483Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7660546Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7660647Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7660900Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7660944Z graph_break [] 2025-12-04T09:45:51.7661034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7661083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7661144Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7661248Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7661498Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7661545Z graph_break [] 2025-12-04T09:45:51.7661618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7661664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7661726Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7661827Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7662079Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7662124Z graph_break [] 2025-12-04T09:45:51.7662200Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7662246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7662305Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7662407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7662660Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7662704Z graph_break [] 2025-12-04T09:45:51.7662802Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7662849Z Unexpected success 2025-12-04T09:45:51.7662923Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7663080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7663143Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7663240Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7663518Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7663557Z graph_break [] 2025-12-04T09:45:51.7663635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7663679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7663741Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7663840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7664109Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7664148Z graph_break [] 2025-12-04T09:45:51.7664229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7664273Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7664336Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7664440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7664700Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7664759Z graph_break [] 2025-12-04T09:45:51.7664838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7664883Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7664948Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7665046Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7665300Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7665342Z graph_break [] 2025-12-04T09:45:51.7665417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7665466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7665525Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7665627Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7665880Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7665926Z graph_break [] 2025-12-04T09:45:51.7666001Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7666049Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7666107Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7666210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7666479Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7666525Z graph_break [] 2025-12-04T09:45:51.7666602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7666650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7666707Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7666811Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7667077Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7667120Z graph_break [] 2025-12-04T09:45:51.7667199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7667243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7667307Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7667404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7667690Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7667729Z graph_break [] 2025-12-04T09:45:51.7667805Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7667846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7667906Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7668004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7668304Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7668354Z graph_break [] 2025-12-04T09:45:51.7668435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7668483Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7668549Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7668656Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7668915Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7668955Z graph_break [] 2025-12-04T09:45:51.7669038Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7669085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7669150Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7669251Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7669504Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7669551Z graph_break [] 2025-12-04T09:45:51.7669626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7669674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7669736Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7669841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7670105Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7670152Z graph_break [] 2025-12-04T09:45:51.7670229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7670279Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7670338Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7670454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7670712Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7670758Z graph_break [] 2025-12-04T09:45:51.7670834Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7670884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7670943Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7671060Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7671316Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7671362Z graph_break [] 2025-12-04T09:45:51.7671443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7671487Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7671552Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7671650Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7671930Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7671971Z graph_break [] 2025-12-04T09:45:51.7672052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7672096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7672163Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7672265Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7672519Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7672560Z graph_break [] 2025-12-04T09:45:51.7672641Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7672685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7672750Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7672849Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7673144Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7673187Z graph_break [] 2025-12-04T09:45:51.7673267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7673312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7673376Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7673474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7673751Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7673797Z graph_break [] 2025-12-04T09:45:51.7673875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7673924Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7673984Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7674107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7674358Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7674404Z graph_break [] 2025-12-04T09:45:51.7674480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7674529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7674591Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7674710Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7674969Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7675017Z graph_break [] 2025-12-04T09:45:51.7675092Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7675141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7675200Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7675323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7675576Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7675622Z graph_break [] 2025-12-04T09:45:51.7675704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7675747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7675813Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7675914Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7676170Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7676209Z graph_break [] 2025-12-04T09:45:51.7676291Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7676334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7676398Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7676496Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7676752Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7676793Z graph_break [] 2025-12-04T09:45:51.7676875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7676920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7676985Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7677098Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7677354Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7677394Z graph_break [] 2025-12-04T09:45:51.7677473Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7677531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7677594Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7677697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7677949Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7677997Z graph_break [] 2025-12-04T09:45:51.7678073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7678122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7678195Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7678298Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7678550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7678596Z graph_break [] 2025-12-04T09:45:51.7678674Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7678724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7678797Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7678903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7679160Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7679204Z graph_break [] 2025-12-04T09:45:51.7679280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7679329Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7679391Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7679495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7679749Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7679792Z graph_break [] 2025-12-04T09:45:51.7679873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7679918Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7679982Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7680081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7680338Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7680379Z graph_break [] 2025-12-04T09:45:51.7680461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7680505Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7680572Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7680711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7680967Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7681008Z graph_break [] 2025-12-04T09:45:51.7681091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7681149Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7681214Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7681314Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7681572Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7681613Z graph_break [] 2025-12-04T09:45:51.7681694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7681768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7681830Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7681936Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7682188Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7682233Z graph_break [] 2025-12-04T09:45:51.7682309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7682371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7682431Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7682534Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7682786Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7682833Z graph_break [] 2025-12-04T09:45:51.7682908Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7683006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7683065Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7683168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7683428Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7683473Z graph_break [] 2025-12-04T09:45:51.7683551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7683599Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7683658Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7683761Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7684014Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7684055Z graph_break [] 2025-12-04T09:45:51.7684136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7684181Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7684264Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7684362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7684616Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7684656Z graph_break [] 2025-12-04T09:45:51.7684751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7684795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7684857Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7684956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7685219Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7685259Z graph_break [] 2025-12-04T09:45:51.7685354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7685399Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7685463Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7685561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7685817Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7685860Z graph_break [] 2025-12-04T09:45:51.7685935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7686001Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7686061Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7686165Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7686416Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7686462Z graph_break [] 2025-12-04T09:45:51.7686537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7686586Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7686649Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7686753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7687016Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7687063Z graph_break [] 2025-12-04T09:45:51.7687139Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7687187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7687247Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7687356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7687613Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7687657Z graph_break [] 2025-12-04T09:45:51.7687743Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7687801Z Unexpected success 2025-12-04T09:45:51.7687877Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7687926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7687986Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7688088Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7688343Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7688397Z graph_break [] 2025-12-04T09:45:51.7688476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7688520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7688584Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7688683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7688953Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7688994Z graph_break [] 2025-12-04T09:45:51.7689073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7689118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7689181Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7689279Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7689540Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7689593Z graph_break [] 2025-12-04T09:45:51.7689673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7689718Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7689784Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7689883Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7690136Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7690182Z graph_break [] 2025-12-04T09:45:51.7690258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7690306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7690367Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7690471Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7690721Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7690766Z graph_break [] 2025-12-04T09:45:51.7690841Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7690892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7690952Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7691055Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7691320Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7691367Z graph_break [] 2025-12-04T09:45:51.7691443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7691493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7691553Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7691657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7691923Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7691967Z graph_break [] 2025-12-04T09:45:51.7692041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7692089Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7692149Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7692250Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7692517Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7692556Z graph_break [] 2025-12-04T09:45:51.7692633Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7692676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7692736Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7692832Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7693134Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7693190Z graph_break [] 2025-12-04T09:45:51.7693266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7693308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7693369Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7693465Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7693721Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7693759Z graph_break [] 2025-12-04T09:45:51.7693834Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7693876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7693936Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7694033Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7694284Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7694325Z graph_break [] 2025-12-04T09:45:51.7694398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7694444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7694504Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7694603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7694865Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7694906Z graph_break [] 2025-12-04T09:45:51.7694979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7695023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7695081Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7695181Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7695467Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7695508Z graph_break [] 2025-12-04T09:45:51.7695580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7695626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7695686Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7695791Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7696054Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7696096Z graph_break [] 2025-12-04T09:45:51.7696173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7696215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7696274Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7696372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7696636Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7696673Z graph_break [] 2025-12-04T09:45:51.7696749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7696793Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7696853Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7696950Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7697201Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7697238Z graph_break [] 2025-12-04T09:45:51.7697314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7697357Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7697417Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7697513Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7697771Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7697809Z graph_break [] 2025-12-04T09:45:51.7697885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7697926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7697985Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7698081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7698344Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7698387Z graph_break [] 2025-12-04T09:45:51.7698461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7698505Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7698562Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7698674Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7698921Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7698961Z graph_break [] 2025-12-04T09:45:51.7699035Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7699081Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7699140Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7699251Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7699499Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7699541Z graph_break [] 2025-12-04T09:45:51.7699614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7699658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7699715Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7699815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7700076Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7700116Z graph_break [] 2025-12-04T09:45:51.7700193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7700235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7700294Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7700391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7700642Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7700682Z graph_break [] 2025-12-04T09:45:51.7700761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7700802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7700861Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7700958Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7701212Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7701252Z graph_break [] 2025-12-04T09:45:51.7701327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7701370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7701444Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7701541Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7701811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7701850Z graph_break [] 2025-12-04T09:45:51.7701927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7701968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7702041Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7702140Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7702392Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7702434Z graph_break [] 2025-12-04T09:45:51.7702508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7702554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7702612Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7702724Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7703019Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7703061Z graph_break [] 2025-12-04T09:45:51.7703134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7703179Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7703235Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7703363Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7703613Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7703653Z graph_break [] 2025-12-04T09:45:51.7703727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7703771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7703831Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7703933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7704190Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7704231Z graph_break [] 2025-12-04T09:45:51.7704309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7704350Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7704411Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7704506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7704757Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7704795Z graph_break [] 2025-12-04T09:45:51.7704870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7704911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7704970Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7705083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7705335Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7705372Z graph_break [] 2025-12-04T09:45:51.7705450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7705507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7705568Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7705665Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7705925Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7705964Z graph_break [] 2025-12-04T09:45:51.7706040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7706081Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7706158Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7706262Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7706512Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7706554Z graph_break [] 2025-12-04T09:45:51.7706628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7706672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7706741Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7706843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7707093Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7707133Z graph_break [] 2025-12-04T09:45:51.7707206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7707251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7707309Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7707407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7707656Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7707697Z graph_break [] 2025-12-04T09:45:51.7707771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7707816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7707874Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7707972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7708221Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7708259Z graph_break [] 2025-12-04T09:45:51.7708335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7708376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7708441Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7708561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7708811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7708849Z graph_break [] 2025-12-04T09:45:51.7708924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7708980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7709040Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7709135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7709388Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7709426Z graph_break [] 2025-12-04T09:45:51.7709503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7709557Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7709617Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7709714Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7709970Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7710007Z graph_break [] 2025-12-04T09:45:51.7710083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7710140Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7710199Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7710298Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7710550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7710592Z graph_break [] 2025-12-04T09:45:51.7710666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7710711Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7710770Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7710871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7711121Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7711163Z graph_break [] 2025-12-04T09:45:51.7711237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7711281Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7711338Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7711437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7711685Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7711725Z graph_break [] 2025-12-04T09:45:51.7711799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7711846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7711916Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7712017Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7712268Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7712305Z graph_break [] 2025-12-04T09:45:51.7712404Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7712443Z Unexpected success 2025-12-04T09:45:51.7712518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7712559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7712618Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7712715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7713022Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7713060Z graph_break [] 2025-12-04T09:45:51.7713135Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7713176Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7713237Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7713333Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7713584Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7713636Z graph_break [] 2025-12-04T09:45:51.7713712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7713754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7713822Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7713919Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7714172Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7714214Z graph_break [] 2025-12-04T09:45:51.7714287Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7714331Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7714388Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7714489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7714737Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7714777Z graph_break [] 2025-12-04T09:45:51.7714850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7714895Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7714952Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7715052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7715301Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7715357Z graph_break [] 2025-12-04T09:45:51.7715432Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7715476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7715535Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7715633Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7715886Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7715944Z graph_break [] 2025-12-04T09:45:51.7716018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7716063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7716121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7716221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7716484Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7716523Z graph_break [] 2025-12-04T09:45:51.7716599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7716641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7716702Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7716798Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7717053Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7717102Z graph_break [] 2025-12-04T09:45:51.7717180Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7717223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7717282Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7717378Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7717629Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7717668Z graph_break [] 2025-12-04T09:45:51.7717744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7717785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7717847Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7717944Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7718195Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7718235Z graph_break [] 2025-12-04T09:45:51.7718307Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7718353Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7718412Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7718509Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7718769Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7718811Z graph_break [] 2025-12-04T09:45:51.7718886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7718930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7718988Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7719087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7719346Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7719386Z graph_break [] 2025-12-04T09:45:51.7719458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7719504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7719562Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7719662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7719925Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7719966Z graph_break [] 2025-12-04T09:45:51.7720041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7720086Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7720143Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7720241Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7720491Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7720550Z graph_break [] 2025-12-04T09:45:51.7720626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7720668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7720728Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7720823Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7721077Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7721114Z graph_break [] 2025-12-04T09:45:51.7721190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7721232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7721294Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7721390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7721645Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7721682Z graph_break [] 2025-12-04T09:45:51.7721759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7721800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7721860Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7721956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7722220Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7722262Z graph_break [] 2025-12-04T09:45:51.7722336Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7722380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7722438Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7722538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7722798Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7722838Z graph_break [] 2025-12-04T09:45:51.7722911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7722997Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7723060Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7723161Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7723426Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7723468Z graph_break [] 2025-12-04T09:45:51.7723540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7723586Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7723644Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7723742Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7724040Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7724080Z graph_break [] 2025-12-04T09:45:51.7724154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7724198Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7724258Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7724354Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7724605Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7724642Z graph_break [] 2025-12-04T09:45:51.7724720Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7724762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7724822Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7724918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7725168Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7725207Z graph_break [] 2025-12-04T09:45:51.7725281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7725323Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7725383Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7725479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7725745Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7725786Z graph_break [] 2025-12-04T09:45:51.7725862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7725903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7725963Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7726075Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7726330Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7726370Z graph_break [] 2025-12-04T09:45:51.7726444Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7726489Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7726546Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7726662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7726910Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7726952Z graph_break [] 2025-12-04T09:45:51.7727024Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7727069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7727126Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7727224Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7727486Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7727528Z graph_break [] 2025-12-04T09:45:51.7727601Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7727645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7727705Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7727805Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7728058Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7728098Z graph_break [] 2025-12-04T09:45:51.7728176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7728218Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7728277Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7728373Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7728623Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7728661Z graph_break [] 2025-12-04T09:45:51.7728737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7728779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7728838Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7728934Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7729199Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7729237Z graph_break [] 2025-12-04T09:45:51.7729314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7729355Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7729428Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7729524Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7729777Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7729815Z graph_break [] 2025-12-04T09:45:51.7729894Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7729936Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7729996Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7730103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7730355Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7730396Z graph_break [] 2025-12-04T09:45:51.7730468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7730512Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7730569Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7730681Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7730932Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7730973Z graph_break [] 2025-12-04T09:45:51.7731046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7731090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7731149Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7731249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7731498Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7731540Z graph_break [] 2025-12-04T09:45:51.7731614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7731658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7731717Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7731817Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7732071Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7732113Z graph_break [] 2025-12-04T09:45:51.7732190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7732232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7732294Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7732408Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7732660Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7732698Z graph_break [] 2025-12-04T09:45:51.7732772Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7732828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7732888Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7733046Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7733296Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7733335Z graph_break [] 2025-12-04T09:45:51.7733411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7733453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7733535Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7733631Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7737975Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7738020Z graph_break [] 2025-12-04T09:45:51.7738097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7738138Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7738215Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7738313Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7738566Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7738604Z graph_break [] 2025-12-04T09:45:51.7738676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7738720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7738777Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7738874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7739126Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7739167Z graph_break [] 2025-12-04T09:45:51.7739239Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7739282Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7739338Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7739434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7739681Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7739720Z graph_break [] 2025-12-04T09:45:51.7739792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7739835Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7739894Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7740004Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7740257Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7740295Z graph_break [] 2025-12-04T09:45:51.7740369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7740422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7740481Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7740575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7740825Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7740864Z graph_break [] 2025-12-04T09:45:51.7740940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7740991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7741051Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7741147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7741395Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7741432Z graph_break [] 2025-12-04T09:45:51.7741515Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7741566Z Unexpected success 2025-12-04T09:45:51.7741639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7741680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7741739Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7741835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7742088Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7742125Z graph_break [] 2025-12-04T09:45:51.7742198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7742239Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7742296Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7742394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7742646Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7742685Z graph_break [] 2025-12-04T09:45:51.7742757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7742799Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7742858Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7743033Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7743282Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7743321Z graph_break [] 2025-12-04T09:45:51.7743413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7743456Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7743512Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7743609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7743855Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7743908Z graph_break [] 2025-12-04T09:45:51.7743980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7744023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7744079Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7744177Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7744449Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7744486Z graph_break [] 2025-12-04T09:45:51.7744558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7744599Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7744658Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7744753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7745005Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7745056Z graph_break [] 2025-12-04T09:45:51.7745130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7745170Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7745232Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7745340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7745588Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7745627Z graph_break [] 2025-12-04T09:45:51.7745700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7745741Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7745800Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7745897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7746156Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7746193Z graph_break [] 2025-12-04T09:45:51.7746267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7746308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7746370Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7746466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7746712Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7746764Z graph_break [] 2025-12-04T09:45:51.7746836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7746878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7746935Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7747032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7747278Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7747329Z graph_break [] 2025-12-04T09:45:51.7747400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7747443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7747500Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7747599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7747858Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7747898Z graph_break [] 2025-12-04T09:45:51.7747971Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7748014Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7748070Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7748168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7748418Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7748465Z graph_break [] 2025-12-04T09:45:51.7748540Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7748582Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7748640Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7748736Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7749174Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7749213Z graph_break [] 2025-12-04T09:45:51.7749286Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7749327Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7749393Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7749495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7749746Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7749782Z graph_break [] 2025-12-04T09:45:51.7749855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7749898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7749958Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7750053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7750329Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7750368Z graph_break [] 2025-12-04T09:45:51.7750440Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7750484Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7750541Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7750640Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7750910Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7750947Z graph_break [] 2025-12-04T09:45:51.7751019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7751062Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7751119Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7751217Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7751478Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7751516Z graph_break [] 2025-12-04T09:45:51.7751589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7751631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7751687Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7751784Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7752034Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7752084Z graph_break [] 2025-12-04T09:45:51.7752158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7752202Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7752258Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7752362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7752612Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7752647Z graph_break [] 2025-12-04T09:45:51.7752722Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7752764Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7752821Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7752915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7753368Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7753405Z graph_break [] 2025-12-04T09:45:51.7753479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7753519Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7753576Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7753673Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7753944Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7753984Z graph_break [] 2025-12-04T09:45:51.7754058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7754098Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7754155Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7754253Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7754521Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7754561Z graph_break [] 2025-12-04T09:45:51.7754632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7754677Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7754733Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7754830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7755092Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7755132Z graph_break [] 2025-12-04T09:45:51.7755204Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7755247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7755304Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7755403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7755665Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7755703Z graph_break [] 2025-12-04T09:45:51.7755776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7755818Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7755877Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7755976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7756222Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7756259Z graph_break [] 2025-12-04T09:45:51.7756333Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7756375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7756431Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7756529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7756780Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7756816Z graph_break [] 2025-12-04T09:45:51.7756890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7756930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7756988Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7757084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7757344Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7757382Z graph_break [] 2025-12-04T09:45:51.7757458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7757499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7757556Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7757664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7757911Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7757948Z graph_break [] 2025-12-04T09:45:51.7758022Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7758062Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7758120Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7758227Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7758481Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7758522Z graph_break [] 2025-12-04T09:45:51.7758594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7758635Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7758692Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7758788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7759050Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7759087Z graph_break [] 2025-12-04T09:45:51.7759160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7759201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7759258Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7759357Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7759603Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7759642Z graph_break [] 2025-12-04T09:45:51.7759714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7759756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7759812Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7759909Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7760157Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7760197Z graph_break [] 2025-12-04T09:45:51.7760270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7760311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7760369Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7760467Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7760728Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7760766Z graph_break [] 2025-12-04T09:45:51.7760839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7760879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7760950Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7761045Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7761294Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7761332Z graph_break [] 2025-12-04T09:45:51.7761406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7761447Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7761516Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7761612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7761862Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7761899Z graph_break [] 2025-12-04T09:45:51.7761974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7762014Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7762072Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7762179Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7762433Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7762470Z graph_break [] 2025-12-04T09:45:51.7762541Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7762584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7762641Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7762737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7763023Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7763063Z graph_break [] 2025-12-04T09:45:51.7763135Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7763177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7763234Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7763330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7763579Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7763618Z graph_break [] 2025-12-04T09:45:51.7763690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7763731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7763788Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7763913Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7764161Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7764198Z graph_break [] 2025-12-04T09:45:51.7764271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7764329Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7764387Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7764483Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7764734Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7764772Z graph_break [] 2025-12-04T09:45:51.7764846Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7764886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7764963Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7765058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7765306Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7765344Z graph_break [] 2025-12-04T09:45:51.7765417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7765458Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7765537Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7765633Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7765882Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7765918Z graph_break [] 2025-12-04T09:45:51.7765992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7766033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7766090Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7766185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7766442Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7766479Z graph_break [] 2025-12-04T09:45:51.7766553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7766595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7766651Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7766749Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7766996Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7767032Z graph_break [] 2025-12-04T09:45:51.7767114Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7767153Z Unexpected success 2025-12-04T09:45:51.7767237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7767280Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7767337Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7767432Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7767680Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7767731Z graph_break [] 2025-12-04T09:45:51.7767802Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7767844Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7767901Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7768000Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7768263Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7768301Z graph_break [] 2025-12-04T09:45:51.7768374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7768414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7768470Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7768565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7768811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7768859Z graph_break [] 2025-12-04T09:45:51.7768933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7768975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7769032Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7769128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7769375Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7769413Z graph_break [] 2025-12-04T09:45:51.7769487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7769529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7769586Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7769681Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7769929Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7769974Z graph_break [] 2025-12-04T09:45:51.7770052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7770095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7770156Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7770255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7770512Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7770553Z graph_break [] 2025-12-04T09:45:51.7770638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7770684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7770743Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7770844Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7771095Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7771150Z graph_break [] 2025-12-04T09:45:51.7771224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7771269Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7771326Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7771429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7771689Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7771733Z graph_break [] 2025-12-04T09:45:51.7771806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7771855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7771914Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7772015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7772268Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7772321Z graph_break [] 2025-12-04T09:45:51.7772400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7772443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7772506Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7772604Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7772856Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7772895Z graph_break [] 2025-12-04T09:45:51.7773019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7773062Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7773124Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7773221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7773475Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7773515Z graph_break [] 2025-12-04T09:45:51.7773591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7773634Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7773695Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7773792Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7774049Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7774122Z graph_break [] 2025-12-04T09:45:51.7774200Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7774242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7774304Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7774403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7774657Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7774714Z graph_break [] 2025-12-04T09:45:51.7774788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7774833Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7774891Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7774992Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7775253Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7775296Z graph_break [] 2025-12-04T09:45:51.7775369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7775416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7775474Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7775573Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7775824Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7775883Z graph_break [] 2025-12-04T09:45:51.7775956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7776003Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7776061Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7776160Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7776416Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7776455Z graph_break [] 2025-12-04T09:45:51.7776530Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7776571Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7776630Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7776728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7776977Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7777014Z graph_break [] 2025-12-04T09:45:51.7777090Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7777133Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7777196Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7777292Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7777555Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7777594Z graph_break [] 2025-12-04T09:45:51.7777668Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7777711Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7777770Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7777867Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7778132Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7778169Z graph_break [] 2025-12-04T09:45:51.7778245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7778290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7778349Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7778448Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7778710Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7778751Z graph_break [] 2025-12-04T09:45:51.7778827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7778871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7778927Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7779025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7779273Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7779325Z graph_break [] 2025-12-04T09:45:51.7779399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7779443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7779500Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7779599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7779848Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7779887Z graph_break [] 2025-12-04T09:45:51.7779958Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7780002Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7780061Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7780159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7780419Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7780457Z graph_break [] 2025-12-04T09:45:51.7780532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7780573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7780629Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7780726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7780984Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7781021Z graph_break [] 2025-12-04T09:45:51.7781098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7781139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7781201Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7781296Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7781557Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7781596Z graph_break [] 2025-12-04T09:45:51.7781671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7781714Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7781776Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7781884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7782136Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7782176Z graph_break [] 2025-12-04T09:45:51.7782247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7782292Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7782348Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7782449Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7782726Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7782764Z graph_break [] 2025-12-04T09:45:51.7782838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7782883Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7782982Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7783080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7783328Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7783366Z graph_break [] 2025-12-04T09:45:51.7783442Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7783486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7783543Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7783641Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7783890Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7783932Z graph_break [] 2025-12-04T09:45:51.7784005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7784050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7784106Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7784204Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7784476Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7784515Z graph_break [] 2025-12-04T09:45:51.7784589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7784631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7784689Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7784800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7785052Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7785091Z graph_break [] 2025-12-04T09:45:51.7785167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7785210Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7785271Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7785380Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7785632Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7785671Z graph_break [] 2025-12-04T09:45:51.7785752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7785795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7785853Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7785950Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7786217Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7786256Z graph_break [] 2025-12-04T09:45:51.7786329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7786375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7786433Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7786532Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7786782Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7786822Z graph_break [] 2025-12-04T09:45:51.7786897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7786942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7786998Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7787099Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7787349Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7787390Z graph_break [] 2025-12-04T09:45:51.7787463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7787506Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7787564Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7787664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7787922Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7787964Z graph_break [] 2025-12-04T09:45:51.7788038Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7788084Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7788154Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7788252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7788513Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7788554Z graph_break [] 2025-12-04T09:45:51.7788631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7788672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7788750Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7788846Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7789097Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7789135Z graph_break [] 2025-12-04T09:45:51.7789210Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7789253Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7789313Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7789422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7789672Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7789710Z graph_break [] 2025-12-04T09:45:51.7789787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7789830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7789891Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7789987Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7790241Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7790283Z graph_break [] 2025-12-04T09:45:51.7790360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7790406Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7790464Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7790563Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7790811Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7790851Z graph_break [] 2025-12-04T09:45:51.7790924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7790967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7791027Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7791137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7791385Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7791425Z graph_break [] 2025-12-04T09:45:51.7791497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7791556Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7791614Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7791712Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7791963Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7792005Z graph_break [] 2025-12-04T09:45:51.7792078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7792121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7792199Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7792296Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7792551Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7792590Z graph_break [] 2025-12-04T09:45:51.7792665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7792706Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7792776Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7792874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7793220Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7793258Z graph_break [] 2025-12-04T09:45:51.7793344Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7793384Z Unexpected success 2025-12-04T09:45:51.7793461Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7793502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7793559Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7793653Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7793903Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7793941Z graph_break [] 2025-12-04T09:45:51.7794015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7794056Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7794113Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7794209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7794461Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7794501Z graph_break [] 2025-12-04T09:45:51.7794589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7794630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7794686Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7794783Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7795034Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7795090Z graph_break [] 2025-12-04T09:45:51.7795164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7795205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7795262Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7795359Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7795621Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7795659Z graph_break [] 2025-12-04T09:45:51.7795734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7795778Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7795834Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7795935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7796183Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7796235Z graph_break [] 2025-12-04T09:45:51.7796309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7796349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7796408Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7796504Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7796755Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7796794Z graph_break [] 2025-12-04T09:45:51.7796870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7796911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7796967Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7797064Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7797313Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7797350Z graph_break [] 2025-12-04T09:45:51.7797423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7797464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7797522Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7797617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7797864Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7797901Z graph_break [] 2025-12-04T09:45:51.7797989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7798032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7798092Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7798187Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7798438Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7798490Z graph_break [] 2025-12-04T09:45:51.7798561Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7798603Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7798659Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7798757Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7799015Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7799053Z graph_break [] 2025-12-04T09:45:51.7799125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7799166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7799223Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7799319Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7799572Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7799622Z graph_break [] 2025-12-04T09:45:51.7799696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7799737Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7799794Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7799892Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7800140Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7800181Z graph_break [] 2025-12-04T09:45:51.7800254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7800296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7800353Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7800451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7800708Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7800743Z graph_break [] 2025-12-04T09:45:51.7800819Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7800860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7800918Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7801014Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7801260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7801310Z graph_break [] 2025-12-04T09:45:51.7801383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7801423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7801482Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7801578Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7801828Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7801883Z graph_break [] 2025-12-04T09:45:51.7801956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7801996Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7802068Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7802171Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7802435Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7802479Z graph_break [] 2025-12-04T09:45:51.7802557Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7802607Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7802667Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7802769Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7803059Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7803120Z graph_break [] 2025-12-04T09:45:51.7803195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7803245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7803305Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7803410Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7803662Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7803706Z graph_break [] 2025-12-04T09:45:51.7803780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7803830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7803889Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7803993Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7804251Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7804291Z graph_break [] 2025-12-04T09:45:51.7804370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7804414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7804478Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7804577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7804853Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7804894Z graph_break [] 2025-12-04T09:45:51.7804975Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7805019Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7805083Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7805183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7805453Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7805493Z graph_break [] 2025-12-04T09:45:51.7805572Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7805616Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7805683Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7805781Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7806049Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7806089Z graph_break [] 2025-12-04T09:45:51.7806168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7806216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7806276Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7806378Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7806634Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7806694Z graph_break [] 2025-12-04T09:45:51.7806771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7806820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7806879Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7806981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7807232Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7807277Z graph_break [] 2025-12-04T09:45:51.7807354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7807404Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7807465Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7807566Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7807815Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7807860Z graph_break [] 2025-12-04T09:45:51.7807934Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7807983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7808041Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7808139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7808399Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7808437Z graph_break [] 2025-12-04T09:45:51.7808513Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7808554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7808614Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7808711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7808976Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7809014Z graph_break [] 2025-12-04T09:45:51.7809089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7809133Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7809192Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7809300Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7809550Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7809590Z graph_break [] 2025-12-04T09:45:51.7809665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7809707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7809767Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7809864Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7810130Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7810170Z graph_break [] 2025-12-04T09:45:51.7810245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7810288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7810347Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7810448Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7810699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7810739Z graph_break [] 2025-12-04T09:45:51.7810816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7810862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7810921Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7811022Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7811270Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7811312Z graph_break [] 2025-12-04T09:45:51.7811385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7811428Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7811485Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7811585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7811843Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7811885Z graph_break [] 2025-12-04T09:45:51.7811961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7812006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7812063Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7812174Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7812423Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7812462Z graph_break [] 2025-12-04T09:45:51.7812539Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7812580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7812640Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7812756Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7813046Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7813084Z graph_break [] 2025-12-04T09:45:51.7813159Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7813201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7813260Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7813356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7813630Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7813668Z graph_break [] 2025-12-04T09:45:51.7813744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7813785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7813847Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7813944Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7814196Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7814236Z graph_break [] 2025-12-04T09:45:51.7814310Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7814354Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7814412Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7814512Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7814762Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7814803Z graph_break [] 2025-12-04T09:45:51.7814876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7814921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7814980Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7815079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7815352Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7815393Z graph_break [] 2025-12-04T09:45:51.7815466Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7815511Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7815583Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7815682Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7815929Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7815970Z graph_break [] 2025-12-04T09:45:51.7816044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7816088Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7816161Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7816261Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7816513Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7816551Z graph_break [] 2025-12-04T09:45:51.7816629Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7816670Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7816730Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7816842Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7817093Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7817130Z graph_break [] 2025-12-04T09:45:51.7817206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7817249Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7817309Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7817405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7817654Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7817693Z graph_break [] 2025-12-04T09:45:51.7817768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7817809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7817871Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7817967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7818219Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7818260Z graph_break [] 2025-12-04T09:45:51.7818332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7818377Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7818436Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7818549Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7818805Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7818846Z graph_break [] 2025-12-04T09:45:51.7818918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7818976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7819034Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7819135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7819390Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7819431Z graph_break [] 2025-12-04T09:45:51.7819504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7819560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7819621Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7819720Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7819969Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7820010Z graph_break [] 2025-12-04T09:45:51.7820092Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7820134Z Unexpected success 2025-12-04T09:45:51.7820217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7820262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7820323Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7820420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7820674Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7820712Z graph_break [] 2025-12-04T09:45:51.7820787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7820829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7820889Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7820984Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7821237Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7821275Z graph_break [] 2025-12-04T09:45:51.7821351Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7821392Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7821453Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7821550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7821799Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7821837Z graph_break [] 2025-12-04T09:45:51.7821923Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7821967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7822026Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7822124Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7822373Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7822426Z graph_break [] 2025-12-04T09:45:51.7822500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7822544Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7822603Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7822705Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7823012Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7823053Z graph_break [] 2025-12-04T09:45:51.7823126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7823170Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7823229Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7823328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7823580Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7823634Z graph_break [] 2025-12-04T09:45:51.7823708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7823752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7823809Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7823910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7824157Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7824199Z graph_break [] 2025-12-04T09:45:51.7824277Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7824318Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7824377Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7824474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7824729Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7824767Z graph_break [] 2025-12-04T09:45:51.7824842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7824883Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7824944Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7825040Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7825289Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7825327Z graph_break [] 2025-12-04T09:45:51.7825417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7825459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7825520Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7825617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7825869Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7825920Z graph_break [] 2025-12-04T09:45:51.7825996Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7826037Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7826097Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7826196Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7829142Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7829199Z graph_break [] 2025-12-04T09:45:51.7829272Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7829324Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7829381Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7829479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7829727Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7829790Z graph_break [] 2025-12-04T09:45:51.7829863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7829907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7829968Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7830069Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7830317Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7830358Z graph_break [] 2025-12-04T09:45:51.7830430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7830474Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7830532Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7830632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7830884Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7830924Z graph_break [] 2025-12-04T09:45:51.7830998Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7831041Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7831101Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7831197Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7831467Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7831505Z graph_break [] 2025-12-04T09:45:51.7831583Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7831625Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7831685Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7831781Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7832031Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7832084Z graph_break [] 2025-12-04T09:45:51.7832159Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7832201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7832262Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7832360Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7832627Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7832665Z graph_break [] 2025-12-04T09:45:51.7832740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7832783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7832842Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7832978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7833230Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7833292Z graph_break [] 2025-12-04T09:45:51.7833364Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7833411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7833468Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7833568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7833822Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7833861Z graph_break [] 2025-12-04T09:45:51.7833933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7833978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7834036Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7834133Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7834383Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7834423Z graph_break [] 2025-12-04T09:45:51.7834495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7834540Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7834599Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7834698Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7834965Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7835004Z graph_break [] 2025-12-04T09:45:51.7835079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7835121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7835180Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7835277Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7835544Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7835581Z graph_break [] 2025-12-04T09:45:51.7835656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7835699Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7835760Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7835856Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7836120Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7836159Z graph_break [] 2025-12-04T09:45:51.7836237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7836278Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7836338Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7836434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7836689Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7836739Z graph_break [] 2025-12-04T09:45:51.7836815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7836857Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7836917Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7837017Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7837275Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7837315Z graph_break [] 2025-12-04T09:45:51.7837388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7837433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7837491Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7837588Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7837839Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7837880Z graph_break [] 2025-12-04T09:45:51.7837952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7837996Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7838052Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7838150Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7838411Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7838451Z graph_break [] 2025-12-04T09:45:51.7838524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7838568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7838626Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7838725Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7838989Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7839025Z graph_break [] 2025-12-04T09:45:51.7839101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7839143Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7839205Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7839312Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7839562Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7839600Z graph_break [] 2025-12-04T09:45:51.7839674Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7839715Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7839774Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7839870Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7840141Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7840180Z graph_break [] 2025-12-04T09:45:51.7840256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7840297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7840356Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7840452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7840708Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7840747Z graph_break [] 2025-12-04T09:45:51.7840822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7840866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7840923Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7841022Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7841268Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7841308Z graph_break [] 2025-12-04T09:45:51.7841380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7841423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7841480Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7841580Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7841837Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7841878Z graph_break [] 2025-12-04T09:45:51.7841951Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7841994Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7842051Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7842164Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7842413Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7842453Z graph_break [] 2025-12-04T09:45:51.7842528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7842573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7842629Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7842748Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7843041Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7843079Z graph_break [] 2025-12-04T09:45:51.7843154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7843195Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7843253Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7843351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7843620Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7843658Z graph_break [] 2025-12-04T09:45:51.7843732Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7843773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7843834Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7843930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7844178Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7844216Z graph_break [] 2025-12-04T09:45:51.7844292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7844333Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7844392Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7844489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7844745Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7844785Z graph_break [] 2025-12-04T09:45:51.7844858Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7844900Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7844956Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7845067Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7845316Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7845355Z graph_break [] 2025-12-04T09:45:51.7845429Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7845472Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7845544Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7845643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7845891Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7845931Z graph_break [] 2025-12-04T09:45:51.7846004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7846048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7846121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7846220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7846467Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7846507Z graph_break [] 2025-12-04T09:45:51.7846581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7846624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7846681Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7846791Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7847043Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7847080Z graph_break [] 2025-12-04T09:45:51.7847154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7847197Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7847255Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7847351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7847600Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7847639Z graph_break [] 2025-12-04T09:45:51.7847713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7847754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7847813Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7847909Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7848157Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7848195Z graph_break [] 2025-12-04T09:45:51.7848270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7848311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7848373Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7848479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7848738Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7848777Z graph_break [] 2025-12-04T09:45:51.7848850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7848907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7848964Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7849062Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7849311Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7849351Z graph_break [] 2025-12-04T09:45:51.7849423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7849476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7849534Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7849632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7849880Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7849920Z graph_break [] 2025-12-04T09:45:51.7850002Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7850043Z Unexpected success 2025-12-04T09:45:51.7850127Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7850172Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7850229Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7850328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7850580Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7850620Z graph_break [] 2025-12-04T09:45:51.7850694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7850738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7850797Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7850893Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7851144Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7851182Z graph_break [] 2025-12-04T09:45:51.7851256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7851297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7851356Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7851453Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7851704Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7851742Z graph_break [] 2025-12-04T09:45:51.7851826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7851868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7851926Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7852023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7852275Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7852324Z graph_break [] 2025-12-04T09:45:51.7852398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7852439Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7852498Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7852595Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7852859Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7852900Z graph_break [] 2025-12-04T09:45:51.7853012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7853056Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7853115Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7853216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7853464Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7853522Z graph_break [] 2025-12-04T09:45:51.7853596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7853640Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7853699Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7853799Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7854049Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7854091Z graph_break [] 2025-12-04T09:45:51.7854163Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7854207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7854264Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7854367Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7854620Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7854660Z graph_break [] 2025-12-04T09:45:51.7854736Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7854778Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7854838Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7854935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7855184Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7855224Z graph_break [] 2025-12-04T09:45:51.7855316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7855358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7855419Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7855516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7855767Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7855829Z graph_break [] 2025-12-04T09:45:51.7855904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7855945Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7856005Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7856103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7856365Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7856402Z graph_break [] 2025-12-04T09:45:51.7856479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7856522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7856581Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7856679Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7856937Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7856990Z graph_break [] 2025-12-04T09:45:51.7857063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7857107Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7857165Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7857264Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7857511Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7857552Z graph_break [] 2025-12-04T09:45:51.7857626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7857670Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7857730Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7857830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7858080Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7858120Z graph_break [] 2025-12-04T09:45:51.7858193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7858240Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7858299Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7858398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7858660Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7858703Z graph_break [] 2025-12-04T09:45:51.7858778Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7858820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7858880Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7858976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7859228Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7859277Z graph_break [] 2025-12-04T09:45:51.7859352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7859393Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7859454Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7859552Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7859817Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7859855Z graph_break [] 2025-12-04T09:45:51.7859932Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7859975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7860034Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7860130Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7860381Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7860428Z graph_break [] 2025-12-04T09:45:51.7860503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7860546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7860606Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7860702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7860955Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7860996Z graph_break [] 2025-12-04T09:45:51.7861069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7861115Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7861173Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7861271Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7861523Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7861562Z graph_break [] 2025-12-04T09:45:51.7861636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7861680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7861737Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7861836Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7862097Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7862138Z graph_break [] 2025-12-04T09:45:51.7862213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7862258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7862315Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7862415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7862680Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7862721Z graph_break [] 2025-12-04T09:45:51.7862797Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7862840Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7862902Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7863043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7863307Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7863345Z graph_break [] 2025-12-04T09:45:51.7863423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7863465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7863525Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7863621Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7863879Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7863930Z graph_break [] 2025-12-04T09:45:51.7864006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7864048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7864108Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7864205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7864460Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7864497Z graph_break [] 2025-12-04T09:45:51.7864573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7864616Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7864676Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7864777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7865027Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7865069Z graph_break [] 2025-12-04T09:45:51.7865142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7865187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7865247Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7865346Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7865611Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7865651Z graph_break [] 2025-12-04T09:45:51.7865724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7865768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7865825Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7865924Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7866187Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7866227Z graph_break [] 2025-12-04T09:45:51.7866300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7866348Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7866406Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7866516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7866770Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7866808Z graph_break [] 2025-12-04T09:45:51.7866884Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7866926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7866985Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7867081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7867345Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7867383Z graph_break [] 2025-12-04T09:45:51.7867457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7867499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7867558Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7867656Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7867906Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7867944Z graph_break [] 2025-12-04T09:45:51.7868020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7868062Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7868121Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7868219Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7868470Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7868509Z graph_break [] 2025-12-04T09:45:51.7868586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7868630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7868687Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7868786Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7869050Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7869091Z graph_break [] 2025-12-04T09:45:51.7869164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7873041Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7873106Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7873227Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7873478Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7873525Z graph_break [] 2025-12-04T09:45:51.7873601Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7873643Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7873700Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7873814Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7874063Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7874103Z graph_break [] 2025-12-04T09:45:51.7874174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7874217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7874273Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7874387Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7874645Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7874682Z graph_break [] 2025-12-04T09:45:51.7874755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7874795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7874855Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7874951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7875202Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7875239Z graph_break [] 2025-12-04T09:45:51.7875314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7875355Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7875416Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7875512Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7875760Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7875798Z graph_break [] 2025-12-04T09:45:51.7875872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7875912Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7875972Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7876083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7876334Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7876371Z graph_break [] 2025-12-04T09:45:51.7876445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7876487Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7876556Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7876655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7876904Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7876943Z graph_break [] 2025-12-04T09:45:51.7877017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7877060Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7877125Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7877224Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7877470Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7877509Z graph_break [] 2025-12-04T09:45:51.7877582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7877624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7877680Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7877791Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7878039Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7878078Z graph_break [] 2025-12-04T09:45:51.7878150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7878193Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7878250Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7878348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7878605Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7878643Z graph_break [] 2025-12-04T09:45:51.7878717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7878758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7878817Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7878913Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7879163Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7879200Z graph_break [] 2025-12-04T09:45:51.7879274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7879314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7879373Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7879478Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7879728Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7879765Z graph_break [] 2025-12-04T09:45:51.7879839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7879893Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7879952Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7880046Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7880295Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7880333Z graph_break [] 2025-12-04T09:45:51.7880410Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7880460Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7880520Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7880619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7880868Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7880908Z graph_break [] 2025-12-04T09:45:51.7880980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7881023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7881090Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7881192Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7881441Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7881480Z graph_break [] 2025-12-04T09:45:51.7881561Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7881603Z Unexpected success 2025-12-04T09:45:51.7881676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7881718Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7881774Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7881871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7882121Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7882160Z graph_break [] 2025-12-04T09:45:51.7882232Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7882275Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7882331Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7882429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7882683Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7882720Z graph_break [] 2025-12-04T09:45:51.7882810Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7882852Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7882909Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7883054Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7883304Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7883361Z graph_break [] 2025-12-04T09:45:51.7883435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7883475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7883533Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7883629Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7883894Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7883931Z graph_break [] 2025-12-04T09:45:51.7884004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7884045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7884104Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7884199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7884451Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7884510Z graph_break [] 2025-12-04T09:45:51.7884583Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7884626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7884683Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7884781Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7885032Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7885070Z graph_break [] 2025-12-04T09:45:51.7885143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7885187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7885244Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7885344Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7885593Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7885631Z graph_break [] 2025-12-04T09:45:51.7885704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7885747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7885805Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7885904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7886159Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7886199Z graph_break [] 2025-12-04T09:45:51.7886283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7886326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7886384Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7886481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7886734Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7886783Z graph_break [] 2025-12-04T09:45:51.7886857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7886898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7886956Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7887053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7887313Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7887350Z graph_break [] 2025-12-04T09:45:51.7887425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7887467Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7887524Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7887619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7887867Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7887916Z graph_break [] 2025-12-04T09:45:51.7887990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7888031Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7888092Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7888187Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7888440Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7888479Z graph_break [] 2025-12-04T09:45:51.7888551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7888593Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7888650Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7888749Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7888997Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7889039Z graph_break [] 2025-12-04T09:45:51.7889112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7889158Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7889215Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7889312Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7889570Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7889611Z graph_break [] 2025-12-04T09:45:51.7889685Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7889729Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7889786Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7889884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7890134Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7890184Z graph_break [] 2025-12-04T09:45:51.7890257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7890299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7890360Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7890458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7890717Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7890754Z graph_break [] 2025-12-04T09:45:51.7890828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7890870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7890929Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7891025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7891280Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7891326Z graph_break [] 2025-12-04T09:45:51.7891401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7891442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7891502Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7891598Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7891850Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7891887Z graph_break [] 2025-12-04T09:45:51.7891963Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7892005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7892065Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7892161Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7892415Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7892454Z graph_break [] 2025-12-04T09:45:51.7892528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7892573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7892630Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7892726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7893039Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7893079Z graph_break [] 2025-12-04T09:45:51.7893153Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7893196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7893253Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7893349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7893612Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7893651Z graph_break [] 2025-12-04T09:45:51.7893723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7893767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7893824Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7893921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7894180Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7894220Z graph_break [] 2025-12-04T09:45:51.7894295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7894335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7894394Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7894491Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7894756Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7894794Z graph_break [] 2025-12-04T09:45:51.7894868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7894909Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7894969Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7895065Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7895314Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7895351Z graph_break [] 2025-12-04T09:45:51.7895425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7895468Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7895526Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7895623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7895872Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7895909Z graph_break [] 2025-12-04T09:45:51.7895984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7896025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7896085Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7896180Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7896444Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7896483Z graph_break [] 2025-12-04T09:45:51.7896559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7896602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7896659Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7896769Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7897017Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7897055Z graph_break [] 2025-12-04T09:45:51.7897127Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7897171Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7897228Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7897356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7897605Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7897644Z graph_break [] 2025-12-04T09:45:51.7897716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7897759Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7897817Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7897913Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7898192Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7898233Z graph_break [] 2025-12-04T09:45:51.7898307Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7898348Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7898407Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7898504Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7898753Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7898790Z graph_break [] 2025-12-04T09:45:51.7898866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7898906Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7898964Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7899061Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7899309Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7899347Z graph_break [] 2025-12-04T09:45:51.7899423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7899464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7899525Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7899621Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7899881Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7899918Z graph_break [] 2025-12-04T09:45:51.7899994Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7900035Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7900093Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7900201Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7900453Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7900492Z graph_break [] 2025-12-04T09:45:51.7900566Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7900608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7900665Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7900772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7901019Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7901058Z graph_break [] 2025-12-04T09:45:51.7901132Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7901175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7901231Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7901340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7901587Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7901627Z graph_break [] 2025-12-04T09:45:51.7901699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7901741Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7901799Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7901896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7902145Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7902184Z graph_break [] 2025-12-04T09:45:51.7902259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7902299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7902360Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7902457Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7902709Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7902746Z graph_break [] 2025-12-04T09:45:51.7902820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7902862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7902920Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7903087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7903337Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7903374Z graph_break [] 2025-12-04T09:45:51.7903447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7903487Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7903561Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7903657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7903907Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7903945Z graph_break [] 2025-12-04T09:45:51.7904019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7904059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7904133Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7904231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7904484Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7904523Z graph_break [] 2025-12-04T09:45:51.7904595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7904638Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7904695Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7904813Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7905065Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7905107Z graph_break [] 2025-12-04T09:45:51.7905180Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7905226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7905284Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7905386Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7905633Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7905676Z graph_break [] 2025-12-04T09:45:51.7905752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7905797Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7905858Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7905960Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7906211Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7906249Z graph_break [] 2025-12-04T09:45:51.7906328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7906370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7906433Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7906541Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7906794Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7906832Z graph_break [] 2025-12-04T09:45:51.7906907Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7906961Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7907021Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7907118Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7907372Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7907411Z graph_break [] 2025-12-04T09:45:51.7907489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7907543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7907607Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7907704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7907962Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7908001Z graph_break [] 2025-12-04T09:45:51.7908077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7908134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7908191Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7908292Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7908548Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7908591Z graph_break [] 2025-12-04T09:45:51.7908664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7908710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7908771Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7908873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7909125Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7909167Z graph_break [] 2025-12-04T09:45:51.7909242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7909289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7909347Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7909450Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7909699Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7909740Z graph_break [] 2025-12-04T09:45:51.7909824Z ___________________ CudaReproTests.test_repeated_masked_load ___________________ 2025-12-04T09:45:51.7909869Z Unexpected success 2025-12-04T09:45:51.7909977Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7910024Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7910082Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7910183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7910443Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7910499Z graph_break [] 2025-12-04T09:45:51.7910576Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7910621Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7910681Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7910777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7911041Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7911078Z graph_break [] 2025-12-04T09:45:51.7911154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7911196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7911256Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7911353Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7911605Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7911656Z graph_break [] 2025-12-04T09:45:51.7911730Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7911771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7911833Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7911929Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7912178Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7912217Z graph_break [] 2025-12-04T09:45:51.7912290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7912332Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7912390Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7912498Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7912748Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7912787Z graph_break [] 2025-12-04T09:45:51.7912858Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7912901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7912997Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7913097Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7913343Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7913400Z graph_break [] 2025-12-04T09:45:51.7913475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7913521Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7913580Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7913677Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7913926Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7913982Z graph_break [] 2025-12-04T09:45:51.7914054Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7914097Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7914153Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7914251Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7914518Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7914556Z graph_break [] 2025-12-04T09:45:51.7914631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7914673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7914731Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7914828Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7915083Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7915135Z graph_break [] 2025-12-04T09:45:51.7915211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7915252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7915311Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7915407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7915655Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7915693Z graph_break [] 2025-12-04T09:45:51.7915768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7915809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7915870Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7915967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7916219Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7916258Z graph_break [] 2025-12-04T09:45:51.7916330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7916374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7916433Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7916531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7916791Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7916830Z graph_break [] 2025-12-04T09:45:51.7916902Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7916948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7917005Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7917103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7917361Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7917399Z graph_break [] 2025-12-04T09:45:51.7917471Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7917516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7917572Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7917670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7917928Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7917971Z graph_break [] 2025-12-04T09:45:51.7918044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7918089Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7918147Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7918245Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7918503Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7918550Z graph_break [] 2025-12-04T09:45:51.7918626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7918667Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7918725Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7918820Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7919068Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7919105Z graph_break [] 2025-12-04T09:45:51.7919178Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7919220Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7919279Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7919374Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7919625Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7919661Z graph_break [] 2025-12-04T09:45:51.7919737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7919777Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7919839Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7919935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7920199Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7920241Z graph_break [] 2025-12-04T09:45:51.7920314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7920357Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7920414Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7920512Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7920771Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7920809Z graph_break [] 2025-12-04T09:45:51.7920881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7920926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7920990Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7921087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7921347Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7921387Z graph_break [] 2025-12-04T09:45:51.7921459Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7921503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7921559Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7921658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7921917Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7921956Z graph_break [] 2025-12-04T09:45:51.7922030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7922072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7922131Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7922228Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7922486Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7922523Z graph_break [] 2025-12-04T09:45:51.7922601Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7922643Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7922701Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7922798Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7923090Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7923129Z graph_break [] 2025-12-04T09:45:51.7923203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7923243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7923303Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7923399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7923677Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7923714Z graph_break [] 2025-12-04T09:45:51.7923789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7923830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7923888Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7924005Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7924260Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7924299Z graph_break [] 2025-12-04T09:45:51.7924373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7924417Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7924474Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7924584Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7924832Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7924871Z graph_break [] 2025-12-04T09:45:51.7924944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7924988Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7925045Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7925143Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7925405Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7925444Z graph_break [] 2025-12-04T09:45:51.7925517Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7925559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7925618Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7925716Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7925964Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7926005Z graph_break [] 2025-12-04T09:45:51.7926080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7926121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7926179Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7926276Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7926530Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7926567Z graph_break [] 2025-12-04T09:45:51.7926640Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7926681Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7926739Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7926835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7927097Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7927135Z graph_break [] 2025-12-04T09:45:51.7927212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7927252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7927323Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7927418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7927667Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7927704Z graph_break [] 2025-12-04T09:45:51.7927779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7927820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7927878Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7927987Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7928236Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7928275Z graph_break [] 2025-12-04T09:45:51.7928350Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7928394Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7928451Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7928560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7928812Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7928852Z graph_break [] 2025-12-04T09:45:51.7928924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7928968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7929026Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7929123Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7929371Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7929410Z graph_break [] 2025-12-04T09:45:51.7929484Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7929529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7929586Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7929685Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7929934Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7929974Z graph_break [] 2025-12-04T09:45:51.7930048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7930088Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7930148Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7930258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7930513Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7930550Z graph_break [] 2025-12-04T09:45:51.7930624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7930677Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7930735Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7930831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7931081Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7931119Z graph_break [] 2025-12-04T09:45:51.7931195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7931235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7931307Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7931403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7931652Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7931690Z graph_break [] 2025-12-04T09:45:51.7931767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7931808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7931877Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7931976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7932226Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7932265Z graph_break [] 2025-12-04T09:45:51.7932341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7932384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7932440Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7932537Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7932787Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7932828Z graph_break [] 2025-12-04T09:45:51.7932901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7932989Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7933047Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7933145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7933393Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7933434Z graph_break [] 2025-12-04T09:45:51.7933507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7933550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7933608Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7933727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7933981Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7934020Z graph_break [] 2025-12-04T09:45:51.7934094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7934150Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7934208Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7934303Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7934557Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7934594Z graph_break [] 2025-12-04T09:45:51.7934670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7934724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7934785Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7934881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7935130Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7935167Z graph_break [] 2025-12-04T09:45:51.7935240Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7935306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7935365Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7935461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7935711Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7935748Z graph_break [] 2025-12-04T09:45:51.7935821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7935864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7935920Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7936018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7936265Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7936305Z graph_break [] 2025-12-04T09:45:51.7936382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7936424Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7936480Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7936577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7936824Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7936862Z graph_break [] 2025-12-04T09:45:51.7936942Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7936988Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7937058Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7937159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7937408Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7937449Z graph_break [] 2025-12-04T09:45:51.7937534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7937580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7937638Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7937737Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7937994Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7938033Z graph_break [] 2025-12-04T09:45:51.7938122Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7938165Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7938226Z stats [('calls_captured', 10), ('unique_graphs', 1)] 2025-12-04T09:45:51.7938323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7938582Z inductor [('triton_bundler_save_kernel', 8), ('pattern_matcher_count', 4), ('pattern_matcher_nodes', 4), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7938622Z graph_break [] 2025-12-04T09:45:51.7938715Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7938776Z Traceback (most recent call last): 2025-12-04T09:45:51.7938949Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7939009Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7939196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7939259Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7939364Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7939431Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7939545Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7939602Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7939660Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7939664Z 2025-12-04T09:45:51.7939743Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7939901Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7939904Z 2025-12-04T09:45:51.7939999Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7940075Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7940123Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7940183Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7940286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7940479Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7940522Z graph_break [] 2025-12-04T09:45:51.7940609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7940656Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7940716Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7940817Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7941010Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7941063Z graph_break [] 2025-12-04T09:45:51.7941154Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7941204Z Traceback (most recent call last): 2025-12-04T09:45:51.7941362Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7941425Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7941592Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7941656Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7941763Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7941831Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7941937Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7941998Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7942050Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7942055Z 2025-12-04T09:45:51.7942132Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7942285Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7942298Z 2025-12-04T09:45:51.7942386Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7942464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7942508Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7942568Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7942669Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7942874Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7942913Z graph_break [] 2025-12-04T09:45:51.7943035Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7943079Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7943138Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7943237Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7943429Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7943468Z graph_break [] 2025-12-04T09:45:51.7943548Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7943590Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7943649Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7943747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7943943Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7943983Z graph_break [] 2025-12-04T09:45:51.7944095Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7944146Z Traceback (most recent call last): 2025-12-04T09:45:51.7944301Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7944362Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7944526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7944604Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7944701Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7944768Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7944875Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7944934Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7944988Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7944992Z 2025-12-04T09:45:51.7945069Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7945234Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7945236Z 2025-12-04T09:45:51.7945329Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7945404Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7945453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7945510Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7945610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7945803Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7945861Z graph_break [] 2025-12-04T09:45:51.7945934Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7945985Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7946042Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7946143Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7946338Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7946377Z graph_break [] 2025-12-04T09:45:51.7946454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7946497Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7946555Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7946653Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7946847Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7946887Z graph_break [] 2025-12-04T09:45:51.7946965Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7947008Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7947067Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7947166Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7947361Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7947400Z graph_break [] 2025-12-04T09:45:51.7947494Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7947550Z Traceback (most recent call last): 2025-12-04T09:45:51.7947709Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7947767Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7947935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7947996Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7948110Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7948173Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7948282Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7948338Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7948394Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7948396Z 2025-12-04T09:45:51.7948475Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7948646Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7948648Z 2025-12-04T09:45:51.7948741Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7948815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7948862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7948919Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7949023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7949217Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7949270Z graph_break [] 2025-12-04T09:45:51.7949344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7949389Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7949447Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7949548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7949737Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7949778Z graph_break [] 2025-12-04T09:45:51.7949852Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7949898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7949953Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7950051Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7950242Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7950285Z graph_break [] 2025-12-04T09:45:51.7950363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7950405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7950463Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7950560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7950753Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7950790Z graph_break [] 2025-12-04T09:45:51.7950865Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7950919Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7950979Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7951079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7951272Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7951310Z graph_break [] 2025-12-04T09:45:51.7951415Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7951462Z Traceback (most recent call last): 2025-12-04T09:45:51.7951619Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7951677Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7951848Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7951912Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7952011Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7952083Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7952192Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7952248Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7952307Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7952310Z 2025-12-04T09:45:51.7952386Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7952538Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7952540Z 2025-12-04T09:45:51.7952631Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7952735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7952781Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7952838Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7952975Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7953168Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7953210Z graph_break [] 2025-12-04T09:45:51.7953284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7953330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7953385Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7953484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7953677Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7953717Z graph_break [] 2025-12-04T09:45:51.7953792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7953838Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7953894Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7953996Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7954187Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7954229Z graph_break [] 2025-12-04T09:45:51.7954304Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7954350Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7954432Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7954533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7954725Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7954763Z graph_break [] 2025-12-04T09:45:51.7954839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7954899Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7954957Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7955053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7955246Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7955285Z graph_break [] 2025-12-04T09:45:51.7955361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7955403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7955480Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7955577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7955769Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7955808Z graph_break [] 2025-12-04T09:45:51.7955904Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7955951Z Traceback (most recent call last): 2025-12-04T09:45:51.7956109Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7956182Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7956349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7956411Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7956510Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7956575Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7956682Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7956738Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7956792Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7956794Z 2025-12-04T09:45:51.7956872Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7957023Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7957024Z 2025-12-04T09:45:51.7957112Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7957189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7957234Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7957289Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7957394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7957588Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7957629Z graph_break [] 2025-12-04T09:45:51.7957701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7957747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7957819Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7957920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7958111Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7958153Z graph_break [] 2025-12-04T09:45:51.7958226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7958283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7958338Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7958437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7958627Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7958670Z graph_break [] 2025-12-04T09:45:51.7958743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7958787Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7958855Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7958952Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7959143Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7959182Z graph_break [] 2025-12-04T09:45:51.7959256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7959296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7959353Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7959461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7959650Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7959687Z graph_break [] 2025-12-04T09:45:51.7959761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7959802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7959861Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7959957Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7960146Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7960182Z graph_break [] 2025-12-04T09:45:51.7960257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7960299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7960356Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7960452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7960642Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7960681Z graph_break [] 2025-12-04T09:45:51.7960771Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7960816Z Traceback (most recent call last): 2025-12-04T09:45:51.7960969Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7961026Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7961200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7961263Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7961362Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7961428Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7961535Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7961592Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7961667Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7961669Z 2025-12-04T09:45:51.7961744Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7961892Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7961894Z 2025-12-04T09:45:51.7961982Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7962056Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7962101Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7962166Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7962265Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7962455Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7962494Z graph_break [] 2025-12-04T09:45:51.7962569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7962611Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7962666Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7962763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7963002Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7963040Z graph_break [] 2025-12-04T09:45:51.7963116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7963157Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7963213Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7963311Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7963505Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7963543Z graph_break [] 2025-12-04T09:45:51.7963616Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7963658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7963714Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7963809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7964000Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7964037Z graph_break [] 2025-12-04T09:45:51.7964112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7964152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7964207Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7964302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7964509Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7964548Z graph_break [] 2025-12-04T09:45:51.7964623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7964664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7964720Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7964815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7965004Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7965060Z graph_break [] 2025-12-04T09:45:51.7965133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7965175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7965231Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7965333Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7965541Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7965580Z graph_break [] 2025-12-04T09:45:51.7965653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7965695Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7965751Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7965848Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7966036Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7966091Z graph_break [] 2025-12-04T09:45:51.7966180Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7966228Z Traceback (most recent call last): 2025-12-04T09:45:51.7966381Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7966437Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7966600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7966663Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7966760Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7966824Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7966927Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7966991Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7967043Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7967046Z 2025-12-04T09:45:51.7967121Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7967272Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7967274Z 2025-12-04T09:45:51.7967359Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7967437Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7967479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7967538Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7967636Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7967829Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7967881Z graph_break [] 2025-12-04T09:45:51.7967960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7968001Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7968058Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7968156Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7968345Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7968394Z graph_break [] 2025-12-04T09:45:51.7968468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7968508Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7968564Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7968664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7968866Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7968903Z graph_break [] 2025-12-04T09:45:51.7968978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7969019Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7969075Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7969172Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7969366Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7969404Z graph_break [] 2025-12-04T09:45:51.7969489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7969534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7969590Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7969688Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7969877Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7969916Z graph_break [] 2025-12-04T09:45:51.7969990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7970033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7970088Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7970185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7970378Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7970417Z graph_break [] 2025-12-04T09:45:51.7970489Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7970534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7970590Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7970687Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7970877Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7970915Z graph_break [] 2025-12-04T09:45:51.7970988Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7971032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7971088Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7971199Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7971394Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7971433Z graph_break [] 2025-12-04T09:45:51.7971507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7971560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7971617Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7971712Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7971900Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7971937Z graph_break [] 2025-12-04T09:45:51.7972029Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7972075Z Traceback (most recent call last): 2025-12-04T09:45:51.7972241Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7972298Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7972463Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7972525Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7972621Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7972683Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7972787Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7972861Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7972913Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7972915Z 2025-12-04T09:45:51.7973134Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7973286Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7973289Z 2025-12-04T09:45:51.7973375Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7973452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7973495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7973551Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7973655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7973848Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7973888Z graph_break [] 2025-12-04T09:45:51.7973962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7974005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7974060Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7974158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7974347Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7974393Z graph_break [] 2025-12-04T09:45:51.7974467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7974510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7974564Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7974692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7974885Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7974923Z graph_break [] 2025-12-04T09:45:51.7974995Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7975038Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7975110Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7975207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7975395Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7975434Z graph_break [] 2025-12-04T09:45:51.7975509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7975553Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7975606Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7975718Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7975910Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7975948Z graph_break [] 2025-12-04T09:45:51.7976021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7976063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7976122Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7976218Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7976423Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7976460Z graph_break [] 2025-12-04T09:45:51.7976535Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7976576Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7976632Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7976727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7976917Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7976953Z graph_break [] 2025-12-04T09:45:51.7977028Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7977069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7977126Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7977221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7977412Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7977448Z graph_break [] 2025-12-04T09:45:51.7977524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7977567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7977625Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7977721Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7977912Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7977962Z graph_break [] 2025-12-04T09:45:51.7978036Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7978079Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7978133Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7978231Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7978421Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7978472Z graph_break [] 2025-12-04T09:45:51.7978560Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7978608Z Traceback (most recent call last): 2025-12-04T09:45:51.7978766Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7978827Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7978992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7979066Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7979162Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7979227Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7979330Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7979387Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7979437Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7979439Z 2025-12-04T09:45:51.7979516Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7979678Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7979680Z 2025-12-04T09:45:51.7979769Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7979843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7979886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7979942Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7980039Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7980233Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7980270Z graph_break [] 2025-12-04T09:45:51.7980343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7980386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7980442Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7980537Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7980728Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7980766Z graph_break [] 2025-12-04T09:45:51.7980840Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7980882Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7980939Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7981034Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7981223Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7981272Z graph_break [] 2025-12-04T09:45:51.7981347Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7981388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7981448Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7981546Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7981745Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7981795Z graph_break [] 2025-12-04T09:45:51.7981868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7981911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7981968Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7982063Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7982255Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7982305Z graph_break [] 2025-12-04T09:45:51.7982378Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7982421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7982474Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7982572Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7982759Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7982799Z graph_break [] 2025-12-04T09:45:51.7982883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7982968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7983023Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7983123Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7983312Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7983350Z graph_break [] 2025-12-04T09:45:51.7983425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7983469Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7983522Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7983619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7983811Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7983851Z graph_break [] 2025-12-04T09:45:51.7983924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7983968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7984022Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7984120Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7984314Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7984351Z graph_break [] 2025-12-04T09:45:51.7984424Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7984465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7984522Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7984635Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7984825Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7984864Z graph_break [] 2025-12-04T09:45:51.7984940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7984980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7985056Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7985151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7985341Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7985380Z graph_break [] 2025-12-04T09:45:51.7985472Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7985518Z Traceback (most recent call last): 2025-12-04T09:45:51.7985694Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7985750Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7985916Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7985977Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7986077Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7986139Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7986248Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7986326Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7986380Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7986383Z 2025-12-04T09:45:51.7986457Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7986607Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7986609Z 2025-12-04T09:45:51.7986696Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7986770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7986814Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7986871Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7986973Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7987165Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7987204Z graph_break [] 2025-12-04T09:45:51.7987277Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7987321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7987375Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7987474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7987669Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7987709Z graph_break [] 2025-12-04T09:45:51.7987783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7987826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7987882Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7987990Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7988181Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7988220Z graph_break [] 2025-12-04T09:45:51.7988295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7988338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7988404Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7988501Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7988694Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7988731Z graph_break [] 2025-12-04T09:45:51.7988806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7988847Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7988903Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7989008Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7989200Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7989238Z graph_break [] 2025-12-04T09:45:51.7989311Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7989352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7989408Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7989507Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7989716Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7989752Z graph_break [] 2025-12-04T09:45:51.7989827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7989868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7989925Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7990019Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7990213Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7990250Z graph_break [] 2025-12-04T09:45:51.7990326Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7990368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7990425Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7990521Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7990712Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7990750Z graph_break [] 2025-12-04T09:45:51.7990823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7990867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7990923Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7991022Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7991209Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7991259Z graph_break [] 2025-12-04T09:45:51.7991332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7991375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7991430Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7991531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7991721Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7991776Z graph_break [] 2025-12-04T09:45:51.7991849Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7991894Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7991950Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7992049Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7992241Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7992289Z graph_break [] 2025-12-04T09:45:51.7992365Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7992409Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7992463Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7992562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7992750Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7992789Z graph_break [] 2025-12-04T09:45:51.7992890Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.7992967Z Traceback (most recent call last): 2025-12-04T09:45:51.7993122Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7993180Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.7993343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.7993404Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.7993503Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.7993570Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.7993681Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.7993736Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.7993791Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.7993793Z 2025-12-04T09:45:51.7993867Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.7994019Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.7994021Z 2025-12-04T09:45:51.7994106Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.7994182Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7994224Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7994282Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7994380Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7994572Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7994610Z graph_break [] 2025-12-04T09:45:51.7994698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7994740Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7994797Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7994894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7995084Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7995141Z graph_break [] 2025-12-04T09:45:51.7995213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7995256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7995310Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7995407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7995602Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7995640Z graph_break [] 2025-12-04T09:45:51.7995731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7995776Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7995831Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7995930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.7996118Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.7999518Z graph_break [] 2025-12-04T09:45:51.7999594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.7999662Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.7999721Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.7999819Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8000011Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8000050Z graph_break [] 2025-12-04T09:45:51.8000125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8000169Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8000223Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8000320Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8000511Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8000548Z graph_break [] 2025-12-04T09:45:51.8000622Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8000664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8000719Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8000815Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8001008Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8001045Z graph_break [] 2025-12-04T09:45:51.8001121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8001162Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8001217Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8001325Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8001517Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8001553Z graph_break [] 2025-12-04T09:45:51.8001628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8001668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8001737Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8001834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8002027Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8002067Z graph_break [] 2025-12-04T09:45:51.8002143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8002184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8002240Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8002360Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8002554Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8002591Z graph_break [] 2025-12-04T09:45:51.8002666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8002708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8002763Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8002861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8003102Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8003144Z graph_break [] 2025-12-04T09:45:51.8003217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8003260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8003314Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8003416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8003607Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8003648Z graph_break [] 2025-12-04T09:45:51.8003721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8003768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8003825Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8003921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8004108Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8004147Z graph_break [] 2025-12-04T09:45:51.8004235Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8004284Z Traceback (most recent call last): 2025-12-04T09:45:51.8004438Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8004496Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8004661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8004741Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8004838Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8004904Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8005012Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8005067Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8005121Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8005144Z 2025-12-04T09:45:51.8005220Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8005370Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8005372Z 2025-12-04T09:45:51.8005457Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8005532Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8005575Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8005632Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8005745Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8005938Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8005975Z graph_break [] 2025-12-04T09:45:51.8006051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8006092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8006148Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8006244Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8006454Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8006490Z graph_break [] 2025-12-04T09:45:51.8006568Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8006611Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8006670Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8006770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8006963Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8007003Z graph_break [] 2025-12-04T09:45:51.8007077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8007121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8007176Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8007275Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8007468Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8007505Z graph_break [] 2025-12-04T09:45:51.8007578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8007621Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8007674Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8007771Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8007961Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8007999Z graph_break [] 2025-12-04T09:45:51.8008083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8008128Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8008185Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8008284Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8008473Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8008527Z graph_break [] 2025-12-04T09:45:51.8008600Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8008643Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8008697Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8008794Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8008987Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8009039Z graph_break [] 2025-12-04T09:45:51.8009114Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8009155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8009212Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8009307Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8009496Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8009532Z graph_break [] 2025-12-04T09:45:51.8009604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8009656Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8009712Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8009808Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8009999Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8010035Z graph_break [] 2025-12-04T09:45:51.8010111Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8010152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8010208Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8010302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8010495Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8010531Z graph_break [] 2025-12-04T09:45:51.8010608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8010650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8010707Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8010802Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8010997Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8011034Z graph_break [] 2025-12-04T09:45:51.8011107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8011148Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8011207Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8011314Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8011503Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8011542Z graph_break [] 2025-12-04T09:45:51.8011614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8011656Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8011723Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8011819Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8012007Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8012047Z graph_break [] 2025-12-04T09:45:51.8012121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8012163Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8012217Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8012323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8012512Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8012551Z graph_break [] 2025-12-04T09:45:51.8012640Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8012687Z Traceback (most recent call last): 2025-12-04T09:45:51.8012839Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8012908Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8013112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8013175Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8013273Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8013337Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8013442Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8013499Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8013552Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8013554Z 2025-12-04T09:45:51.8013629Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8013779Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8013782Z 2025-12-04T09:45:51.8013870Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8013945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8013988Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8014045Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8014142Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8014332Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8014371Z graph_break [] 2025-12-04T09:45:51.8014446Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8014487Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8014544Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8014662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8014855Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8014891Z graph_break [] 2025-12-04T09:45:51.8014967Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8015007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8015063Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8015193Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8015386Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8015424Z graph_break [] 2025-12-04T09:45:51.8015499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8015543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8015597Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8015711Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8015901Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8015941Z graph_break [] 2025-12-04T09:45:51.8016015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8016059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8016113Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8016209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8016413Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8016451Z graph_break [] 2025-12-04T09:45:51.8016524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8016567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8016620Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8016719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8016910Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8016949Z graph_break [] 2025-12-04T09:45:51.8017021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8017064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8017119Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8017220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8017410Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8017447Z graph_break [] 2025-12-04T09:45:51.8017519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8017562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8017618Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8017713Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8017903Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8017940Z graph_break [] 2025-12-04T09:45:51.8018025Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8018067Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8018124Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8018219Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8018407Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8018458Z graph_break [] 2025-12-04T09:45:51.8018533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8018573Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8018631Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8018727Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8018923Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8018970Z graph_break [] 2025-12-04T09:45:51.8019045Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8019086Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8019141Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8019236Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8019430Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8019467Z graph_break [] 2025-12-04T09:45:51.8019541Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8019593Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8019650Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8019745Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8019935Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8019972Z graph_break [] 2025-12-04T09:45:51.8020047Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8020090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8020143Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8020240Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8020428Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8020467Z graph_break [] 2025-12-04T09:45:51.8020539Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8020585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8020638Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8020735Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8020930Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8020967Z graph_break [] 2025-12-04T09:45:51.8021039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8021083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8021138Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8021245Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8021439Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8021477Z graph_break [] 2025-12-04T09:45:51.8021565Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8021614Z Traceback (most recent call last): 2025-12-04T09:45:51.8021779Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8021836Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8021999Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8022061Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8022159Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8022221Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8022334Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8022389Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8022442Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8022444Z 2025-12-04T09:45:51.8022517Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8022668Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8022672Z 2025-12-04T09:45:51.8022758Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8022833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8022885Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8022979Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8023080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8023275Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8023311Z graph_break [] 2025-12-04T09:45:51.8023386Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8023430Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8023486Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8023582Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8023773Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8023811Z graph_break [] 2025-12-04T09:45:51.8023886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8023928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8023986Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8024082Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8024270Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8024309Z graph_break [] 2025-12-04T09:45:51.8024381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8024424Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8024477Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8024593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8024782Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8024820Z graph_break [] 2025-12-04T09:45:51.8024893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8024937Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8025008Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8025105Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8025293Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8025332Z graph_break [] 2025-12-04T09:45:51.8025406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8025451Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8025505Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8025620Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8025809Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8025847Z graph_break [] 2025-12-04T09:45:51.8025919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8025961Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8026015Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8026112Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8026315Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8026351Z graph_break [] 2025-12-04T09:45:51.8026425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8026466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8026522Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8026617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8026810Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8026846Z graph_break [] 2025-12-04T09:45:51.8026921Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8026962Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8027018Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8027113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8027304Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8027340Z graph_break [] 2025-12-04T09:45:51.8027414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8027456Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8027511Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8027606Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8027797Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8027834Z graph_break [] 2025-12-04T09:45:51.8027929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8027971Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8028029Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8028124Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8028319Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8028377Z graph_break [] 2025-12-04T09:45:51.8028451Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8028496Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8028552Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8028651Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8028844Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8028896Z graph_break [] 2025-12-04T09:45:51.8028971Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8029016Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8029071Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8029173Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8029363Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8029404Z graph_break [] 2025-12-04T09:45:51.8029479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8029540Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8029595Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8029695Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8029885Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8029926Z graph_break [] 2025-12-04T09:45:51.8030000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8030047Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8030103Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8030202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8030397Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8030439Z graph_break [] 2025-12-04T09:45:51.8030515Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8030559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8030616Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8030715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8030914Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8030951Z graph_break [] 2025-12-04T09:45:51.8031046Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8031093Z Traceback (most recent call last): 2025-12-04T09:45:51.8031261Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8031319Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8031485Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8031547Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8031648Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8031711Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8031831Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8031886Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8031942Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8031944Z 2025-12-04T09:45:51.8032020Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8032177Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8032180Z 2025-12-04T09:45:51.8032267Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8032354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8032398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8032457Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8032556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8032748Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8032789Z graph_break [] 2025-12-04T09:45:51.8032863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8032920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8033021Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8033120Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8033316Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8033356Z graph_break [] 2025-12-04T09:45:51.8033430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8033475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8033532Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8033630Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8033823Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8033866Z graph_break [] 2025-12-04T09:45:51.8033940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8033986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8034041Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8034139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8034327Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8034368Z graph_break [] 2025-12-04T09:45:51.8034441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8034486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8034540Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8034655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8034849Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8034887Z graph_break [] 2025-12-04T09:45:51.8034966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8035009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8035082Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8035179Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8035371Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8035408Z graph_break [] 2025-12-04T09:45:51.8035487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8035529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8035589Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8035699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8035893Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8035932Z graph_break [] 2025-12-04T09:45:51.8036010Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8036052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8036112Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8036208Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8036418Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8036456Z graph_break [] 2025-12-04T09:45:51.8036533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8036575Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8036633Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8036729Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8036924Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8036964Z graph_break [] 2025-12-04T09:45:51.8037041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8037087Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8037142Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8037243Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8037434Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8037475Z graph_break [] 2025-12-04T09:45:51.8037549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8037598Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8037655Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8037753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8037943Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8037985Z graph_break [] 2025-12-04T09:45:51.8038068Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8038116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8038172Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8038269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8038458Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8038513Z graph_break [] 2025-12-04T09:45:51.8038586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8038632Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8038687Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8038786Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8038977Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8039029Z graph_break [] 2025-12-04T09:45:51.8039107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8039153Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8039211Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8039308Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8039500Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8039537Z graph_break [] 2025-12-04T09:45:51.8039614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8039679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8039739Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8039835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8040029Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8040067Z graph_break [] 2025-12-04T09:45:51.8040144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8040188Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8040246Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8040342Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8040538Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8040577Z graph_break [] 2025-12-04T09:45:51.8040652Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8040694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8040752Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8040847Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8041043Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8041082Z graph_break [] 2025-12-04T09:45:51.8041175Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8041221Z Traceback (most recent call last): 2025-12-04T09:45:51.8041391Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8041450Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8041621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8041686Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8041783Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8041858Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8041966Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8042024Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8042076Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8042078Z 2025-12-04T09:45:51.8042159Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8042311Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8042314Z 2025-12-04T09:45:51.8042402Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8042486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8042533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8042589Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8042690Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8042883Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8042922Z graph_break [] 2025-12-04T09:45:51.8043043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8043111Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8043171Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8043276Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8043474Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8043512Z graph_break [] 2025-12-04T09:45:51.8043588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8043631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8043689Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8043785Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8043975Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8044015Z graph_break [] 2025-12-04T09:45:51.8044091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8044134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8044192Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8044287Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8044479Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8044518Z graph_break [] 2025-12-04T09:45:51.8044595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8044637Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8044694Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8044807Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8045002Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8045040Z graph_break [] 2025-12-04T09:45:51.8045116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8045159Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8045235Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8045336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8045528Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8045569Z graph_break [] 2025-12-04T09:45:51.8045648Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8045692Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8045747Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8045861Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8046053Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8046095Z graph_break [] 2025-12-04T09:45:51.8046168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8046214Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8046268Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8046368Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8046571Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8046613Z graph_break [] 2025-12-04T09:45:51.8046690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8046735Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8046790Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8046890Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8047081Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8047123Z graph_break [] 2025-12-04T09:45:51.8047199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8047245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8047303Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8047405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8047594Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8047635Z graph_break [] 2025-12-04T09:45:51.8047708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8047752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8047807Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8047905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8048096Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8048135Z graph_break [] 2025-12-04T09:45:51.8048224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8048268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8048325Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8048422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8048612Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8048662Z graph_break [] 2025-12-04T09:45:51.8048739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8048782Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8048840Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8048935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8049130Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8049183Z graph_break [] 2025-12-04T09:45:51.8049259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8049301Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8049358Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8049456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8049649Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8049685Z graph_break [] 2025-12-04T09:45:51.8049758Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8049811Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8049867Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8049961Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8050153Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8050190Z graph_break [] 2025-12-04T09:45:51.8050264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8050306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8050360Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8050456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8050644Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8050683Z graph_break [] 2025-12-04T09:45:51.8050755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8050798Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8050851Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8050949Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8051142Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8051180Z graph_break [] 2025-12-04T09:45:51.8051252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8051296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8051352Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8051461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8051650Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8051688Z graph_break [] 2025-12-04T09:45:51.8051777Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8051824Z Traceback (most recent call last): 2025-12-04T09:45:51.8051990Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8052047Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8052210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8052273Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8052371Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8052433Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8052558Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8052612Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8052666Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8052669Z 2025-12-04T09:45:51.8052746Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8052897Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8052900Z 2025-12-04T09:45:51.8053033Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8053107Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8053168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8053226Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8053322Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8053515Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8053551Z graph_break [] 2025-12-04T09:45:51.8053626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8053669Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8053724Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8053820Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8054012Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8054049Z graph_break [] 2025-12-04T09:45:51.8054123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8054168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8054224Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8054321Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8054509Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8054548Z graph_break [] 2025-12-04T09:45:51.8054620Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8054662Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8054716Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8054829Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8055019Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8055058Z graph_break [] 2025-12-04T09:45:51.8055130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8055172Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8055245Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8055346Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8055538Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8055577Z graph_break [] 2025-12-04T09:45:51.8055650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8055693Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8055747Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8055858Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8056046Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8056085Z graph_break [] 2025-12-04T09:45:51.8056157Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8056200Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8056253Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8056349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8056551Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8056588Z graph_break [] 2025-12-04T09:45:51.8056662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8056703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8056761Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8056856Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8057048Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8057083Z graph_break [] 2025-12-04T09:45:51.8057159Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8057205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8057260Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8057356Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8057555Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8057593Z graph_break [] 2025-12-04T09:45:51.8057669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8057713Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8057771Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8057867Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8058059Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8058098Z graph_break [] 2025-12-04T09:45:51.8058190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8058233Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8058297Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8058394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8058586Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8058640Z graph_break [] 2025-12-04T09:45:51.8058714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8058760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8058815Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8058916Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8059106Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8059159Z graph_break [] 2025-12-04T09:45:51.8059235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8059282Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8059337Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8059441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8059632Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8059673Z graph_break [] 2025-12-04T09:45:51.8059746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8059804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8059858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8059959Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8060148Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8060191Z graph_break [] 2025-12-04T09:45:51.8060266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8060311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8060367Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8060466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8060658Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8060701Z graph_break [] 2025-12-04T09:45:51.8060774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8060820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8060881Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8060978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8061174Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8061212Z graph_break [] 2025-12-04T09:45:51.8061289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8061332Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8061393Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8061502Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8061699Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8061737Z graph_break [] 2025-12-04T09:45:51.8061814Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8061855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8061927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8062028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8062221Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8062260Z graph_break [] 2025-12-04T09:45:51.8062339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8062381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8062439Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8062544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8062737Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8062774Z graph_break [] 2025-12-04T09:45:51.8062864Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8062909Z Traceback (most recent call last): 2025-12-04T09:45:51.8063107Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8063182Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8063348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8063410Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8063508Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8063572Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8063675Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8063733Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8063784Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8063786Z 2025-12-04T09:45:51.8063862Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8064009Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8064012Z 2025-12-04T09:45:51.8064100Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8064172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8064215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8064272Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8064371Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8064561Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8064603Z graph_break [] 2025-12-04T09:45:51.8064675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8064720Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8064776Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8064890Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8065085Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8065121Z graph_break [] 2025-12-04T09:45:51.8065195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8065238Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8065319Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8065415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8065606Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8065644Z graph_break [] 2025-12-04T09:45:51.8065721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8065762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8065820Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8065937Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8066128Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8066165Z graph_break [] 2025-12-04T09:45:51.8066238Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8066279Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8066334Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8066429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8066632Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8066668Z graph_break [] 2025-12-04T09:45:51.8066743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8066785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8066840Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8066935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8067132Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8067169Z graph_break [] 2025-12-04T09:45:51.8067244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8067288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8067343Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8067439Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8067628Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8067668Z graph_break [] 2025-12-04T09:45:51.8067740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8067784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8067838Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8067935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8068122Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8068161Z graph_break [] 2025-12-04T09:45:51.8068243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8068289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8068346Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8068444Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8068633Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8068683Z graph_break [] 2025-12-04T09:45:51.8068756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8068799Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8068854Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8068955Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8069148Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8069196Z graph_break [] 2025-12-04T09:45:51.8069269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8069312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8069366Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8069463Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8069653Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8069689Z graph_break [] 2025-12-04T09:45:51.8069764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8069817Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8069874Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8069969Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8070160Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8070196Z graph_break [] 2025-12-04T09:45:51.8070272Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8070313Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8070369Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8070464Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8070655Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8070693Z graph_break [] 2025-12-04T09:45:51.8070767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8070808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8070863Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8070961Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8071160Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8071196Z graph_break [] 2025-12-04T09:45:51.8071270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8071312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8071368Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8071477Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8071670Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8071709Z graph_break [] 2025-12-04T09:45:51.8071782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8071825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8071891Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8071990Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8072180Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8072220Z graph_break [] 2025-12-04T09:45:51.8072294Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8072338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8072395Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8072504Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8072693Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8072732Z graph_break [] 2025-12-04T09:45:51.8072806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8072850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8072904Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8073042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8073256Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8073294Z graph_break [] 2025-12-04T09:45:51.8073367Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8073410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8073464Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8073561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8073751Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8073790Z graph_break [] 2025-12-04T09:45:51.8073866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8073908Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8073965Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8074059Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8074249Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8074285Z graph_break [] 2025-12-04T09:45:51.8074375Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8074422Z Traceback (most recent call last): 2025-12-04T09:45:51.8074578Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8074633Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8074797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8074873Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8074973Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8075036Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8075141Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8075197Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8075250Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8075266Z 2025-12-04T09:45:51.8075343Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8075495Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8075497Z 2025-12-04T09:45:51.8075582Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8075660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8075701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8075761Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8075874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8076064Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8076107Z graph_break [] 2025-12-04T09:45:51.8076180Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8076223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8076278Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8076376Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8076577Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8076616Z graph_break [] 2025-12-04T09:45:51.8076689Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8076732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8076787Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8076886Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8077077Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8077118Z graph_break [] 2025-12-04T09:45:51.8077193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8077236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8077290Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8077388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8077577Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8077615Z graph_break [] 2025-12-04T09:45:51.8077687Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8077731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8077785Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8077882Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8078072Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8078109Z graph_break [] 2025-12-04T09:45:51.8078206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8078248Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8078304Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8078399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8078592Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8078641Z graph_break [] 2025-12-04T09:45:51.8078714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8078755Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8078810Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8078906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8079101Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8079151Z graph_break [] 2025-12-04T09:45:51.8079226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8079267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8079323Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8079420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8079610Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8079647Z graph_break [] 2025-12-04T09:45:51.8079722Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8079776Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8079836Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8079933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8080122Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8080160Z graph_break [] 2025-12-04T09:45:51.8080233Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8080276Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8080329Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8080428Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8080617Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8080656Z graph_break [] 2025-12-04T09:45:51.8080727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8080773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8080826Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8080925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8081115Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8081155Z graph_break [] 2025-12-04T09:45:51.8081229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8081272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8081328Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8081440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8081630Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8081668Z graph_break [] 2025-12-04T09:45:51.8081740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8081784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8081850Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8081948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8082137Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8082178Z graph_break [] 2025-12-04T09:45:51.8082251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8082293Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8082347Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8082458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8082650Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8082689Z graph_break [] 2025-12-04T09:45:51.8082764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8082806Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8082861Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8082999Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8083216Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8083253Z graph_break [] 2025-12-04T09:45:51.8083328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8083369Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8083424Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8083523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8083714Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8083751Z graph_break [] 2025-12-04T09:45:51.8083824Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8083867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8083926Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8084021Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8084212Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8084250Z graph_break [] 2025-12-04T09:45:51.8084324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8084367Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8084423Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8084519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8084707Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8084762Z graph_break [] 2025-12-04T09:45:51.8084836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8084879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8084933Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8085030Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8085220Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8085272Z graph_break [] 2025-12-04T09:45:51.8085347Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8085390Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8085444Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8085544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8085751Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8085790Z graph_break [] 2025-12-04T09:45:51.8085862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8085905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8085958Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8086056Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8086244Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8086289Z graph_break [] 2025-12-04T09:45:51.8086390Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8086438Z Traceback (most recent call last): 2025-12-04T09:45:51.8086591Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8086648Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8086814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8086876Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8086974Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8087036Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8087144Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8087200Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8087253Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8087256Z 2025-12-04T09:45:51.8087333Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8087489Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8087491Z 2025-12-04T09:45:51.8087576Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8087650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8087692Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8087748Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8087846Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8088038Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8088074Z graph_break [] 2025-12-04T09:45:51.8088158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8088200Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8088257Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8088352Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8088541Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8088589Z graph_break [] 2025-12-04T09:45:51.8088665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8088707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8088761Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8088862Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8089056Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8089104Z graph_break [] 2025-12-04T09:45:51.8089177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8089219Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8089273Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8089370Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8089557Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8089594Z graph_break [] 2025-12-04T09:45:51.8089666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8089729Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8089783Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8089881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8090070Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8090108Z graph_break [] 2025-12-04T09:45:51.8090181Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8090225Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8090280Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8090375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8090563Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8090602Z graph_break [] 2025-12-04T09:45:51.8090675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8090719Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8090774Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8090871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8091065Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8091101Z graph_break [] 2025-12-04T09:45:51.8091175Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8091216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8091274Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8091379Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8091570Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8091607Z graph_break [] 2025-12-04T09:45:51.8091682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8091722Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8091792Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8091887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8092081Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8092118Z graph_break [] 2025-12-04T09:45:51.8092193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8092234Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8092290Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8092395Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8092585Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8092623Z graph_break [] 2025-12-04T09:45:51.8092696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8092737Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8092792Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8092887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8093133Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8093171Z graph_break [] 2025-12-04T09:45:51.8093244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8093288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8093346Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8093443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8093633Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8093670Z graph_break [] 2025-12-04T09:45:51.8093743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8093786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8093840Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8093940Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8094133Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8094170Z graph_break [] 2025-12-04T09:45:51.8094242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8094287Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8094341Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8094438Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8094625Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8094684Z graph_break [] 2025-12-04T09:45:51.8094760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8094803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8094857Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8094953Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8095140Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8095193Z graph_break [] 2025-12-04T09:45:51.8095266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8095307Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8095362Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8095458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8095662Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8095699Z graph_break [] 2025-12-04T09:45:51.8095773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8095813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8095870Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8095964Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8096155Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8096191Z graph_break [] 2025-12-04T09:45:51.8096281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8096322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8096377Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8096473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8096664Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8096701Z graph_break [] 2025-12-04T09:45:51.8096775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8096816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8096871Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8096967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8097158Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8097194Z graph_break [] 2025-12-04T09:45:51.8097269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8097310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8097367Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8097463Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8097652Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8097690Z graph_break [] 2025-12-04T09:45:51.8097762Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8097804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8097858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8097966Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8098155Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8098193Z graph_break [] 2025-12-04T09:45:51.8098264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8098320Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8098374Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8098469Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8098659Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8098698Z graph_break [] 2025-12-04T09:45:51.8098791Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8098838Z Traceback (most recent call last): 2025-12-04T09:45:51.8098999Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8099057Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8099218Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8099282Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8099378Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8099442Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8099545Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8099615Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8099667Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8099669Z 2025-12-04T09:45:51.8099745Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8099897Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8099899Z 2025-12-04T09:45:51.8099984Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8100061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8100103Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8100159Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8100256Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8100448Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8100485Z graph_break [] 2025-12-04T09:45:51.8100559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8100602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8100662Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8100762Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8100957Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8100994Z graph_break [] 2025-12-04T09:45:51.8101071Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8101113Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8101170Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8101275Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8101469Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8101508Z graph_break [] 2025-12-04T09:45:51.8101580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8101624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8101690Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8101789Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8101977Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8102018Z graph_break [] 2025-12-04T09:45:51.8102091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8102134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8102187Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8102307Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8102495Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8102538Z graph_break [] 2025-12-04T09:45:51.8102610Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8102654Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8102710Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8102812Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8103049Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8103088Z graph_break [] 2025-12-04T09:45:51.8103164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8103207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8103260Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8103358Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8103549Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8103589Z graph_break [] 2025-12-04T09:45:51.8103660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8103704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8103758Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8103855Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8104046Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8104082Z graph_break [] 2025-12-04T09:45:51.8104158Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8104201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8104256Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8104351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8104541Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8104600Z graph_break [] 2025-12-04T09:45:51.8104676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8104717Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8104773Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8104874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8105066Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8105116Z graph_break [] 2025-12-04T09:45:51.8105190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8105233Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8105288Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8105386Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8105593Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8105630Z graph_break [] 2025-12-04T09:45:51.8105704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8105745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8105802Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8105897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8106087Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8106125Z graph_break [] 2025-12-04T09:45:51.8106214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8106258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8106312Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8106409Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8106598Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8106637Z graph_break [] 2025-12-04T09:45:51.8106710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8106753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8106809Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8106906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8107097Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8107134Z graph_break [] 2025-12-04T09:45:51.8107207Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8107250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8107303Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8107400Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8107592Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8107632Z graph_break [] 2025-12-04T09:45:51.8107705Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8107750Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8107804Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8107911Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8108101Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8108140Z graph_break [] 2025-12-04T09:45:51.8108217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8108271Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8108328Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8108422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8108615Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8108652Z graph_break [] 2025-12-04T09:45:51.8108727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8108768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8108834Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8108930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8109119Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8109157Z graph_break [] 2025-12-04T09:45:51.8109230Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8109271Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8109326Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8109421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8109627Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8109664Z graph_break [] 2025-12-04T09:45:51.8109739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8109780Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8109836Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8109931Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8110118Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8110154Z graph_break [] 2025-12-04T09:45:51.8110228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8110272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8110327Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8110424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8110619Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8110659Z graph_break [] 2025-12-04T09:45:51.8110733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8110775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8110832Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8110928Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8111131Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8111173Z graph_break [] 2025-12-04T09:45:51.8111246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8111289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8111343Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8111440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8111641Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8111679Z graph_break [] 2025-12-04T09:45:51.8111767Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8111817Z Traceback (most recent call last): 2025-12-04T09:45:51.8111971Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8112030Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8112207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8112270Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8112369Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8112433Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8112538Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8112592Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8112644Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8112646Z 2025-12-04T09:45:51.8112724Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8112887Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8112889Z 2025-12-04T09:45:51.8113008Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8113085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8113126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8113183Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8113279Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8113473Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8113509Z graph_break [] 2025-12-04T09:45:51.8113585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8113627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8113685Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8113788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8113980Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8114016Z graph_break [] 2025-12-04T09:45:51.8114091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8114133Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8114192Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8114286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8114474Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8114548Z graph_break [] 2025-12-04T09:45:51.8114622Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8114664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8114718Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8114819Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8115011Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8118176Z graph_break [] 2025-12-04T09:45:51.8118255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8118298Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8118352Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8118454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8118673Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8118711Z graph_break [] 2025-12-04T09:45:51.8118783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8118826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8118882Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8118979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8119166Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8119203Z graph_break [] 2025-12-04T09:45:51.8119294Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8119337Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8119392Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8119492Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8119681Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8119720Z graph_break [] 2025-12-04T09:45:51.8119793Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8119836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8119889Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8119985Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8120176Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8120213Z graph_break [] 2025-12-04T09:45:51.8120288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8120329Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8120383Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8120478Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8120668Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8120704Z graph_break [] 2025-12-04T09:45:51.8120780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8120824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8120878Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8120983Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8121175Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8121212Z graph_break [] 2025-12-04T09:45:51.8121286Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8121342Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8121397Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8121491Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8121685Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8121723Z graph_break [] 2025-12-04T09:45:51.8121798Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8121839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8121906Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8122002Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8122192Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8122232Z graph_break [] 2025-12-04T09:45:51.8122303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8122345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8122399Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8122495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8122696Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8122735Z graph_break [] 2025-12-04T09:45:51.8122808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8122849Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8122902Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8123036Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8123224Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8123262Z graph_break [] 2025-12-04T09:45:51.8123334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8123379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8123435Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8123532Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8123720Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8123758Z graph_break [] 2025-12-04T09:45:51.8123831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8123874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8123928Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8124024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8124229Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8124269Z graph_break [] 2025-12-04T09:45:51.8124342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8124384Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8124439Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8124533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8124738Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8124775Z graph_break [] 2025-12-04T09:45:51.8124851Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8124892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8124948Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8125045Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8125257Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8125294Z graph_break [] 2025-12-04T09:45:51.8125368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8125408Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8125464Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8125561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8125751Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8125804Z graph_break [] 2025-12-04T09:45:51.8125879Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8125919Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8125976Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8126071Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8126263Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8126300Z graph_break [] 2025-12-04T09:45:51.8126373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8126414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8126469Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8126565Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8126755Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8126793Z graph_break [] 2025-12-04T09:45:51.8126866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8126908Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8126962Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8127063Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8127253Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8127291Z graph_break [] 2025-12-04T09:45:51.8127362Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8127406Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8127473Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8127570Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8127758Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8127796Z graph_break [] 2025-12-04T09:45:51.8127868Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8127923Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8127977Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8128073Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8128265Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8128305Z graph_break [] 2025-12-04T09:45:51.8128394Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8128442Z Traceback (most recent call last): 2025-12-04T09:45:51.8128607Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8128665Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8128832Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8128894Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8128992Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8129054Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8129160Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8129228Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8129280Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8129282Z 2025-12-04T09:45:51.8129358Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8129510Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8129514Z 2025-12-04T09:45:51.8129599Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8129674Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8129717Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8129773Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8129870Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8130062Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8130098Z graph_break [] 2025-12-04T09:45:51.8130172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8130213Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8130268Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8130362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8130554Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8130591Z graph_break [] 2025-12-04T09:45:51.8130663Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8130708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8130762Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8130884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8131077Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8131115Z graph_break [] 2025-12-04T09:45:51.8131187Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8131242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8131295Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8131390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8131579Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8131618Z graph_break [] 2025-12-04T09:45:51.8131690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8131733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8131796Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8131892Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8132079Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8132119Z graph_break [] 2025-12-04T09:45:51.8132190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8132232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8132285Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8132394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8132588Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8132627Z graph_break [] 2025-12-04T09:45:51.8132699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8132742Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8132800Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8132895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8133141Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8133177Z graph_break [] 2025-12-04T09:45:51.8133250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8133293Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8133347Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8133443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8133632Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8133668Z graph_break [] 2025-12-04T09:45:51.8133742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8133783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8133837Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8133931Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8134148Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8134186Z graph_break [] 2025-12-04T09:45:51.8134262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8134304Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8134360Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8134454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8134658Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8134695Z graph_break [] 2025-12-04T09:45:51.8134768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8134809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8134865Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8134963Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8135187Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8135226Z graph_break [] 2025-12-04T09:45:51.8135298Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8135341Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8135399Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8135500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8135696Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8135750Z graph_break [] 2025-12-04T09:45:51.8135825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8135868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8135922Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8136019Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8136208Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8136249Z graph_break [] 2025-12-04T09:45:51.8136320Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8136363Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8136417Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8136513Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8136705Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8136743Z graph_break [] 2025-12-04T09:45:51.8136816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8136859Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8136914Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8137012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8137207Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8137243Z graph_break [] 2025-12-04T09:45:51.8137316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8137358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8137423Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8137518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8137707Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8137743Z graph_break [] 2025-12-04T09:45:51.8137817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8137870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8137926Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8138020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8138209Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8138247Z graph_break [] 2025-12-04T09:45:51.8138323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8138364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8138431Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8138526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8138717Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8138755Z graph_break [] 2025-12-04T09:45:51.8138830Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8138871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8138927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8139041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8139232Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8139270Z graph_break [] 2025-12-04T09:45:51.8139343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8139388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8139441Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8139539Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8139729Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8139768Z graph_break [] 2025-12-04T09:45:51.8139841Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8139885Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8139940Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8140038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8140226Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8140265Z graph_break [] 2025-12-04T09:45:51.8140337Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8140380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8140434Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8140529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8140730Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8140769Z graph_break [] 2025-12-04T09:45:51.8140843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8140886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8140942Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8141041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8141242Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8141281Z graph_break [] 2025-12-04T09:45:51.8141353Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8141397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8141451Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8141548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8141749Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8141787Z graph_break [] 2025-12-04T09:45:51.8141860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8141902Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8141957Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8142051Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8142239Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8142299Z graph_break [] 2025-12-04T09:45:51.8142393Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8142438Z Traceback (most recent call last): 2025-12-04T09:45:51.8142594Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8142650Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8142817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8142879Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8143030Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8143093Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8143199Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8143254Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8143309Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8143311Z 2025-12-04T09:45:51.8143387Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8143540Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8143542Z 2025-12-04T09:45:51.8143630Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8143706Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8143749Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8143804Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8143903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8144116Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8144156Z graph_break [] 2025-12-04T09:45:51.8144228Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8144271Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8144325Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8144422Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8144634Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8144671Z graph_break [] 2025-12-04T09:45:51.8144744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8144786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8144842Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8144940Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8145156Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8145195Z graph_break [] 2025-12-04T09:45:51.8145267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8145309Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8145364Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8145461Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8145649Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8145702Z graph_break [] 2025-12-04T09:45:51.8145776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8145817Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8145872Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8145971Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8146166Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8146203Z graph_break [] 2025-12-04T09:45:51.8146276Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8146317Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8146374Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8146469Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8146661Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8146697Z graph_break [] 2025-12-04T09:45:51.8146779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8146822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8146881Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8146980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8147180Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8147218Z graph_break [] 2025-12-04T09:45:51.8147294Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8147338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8147408Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8147506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8147699Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8147736Z graph_break [] 2025-12-04T09:45:51.8147813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8147869Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8147926Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8148025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8148213Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8148257Z graph_break [] 2025-12-04T09:45:51.8148330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8148376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8148444Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8148543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8148732Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8148774Z graph_break [] 2025-12-04T09:45:51.8148848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8148894Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8148950Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8149066Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8149263Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8149304Z graph_break [] 2025-12-04T09:45:51.8149377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8149422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8149476Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8149575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8149763Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8149803Z graph_break [] 2025-12-04T09:45:51.8149877Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8149923Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8149978Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8150077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8150270Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8150308Z graph_break [] 2025-12-04T09:45:51.8150384Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8150427Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8150487Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8150583Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8150788Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8150828Z graph_break [] 2025-12-04T09:45:51.8150906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8150949Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8151007Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8151104Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8151310Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8151347Z graph_break [] 2025-12-04T09:45:51.8151422Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8151464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8151522Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8151619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8151824Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8151862Z graph_break [] 2025-12-04T09:45:51.8151937Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8151980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8152036Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8152131Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8152320Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8152371Z graph_break [] 2025-12-04T09:45:51.8152443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8152486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8152544Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8152640Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8152827Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8152866Z graph_break [] 2025-12-04T09:45:51.8152984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8153027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8153080Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8153177Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8153370Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8153407Z graph_break [] 2025-12-04T09:45:51.8153480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8153522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8153576Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8153673Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8153860Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8153897Z graph_break [] 2025-12-04T09:45:51.8153972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8154017Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8154092Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8154189Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8154377Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8154415Z graph_break [] 2025-12-04T09:45:51.8154503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8154546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8154602Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8154697Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8154891Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8154928Z graph_break [] 2025-12-04T09:45:51.8155001Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8155074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8155130Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8155225Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8155418Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8155455Z graph_break [] 2025-12-04T09:45:51.8155527Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8155568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8155623Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8155735Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8155927Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8155964Z graph_break [] 2025-12-04T09:45:51.8156037Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8156078Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8156134Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8156229Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8156419Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8156456Z graph_break [] 2025-12-04T09:45:51.8156531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8156572Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8156628Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8156726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8156919Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8156958Z graph_break [] 2025-12-04T09:45:51.8157048Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8157095Z Traceback (most recent call last): 2025-12-04T09:45:51.8157248Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8157306Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8157486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8157549Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8157648Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8157712Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8157817Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8157886Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8157938Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8157940Z 2025-12-04T09:45:51.8158019Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8158172Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8158175Z 2025-12-04T09:45:51.8158265Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8158337Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8158381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8158445Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8158543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8158733Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8158771Z graph_break [] 2025-12-04T09:45:51.8158844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8158886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8158942Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8159051Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8159243Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8159280Z graph_break [] 2025-12-04T09:45:51.8159358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8159399Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8159454Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8159549Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8159737Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8159773Z graph_break [] 2025-12-04T09:45:51.8159847Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8159889Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8159944Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8160040Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8160230Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8160267Z graph_break [] 2025-12-04T09:45:51.8160340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8160381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8160436Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8160531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8160735Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8160773Z graph_break [] 2025-12-04T09:45:51.8160846Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8160888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8160942Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8161044Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8161250Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8161288Z graph_break [] 2025-12-04T09:45:51.8161361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8161403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8161460Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8161557Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8161757Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8161795Z graph_break [] 2025-12-04T09:45:51.8161870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8161913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8161969Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8162065Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8162254Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8162304Z graph_break [] 2025-12-04T09:45:51.8162377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8162419Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8162474Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8162571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8162760Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8162799Z graph_break [] 2025-12-04T09:45:51.8162872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8162914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8163010Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8163106Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8163298Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8163338Z graph_break [] 2025-12-04T09:45:51.8163412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8163453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8163508Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8163603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8163791Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8163827Z graph_break [] 2025-12-04T09:45:51.8163900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8163942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8164019Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8164114Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8164303Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8164340Z graph_break [] 2025-12-04T09:45:51.8164431Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8164472Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8164528Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8164623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8164814Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8164851Z graph_break [] 2025-12-04T09:45:51.8164925Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8164983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8165040Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8165135Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8165326Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8165365Z graph_break [] 2025-12-04T09:45:51.8165442Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8165484Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8165538Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8165653Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8165843Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8165880Z graph_break [] 2025-12-04T09:45:51.8165952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8165995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8166050Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8166147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8166335Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8166375Z graph_break [] 2025-12-04T09:45:51.8166448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8166490Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8166544Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8166642Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8166835Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8166874Z graph_break [] 2025-12-04T09:45:51.8166946Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8166988Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8167042Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8167138Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8167339Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8167377Z graph_break [] 2025-12-04T09:45:51.8167452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8167493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8167548Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8167643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8167857Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8167894Z graph_break [] 2025-12-04T09:45:51.8167968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8168010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8168068Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8168163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8168367Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8168404Z graph_break [] 2025-12-04T09:45:51.8168478Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8168520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8168576Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8168672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8168865Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8168915Z graph_break [] 2025-12-04T09:45:51.8168990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8169031Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8169087Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8169182Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8169371Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8169408Z graph_break [] 2025-12-04T09:45:51.8169484Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8169524Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8169580Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8169676Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8169864Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8169903Z graph_break [] 2025-12-04T09:45:51.8169976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8170018Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8170072Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8170170Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8170357Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8170395Z graph_break [] 2025-12-04T09:45:51.8170468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8170523Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8170578Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8170675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8170870Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8170921Z graph_break [] 2025-12-04T09:45:51.8170993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8171035Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8171089Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8171185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8171377Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8171415Z graph_break [] 2025-12-04T09:45:51.8171487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8171542Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8171597Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8171694Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8171885Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8171921Z graph_break [] 2025-12-04T09:45:51.8172014Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8172060Z Traceback (most recent call last): 2025-12-04T09:45:51.8172240Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8172296Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8172462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8172522Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8172619Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8172682Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8172789Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8172843Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8172895Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8172897Z 2025-12-04T09:45:51.8173011Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8173163Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8173165Z 2025-12-04T09:45:51.8173252Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8173329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8173371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8173429Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8173527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8173718Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8173756Z graph_break [] 2025-12-04T09:45:51.8173828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8173900Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8173955Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8174052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8174242Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8174280Z graph_break [] 2025-12-04T09:45:51.8174368Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8174411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8174465Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8174562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8174753Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8174792Z graph_break [] 2025-12-04T09:45:51.8174866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8174922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8174976Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8175073Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8175263Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8175301Z graph_break [] 2025-12-04T09:45:51.8175373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8175415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8175491Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8175591Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8175782Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8175823Z graph_break [] 2025-12-04T09:45:51.8175896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8175941Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8175999Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8176096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8176291Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8176330Z graph_break [] 2025-12-04T09:45:51.8176407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8176450Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8176507Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8176605Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8176801Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8176839Z graph_break [] 2025-12-04T09:45:51.8176916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8176959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8177016Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8177115Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8177318Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8177357Z graph_break [] 2025-12-04T09:45:51.8177434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8177477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8177539Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8177634Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8177837Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8177875Z graph_break [] 2025-12-04T09:45:51.8177951Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8177995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8178052Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8178149Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8178351Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8178393Z graph_break [] 2025-12-04T09:45:51.8178465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8178511Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8178567Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8178665Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8178857Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8178911Z graph_break [] 2025-12-04T09:45:51.8178987Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8179034Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8179090Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8179192Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8179382Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8179427Z graph_break [] 2025-12-04T09:45:51.8179500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8179546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8179602Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8179703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8179892Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8179934Z graph_break [] 2025-12-04T09:45:51.8180007Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8180053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8180108Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8180208Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8180401Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8180439Z graph_break [] 2025-12-04T09:45:51.8180516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8180583Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8180642Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8180740Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8180936Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8180985Z graph_break [] 2025-12-04T09:45:51.8181063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8181104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8181161Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8181257Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8181452Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8181489Z graph_break [] 2025-12-04T09:45:51.8181574Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8181616Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8181673Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8181769Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8181963Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8182002Z graph_break [] 2025-12-04T09:45:51.8182080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8182122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8182197Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8182293Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8182489Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8182527Z graph_break [] 2025-12-04T09:45:51.8182604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8182651Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8182706Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8182808Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8183044Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8183086Z graph_break [] 2025-12-04T09:45:51.8183163Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8183209Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8183265Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8183365Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8183555Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8183596Z graph_break [] 2025-12-04T09:45:51.8183670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8183716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8183772Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8183871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8184081Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8184123Z graph_break [] 2025-12-04T09:45:51.8184198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8184243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8184298Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8184412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8184603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8184645Z graph_break [] 2025-12-04T09:45:51.8184719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8184768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8184824Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8184922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8185137Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8185176Z graph_break [] 2025-12-04T09:45:51.8185255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8185299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8185356Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8185452Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8185644Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8185697Z graph_break [] 2025-12-04T09:45:51.8185773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8185816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8185875Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8185971Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8186162Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8186201Z graph_break [] 2025-12-04T09:45:51.8186278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8186320Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8186381Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8186479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8186675Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8186713Z graph_break [] 2025-12-04T09:45:51.8186788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8186831Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8186892Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8186992Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8187192Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8187234Z graph_break [] 2025-12-04T09:45:51.8187318Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8187364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8187419Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8187519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8187708Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8187761Z graph_break [] 2025-12-04T09:45:51.8187850Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8187898Z Traceback (most recent call last): 2025-12-04T09:45:51.8188054Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8188113Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8188280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8188343Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8188452Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8188518Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8188621Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8188680Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8188733Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8188735Z 2025-12-04T09:45:51.8188813Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8188965Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8188978Z 2025-12-04T09:45:51.8189068Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8189145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8189188Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8189250Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8189349Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8189544Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8189584Z graph_break [] 2025-12-04T09:45:51.8189659Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8189703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8189762Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8189859Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8190050Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8190087Z graph_break [] 2025-12-04T09:45:51.8190169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8190212Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8190271Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8190369Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8190562Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8190600Z graph_break [] 2025-12-04T09:45:51.8190680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8190733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8190791Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8190888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8191088Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8191138Z graph_break [] 2025-12-04T09:45:51.8191213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8191256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8191313Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8191412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8191607Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8191647Z graph_break [] 2025-12-04T09:45:51.8191733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8191778Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8191833Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8191933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8192127Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8192169Z graph_break [] 2025-12-04T09:45:51.8192243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8192288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8192374Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8192474Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8192664Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8192705Z graph_break [] 2025-12-04T09:45:51.8192779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8192825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8192880Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8193018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8193209Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8193251Z graph_break [] 2025-12-04T09:45:51.8193325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8193369Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8193425Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8193525Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8193717Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8193757Z graph_break [] 2025-12-04T09:45:51.8193836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8193879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8193938Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8194035Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8194255Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8194295Z graph_break [] 2025-12-04T09:45:51.8194372Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8194414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8194472Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8194586Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8194777Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8194814Z graph_break [] 2025-12-04T09:45:51.8194891Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8194934Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8194993Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8195091Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8195306Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8195343Z graph_break [] 2025-12-04T09:45:51.8195420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8195463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8195520Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8195618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8195810Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8195865Z graph_break [] 2025-12-04T09:45:51.8195938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8195986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8196040Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8196139Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8196330Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8196372Z graph_break [] 2025-12-04T09:45:51.8196445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8196490Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8196545Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8196646Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8196836Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8196873Z graph_break [] 2025-12-04T09:45:51.8196945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8196987Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8197041Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8197138Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8197325Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8197364Z graph_break [] 2025-12-04T09:45:51.8197446Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8197490Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8197546Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8197643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8197830Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8197880Z graph_break [] 2025-12-04T09:45:51.8197952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8197995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8198050Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8198145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8198337Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8198373Z graph_break [] 2025-12-04T09:45:51.8198463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8198504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8198559Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8198654Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8198844Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8198880Z graph_break [] 2025-12-04T09:45:51.8198956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8199010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8199066Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8199162Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8199353Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8199389Z graph_break [] 2025-12-04T09:45:51.8199465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8199507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8199563Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8199658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8199848Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8199885Z graph_break [] 2025-12-04T09:45:51.8199960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8200001Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8200057Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8200152Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8200342Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8200382Z graph_break [] 2025-12-04T09:45:51.8200455Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8200497Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8200550Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8200648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8200846Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8200886Z graph_break [] 2025-12-04T09:45:51.8200959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8201003Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8201057Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8201168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8201354Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8201392Z graph_break [] 2025-12-04T09:45:51.8201465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8201508Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8201564Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8201675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8201863Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8201902Z graph_break [] 2025-12-04T09:45:51.8201976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8202018Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8202071Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8202168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8202357Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8202406Z graph_break [] 2025-12-04T09:45:51.8202480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8202522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8202577Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8202672Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8202865Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8202901Z graph_break [] 2025-12-04T09:45:51.8203023Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8203065Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8203121Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8203217Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8203410Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8203447Z graph_break [] 2025-12-04T09:45:51.8203521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8203561Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8203617Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8203713Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8203902Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8203940Z graph_break [] 2025-12-04T09:45:51.8204051Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8204097Z Traceback (most recent call last): 2025-12-04T09:45:51.8204252Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8204307Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8204476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8204555Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8204660Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8204724Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8204828Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8204885Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8204937Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8204939Z 2025-12-04T09:45:51.8205016Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8205193Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8205195Z 2025-12-04T09:45:51.8205285Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8205358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8205401Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8205456Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8205558Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8205752Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8205806Z graph_break [] 2025-12-04T09:45:51.8205879Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8205922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8205977Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8206074Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8206262Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8206302Z graph_break [] 2025-12-04T09:45:51.8206377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8206423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8206476Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8206574Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8206763Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8206799Z graph_break [] 2025-12-04T09:45:51.8206873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8206913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8206974Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8207070Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8207259Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8207296Z graph_break [] 2025-12-04T09:45:51.8207382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8207423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8207478Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8207573Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8207764Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8207816Z graph_break [] 2025-12-04T09:45:51.8207892Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8207933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8207988Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8208083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8208280Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8208316Z graph_break [] 2025-12-04T09:45:51.8208402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8208444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8208499Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8208593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8208784Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8208825Z graph_break [] 2025-12-04T09:45:51.8208898Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8208953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8209010Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8209107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8209296Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8209334Z graph_break [] 2025-12-04T09:45:51.8209406Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8209449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8209503Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8209599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8209786Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8209828Z graph_break [] 2025-12-04T09:45:51.8209900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8209942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8209996Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8210092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8210281Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8210319Z graph_break [] 2025-12-04T09:45:51.8210394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8210436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8210490Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8210587Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8210792Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8210831Z graph_break [] 2025-12-04T09:45:51.8210905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8210947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8211003Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8211112Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8211302Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8211338Z graph_break [] 2025-12-04T09:45:51.8211413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8211454Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8211510Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8211617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8211809Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8211845Z graph_break [] 2025-12-04T09:45:51.8211920Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8211961Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8212016Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8212111Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8212301Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8212352Z graph_break [] 2025-12-04T09:45:51.8212427Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8212470Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8212526Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8212619Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8212812Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8212848Z graph_break [] 2025-12-04T09:45:51.8212922Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8213005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8213061Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8213158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8213350Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8213388Z graph_break [] 2025-12-04T09:45:51.8213460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8213504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8213559Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8213655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8213846Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8213885Z graph_break [] 2025-12-04T09:45:51.8213980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8214023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8214081Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8214178Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8214365Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8214419Z graph_break [] 2025-12-04T09:45:51.8214491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8214533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8214588Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8214684Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8214876Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8214914Z graph_break [] 2025-12-04T09:45:51.8215004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8215048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8215106Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8215202Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8215394Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8215431Z graph_break [] 2025-12-04T09:45:51.8215505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8215564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8215620Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8215714Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8215904Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8215940Z graph_break [] 2025-12-04T09:45:51.8216015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8216058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8216112Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8216207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8216395Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8216433Z graph_break [] 2025-12-04T09:45:51.8216509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8216550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8216608Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8216703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8216893Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8216930Z graph_break [] 2025-12-04T09:45:51.8217004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8217045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8217100Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8217211Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8217403Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8217441Z graph_break [] 2025-12-04T09:45:51.8217513Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8217555Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8217637Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8217734Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8217926Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8217967Z graph_break [] 2025-12-04T09:45:51.8218042Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8218085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8218140Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8218248Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8218437Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8218476Z graph_break [] 2025-12-04T09:45:51.8218549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8218591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8218644Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8218741Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8218942Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8218980Z graph_break [] 2025-12-04T09:45:51.8219055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8219097Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8219154Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8219253Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8219442Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8219479Z graph_break [] 2025-12-04T09:45:51.8219551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8219594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8219648Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8219744Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8219933Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8219969Z graph_break [] 2025-12-04T09:45:51.8220042Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8220084Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8220139Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8220233Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8220421Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8220459Z graph_break [] 2025-12-04T09:45:51.8220564Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8220610Z Traceback (most recent call last): 2025-12-04T09:45:51.8220766Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8220821Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8220990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8221064Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8221161Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8221222Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8221329Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8221385Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8221438Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8221440Z 2025-12-04T09:45:51.8221514Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8221677Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8221679Z 2025-12-04T09:45:51.8221767Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8221841Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8221884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8221940Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8222038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8222227Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8222277Z graph_break [] 2025-12-04T09:45:51.8222349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8222398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8222459Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8222556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8222752Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8222791Z graph_break [] 2025-12-04T09:45:51.8222863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8222905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8222990Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8223088Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8223277Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8223316Z graph_break [] 2025-12-04T09:45:51.8223388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8223432Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8223486Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8223583Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8223772Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8223811Z graph_break [] 2025-12-04T09:45:51.8223909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8223951Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8224006Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8224100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8224289Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8224345Z graph_break [] 2025-12-04T09:45:51.8224418Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8224459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8224514Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8224612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8224806Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8224842Z graph_break [] 2025-12-04T09:45:51.8224932Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8224973Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8225027Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8225122Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8225316Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8225353Z graph_break [] 2025-12-04T09:45:51.8225427Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8225486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8225543Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8225637Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8225827Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8225863Z graph_break [] 2025-12-04T09:45:51.8225938Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8225981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8226035Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8226132Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8226320Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8226361Z graph_break [] 2025-12-04T09:45:51.8226434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8226477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8226534Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8226631Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8226820Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8226858Z graph_break [] 2025-12-04T09:45:51.8226930Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8226972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8227025Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8227134Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8227323Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8227361Z graph_break [] 2025-12-04T09:45:51.8227434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8227477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8227543Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8227640Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8227828Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8227866Z graph_break [] 2025-12-04T09:45:51.8227944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8227986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8228040Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8228148Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8228339Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8228376Z graph_break [] 2025-12-04T09:45:51.8228450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8228492Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8228547Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8228643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8228848Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8228885Z graph_break [] 2025-12-04T09:45:51.8228959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8229000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8229056Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8229151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8229344Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8229380Z graph_break [] 2025-12-04T09:45:51.8229453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8229495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8229551Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8229647Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8229838Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8229874Z graph_break [] 2025-12-04T09:45:51.8229948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8229990Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8230045Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8230140Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8230330Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8230369Z graph_break [] 2025-12-04T09:45:51.8230468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8230511Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8230568Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8230665Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8230856Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8230907Z graph_break [] 2025-12-04T09:45:51.8230980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8231022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8231076Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8231172Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8231363Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8231412Z graph_break [] 2025-12-04T09:45:51.8231485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8231527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8231581Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8231679Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8231866Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8231904Z graph_break [] 2025-12-04T09:45:51.8231979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8232035Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8232089Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8232186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8232378Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8232416Z graph_break [] 2025-12-04T09:45:51.8232491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8232531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8232586Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8232681Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8232871Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8232908Z graph_break [] 2025-12-04T09:45:51.8233018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8235748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8235809Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8235905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8236099Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8236136Z graph_break [] 2025-12-04T09:45:51.8236212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8236252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8236311Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8236434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8236625Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8236662Z graph_break [] 2025-12-04T09:45:51.8236738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8236779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8236854Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8236949Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8237142Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8237179Z graph_break [] 2025-12-04T09:45:51.8237255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8237296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8237352Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8237464Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8237655Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8237694Z graph_break [] 2025-12-04T09:45:51.8237767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8237810Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8237863Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8237962Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8238169Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8238207Z graph_break [] 2025-12-04T09:45:51.8238280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8238322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8238376Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8238473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8238663Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8238700Z graph_break [] 2025-12-04T09:45:51.8238772Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8238816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8238871Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8238968Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8239160Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8239199Z graph_break [] 2025-12-04T09:45:51.8239272Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8239316Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8239373Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8239470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8239658Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8239708Z graph_break [] 2025-12-04T09:45:51.8239783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8239825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8239884Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8239980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8240170Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8240220Z graph_break [] 2025-12-04T09:45:51.8240311Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8240359Z Traceback (most recent call last): 2025-12-04T09:45:51.8240517Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8240577Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8240745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8240817Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8240917Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8240980Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8241087Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8241143Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8241198Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8241200Z 2025-12-04T09:45:51.8241276Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8241441Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8241443Z 2025-12-04T09:45:51.8241530Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8241607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8241649Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8241705Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8241804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8241996Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8242034Z graph_break [] 2025-12-04T09:45:51.8242108Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8242152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8242205Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8242304Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8242497Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8242535Z graph_break [] 2025-12-04T09:45:51.8242607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8242650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8242703Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8242800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8243039Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8243079Z graph_break [] 2025-12-04T09:45:51.8243174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8243218Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8243273Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8243370Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8243561Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8243621Z graph_break [] 2025-12-04T09:45:51.8243694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8243737Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8243790Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8243888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8244078Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8244132Z graph_break [] 2025-12-04T09:45:51.8244206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8244247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8244302Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8244398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8244591Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8244627Z graph_break [] 2025-12-04T09:45:51.8244701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8244769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8244828Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8244925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8245114Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8245150Z graph_break [] 2025-12-04T09:45:51.8245225Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8245266Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8245321Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8245416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8245607Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8245645Z graph_break [] 2025-12-04T09:45:51.8245719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8245761Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8245816Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8245911Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8246102Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8246139Z graph_break [] 2025-12-04T09:45:51.8246214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8246256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8246311Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8246421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8246613Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8246651Z graph_break [] 2025-12-04T09:45:51.8246725Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8246768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8246833Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8246930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8247118Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8247157Z graph_break [] 2025-12-04T09:45:51.8247230Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8247272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8247325Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8247432Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8247622Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8247661Z graph_break [] 2025-12-04T09:45:51.8247733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8247774Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8247828Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8247925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8248130Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8248168Z graph_break [] 2025-12-04T09:45:51.8248240Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8248283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8248339Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8248433Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8248625Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8248661Z graph_break [] 2025-12-04T09:45:51.8248735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8248777Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8248835Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8248929Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8249117Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8249154Z graph_break [] 2025-12-04T09:45:51.8249227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8249268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8249324Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8249417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8249606Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8249654Z graph_break [] 2025-12-04T09:45:51.8249729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8249769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8249825Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8249920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8250108Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8250157Z graph_break [] 2025-12-04T09:45:51.8250235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8250277Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8250332Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8250433Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8250634Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8250673Z graph_break [] 2025-12-04T09:45:51.8250747Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8250790Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8250843Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8250946Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8251133Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8251171Z graph_break [] 2025-12-04T09:45:51.8251255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8251299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8251353Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8251450Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8251640Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8251680Z graph_break [] 2025-12-04T09:45:51.8251753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8251795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8251849Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8251947Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8252137Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8252175Z graph_break [] 2025-12-04T09:45:51.8252251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8252294Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8252347Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8252443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8252633Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8252669Z graph_break [] 2025-12-04T09:45:51.8252742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8252782Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8252838Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8253001Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8253192Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8253229Z graph_break [] 2025-12-04T09:45:51.8253303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8253363Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8253420Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8253514Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8253707Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8253745Z graph_break [] 2025-12-04T09:45:51.8253821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8253862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8253931Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8254028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8254217Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8254254Z graph_break [] 2025-12-04T09:45:51.8254327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8254368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8254424Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8254518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8254723Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8254760Z graph_break [] 2025-12-04T09:45:51.8254833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8254875Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8254933Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8255031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8255218Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8255255Z graph_break [] 2025-12-04T09:45:51.8255327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8255370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8255425Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8255521Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8255711Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8255749Z graph_break [] 2025-12-04T09:45:51.8255823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8255866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8255920Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8256016Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8256215Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8256255Z graph_break [] 2025-12-04T09:45:51.8256329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8256372Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8256426Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8256523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8256711Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8256762Z graph_break [] 2025-12-04T09:45:51.8256834Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8256877Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8256931Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8257029Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8257240Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8257277Z graph_break [] 2025-12-04T09:45:51.8257352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8257392Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8257449Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8257544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8257739Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8257786Z graph_break [] 2025-12-04T09:45:51.8257878Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8257925Z Traceback (most recent call last): 2025-12-04T09:45:51.8258083Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8258140Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8258307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8258369Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8258466Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8258527Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8258632Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8258687Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8258740Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8258743Z 2025-12-04T09:45:51.8258817Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8258969Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8258974Z 2025-12-04T09:45:51.8259061Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8259134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8259178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8259232Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8259331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8259523Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8259575Z graph_break [] 2025-12-04T09:45:51.8259649Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8259691Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8259746Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8259842Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8260029Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8260079Z graph_break [] 2025-12-04T09:45:51.8260151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8260193Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8260249Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8260348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8260552Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8260591Z graph_break [] 2025-12-04T09:45:51.8260664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8260707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8260761Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8260858Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8261046Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8261083Z graph_break [] 2025-12-04T09:45:51.8261168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8261211Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8261266Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8261362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8261551Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8261589Z graph_break [] 2025-12-04T09:45:51.8261664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8261705Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8261760Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8261855Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8262047Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8262083Z graph_break [] 2025-12-04T09:45:51.8262157Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8262198Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8262253Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8262346Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8262544Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8262581Z graph_break [] 2025-12-04T09:45:51.8262655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8262695Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8262751Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8262858Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8263085Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8263121Z graph_break [] 2025-12-04T09:45:51.8263195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8263255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8263310Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8263406Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8263594Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8263634Z graph_break [] 2025-12-04T09:45:51.8263706Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8263748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8263818Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8263915Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8264103Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8264141Z graph_break [] 2025-12-04T09:45:51.8264214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8264256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8264311Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8264415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8264623Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8264664Z graph_break [] 2025-12-04T09:45:51.8264740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8264786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8264841Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8264941Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8265129Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8265169Z graph_break [] 2025-12-04T09:45:51.8265242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8265288Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8265344Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8265442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8265634Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8265671Z graph_break [] 2025-12-04T09:45:51.8265750Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8265792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8265850Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8265946Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8266149Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8266188Z graph_break [] 2025-12-04T09:45:51.8266265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8266308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8266367Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8266466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8266663Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8266714Z graph_break [] 2025-12-04T09:45:51.8266791Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8266834Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8266891Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8266988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8267193Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8267233Z graph_break [] 2025-12-04T09:45:51.8267309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8267351Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8267410Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8267506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8267697Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8267748Z graph_break [] 2025-12-04T09:45:51.8267824Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8267869Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8267926Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8268026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8268215Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8268257Z graph_break [] 2025-12-04T09:45:51.8268330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8268375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8268431Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8268531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8268727Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8268769Z graph_break [] 2025-12-04T09:45:51.8268842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8268886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8268941Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8269040Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8269230Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8269271Z graph_break [] 2025-12-04T09:45:51.8269343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8269389Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8269454Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8269554Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8269743Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8269783Z graph_break [] 2025-12-04T09:45:51.8269857Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8269920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8269977Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8270073Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8270264Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8270303Z graph_break [] 2025-12-04T09:45:51.8270379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8270420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8270488Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8270586Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8270784Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8270824Z graph_break [] 2025-12-04T09:45:51.8270902Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8270943Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8271001Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8271106Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8271299Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8271337Z graph_break [] 2025-12-04T09:45:51.8271412Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8271454Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8271511Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8271607Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8271798Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8271836Z graph_break [] 2025-12-04T09:45:51.8271912Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8271955Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8272013Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8272111Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8272302Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8272348Z graph_break [] 2025-12-04T09:45:51.8272421Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8272466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8272524Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8272626Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8272829Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8272871Z graph_break [] 2025-12-04T09:45:51.8272976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8273022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8273078Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8273176Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8273384Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8273426Z graph_break [] 2025-12-04T09:45:51.8273499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8273543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8273601Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8273702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8273904Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8273945Z graph_break [] 2025-12-04T09:45:51.8274021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8274068Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8274123Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8274221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8274414Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8274468Z graph_break [] 2025-12-04T09:45:51.8274547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8274589Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8274647Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8274744Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8274937Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8274975Z graph_break [] 2025-12-04T09:45:51.8275052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8275093Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8275150Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8275246Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8275445Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8275483Z graph_break [] 2025-12-04T09:45:51.8275561Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8275603Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8275661Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8275758Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8275949Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8275986Z graph_break [] 2025-12-04T09:45:51.8276081Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8276131Z Traceback (most recent call last): 2025-12-04T09:45:51.8276302Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8276360Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8276527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8276590Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8276701Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8276767Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8276874Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8276934Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8276986Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8276989Z 2025-12-04T09:45:51.8277069Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8277218Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8277219Z 2025-12-04T09:45:51.8277318Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8277392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8277436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8277493Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8277593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8277784Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8277836Z graph_break [] 2025-12-04T09:45:51.8277911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8277957Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8278015Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8278116Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8278306Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8278347Z graph_break [] 2025-12-04T09:45:51.8278420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8278465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8278519Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8278618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8278817Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8278855Z graph_break [] 2025-12-04T09:45:51.8278933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8278977Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8279035Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8279133Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8279329Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8279366Z graph_break [] 2025-12-04T09:45:51.8279445Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8279489Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8279562Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8279658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8279849Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8279887Z graph_break [] 2025-12-04T09:45:51.8279963Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8280019Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8280076Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8280171Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8280363Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8280402Z graph_break [] 2025-12-04T09:45:51.8280479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8280520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8280593Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8280693Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8280888Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8280931Z graph_break [] 2025-12-04T09:45:51.8281006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8281051Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8281105Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8281215Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8281405Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8281447Z graph_break [] 2025-12-04T09:45:51.8281519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8281564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8281618Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8281717Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8281906Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8281946Z graph_break [] 2025-12-04T09:45:51.8282020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8282067Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8282123Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8282223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8282413Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8282454Z graph_break [] 2025-12-04T09:45:51.8282528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8282574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8282630Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8282731Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8282995Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8283036Z graph_break [] 2025-12-04T09:45:51.8283113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8283156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8283213Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8283309Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8283523Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8283560Z graph_break [] 2025-12-04T09:45:51.8283639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8283680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8283739Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8283836Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8284041Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8284080Z graph_break [] 2025-12-04T09:45:51.8284156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8284199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8284256Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8284351Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8284542Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8284593Z graph_break [] 2025-12-04T09:45:51.8284672Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8284714Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8284770Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8284869Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8285062Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8285100Z graph_break [] 2025-12-04T09:45:51.8285176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8285217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8285275Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8285374Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8285565Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8285603Z graph_break [] 2025-12-04T09:45:51.8285677Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8285719Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8285772Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8285868Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8286056Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8286094Z graph_break [] 2025-12-04T09:45:51.8286165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8286209Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8286279Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8286376Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8286565Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8286603Z graph_break [] 2025-12-04T09:45:51.8286675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8286731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8286784Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8286881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8287069Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8287107Z graph_break [] 2025-12-04T09:45:51.8287179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8287235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8287291Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8287388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8287576Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8287613Z graph_break [] 2025-12-04T09:45:51.8287692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8287732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8287787Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8287894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8288086Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8288124Z graph_break [] 2025-12-04T09:45:51.8288199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8288239Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8288297Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8288393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8288583Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8288620Z graph_break [] 2025-12-04T09:45:51.8288695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8288736Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8288791Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8288888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8289081Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8289118Z graph_break [] 2025-12-04T09:45:51.8289192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8289232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8289287Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8289382Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8289584Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8289623Z graph_break [] 2025-12-04T09:45:51.8289696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8289738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8289793Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8289889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8290091Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8290129Z graph_break [] 2025-12-04T09:45:51.8290201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8290245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8290302Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8290399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8290598Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8290637Z graph_break [] 2025-12-04T09:45:51.8290710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8290753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8290807Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8290903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8291090Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8291139Z graph_break [] 2025-12-04T09:45:51.8291212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8291254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8291308Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8291404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8291591Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8291630Z graph_break [] 2025-12-04T09:45:51.8291704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8291746Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8291801Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8291897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8292087Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8292124Z graph_break [] 2025-12-04T09:45:51.8292198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8292239Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8292294Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8292390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8292578Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8292615Z graph_break [] 2025-12-04T09:45:51.8292688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8292743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8292798Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8292895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8293131Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8293168Z graph_break [] 2025-12-04T09:45:51.8293266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8293311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8293369Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8293467Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8293662Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8293702Z graph_break [] 2025-12-04T09:45:51.8293778Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8293835Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8293892Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8293988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8294181Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8294222Z graph_break [] 2025-12-04T09:45:51.8294294Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8294340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8294416Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8294517Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8294709Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8294748Z graph_break [] 2025-12-04T09:45:51.8294838Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8294887Z Traceback (most recent call last): 2025-12-04T09:45:51.8295048Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8295109Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8295280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8295347Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8295444Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8295515Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8295620Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8295679Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8295730Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8295732Z 2025-12-04T09:45:51.8295813Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8295962Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8295968Z 2025-12-04T09:45:51.8296055Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8296133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8296178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8296247Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8296345Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8296540Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8296578Z graph_break [] 2025-12-04T09:45:51.8296657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8296712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8296770Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8296866Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8297059Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8297099Z graph_break [] 2025-12-04T09:45:51.8297177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8297229Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8297287Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8297384Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8297575Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8297614Z graph_break [] 2025-12-04T09:45:51.8297690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8297732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8297790Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8297899Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8298090Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8298130Z graph_break [] 2025-12-04T09:45:51.8298203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8298247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8298303Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8298402Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8298595Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8298634Z graph_break [] 2025-12-04T09:45:51.8298708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8298751Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8298805Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8298902Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8299091Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8299129Z graph_break [] 2025-12-04T09:45:51.8299202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8299244Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8299297Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8299393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8299594Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8299633Z graph_break [] 2025-12-04T09:45:51.8299707Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8299750Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8299806Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8299903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8300104Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8300141Z graph_break [] 2025-12-04T09:45:51.8300214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8300257Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8300311Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8300408Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8300611Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8300648Z graph_break [] 2025-12-04T09:45:51.8300724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8300767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8300822Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8300916Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8301106Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8301156Z graph_break [] 2025-12-04T09:45:51.8301233Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8301273Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8301329Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8301423Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8301612Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8301650Z graph_break [] 2025-12-04T09:45:51.8301723Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8301765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8301821Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8301916Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8302105Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8302141Z graph_break [] 2025-12-04T09:45:51.8302216Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8302257Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8302313Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8302409Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8302603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8302641Z graph_break [] 2025-12-04T09:45:51.8302714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8302768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8302823Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8302921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8303146Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8303184Z graph_break [] 2025-12-04T09:45:51.8303274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8303316Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8303370Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8303466Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8303656Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8303696Z graph_break [] 2025-12-04T09:45:51.8303768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8303825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8303881Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8303980Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8304172Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8304211Z graph_break [] 2025-12-04T09:45:51.8304283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8304327Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8304394Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8304495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8304684Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8304722Z graph_break [] 2025-12-04T09:45:51.8304796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8304838Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8304895Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8304989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8305179Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8305216Z graph_break [] 2025-12-04T09:45:51.8305293Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8305334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8305389Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8305484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8305672Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8305709Z graph_break [] 2025-12-04T09:45:51.8305783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8305823Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8305878Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8305972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8306178Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8306215Z graph_break [] 2025-12-04T09:45:51.8306292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8306333Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8306388Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8306485Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8306694Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8306731Z graph_break [] 2025-12-04T09:45:51.8306805Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8306847Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8306904Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8307000Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8307206Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8307245Z graph_break [] 2025-12-04T09:45:51.8307317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8307360Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8307414Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8307510Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8307698Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8307750Z graph_break [] 2025-12-04T09:45:51.8307822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8307865Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8307922Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8308018Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8308206Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8308244Z graph_break [] 2025-12-04T09:45:51.8308317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8308359Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8308413Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8308514Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8308704Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8308743Z graph_break [] 2025-12-04T09:45:51.8308815Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8308858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8308915Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8309013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8309203Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8309239Z graph_break [] 2025-12-04T09:45:51.8309316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8309370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8309427Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8309523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8309712Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8309761Z graph_break [] 2025-12-04T09:45:51.8309835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8309876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8309930Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8310026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8310222Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8310258Z graph_break [] 2025-12-04T09:45:51.8310342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8310383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8310438Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8310533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8310727Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8310763Z graph_break [] 2025-12-04T09:45:51.8310838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8310878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8310945Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8311042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8311234Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8311272Z graph_break [] 2025-12-04T09:45:51.8311344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8311388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8311441Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8311539Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8311729Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8311768Z graph_break [] 2025-12-04T09:45:51.8311841Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8311884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8311940Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8312038Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8312227Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8312266Z graph_break [] 2025-12-04T09:45:51.8312339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8312380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8312434Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8312530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8312732Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8312774Z graph_break [] 2025-12-04T09:45:51.8312848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8312890Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8312979Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8313097Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8313284Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8313323Z graph_break [] 2025-12-04T09:45:51.8313396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8313441Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8313496Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8313591Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8313794Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8313831Z graph_break [] 2025-12-04T09:45:51.8313923Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8313969Z Traceback (most recent call last): 2025-12-04T09:45:51.8314125Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8314182Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8314348Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8314422Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8314519Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8314582Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8314687Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8314741Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8314797Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8314799Z 2025-12-04T09:45:51.8314875Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8315027Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8315029Z 2025-12-04T09:45:51.8315114Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8315191Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8315232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8315289Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8315387Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8315579Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8315618Z graph_break [] 2025-12-04T09:45:51.8315690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8315733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8315787Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8315885Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8316091Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8316129Z graph_break [] 2025-12-04T09:45:51.8316203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8316246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8316299Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8316396Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8316598Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8316636Z graph_break [] 2025-12-04T09:45:51.8316709Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8316753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8316808Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8316905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8317105Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8317144Z graph_break [] 2025-12-04T09:45:51.8317217Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8317262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8317317Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8317413Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8317601Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8317650Z graph_break [] 2025-12-04T09:45:51.8317725Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8317766Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8317823Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8317918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8318110Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8318148Z graph_break [] 2025-12-04T09:45:51.8318223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8318263Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8318319Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8318415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8318606Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8318643Z graph_break [] 2025-12-04T09:45:51.8318722Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8318762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8318818Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8318913Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8319103Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8319139Z graph_break [] 2025-12-04T09:45:51.8319213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8319264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8319320Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8319415Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8319603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8319659Z graph_break [] 2025-12-04T09:45:51.8319733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8319776Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8319829Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8319926Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8320123Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8320161Z graph_break [] 2025-12-04T09:45:51.8320247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8320290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8320343Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8320441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8320630Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8320668Z graph_break [] 2025-12-04T09:45:51.8320741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8320786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8320851Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8320949Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8321140Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8321178Z graph_break [] 2025-12-04T09:45:51.8321251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8321296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8321351Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8321448Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8321635Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8321673Z graph_break [] 2025-12-04T09:45:51.8321746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8321788Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8321848Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8321945Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8322134Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8322172Z graph_break [] 2025-12-04T09:45:51.8322245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8322285Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8322340Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8322434Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8322643Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8322681Z graph_break [] 2025-12-04T09:45:51.8322758Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8322799Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8322854Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8323006Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8323196Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8323232Z graph_break [] 2025-12-04T09:45:51.8323306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8323349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8323405Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8323499Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8323705Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8323742Z graph_break [] 2025-12-04T09:45:51.8323818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8323858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8323913Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8324008Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8324200Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8324253Z graph_break [] 2025-12-04T09:45:51.8324325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8324368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8324422Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8324518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8324708Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8324746Z graph_break [] 2025-12-04T09:45:51.8324818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8324860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8324914Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8325012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8325202Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8325239Z graph_break [] 2025-12-04T09:45:51.8325312Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8325354Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8325411Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8325508Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8325698Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8325738Z graph_break [] 2025-12-04T09:45:51.8325826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8325868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8325922Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8326019Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8326206Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8326260Z graph_break [] 2025-12-04T09:45:51.8326334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8326374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8326429Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8326523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8326715Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8326751Z graph_break [] 2025-12-04T09:45:51.8326842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8326884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8326938Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8327033Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8327223Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8327259Z graph_break [] 2025-12-04T09:45:51.8327332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8327385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8327441Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8327535Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8327724Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8327761Z graph_break [] 2025-12-04T09:45:51.8327834Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8327876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8327931Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8328026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8328216Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8328254Z graph_break [] 2025-12-04T09:45:51.8328327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8328368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8328424Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8328520Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8328707Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8328746Z graph_break [] 2025-12-04T09:45:51.8328819Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8328861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8328915Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8329025Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8329214Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8329252Z graph_break [] 2025-12-04T09:45:51.8329324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8329366Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8329421Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8329531Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8329717Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8329754Z graph_break [] 2025-12-04T09:45:51.8329827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8329872Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8329925Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8330032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8330221Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8330260Z graph_break [] 2025-12-04T09:45:51.8330332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8330374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8330427Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8330523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8330725Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8330761Z graph_break [] 2025-12-04T09:45:51.8330838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8330878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8330933Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8331028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8331218Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8331254Z graph_break [] 2025-12-04T09:45:51.8331327Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8331368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8331424Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8331520Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8331711Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8331747Z graph_break [] 2025-12-04T09:45:51.8331820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8331862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8331917Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8332012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8332203Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8332240Z graph_break [] 2025-12-04T09:45:51.8332334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8332376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8332431Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8332527Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8332719Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8332771Z graph_break [] 2025-12-04T09:45:51.8332845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8332888Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8332971Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8333068Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8333260Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8333298Z graph_break [] 2025-12-04T09:45:51.8333411Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8333459Z Traceback (most recent call last): 2025-12-04T09:45:51.8333613Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8333672Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8333837Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8333899Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8333995Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8334074Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8334177Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8334237Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8334290Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8334292Z 2025-12-04T09:45:51.8334367Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8334515Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8334518Z 2025-12-04T09:45:51.8334605Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8334678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8334721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8334777Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8334881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8335075Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8335111Z graph_break [] 2025-12-04T09:45:51.8335185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8335226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8335282Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8335377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8335569Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8335606Z graph_break [] 2025-12-04T09:45:51.8335692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8335734Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8335789Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8335884Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8336073Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8336126Z graph_break [] 2025-12-04T09:45:51.8336202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8336244Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8336299Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8336394Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8336589Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8336626Z graph_break [] 2025-12-04T09:45:51.8336711Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8336753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8336808Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8336903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8337096Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8337133Z graph_break [] 2025-12-04T09:45:51.8337206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8337261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8337316Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8337412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8337604Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8337641Z graph_break [] 2025-12-04T09:45:51.8337713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8337757Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8337811Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8337908Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8338096Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8338137Z graph_break [] 2025-12-04T09:45:51.8338209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8338251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8338307Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8338403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8338591Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8338630Z graph_break [] 2025-12-04T09:45:51.8338703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8338747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8338803Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8338912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8339102Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8339140Z graph_break [] 2025-12-04T09:45:51.8339214Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8339256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8339311Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8339416Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8339604Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8339641Z graph_break [] 2025-12-04T09:45:51.8339717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8339758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8339815Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8339920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8340110Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8340147Z graph_break [] 2025-12-04T09:45:51.8340223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8340264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8340318Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8340413Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8340615Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8340651Z graph_break [] 2025-12-04T09:45:51.8340726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8340767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8340822Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8340918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8341108Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8341145Z graph_break [] 2025-12-04T09:45:51.8341218Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8341260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8341315Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8341412Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8341603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8341641Z graph_break [] 2025-12-04T09:45:51.8341713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8341756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8341809Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8341905Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8342092Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8342130Z graph_break [] 2025-12-04T09:45:51.8342215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8342258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8342313Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8342411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8342602Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8342654Z graph_break [] 2025-12-04T09:45:51.8342727Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8342769Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8342824Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8342921Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8343154Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8343192Z graph_break [] 2025-12-04T09:45:51.8343278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8343321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8343375Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8343473Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8343663Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8343699Z graph_break [] 2025-12-04T09:45:51.8343774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8343835Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8343892Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8343986Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8344175Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8344212Z graph_break [] 2025-12-04T09:45:51.8344289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8344329Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8344384Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8344482Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8344674Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8344711Z graph_break [] 2025-12-04T09:45:51.8344784Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8344826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8344882Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8344977Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8345167Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8345205Z graph_break [] 2025-12-04T09:45:51.8345279Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8345319Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8345374Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8345491Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8345685Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8345724Z graph_break [] 2025-12-04T09:45:51.8345795Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8345839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8345908Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8346005Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8346193Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8346232Z graph_break [] 2025-12-04T09:45:51.8346309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8346352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8346405Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8346514Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8346706Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8346746Z graph_break [] 2025-12-04T09:45:51.8346818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8346861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8346917Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8347013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8347213Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8347251Z graph_break [] 2025-12-04T09:45:51.8347325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8347367Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8347420Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8347517Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8347706Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8347743Z graph_break [] 2025-12-04T09:45:51.8347816Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8347858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8347913Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8348007Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8348197Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8348233Z graph_break [] 2025-12-04T09:45:51.8348309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8348352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8348408Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8348503Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8348696Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8348744Z graph_break [] 2025-12-04T09:45:51.8348819Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8348860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8348917Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8349012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8349201Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8349251Z graph_break [] 2025-12-04T09:45:51.8349324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8349365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8349422Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8349517Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8349708Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8349758Z graph_break [] 2025-12-04T09:45:51.8349833Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8349873Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8349928Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8350024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8350213Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8352762Z graph_break [] 2025-12-04T09:45:51.8352855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8352898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8352993Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8353092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8353281Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8353317Z graph_break [] 2025-12-04T09:45:51.8353391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8353432Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8353487Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8353583Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8353774Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8353812Z graph_break [] 2025-12-04T09:45:51.8353883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8353926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8353979Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8354075Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8354267Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8354304Z graph_break [] 2025-12-04T09:45:51.8354375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8354417Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8354472Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8354585Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8354777Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8354813Z graph_break [] 2025-12-04T09:45:51.8354888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8354929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8354999Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8355094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8355283Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8355321Z graph_break [] 2025-12-04T09:45:51.8355394Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8355434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8355489Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8355599Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8355789Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8355826Z graph_break [] 2025-12-04T09:45:51.8355915Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8355960Z Traceback (most recent call last): 2025-12-04T09:45:51.8356118Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8356191Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8356360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8356422Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8356518Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8356581Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8356685Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8356741Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8356794Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8356796Z 2025-12-04T09:45:51.8356869Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8357021Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8357024Z 2025-12-04T09:45:51.8357112Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8357184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8357227Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8357281Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8357378Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8357568Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8357605Z graph_break [] 2025-12-04T09:45:51.8357677Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8357719Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8357772Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8357882Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8358073Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8358110Z graph_break [] 2025-12-04T09:45:51.8358186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8358227Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8358294Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8358389Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8358578Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8358616Z graph_break [] 2025-12-04T09:45:51.8358688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8358730Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8358784Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8358897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8359087Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8359125Z graph_break [] 2025-12-04T09:45:51.8359197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8359237Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8359291Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8359386Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8359591Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8359627Z graph_break [] 2025-12-04T09:45:51.8359701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8359741Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8359794Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8359888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8361820Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8361861Z graph_break [] 2025-12-04T09:45:51.8361934Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8361976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8362030Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8362126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8362318Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8362353Z graph_break [] 2025-12-04T09:45:51.8362427Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8362468Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8362524Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8362639Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8362827Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8362866Z graph_break [] 2025-12-04T09:45:51.8362978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8363020Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8363074Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8363169Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8363357Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8363418Z graph_break [] 2025-12-04T09:45:51.8363491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8363533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8363588Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8363683Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8363871Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8363922Z graph_break [] 2025-12-04T09:45:51.8363997Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8364038Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8364092Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8364188Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8364378Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8364418Z graph_break [] 2025-12-04T09:45:51.8364512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8364552Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8364607Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8364703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8364893Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8364929Z graph_break [] 2025-12-04T09:45:51.8365003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8365043Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8365097Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8365267Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8365459Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8365497Z graph_break [] 2025-12-04T09:45:51.8365569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8365611Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8365664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8365761Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8365952Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8365989Z graph_break [] 2025-12-04T09:45:51.8366061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8366103Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8366157Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8366254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8366445Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8366482Z graph_break [] 2025-12-04T09:45:51.8366553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8366608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8366663Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8366758Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8366946Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8366983Z graph_break [] 2025-12-04T09:45:51.8367054Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8367095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8367150Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8367255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8367443Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8367480Z graph_break [] 2025-12-04T09:45:51.8367553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8367594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8367649Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8367744Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8367944Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8367980Z graph_break [] 2025-12-04T09:45:51.8368055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8368095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8368150Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8368244Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8368460Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8368497Z graph_break [] 2025-12-04T09:45:51.8368569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8368610Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8368664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8368759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8368948Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8368984Z graph_break [] 2025-12-04T09:45:51.8369057Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8369099Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8369154Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8369249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8369439Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8369476Z graph_break [] 2025-12-04T09:45:51.8369549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8369589Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8369644Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8369739Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8369926Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8369979Z graph_break [] 2025-12-04T09:45:51.8370052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8370093Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8370146Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8370246Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8370450Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8370489Z graph_break [] 2025-12-04T09:45:51.8370561Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8370602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8370658Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8370754Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8370943Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8370980Z graph_break [] 2025-12-04T09:45:51.8371063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8371105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8371158Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8371256Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8371444Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8371481Z graph_break [] 2025-12-04T09:45:51.8371553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8371595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8371660Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8371756Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8371947Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8371982Z graph_break [] 2025-12-04T09:45:51.8372059Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8372099Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8372153Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8372247Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8372437Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8372473Z graph_break [] 2025-12-04T09:45:51.8372546Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8372587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8372641Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8372735Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8372924Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8372996Z graph_break [] 2025-12-04T09:45:51.8373069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8373137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8373191Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8373286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8373476Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8373513Z graph_break [] 2025-12-04T09:45:51.8373590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8373630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8373697Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8373792Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8373983Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8374021Z graph_break [] 2025-12-04T09:45:51.8374093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8374135Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8374188Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8374283Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8374484Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8374522Z graph_break [] 2025-12-04T09:45:51.8374594Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8374635Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8374691Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8374787Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8374988Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8375025Z graph_break [] 2025-12-04T09:45:51.8375097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8375139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8375192Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8375288Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8375477Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8375513Z graph_break [] 2025-12-04T09:45:51.8375586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8375627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8375680Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8375777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8375965Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8376003Z graph_break [] 2025-12-04T09:45:51.8376077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8376119Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8376172Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8376269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8376472Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8376508Z graph_break [] 2025-12-04T09:45:51.8376581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8376621Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8376676Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8376770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8376970Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8377006Z graph_break [] 2025-12-04T09:45:51.8377078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8377118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8377174Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8377268Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8377460Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8377506Z graph_break [] 2025-12-04T09:45:51.8377579Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8377619Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8377673Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8377768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8377960Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8377997Z graph_break [] 2025-12-04T09:45:51.8378087Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8378133Z Traceback (most recent call last): 2025-12-04T09:45:51.8378302Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8378360Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8378526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8378587Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8378685Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8378748Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8378852Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8378907Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8378958Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8378960Z 2025-12-04T09:45:51.8379036Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8379186Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8379189Z 2025-12-04T09:45:51.8379276Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8379349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8379391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8379445Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8379543Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8379732Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8379782Z graph_break [] 2025-12-04T09:45:51.8379856Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8379898Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8379953Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8380052Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8380252Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8380290Z graph_break [] 2025-12-04T09:45:51.8380363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8380403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8380458Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8380553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8380743Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8380791Z graph_break [] 2025-12-04T09:45:51.8380863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8380903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8380957Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8381053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8381241Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8381280Z graph_break [] 2025-12-04T09:45:51.8381354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8381395Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8381461Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8381556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8381744Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8381780Z graph_break [] 2025-12-04T09:45:51.8381854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8381895Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8381949Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8382043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8382232Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8382268Z graph_break [] 2025-12-04T09:45:51.8382341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8382383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8382436Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8382530Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8382720Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8382760Z graph_break [] 2025-12-04T09:45:51.8382835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8382891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8382985Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8383082Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8383273Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8383312Z graph_break [] 2025-12-04T09:45:51.8383387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8383427Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8383499Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8383594Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8383787Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8383826Z graph_break [] 2025-12-04T09:45:51.8383901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8383943Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8384001Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8384111Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8384301Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8384339Z graph_break [] 2025-12-04T09:45:51.8384413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8384455Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8384510Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8384606Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8384817Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8384855Z graph_break [] 2025-12-04T09:45:51.8384929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8384972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8385028Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8385125Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8385315Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8385355Z graph_break [] 2025-12-04T09:45:51.8385430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8385473Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8385528Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8385628Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8385822Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8385863Z graph_break [] 2025-12-04T09:45:51.8385936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8385981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8386037Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8386137Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8386344Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8386384Z graph_break [] 2025-12-04T09:45:51.8386457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8386503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8386558Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8386655Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8386856Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8386894Z graph_break [] 2025-12-04T09:45:51.8386967Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8387010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8387066Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8387162Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8387355Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8387404Z graph_break [] 2025-12-04T09:45:51.8387481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8387522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8387577Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8387677Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8387877Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8387915Z graph_break [] 2025-12-04T09:45:51.8387990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8388030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8388103Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8388198Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8388388Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8388424Z graph_break [] 2025-12-04T09:45:51.8388498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8388538Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8388593Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8388686Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8388878Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8388915Z graph_break [] 2025-12-04T09:45:51.8388989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8389030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8389085Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8389181Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8389372Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8389407Z graph_break [] 2025-12-04T09:45:51.8389480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8389534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8389588Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8389684Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8389871Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8389910Z graph_break [] 2025-12-04T09:45:51.8389982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8390023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8390090Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8390187Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8390374Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8390413Z graph_break [] 2025-12-04T09:45:51.8390485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8390527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8390582Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8390692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8390880Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8390918Z graph_break [] 2025-12-04T09:45:51.8390990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8391032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8391085Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8391185Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8391391Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8391429Z graph_break [] 2025-12-04T09:45:51.8391505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8391546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8391600Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8391699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8391888Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8391925Z graph_break [] 2025-12-04T09:45:51.8391997Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8392037Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8392093Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8392187Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8392376Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8392411Z graph_break [] 2025-12-04T09:45:51.8392485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8392526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8392581Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8392675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8392881Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8392918Z graph_break [] 2025-12-04T09:45:51.8393032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8393072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8393129Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8393228Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8393441Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8393478Z graph_break [] 2025-12-04T09:45:51.8393551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8393593Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8393648Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8393743Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8393931Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8393983Z graph_break [] 2025-12-04T09:45:51.8394055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8394096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8394153Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8394249Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8394437Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8394476Z graph_break [] 2025-12-04T09:45:51.8394549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8394606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8394661Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8394757Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8394950Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8394987Z graph_break [] 2025-12-04T09:45:51.8395061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8395103Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8395156Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8395254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8395445Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8395481Z graph_break [] 2025-12-04T09:45:51.8395555Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8395598Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8395652Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8395748Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8395938Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8395975Z graph_break [] 2025-12-04T09:45:51.8396063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8396105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8396159Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8396255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8396444Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8396481Z graph_break [] 2025-12-04T09:45:51.8396554Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8396606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8396661Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8396755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8396951Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8396987Z graph_break [] 2025-12-04T09:45:51.8397061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8397102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8397156Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8397271Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8397459Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8397496Z graph_break [] 2025-12-04T09:45:51.8397568Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8397608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8397664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8397758Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8397965Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8398003Z graph_break [] 2025-12-04T09:45:51.8398076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8398116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8398173Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8398269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8398457Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8398496Z graph_break [] 2025-12-04T09:45:51.8398568Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8398609Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8398664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8398759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8398952Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8398988Z graph_break [] 2025-12-04T09:45:51.8399077Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8399124Z Traceback (most recent call last): 2025-12-04T09:45:51.8399277Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8399345Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8399509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8399572Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8399671Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8399735Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8399838Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8399894Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8399957Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8399959Z 2025-12-04T09:45:51.8400034Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8400184Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8400188Z 2025-12-04T09:45:51.8400273Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8400347Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8400387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8400443Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8400553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8400744Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8400779Z graph_break [] 2025-12-04T09:45:51.8400855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8400896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8400952Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8401050Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8401258Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8401295Z graph_break [] 2025-12-04T09:45:51.8401369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8401409Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8401466Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8401561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8401751Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8401788Z graph_break [] 2025-12-04T09:45:51.8401862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8401901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8401956Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8402050Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8402244Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8402281Z graph_break [] 2025-12-04T09:45:51.8402354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8402396Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8402450Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8402544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8402743Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8402781Z graph_break [] 2025-12-04T09:45:51.8402854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8402896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8402987Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8403083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8403290Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8403328Z graph_break [] 2025-12-04T09:45:51.8403400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8403443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8403498Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8403594Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8403786Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8403838Z graph_break [] 2025-12-04T09:45:51.8403910Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8403951Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8404005Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8404100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8404293Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8404333Z graph_break [] 2025-12-04T09:45:51.8404405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8404462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8404516Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8404612Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8404806Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8404842Z graph_break [] 2025-12-04T09:45:51.8404918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8404958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8405014Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8405109Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8405300Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8405336Z graph_break [] 2025-12-04T09:45:51.8405408Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8405449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8405503Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8405597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8405786Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8405822Z graph_break [] 2025-12-04T09:45:51.8405910Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8405950Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8406004Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8406100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8406290Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8406327Z graph_break [] 2025-12-04T09:45:51.8406400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8406451Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8406507Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8406602Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8406795Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8406834Z graph_break [] 2025-12-04T09:45:51.8406906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8406948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8407000Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8407107Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8407294Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8407331Z graph_break [] 2025-12-04T09:45:51.8407403Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8407444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8407500Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8407596Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8409416Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8409454Z graph_break [] 2025-12-04T09:45:51.8409526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8409568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8409625Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8409721Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8409909Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8409947Z graph_break [] 2025-12-04T09:45:51.8410018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8410059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8410113Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8410209Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8410404Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8410442Z graph_break [] 2025-12-04T09:45:51.8410518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8410559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8410613Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8410707Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8412190Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8412226Z graph_break [] 2025-12-04T09:45:51.8412299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8412341Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8412395Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8412489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8412700Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8412737Z graph_break [] 2025-12-04T09:45:51.8412810Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8412852Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8412906Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8413042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8413235Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8413287Z graph_break [] 2025-12-04T09:45:51.8413360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8413401Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8413457Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8413554Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8413750Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8413787Z graph_break [] 2025-12-04T09:45:51.8413876Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8413918Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8413972Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8414072Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8414261Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8414301Z graph_break [] 2025-12-04T09:45:51.8414375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8414420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8414476Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8414575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8414765Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8414805Z graph_break [] 2025-12-04T09:45:51.8414882Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8414927Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8414982Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8415081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8415271Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8415328Z graph_break [] 2025-12-04T09:45:51.8415402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8415447Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8415503Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8415603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8415793Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8415834Z graph_break [] 2025-12-04T09:45:51.8415910Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8415967Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8416023Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8416122Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8416314Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8416351Z graph_break [] 2025-12-04T09:45:51.8416428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8416470Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8416539Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8416635Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8416827Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8416865Z graph_break [] 2025-12-04T09:45:51.8416940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8416982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8417040Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8417136Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8417346Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8417385Z graph_break [] 2025-12-04T09:45:51.8417460Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8417502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8417560Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8417657Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8417851Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8417891Z graph_break [] 2025-12-04T09:45:51.8417968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8418010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8418067Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8418163Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8418354Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8418394Z graph_break [] 2025-12-04T09:45:51.8418469Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8418513Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8418570Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8418682Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8418871Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8418911Z graph_break [] 2025-12-04T09:45:51.8418984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8419029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8419084Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8419181Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8419386Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8419428Z graph_break [] 2025-12-04T09:45:51.8419502Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8419549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8419605Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8419704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8419894Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8419945Z graph_break [] 2025-12-04T09:45:51.8420021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8420067Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8420121Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8420220Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8420409Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8420451Z graph_break [] 2025-12-04T09:45:51.8420559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8420601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8420657Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8420756Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8420949Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8420986Z graph_break [] 2025-12-04T09:45:51.8421061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8421103Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8421161Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8421256Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8421451Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8421489Z graph_break [] 2025-12-04T09:45:51.8421565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8421606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8421663Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8421760Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8421953Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8422005Z graph_break [] 2025-12-04T09:45:51.8422080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8422121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8422180Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8422276Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8422469Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8422506Z graph_break [] 2025-12-04T09:45:51.8422593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8422635Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8422694Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8422789Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8423017Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8423059Z graph_break [] 2025-12-04T09:45:51.8423133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8423196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8423251Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8423348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8423538Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8423581Z graph_break [] 2025-12-04T09:45:51.8423672Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8423722Z Traceback (most recent call last): 2025-12-04T09:45:51.8423876Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8423953Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8424121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8424188Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8424287Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8424352Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8424457Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8424515Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8424567Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8424570Z 2025-12-04T09:45:51.8424647Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8424799Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8424807Z 2025-12-04T09:45:51.8424894Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8424972Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8425014Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8425072Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8425170Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8425363Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8425425Z graph_break [] 2025-12-04T09:45:51.8425503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8425546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8425606Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8425702Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8425894Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8425932Z graph_break [] 2025-12-04T09:45:51.8426021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8426064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8426121Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8426221Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8426414Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8426451Z graph_break [] 2025-12-04T09:45:51.8426528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8426570Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8426637Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8426732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8426928Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8426968Z graph_break [] 2025-12-04T09:45:51.8427041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8427086Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8427140Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8427238Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8427437Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8427477Z graph_break [] 2025-12-04T09:45:51.8427550Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8427595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8427650Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8427748Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8427937Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8427977Z graph_break [] 2025-12-04T09:45:51.8428050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8428095Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8428153Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8428252Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8428442Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8428482Z graph_break [] 2025-12-04T09:45:51.8428556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8428600Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8428654Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8428765Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8428954Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8428994Z graph_break [] 2025-12-04T09:45:51.8429067Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8429113Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8429167Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8429264Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8429464Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8429501Z graph_break [] 2025-12-04T09:45:51.8429578Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8429622Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8429678Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8429774Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8429964Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8430012Z graph_break [] 2025-12-04T09:45:51.8430089Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8430131Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8430188Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8430289Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8430485Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8430524Z graph_break [] 2025-12-04T09:45:51.8430611Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8430653Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8430713Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8430809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8431002Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8431037Z graph_break [] 2025-12-04T09:45:51.8431113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8431154Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8431213Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8431309Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8431500Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8431540Z graph_break [] 2025-12-04T09:45:51.8431613Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8431659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8431714Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8431812Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8432001Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8432055Z graph_break [] 2025-12-04T09:45:51.8432128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8432172Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8432228Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8432327Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8432519Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8432560Z graph_break [] 2025-12-04T09:45:51.8432643Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8432688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8432742Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8432840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8433089Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8433129Z graph_break [] 2025-12-04T09:45:51.8433203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8433260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8433314Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8433411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8433602Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8433644Z graph_break [] 2025-12-04T09:45:51.8433720Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8433764Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8433820Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8433931Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8434127Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8434165Z graph_break [] 2025-12-04T09:45:51.8434241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8434283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8434340Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8434435Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8434624Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8434663Z graph_break [] 2025-12-04T09:45:51.8434739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8434781Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8434837Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8434933Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8435125Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8435163Z graph_break [] 2025-12-04T09:45:51.8435236Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8435277Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8435331Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8435443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8435632Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8435668Z graph_break [] 2025-12-04T09:45:51.8435742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8435785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8435841Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8435951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8436143Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8436181Z graph_break [] 2025-12-04T09:45:51.8436254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8436296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8436351Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8436447Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8436635Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8436683Z graph_break [] 2025-12-04T09:45:51.8436755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8436798Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8436851Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8436946Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8437136Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8437175Z graph_break [] 2025-12-04T09:45:51.8437264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8437307Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8437361Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8437458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8437646Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8437684Z graph_break [] 2025-12-04T09:45:51.8437756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8437798Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8437853Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8437948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8438143Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8438180Z graph_break [] 2025-12-04T09:45:51.8438253Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8438293Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8438348Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8438443Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8438631Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8438679Z graph_break [] 2025-12-04T09:45:51.8438752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8438792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8438850Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8438944Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8439135Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8439171Z graph_break [] 2025-12-04T09:45:51.8439256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8439299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8439354Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8439448Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8439641Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8439678Z graph_break [] 2025-12-04T09:45:51.8439751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8439804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8439858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8439956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8440150Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8440187Z graph_break [] 2025-12-04T09:45:51.8440259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8440302Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8440356Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8440462Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8440651Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8440690Z graph_break [] 2025-12-04T09:45:51.8440762Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8440804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8440858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8440956Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8441144Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8441183Z graph_break [] 2025-12-04T09:45:51.8441256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8441299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8441352Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8441449Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8441638Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8441676Z graph_break [] 2025-12-04T09:45:51.8441750Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8441792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8441845Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8441954Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8442142Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8442179Z graph_break [] 2025-12-04T09:45:51.8442252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8442294Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8442349Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8442456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8442645Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8442682Z graph_break [] 2025-12-04T09:45:51.8442759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8442800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8442857Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8442995Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8443206Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8443242Z graph_break [] 2025-12-04T09:45:51.8443317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8443358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8443414Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8443509Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8443704Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8443753Z graph_break [] 2025-12-04T09:45:51.8443828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8443870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8443927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8444021Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8444211Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8444247Z graph_break [] 2025-12-04T09:45:51.8444322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8444364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8444422Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8444518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8444709Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8444748Z graph_break [] 2025-12-04T09:45:51.8444820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8444864Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8444920Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8445016Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8445203Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8445255Z graph_break [] 2025-12-04T09:45:51.8445328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8445371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8445425Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8445521Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8445713Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8445763Z graph_break [] 2025-12-04T09:45:51.8445854Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8445902Z Traceback (most recent call last): 2025-12-04T09:45:51.8446058Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8446117Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8446288Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8446351Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8446448Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8446523Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8446626Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8446684Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8446735Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8446739Z 2025-12-04T09:45:51.8446812Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8446964Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8446967Z 2025-12-04T09:45:51.8447054Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8447142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8447186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8447244Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8447341Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8447533Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8447570Z graph_break [] 2025-12-04T09:45:51.8447644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8447686Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8447743Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8447843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8448038Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8448075Z graph_break [] 2025-12-04T09:45:51.8448148Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8448189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8448244Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8448339Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8448532Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8448583Z graph_break [] 2025-12-04T09:45:51.8448655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8448698Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8448752Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8448848Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8449037Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8449075Z graph_break [] 2025-12-04T09:45:51.8449160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8449203Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8449257Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8449353Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8449542Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8449580Z graph_break [] 2025-12-04T09:45:51.8449652Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8449712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8449766Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8449863Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8450062Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8450101Z graph_break [] 2025-12-04T09:45:51.8450173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8450216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8450272Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8450379Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8450569Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8450609Z graph_break [] 2025-12-04T09:45:51.8450682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8450724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8450778Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8450874Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8451063Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8451100Z graph_break [] 2025-12-04T09:45:51.8451176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8451216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8451271Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8451366Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8451556Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8451592Z graph_break [] 2025-12-04T09:45:51.8451667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8451707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8451774Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8451869Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8452060Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8452097Z graph_break [] 2025-12-04T09:45:51.8452172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8452213Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8452268Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8452372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8452565Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8452603Z graph_break [] 2025-12-04T09:45:51.8452677Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8452718Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8452774Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8452870Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8453113Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8453152Z graph_break [] 2025-12-04T09:45:51.8453226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8453268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8453322Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8453420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8453615Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8453669Z graph_break [] 2025-12-04T09:45:51.8453742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8453784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8453840Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8453935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8454123Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8454161Z graph_break [] 2025-12-04T09:45:51.8454234Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8454278Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8454332Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8454429Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8454625Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8454663Z graph_break [] 2025-12-04T09:45:51.8454735Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8454777Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8454834Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8454930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8455118Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8455171Z graph_break [] 2025-12-04T09:45:51.8455245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8455287Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8455342Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8455437Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8455633Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8455684Z graph_break [] 2025-12-04T09:45:51.8455759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8455800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8455855Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8455951Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8456143Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8456179Z graph_break [] 2025-12-04T09:45:51.8456252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8456308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8456364Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8456458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8456654Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8456690Z graph_break [] 2025-12-04T09:45:51.8456767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8456808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8456863Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8456968Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8457161Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8457198Z graph_break [] 2025-12-04T09:45:51.8457276Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8457318Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8457374Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8457472Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8457661Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8457700Z graph_break [] 2025-12-04T09:45:51.8457773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8457816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8457870Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8457966Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8458158Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8458195Z graph_break [] 2025-12-04T09:45:51.8458267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8458310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8458375Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8458471Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8458661Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8458700Z graph_break [] 2025-12-04T09:45:51.8458772Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8458815Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8458868Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8458979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8459168Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8459207Z graph_break [] 2025-12-04T09:45:51.8459281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8459323Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8459378Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8459475Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8459675Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8459711Z graph_break [] 2025-12-04T09:45:51.8459786Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8459827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8459883Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8459978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8460179Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8460216Z graph_break [] 2025-12-04T09:45:51.8460289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8460335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8460390Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8460484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8460673Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8460710Z graph_break [] 2025-12-04T09:45:51.8460783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8460827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8460882Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8460978Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8461169Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8461207Z graph_break [] 2025-12-04T09:45:51.8461283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8461325Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8461383Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8461481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8461670Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8461719Z graph_break [] 2025-12-04T09:45:51.8461792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8461834Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8461888Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8461986Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8462174Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8462228Z graph_break [] 2025-12-04T09:45:51.8462301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8462344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8462398Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8462496Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8462688Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8462725Z graph_break [] 2025-12-04T09:45:51.8462808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8462850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8462904Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8463043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8463234Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8463276Z graph_break [] 2025-12-04T09:45:51.8463348Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8463391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8463464Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8463561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8463751Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8463789Z graph_break [] 2025-12-04T09:45:51.8463861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8463904Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8463959Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8464054Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8464245Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8464281Z graph_break [] 2025-12-04T09:45:51.8464356Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8464397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8464455Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8464551Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8464742Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8464778Z graph_break [] 2025-12-04T09:45:51.8464852Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8464907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8464963Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8465058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8465250Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8465288Z graph_break [] 2025-12-04T09:45:51.8465363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8465403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8465458Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8465571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8465761Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8465799Z graph_break [] 2025-12-04T09:45:51.8465873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8465914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8465969Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8466064Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8466269Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8466307Z graph_break [] 2025-12-04T09:45:51.8466381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8466423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8466477Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8466575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8466777Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8466815Z graph_break [] 2025-12-04T09:45:51.8466888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8466931Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8466985Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8467081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8467272Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8467310Z graph_break [] 2025-12-04T09:45:51.8467382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8467426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8467479Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8467577Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8467766Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8467806Z graph_break [] 2025-12-04T09:45:51.8467880Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8467925Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8467980Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8468077Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8468267Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8468316Z graph_break [] 2025-12-04T09:45:51.8468408Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8468454Z Traceback (most recent call last): 2025-12-04T09:45:51.8468610Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8468667Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8468843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8468905Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8469002Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8469064Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8469175Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8469229Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8469283Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8469285Z 2025-12-04T09:45:51.8469361Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8469525Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8469527Z 2025-12-04T09:45:51.8469614Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8469690Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8469732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8469789Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8469886Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8470090Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8470129Z graph_break [] 2025-12-04T09:45:51.8470202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8470246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8470301Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8470398Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8470586Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8470624Z graph_break [] 2025-12-04T09:45:51.8470699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8470743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8470797Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8470895Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8471088Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8471127Z graph_break [] 2025-12-04T09:45:51.8471199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8471243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8474684Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8474797Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8474986Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8475056Z graph_break [] 2025-12-04T09:45:51.8475130Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8475174Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8475230Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8475330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8475541Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8475581Z graph_break [] 2025-12-04T09:45:51.8475654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8475697Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8475752Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8475850Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8476041Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8476078Z graph_break [] 2025-12-04T09:45:51.8476169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8476210Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8476265Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8476364Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8476558Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8476597Z graph_break [] 2025-12-04T09:45:51.8476671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8476712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8476797Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8476893Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8477089Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8477125Z graph_break [] 2025-12-04T09:45:51.8477200Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8477241Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8477296Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8477391Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8477582Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8477619Z graph_break [] 2025-12-04T09:45:51.8477694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8477734Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8477793Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8477889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8478080Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8478118Z graph_break [] 2025-12-04T09:45:51.8478191Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8478261Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8478316Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8478414Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8478603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8478642Z graph_break [] 2025-12-04T09:45:51.8478715Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8478757Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8478815Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8478927Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8479117Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8479159Z graph_break [] 2025-12-04T09:45:51.8479231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8479274Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8479329Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8479426Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8479626Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8479664Z graph_break [] 2025-12-04T09:45:51.8479738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8479781Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8479835Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8479935Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8480134Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8480173Z graph_break [] 2025-12-04T09:45:51.8480247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8480290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8480345Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8480441Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8480633Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8480670Z graph_break [] 2025-12-04T09:45:51.8480746Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8480788Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8480844Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8480942Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8481134Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8481173Z graph_break [] 2025-12-04T09:45:51.8481248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8481289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8481345Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8481440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8481631Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8481680Z graph_break [] 2025-12-04T09:45:51.8481756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8481796Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8481852Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8481948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8482149Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8482186Z graph_break [] 2025-12-04T09:45:51.8482260Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8482301Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8482360Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8482456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8482648Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8482697Z graph_break [] 2025-12-04T09:45:51.8482771Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8482813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8482868Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8483020Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8483208Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8483247Z graph_break [] 2025-12-04T09:45:51.8483320Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8483362Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8483431Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8483529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8483719Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8483758Z graph_break [] 2025-12-04T09:45:51.8483831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8483873Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8483927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8484024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8484214Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8484253Z graph_break [] 2025-12-04T09:45:51.8484326Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8484370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8484424Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8484520Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8484711Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8484749Z graph_break [] 2025-12-04T09:45:51.8484824Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8484879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8484934Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8485031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8485220Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8485257Z graph_break [] 2025-12-04T09:45:51.8485332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8485373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8485450Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8485546Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8485737Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8485774Z graph_break [] 2025-12-04T09:45:51.8485848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8485890Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8485945Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8486054Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8486241Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8486279Z graph_break [] 2025-12-04T09:45:51.8486354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8486395Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8486450Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8486546Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8486748Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8486785Z graph_break [] 2025-12-04T09:45:51.8486861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8486901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8486957Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8487055Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8487245Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8487283Z graph_break [] 2025-12-04T09:45:51.8487356Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8487398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8487452Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8487550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8487738Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8487777Z graph_break [] 2025-12-04T09:45:51.8487849Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8487892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8487946Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8488042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8488244Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8488282Z graph_break [] 2025-12-04T09:45:51.8488357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8488401Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8488456Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8488553Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8488754Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8488792Z graph_break [] 2025-12-04T09:45:51.8488865Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8488907Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8488965Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8489063Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8489258Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8489305Z graph_break [] 2025-12-04T09:45:51.8489378Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8489419Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8489474Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8489571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8489762Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8489800Z graph_break [] 2025-12-04T09:45:51.8489874Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8489933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8489989Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8490084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8490275Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8490311Z graph_break [] 2025-12-04T09:45:51.8490386Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8490427Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8490483Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8490580Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8490777Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8490813Z graph_break [] 2025-12-04T09:45:51.8490888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8490929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8490986Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8491081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8491272Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8491310Z graph_break [] 2025-12-04T09:45:51.8491382Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8491438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8491492Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8491590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8491778Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8491817Z graph_break [] 2025-12-04T09:45:51.8491889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8491932Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8491996Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8492093Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8492279Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8492319Z graph_break [] 2025-12-04T09:45:51.8492393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8492435Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8492490Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8492600Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8492789Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8492827Z graph_break [] 2025-12-04T09:45:51.8492898Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8492978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8493034Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8493130Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8493329Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8493367Z graph_break [] 2025-12-04T09:45:51.8493441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8493483Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8493538Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8493633Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8493825Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8493862Z graph_break [] 2025-12-04T09:45:51.8493935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8493976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8494031Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8494126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8494315Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8494351Z graph_break [] 2025-12-04T09:45:51.8494425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8494466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8494521Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8494616Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8494820Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8494858Z graph_break [] 2025-12-04T09:45:51.8494949Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8494995Z Traceback (most recent call last): 2025-12-04T09:45:51.8495157Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8495213Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8495396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8495459Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8495557Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8495622Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8495727Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8495783Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8495834Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8495837Z 2025-12-04T09:45:51.8495926Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8496077Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8496079Z 2025-12-04T09:45:51.8496170Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8496245Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8496289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8496344Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8496446Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8496646Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8496685Z graph_break [] 2025-12-04T09:45:51.8496760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8496802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8496856Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8496957Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8497152Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8497190Z graph_break [] 2025-12-04T09:45:51.8497264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8497307Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8497360Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8497458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8497648Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8497685Z graph_break [] 2025-12-04T09:45:51.8497760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8497802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8497857Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8497952Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8498155Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8498191Z graph_break [] 2025-12-04T09:45:51.8498267Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8498308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8498364Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8498458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8498663Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8498700Z graph_break [] 2025-12-04T09:45:51.8498773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8498814Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8498871Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8498967Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8499163Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8499211Z graph_break [] 2025-12-04T09:45:51.8499285Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8499326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8499383Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8499478Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8499667Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8499706Z graph_break [] 2025-12-04T09:45:51.8499779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8499831Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8499886Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8499982Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8500173Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8500211Z graph_break [] 2025-12-04T09:45:51.8500284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8500327Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8500381Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8500477Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8500667Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8500704Z graph_break [] 2025-12-04T09:45:51.8500777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8500820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8500873Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8500972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8501163Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8501201Z graph_break [] 2025-12-04T09:45:51.8501273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8501328Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8501381Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8501479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8501666Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8501705Z graph_break [] 2025-12-04T09:45:51.8501777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8501820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8501884Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8501981Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8502169Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8502207Z graph_break [] 2025-12-04T09:45:51.8502281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8502322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8502377Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8502492Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8502683Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8502719Z graph_break [] 2025-12-04T09:45:51.8502792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8502833Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8502889Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8503024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8503249Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8503287Z graph_break [] 2025-12-04T09:45:51.8503373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8503416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8503474Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8503572Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8503768Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8503807Z graph_break [] 2025-12-04T09:45:51.8503883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8503925Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8503985Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8504082Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8506224Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8506273Z graph_break [] 2025-12-04T09:45:51.8506347Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8506391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8506449Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8506548Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8506779Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8506822Z graph_break [] 2025-12-04T09:45:51.8506897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8506942Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8506996Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8507100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8507311Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8507353Z graph_break [] 2025-12-04T09:45:51.8507426Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8507476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8507532Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8507632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8507822Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8507882Z graph_break [] 2025-12-04T09:45:51.8507955Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8507999Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8508056Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8508155Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8508347Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8508387Z graph_break [] 2025-12-04T09:45:51.8508463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8508515Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8508573Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8508670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8508866Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8508905Z graph_break [] 2025-12-04T09:45:51.8508982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8509025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8509083Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8509186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8509381Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8509419Z graph_break [] 2025-12-04T09:45:51.8509495Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8509539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8509595Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8509692Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8509884Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8509922Z graph_break [] 2025-12-04T09:45:51.8510011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8510054Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8510114Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8510212Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8510403Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8510441Z graph_break [] 2025-12-04T09:45:51.8510516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8510569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8510628Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8510726Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8510917Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8510957Z graph_break [] 2025-12-04T09:45:51.8511031Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8511077Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8511144Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8511243Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8511438Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8511478Z graph_break [] 2025-12-04T09:45:51.8511551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8511595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8511653Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8511754Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8511956Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8511999Z graph_break [] 2025-12-04T09:45:51.8512074Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8512118Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8512172Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8512272Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8512459Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8512504Z graph_break [] 2025-12-04T09:45:51.8512577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8512622Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8512680Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8512779Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8513009Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8513047Z graph_break [] 2025-12-04T09:45:51.8513125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8513167Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8513225Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8513324Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8513546Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8513584Z graph_break [] 2025-12-04T09:45:51.8513662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8513704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8513761Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8513857Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8514065Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8514103Z graph_break [] 2025-12-04T09:45:51.8514178Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8514221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8514278Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8514375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8514566Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8514622Z graph_break [] 2025-12-04T09:45:51.8514701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8514742Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8514802Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8514899Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8515093Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8515135Z graph_break [] 2025-12-04T09:45:51.8515224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8515269Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8515324Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8515424Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8515613Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8515655Z graph_break [] 2025-12-04T09:45:51.8515728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8515773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8515827Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8515927Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8516116Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8516157Z graph_break [] 2025-12-04T09:45:51.8516233Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8516278Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8516334Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8516435Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8516623Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8516675Z graph_break [] 2025-12-04T09:45:51.8516748Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8516794Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8516850Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8516950Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8517146Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8517188Z graph_break [] 2025-12-04T09:45:51.8517280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8517326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8517383Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8517479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8517674Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8517712Z graph_break [] 2025-12-04T09:45:51.8517788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8517829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8517897Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8517993Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8518186Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8518223Z graph_break [] 2025-12-04T09:45:51.8518299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8518342Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8518399Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8518495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8518696Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8518735Z graph_break [] 2025-12-04T09:45:51.8518811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8518853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8518914Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8519010Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8519203Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8519242Z graph_break [] 2025-12-04T09:45:51.8519319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8519362Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8519420Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8519516Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8519708Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8519750Z graph_break [] 2025-12-04T09:45:51.8519823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8519869Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8519925Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8520039Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8520227Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8520269Z graph_break [] 2025-12-04T09:45:51.8520344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8520391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8520446Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8520544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8520742Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8520782Z graph_break [] 2025-12-04T09:45:51.8520874Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8520923Z Traceback (most recent call last): 2025-12-04T09:45:51.8521081Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8521141Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8521315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8521391Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8521489Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8521556Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8521661Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8521722Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8521779Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8521784Z 2025-12-04T09:45:51.8521861Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8522026Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8522028Z 2025-12-04T09:45:51.8522115Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8522195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8522241Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8522302Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8522401Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8522594Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8522633Z graph_break [] 2025-12-04T09:45:51.8522710Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8522752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8522809Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8522906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8523131Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8523168Z graph_break [] 2025-12-04T09:45:51.8523246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8523289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8523346Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8523442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8523665Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8523704Z graph_break [] 2025-12-04T09:45:51.8523783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8523828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8523883Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8523983Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8524193Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8524234Z graph_break [] 2025-12-04T09:45:51.8524308Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8524353Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8524410Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8524509Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8524697Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8524752Z graph_break [] 2025-12-04T09:45:51.8524825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8524871Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8524927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8525024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8525215Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8525256Z graph_break [] 2025-12-04T09:45:51.8525344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8525389Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8525444Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8525544Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8525736Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8525777Z graph_break [] 2025-12-04T09:45:51.8525851Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8525894Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8525949Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8526047Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8526239Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8526277Z graph_break [] 2025-12-04T09:45:51.8526354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8526397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8526453Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8526550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8526739Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8526788Z graph_break [] 2025-12-04T09:45:51.8526862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8526903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8526960Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8527055Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8527248Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8527285Z graph_break [] 2025-12-04T09:45:51.8527372Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8527413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8527468Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8527563Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8527761Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8527799Z graph_break [] 2025-12-04T09:45:51.8527873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8527913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8527981Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8528076Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8528269Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8528308Z graph_break [] 2025-12-04T09:45:51.8528380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8528424Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8528479Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8528576Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8528773Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8528813Z graph_break [] 2025-12-04T09:45:51.8528885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8528928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8528982Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8529079Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8529268Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8529308Z graph_break [] 2025-12-04T09:45:51.8529380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8529424Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8529478Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8529578Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8529770Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8529807Z graph_break [] 2025-12-04T09:45:51.8529882Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8529924Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8529977Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8530094Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8530284Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8530323Z graph_break [] 2025-12-04T09:45:51.8530396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8530438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8530495Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8530589Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8530789Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8530828Z graph_break [] 2025-12-04T09:45:51.8530904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8530944Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8531001Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8531096Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8531289Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8531336Z graph_break [] 2025-12-04T09:45:51.8531409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8531452Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8531508Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8531605Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8531797Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8531836Z graph_break [] 2025-12-04T09:45:51.8531929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8531970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8532026Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8532121Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8532310Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8532346Z graph_break [] 2025-12-04T09:45:51.8532420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8532462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8532519Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8532615Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8532805Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8532846Z graph_break [] 2025-12-04T09:45:51.8532919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8533009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8533064Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8533162Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8533352Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8533414Z graph_break [] 2025-12-04T09:45:51.8533488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8533530Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8533587Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8533686Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8533878Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8533915Z graph_break [] 2025-12-04T09:45:51.8534003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8534046Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8534100Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8534203Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8534394Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8534436Z graph_break [] 2025-12-04T09:45:51.8534509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8534569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8534625Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8534723Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8534915Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8534952Z graph_break [] 2025-12-04T09:45:51.8535028Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8535072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8535129Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8535241Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8535435Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8535475Z graph_break [] 2025-12-04T09:45:51.8535552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8535594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8535652Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8535747Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8535940Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8535978Z graph_break [] 2025-12-04T09:45:51.8536057Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8536100Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8536158Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8536255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8536447Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8536487Z graph_break [] 2025-12-04T09:45:51.8536564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8536605Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8536664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8536771Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8536967Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8537007Z graph_break [] 2025-12-04T09:45:51.8537082Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8537126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8537181Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8537291Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8537481Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8537521Z graph_break [] 2025-12-04T09:45:51.8537596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8537641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8537696Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8537800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8537991Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8538044Z graph_break [] 2025-12-04T09:45:51.8538119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8538166Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8538222Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8538322Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8538514Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8538554Z graph_break [] 2025-12-04T09:45:51.8538640Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8538685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8538741Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8538839Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8539027Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8539067Z graph_break [] 2025-12-04T09:45:51.8539140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8539186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8539241Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8539338Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8539530Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8539568Z graph_break [] 2025-12-04T09:45:51.8539643Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8539684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8539739Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8539835Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8540024Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8540072Z graph_break [] 2025-12-04T09:45:51.8540146Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8540188Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8540244Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8540338Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8540530Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8540566Z graph_break [] 2025-12-04T09:45:51.8540650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8540691Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8540747Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8540841Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8541037Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8541073Z graph_break [] 2025-12-04T09:45:51.8541149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8541201Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8541256Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8541353Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8541545Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8541583Z graph_break [] 2025-12-04T09:45:51.8541656Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8541703Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8541757Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8541873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8542062Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8542103Z graph_break [] 2025-12-04T09:45:51.8542177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8542220Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8542275Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8542371Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8542561Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8542600Z graph_break [] 2025-12-04T09:45:51.8542673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8542716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8542769Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8542867Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8543097Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8543136Z graph_break [] 2025-12-04T09:45:51.8543209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8543251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8543320Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8543418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8543612Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8543651Z graph_break [] 2025-12-04T09:45:51.8543726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8543767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8543822Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8543928Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8544118Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8544155Z graph_break [] 2025-12-04T09:45:51.8544229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8544270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8544326Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8544421Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8544621Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8544658Z graph_break [] 2025-12-04T09:45:51.8544732Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8544773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8544829Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8544924Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8545116Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8545163Z graph_break [] 2025-12-04T09:45:51.8545254Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8545301Z Traceback (most recent call last): 2025-12-04T09:45:51.8545458Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8545513Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8545688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8545749Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8545846Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8545910Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8546013Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8546070Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8546121Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8546123Z 2025-12-04T09:45:51.8546203Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8546353Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8546355Z 2025-12-04T09:45:51.8546443Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8546516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8546560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8546615Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8546728Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8546918Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8546957Z graph_break [] 2025-12-04T09:45:51.8547030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8547073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8547127Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8547236Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8547425Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8547463Z graph_break [] 2025-12-04T09:45:51.8547537Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8547580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8547635Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8547732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8547921Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8547968Z graph_break [] 2025-12-04T09:45:51.8548043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8548084Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8548139Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8548234Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8548424Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8548461Z graph_break [] 2025-12-04T09:45:51.8548547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8548590Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8548647Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8548743Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8548936Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8548975Z graph_break [] 2025-12-04T09:45:51.8549050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8549092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8549147Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8549242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8549437Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8549474Z graph_break [] 2025-12-04T09:45:51.8549547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8549588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8549643Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8549738Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8549927Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8549976Z graph_break [] 2025-12-04T09:45:51.8550049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8550094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8550149Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8550248Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8550438Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8550477Z graph_break [] 2025-12-04T09:45:51.8550558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8550602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8550655Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8550751Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8550941Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8550980Z graph_break [] 2025-12-04T09:45:51.8551052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8551104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8551158Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8551255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8551444Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8551483Z graph_break [] 2025-12-04T09:45:51.8551556Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8551600Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8551653Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8551760Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8551950Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8551989Z graph_break [] 2025-12-04T09:45:51.8552063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8552105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8552160Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8552254Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8552448Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8552487Z graph_break [] 2025-12-04T09:45:51.8552562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8552604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8552661Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8552757Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8553011Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8553047Z graph_break [] 2025-12-04T09:45:51.8553123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8553163Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8553253Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8553348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8553539Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8553577Z graph_break [] 2025-12-04T09:45:51.8553650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8553691Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8553746Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8553857Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8554053Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8554090Z graph_break [] 2025-12-04T09:45:51.8554164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8554205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8554263Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8554360Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8554578Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8554616Z graph_break [] 2025-12-04T09:45:51.8554689Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8554731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8554785Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8554881Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8555072Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8555126Z graph_break [] 2025-12-04T09:45:51.8555199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8555243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8555297Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8555393Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8555583Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8555621Z graph_break [] 2025-12-04T09:45:51.8555694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8555738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8555793Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8555891Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8556082Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8556123Z graph_break [] 2025-12-04T09:45:51.8556196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8556239Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8556293Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8556390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8556580Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8556629Z graph_break [] 2025-12-04T09:45:51.8556703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8556745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8556801Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8556897Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8557087Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8557144Z graph_break [] 2025-12-04T09:45:51.8557219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8557260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8557315Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8557411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8557602Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8557639Z graph_break [] 2025-12-04T09:45:51.8557712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8557765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8557821Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8557916Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8558111Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8558148Z graph_break [] 2025-12-04T09:45:51.8558224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8558265Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8558322Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8558432Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8558623Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8558661Z graph_break [] 2025-12-04T09:45:51.8558733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8558776Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8558830Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8558927Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8559119Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8559158Z graph_break [] 2025-12-04T09:45:51.8559231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8559275Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8559330Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8559428Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8559617Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8559656Z graph_break [] 2025-12-04T09:45:51.8559729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8559771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8559838Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8559937Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8560129Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8560169Z graph_break [] 2025-12-04T09:45:51.8560241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8560284Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8560337Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8560442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8560631Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8560671Z graph_break [] 2025-12-04T09:45:51.8560743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8560786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8560841Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8560937Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8561141Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8561177Z graph_break [] 2025-12-04T09:45:51.8561252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8561295Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8561350Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8561445Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8561647Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8561684Z graph_break [] 2025-12-04T09:45:51.8561761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8561803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8561858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8561953Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8562147Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8562184Z graph_break [] 2025-12-04T09:45:51.8562257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8562299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8562356Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8562451Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8562644Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8562681Z graph_break [] 2025-12-04T09:45:51.8562755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8562802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8562858Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8562998Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8563189Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8563264Z graph_break [] 2025-12-04T09:45:51.8563338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8563380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8563434Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8563532Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8563738Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8563777Z graph_break [] 2025-12-04T09:45:51.8563850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8563892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8563945Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8564044Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8564235Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8564273Z graph_break [] 2025-12-04T09:45:51.8564367Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8564410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8564463Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8564561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8564750Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8564790Z graph_break [] 2025-12-04T09:45:51.8564862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8564905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8564973Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8565070Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8565261Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8565299Z graph_break [] 2025-12-04T09:45:51.8565373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8565414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8565470Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8565564Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8565760Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8565797Z graph_break [] 2025-12-04T09:45:51.8565871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8565912Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8565968Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8566062Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8566253Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8566289Z graph_break [] 2025-12-04T09:45:51.8566364Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8566415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8566473Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8566568Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8566758Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8566796Z graph_break [] 2025-12-04T09:45:51.8566870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8566910Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8566984Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8567080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8567269Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8567306Z graph_break [] 2025-12-04T09:45:51.8567381Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8567423Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8567477Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8567574Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8567776Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8567814Z graph_break [] 2025-12-04T09:45:51.8567888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8567933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8567988Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8568086Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8568287Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8568325Z graph_break [] 2025-12-04T09:45:51.8568397Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8568441Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8568494Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8568590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8568778Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8568816Z graph_break [] 2025-12-04T09:45:51.8568889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8568932Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8568985Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8569081Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8569272Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8569311Z graph_break [] 2025-12-04T09:45:51.8569383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8569426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8569480Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8569576Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8569773Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8569822Z graph_break [] 2025-12-04T09:45:51.8569916Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8569962Z Traceback (most recent call last): 2025-12-04T09:45:51.8570123Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8570180Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8570357Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8570418Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8570516Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8570577Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8570684Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8570738Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8570791Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8570794Z 2025-12-04T09:45:51.8570870Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8571031Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8571034Z 2025-12-04T09:45:51.8571120Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8571195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8571237Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8571294Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8571392Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8571598Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8571637Z graph_break [] 2025-12-04T09:45:51.8571708Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8571752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8571807Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8571904Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8572094Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8572131Z graph_break [] 2025-12-04T09:45:51.8572203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8572247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8572301Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8572401Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8572590Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8572629Z graph_break [] 2025-12-04T09:45:51.8572700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8572742Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8572797Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8572894Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8573122Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8573191Z graph_break [] 2025-12-04T09:45:51.8573266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8573311Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8573365Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8573465Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8573669Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8573708Z graph_break [] 2025-12-04T09:45:51.8573781Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8573821Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8573876Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8573972Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8574161Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8574198Z graph_break [] 2025-12-04T09:45:51.8574289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8574330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8574385Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8574481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8574673Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8574710Z graph_break [] 2025-12-04T09:45:51.8574783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8574824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8574894Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8574989Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8575180Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8575216Z graph_break [] 2025-12-04T09:45:51.8575290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8575330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8575386Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8575481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8575672Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8575709Z graph_break [] 2025-12-04T09:45:51.8575783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8575824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8575881Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8575976Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8576167Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8576204Z graph_break [] 2025-12-04T09:45:51.8576277Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8576331Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8576385Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8576481Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8576672Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8576711Z graph_break [] 2025-12-04T09:45:51.8576783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8576825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8576891Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8576988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8577175Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8577215Z graph_break [] 2025-12-04T09:45:51.8577288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8577334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8577388Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8577484Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8577684Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8577724Z graph_break [] 2025-12-04T09:45:51.8577796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8577839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8577893Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8577991Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8578193Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8578230Z graph_break [] 2025-12-04T09:45:51.8578303Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8578345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8578401Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8578496Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8578689Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8578725Z graph_break [] 2025-12-04T09:45:51.8578801Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8578844Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8578899Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8578996Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8579186Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8579223Z graph_break [] 2025-12-04T09:45:51.8579297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8579338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8579394Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8579488Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8579677Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8579739Z graph_break [] 2025-12-04T09:45:51.8579813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8579854Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8579911Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8580011Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8580217Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8580256Z graph_break [] 2025-12-04T09:45:51.8580329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8580371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8580426Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8580523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8580713Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8580762Z graph_break [] 2025-12-04T09:45:51.8580835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8580878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8580932Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8581031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8581220Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8581260Z graph_break [] 2025-12-04T09:45:51.8581333Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8581375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8581439Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8581536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8581726Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8581764Z graph_break [] 2025-12-04T09:45:51.8581837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8581880Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8581934Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8582032Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8582224Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8582263Z graph_break [] 2025-12-04T09:45:51.8582335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8582379Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8582432Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8582528Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8582718Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8582754Z graph_break [] 2025-12-04T09:45:51.8582827Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8582890Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8582987Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8583083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8583274Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8583312Z graph_break [] 2025-12-04T09:45:51.8583385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8583426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8583514Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8583609Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8583799Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8583836Z graph_break [] 2025-12-04T09:45:51.8583911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8583952Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8584011Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8584123Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8584314Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8584353Z graph_break [] 2025-12-04T09:45:51.8584427Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8584470Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8584528Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8584623Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8584848Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8584887Z graph_break [] 2025-12-04T09:45:51.8584961Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8585003Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8585057Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8585154Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8585343Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8585382Z graph_break [] 2025-12-04T09:45:51.8585455Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8585497Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8585552Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8585651Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8585841Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8585880Z graph_break [] 2025-12-04T09:45:51.8585952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8585995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8586050Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8586152Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8586363Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8586401Z graph_break [] 2025-12-04T09:45:51.8586476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8586518Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8586574Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8586671Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8586871Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8586910Z graph_break [] 2025-12-04T09:45:51.8586983Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8587025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8587081Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8587175Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8587365Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8587411Z graph_break [] 2025-12-04T09:45:51.8587486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8587526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8587582Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8587677Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8587867Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8587905Z graph_break [] 2025-12-04T09:45:51.8587979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8588033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8588090Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8588186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8588380Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8588416Z graph_break [] 2025-12-04T09:45:51.8588491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8588532Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8588588Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8588684Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8588876Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8588912Z graph_break [] 2025-12-04T09:45:51.8588987Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8589029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8589084Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8589181Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8589371Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8589409Z graph_break [] 2025-12-04T09:45:51.8589482Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8589539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8589593Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8589691Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8589878Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8589917Z graph_break [] 2025-12-04T09:45:51.8589990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8590045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8590100Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8590197Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8590386Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8590425Z graph_break [] 2025-12-04T09:45:51.8590498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8590540Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8590594Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8590703Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8590895Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8590933Z graph_break [] 2025-12-04T09:45:51.8591005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8591048Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8591103Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8591200Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8591418Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8594077Z graph_break [] 2025-12-04T09:45:51.8594154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8594195Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8594251Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8594348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8594540Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8594577Z graph_break [] 2025-12-04T09:45:51.8594651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8594692Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8594750Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8594846Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8595039Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8595075Z graph_break [] 2025-12-04T09:45:51.8595150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8595191Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8595246Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8595340Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8595568Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8595605Z graph_break [] 2025-12-04T09:45:51.8595680Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8595722Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8595778Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8595873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8596081Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8596118Z graph_break [] 2025-12-04T09:45:51.8596193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8596237Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8596291Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8596390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8596584Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8596639Z graph_break [] 2025-12-04T09:45:51.8596712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8596754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8596809Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8596906Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8597095Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8597134Z graph_break [] 2025-12-04T09:45:51.8597207Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8597267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8597322Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8597420Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8597611Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8597649Z graph_break [] 2025-12-04T09:45:51.8597739Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8597788Z Traceback (most recent call last): 2025-12-04T09:45:51.8597950Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8598011Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8598181Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8598244Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8598342Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8598409Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8598515Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8598571Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8598624Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8598626Z 2025-12-04T09:45:51.8598702Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8598868Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8598872Z 2025-12-04T09:45:51.8598958Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8599034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8599076Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8599133Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8599230Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8599438Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8599475Z graph_break [] 2025-12-04T09:45:51.8599550Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8599594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8599650Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8599745Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8599939Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8599987Z graph_break [] 2025-12-04T09:45:51.8600061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8600102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8600158Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8600255Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8600447Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8600485Z graph_break [] 2025-12-04T09:45:51.8600558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8600610Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8600664Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8600764Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8600955Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8600993Z graph_break [] 2025-12-04T09:45:51.8601065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8601108Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8601161Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8601259Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8601449Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8601487Z graph_break [] 2025-12-04T09:45:51.8601560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8601603Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8601656Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8601753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8601941Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8601979Z graph_break [] 2025-12-04T09:45:51.8602051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8602107Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8602161Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8602257Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8602445Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8602483Z graph_break [] 2025-12-04T09:45:51.8602558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8602610Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8602666Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8602763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8603005Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8603042Z graph_break [] 2025-12-04T09:45:51.8603117Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8603158Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8603213Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8603332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8603521Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8603558Z graph_break [] 2025-12-04T09:45:51.8603631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8603671Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8603728Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8603822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8604027Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8604065Z graph_break [] 2025-12-04T09:45:51.8604140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8604181Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8604237Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8604333Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8604523Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8604560Z graph_break [] 2025-12-04T09:45:51.8604635Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8604676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8604733Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8604831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8605021Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8605058Z graph_break [] 2025-12-04T09:45:51.8605131Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8605173Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8605227Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8605323Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8605531Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8605570Z graph_break [] 2025-12-04T09:45:51.8605644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8605687Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8605740Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8605836Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8606043Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8606083Z graph_break [] 2025-12-04T09:45:51.8606155Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8606199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8606252Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8606350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8606543Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8606605Z graph_break [] 2025-12-04T09:45:51.8606678Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8606721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8606775Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8606871Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8607063Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8607101Z graph_break [] 2025-12-04T09:45:51.8607175Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8607232Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8607289Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8607385Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8607575Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8607612Z graph_break [] 2025-12-04T09:45:51.8607686Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8607727Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8607782Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8607878Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8608067Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8608103Z graph_break [] 2025-12-04T09:45:51.8608176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8608218Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8608276Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8608372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8608567Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8608605Z graph_break [] 2025-12-04T09:45:51.8608695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8608735Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8608792Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8608888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8609080Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8609119Z graph_break [] 2025-12-04T09:45:51.8609192Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8609247Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8609302Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8609399Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8609589Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8609628Z graph_break [] 2025-12-04T09:45:51.8609703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8609746Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8609813Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8609912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8610100Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8610139Z graph_break [] 2025-12-04T09:45:51.8610212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8610255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8610310Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8610407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8610611Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8610650Z graph_break [] 2025-12-04T09:45:51.8610724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8610766Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8610819Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8610918Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8611108Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8611147Z graph_break [] 2025-12-04T09:45:51.8611220Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8611262Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8611317Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8611414Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8611604Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8611642Z graph_break [] 2025-12-04T09:45:51.8611717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8611760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8611814Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8611908Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8612111Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8612149Z graph_break [] 2025-12-04T09:45:51.8612223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8612265Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8612321Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8612417Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8612619Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8612656Z graph_break [] 2025-12-04T09:45:51.8612730Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8612772Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8612827Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8612922Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8613160Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8613223Z graph_break [] 2025-12-04T09:45:51.8613298Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8613338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8613394Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8613489Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8613679Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8613718Z graph_break [] 2025-12-04T09:45:51.8613811Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8613855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8613909Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8614006Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8614195Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8614233Z graph_break [] 2025-12-04T09:45:51.8614306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8614349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8614405Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8614507Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8614695Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8614733Z graph_break [] 2025-12-04T09:45:51.8614806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8614850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8614904Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8615001Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8615191Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8615249Z graph_break [] 2025-12-04T09:45:51.8615322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8615364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8615419Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8615520Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8615710Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8615748Z graph_break [] 2025-12-04T09:45:51.8615835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8615877Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8615932Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8616026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8616218Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8616255Z graph_break [] 2025-12-04T09:45:51.8616329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8616370Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8616436Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8616533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8616727Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8616763Z graph_break [] 2025-12-04T09:45:51.8616837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8616879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8616934Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8617028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8617228Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8617266Z graph_break [] 2025-12-04T09:45:51.8617340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8617382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8617438Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8617533Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8617723Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8617761Z graph_break [] 2025-12-04T09:45:51.8617837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8617879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8617933Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8618030Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8618221Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8618260Z graph_break [] 2025-12-04T09:45:51.8618333Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8618375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8618429Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8618536Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8618725Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8618763Z graph_break [] 2025-12-04T09:45:51.8618835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8618879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8618932Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8619029Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8619241Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8619280Z graph_break [] 2025-12-04T09:45:51.8619354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8619399Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8619452Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8619550Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8619740Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8619788Z graph_break [] 2025-12-04T09:45:51.8619861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8619906Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8619959Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8620056Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8620246Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8620284Z graph_break [] 2025-12-04T09:45:51.8620369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8620410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8620466Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8620562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8620755Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8620791Z graph_break [] 2025-12-04T09:45:51.8620865Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8620905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8620962Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8621057Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8621247Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8621284Z graph_break [] 2025-12-04T09:45:51.8621357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8621398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8621453Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8621549Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8621739Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8621787Z graph_break [] 2025-12-04T09:45:51.8621863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8621904Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8621960Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8622056Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8622250Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8622287Z graph_break [] 2025-12-04T09:45:51.8622370Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8622413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8622473Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8622573Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8622766Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8622807Z graph_break [] 2025-12-04T09:45:51.8622880Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8622970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8623026Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8623126Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8623318Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8623359Z graph_break [] 2025-12-04T09:45:51.8623449Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8623501Z Traceback (most recent call last): 2025-12-04T09:45:51.8623656Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8623739Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8623910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8623976Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8624074Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8624142Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8624248Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8624305Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8624358Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8624364Z 2025-12-04T09:45:51.8624439Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8624597Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8624601Z 2025-12-04T09:45:51.8624690Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8624770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8624813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8624873Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8624973Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8625168Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8625224Z graph_break [] 2025-12-04T09:45:51.8625301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8625344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8625403Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8625500Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8625691Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8625729Z graph_break [] 2025-12-04T09:45:51.8625824Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8625867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8625927Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8626023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8626218Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8626257Z graph_break [] 2025-12-04T09:45:51.8626334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8626378Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8626451Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8626551Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8626741Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8626782Z graph_break [] 2025-12-04T09:45:51.8626856Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8626902Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8626957Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8627065Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8627255Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8627298Z graph_break [] 2025-12-04T09:45:51.8627371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8627416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8627472Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8627570Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8627759Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8627799Z graph_break [] 2025-12-04T09:45:51.8627872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8627916Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8627970Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8628066Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8628256Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8628296Z graph_break [] 2025-12-04T09:45:51.8628369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8628415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8628469Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8628578Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8628769Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8628805Z graph_break [] 2025-12-04T09:45:51.8628878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8628921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8628976Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8629071Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8629273Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8629310Z graph_break [] 2025-12-04T09:45:51.8629385Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8629426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8629481Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8629576Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8629768Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8629815Z graph_break [] 2025-12-04T09:45:51.8629891Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8629933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8629990Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8630084Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8630276Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8630312Z graph_break [] 2025-12-04T09:45:51.8630399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8630441Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8630497Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8630593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8630784Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8630822Z graph_break [] 2025-12-04T09:45:51.8630894Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8630937Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8630991Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8631087Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8631276Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8631314Z graph_break [] 2025-12-04T09:45:51.8631387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8631430Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8631483Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8631581Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8631770Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8631833Z graph_break [] 2025-12-04T09:45:51.8631905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8631947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8632002Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8632100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8632294Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8632332Z graph_break [] 2025-12-04T09:45:51.8632416Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8632460Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8632513Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8632610Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8632802Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8632841Z graph_break [] 2025-12-04T09:45:51.8632913Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8633007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8633060Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8633157Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8633346Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8633383Z graph_break [] 2025-12-04T09:45:51.8633458Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8633501Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8633558Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8633667Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8633858Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8633896Z graph_break [] 2025-12-04T09:45:51.8633969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8634010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8634067Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8634162Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8634354Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8634392Z graph_break [] 2025-12-04T09:45:51.8634467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8634507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8634562Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8634658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8634847Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8634883Z graph_break [] 2025-12-04T09:45:51.8634957Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8634998Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8635053Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8635161Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8635350Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8635388Z graph_break [] 2025-12-04T09:45:51.8635463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8635506Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8635560Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8635668Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8635857Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8635895Z graph_break [] 2025-12-04T09:45:51.8635968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8636010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8636065Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8636161Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8636366Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8636403Z graph_break [] 2025-12-04T09:45:51.8636476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8636519Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8636573Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8636670Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8636862Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8636899Z graph_break [] 2025-12-04T09:45:51.8636985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8637032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8637087Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8637183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8637370Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8637409Z graph_break [] 2025-12-04T09:45:51.8637482Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8637524Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8637580Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8637675Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8637864Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8637902Z graph_break [] 2025-12-04T09:45:51.8637975Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8638015Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8638074Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8638171Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8638364Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8638414Z graph_break [] 2025-12-04T09:45:51.8638487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8638529Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8638584Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8638679Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8638872Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8638908Z graph_break [] 2025-12-04T09:45:51.8638992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8639034Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8639089Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8639186Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8639375Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8639412Z graph_break [] 2025-12-04T09:45:51.8639487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8639541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8639595Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8639691Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8639878Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8639916Z graph_break [] 2025-12-04T09:45:51.8639988Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8640032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8640086Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8640205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8640395Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8640434Z graph_break [] 2025-12-04T09:45:51.8640506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8640550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8640604Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8640701Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8640890Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8640929Z graph_break [] 2025-12-04T09:45:51.8641001Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8641044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8641097Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8641196Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8641386Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8641424Z graph_break [] 2025-12-04T09:45:51.8641497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8641539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8641605Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8641701Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8641892Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8641929Z graph_break [] 2025-12-04T09:45:51.8642002Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8642043Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8642099Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8642205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8642395Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8642432Z graph_break [] 2025-12-04T09:45:51.8642507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8642547Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8642603Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8642698Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8642897Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8642969Z graph_break [] 2025-12-04T09:45:51.8643044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8643085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8643140Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8643235Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8643426Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8643498Z graph_break [] 2025-12-04T09:45:51.8643573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8643615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8643670Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8643766Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8643958Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8643996Z graph_break [] 2025-12-04T09:45:51.8644069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8644113Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8644167Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8644266Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8644457Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8644496Z graph_break [] 2025-12-04T09:45:51.8644568Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8644611Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8644666Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8644763Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8644953Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8645013Z graph_break [] 2025-12-04T09:45:51.8645086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8645131Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8645186Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8645282Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8645470Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8645524Z graph_break [] 2025-12-04T09:45:51.8645597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8645640Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8645693Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8645793Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8645983Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8646021Z graph_break [] 2025-12-04T09:45:51.8646095Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8646151Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8646209Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8646305Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8646494Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8646529Z graph_break [] 2025-12-04T09:45:51.8646606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8646647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8646702Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8646809Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8647000Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8647038Z graph_break [] 2025-12-04T09:45:51.8647111Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8647152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8647208Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8647303Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8647494Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8647530Z graph_break [] 2025-12-04T09:45:51.8647607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8647648Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8647705Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8647800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8647997Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8648034Z graph_break [] 2025-12-04T09:45:51.8648108Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8648150Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8648219Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8648315Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8648510Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8648549Z graph_break [] 2025-12-04T09:45:51.8648621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8648663Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8648717Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8648824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8649013Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8649052Z graph_break [] 2025-12-04T09:45:51.8649124Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8649167Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8649221Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8649318Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8649517Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8649555Z graph_break [] 2025-12-04T09:45:51.8649644Z ___________ CudaReproTests.test_truediv_base_not_bitwise_equivalent ____________ 2025-12-04T09:45:51.8649692Z Traceback (most recent call last): 2025-12-04T09:45:51.8649846Z File "/var/lib/jenkins/pytorch/test/inductor/test_cuda_repro.py", line 2657, in test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8649905Z self.assertNotEqual(eager_div, compiled_div) 2025-12-04T09:45:51.8650084Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4293, in assertNotEqual 2025-12-04T09:45:51.8650147Z with self.assertRaises(AssertionError, msg=msg): 2025-12-04T09:45:51.8650243Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 263, in __exit__ 2025-12-04T09:45:51.8650308Z self._raiseFailure("{} not raised".format(exc_name)) 2025-12-04T09:45:51.8650412Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 200, in _raiseFailure 2025-12-04T09:45:51.8650469Z raise self.test_case.failureException(msg) 2025-12-04T09:45:51.8650521Z AssertionError: AssertionError not raised 2025-12-04T09:45:51.8650525Z 2025-12-04T09:45:51.8650600Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8650751Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8650754Z 2025-12-04T09:45:51.8650840Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8650916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8650959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8651015Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8651114Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8651313Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8651352Z graph_break [] 2025-12-04T09:45:51.8651428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8651471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8651544Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8651641Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8651837Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8651876Z graph_break [] 2025-12-04T09:45:51.8651951Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8651994Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8652051Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8652157Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8652349Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8652390Z graph_break [] 2025-12-04T09:45:51.8652464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8652509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8652564Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8652666Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8652867Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8652907Z graph_break [] 2025-12-04T09:45:51.8653022Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8653068Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8653122Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8653222Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8653413Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8653466Z graph_break [] 2025-12-04T09:45:51.8653539Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8653585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8653641Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8653740Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8653931Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8653972Z graph_break [] 2025-12-04T09:45:51.8654044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8654090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8654145Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8654243Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8654432Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8654473Z graph_break [] 2025-12-04T09:45:51.8654549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8654596Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8654653Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8654753Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8654945Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8654994Z graph_break [] 2025-12-04T09:45:51.8655072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8655116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8655174Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8655271Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8655462Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8655511Z graph_break [] 2025-12-04T09:45:51.8655586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8655628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8655685Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8655783Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8655975Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8656013Z graph_break [] 2025-12-04T09:45:51.8656088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8656156Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8656214Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8656311Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8656503Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8656540Z graph_break [] 2025-12-04T09:45:51.8656618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8656660Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8656716Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8656824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8657016Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8657056Z graph_break [] 2025-12-04T09:45:51.8657133Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8657177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8657232Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8657330Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8657521Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8657563Z graph_break [] 2025-12-04T09:45:51.8657638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8657683Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8657740Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8657838Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8658029Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8658071Z graph_break [] 2025-12-04T09:45:51.8658144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8658188Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8658255Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8658353Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8658548Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8658590Z graph_break [] 2025-12-04T09:45:51.8658664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8658710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8658764Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8658873Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8659063Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8659104Z graph_break [] 2025-12-04T09:45:51.8659179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8659222Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8659281Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8659377Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8659579Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8659616Z graph_break [] 2025-12-04T09:45:51.8659692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8659734Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8659793Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8659889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8660094Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8660132Z graph_break [] 2025-12-04T09:45:51.8660207Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8660252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8660309Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8660405Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8660603Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8660641Z graph_break [] 2025-12-04T09:45:51.8660716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8660761Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8660818Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8660914Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8661104Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8661143Z graph_break [] 2025-12-04T09:45:51.8661220Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8661264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8661320Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8661418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8661607Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8661662Z graph_break [] 2025-12-04T09:45:51.8661737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8661784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8661839Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8661939Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8662140Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8662182Z graph_break [] 2025-12-04T09:45:51.8662256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8662302Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8662359Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8662457Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8662656Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8662698Z graph_break [] 2025-12-04T09:45:51.8662781Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8662826Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8662881Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8663021Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8663210Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8663252Z graph_break [] 2025-12-04T09:45:51.8663325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8663371Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8663457Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8663557Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8663749Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8663785Z graph_break [] 2025-12-04T09:45:51.8663861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8663903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8663960Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8664056Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8664250Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8664288Z graph_break [] 2025-12-04T09:45:51.8664364Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8664405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8664464Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8664560Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8664760Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8664798Z graph_break [] 2025-12-04T09:45:51.8664874Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8664934Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8664992Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8665089Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8665280Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8665320Z graph_break [] 2025-12-04T09:45:51.8665396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8665437Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8665509Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8665605Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8665802Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8665844Z graph_break [] 2025-12-04T09:45:51.8665918Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8665965Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8666020Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8666120Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8666326Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8666368Z graph_break [] 2025-12-04T09:45:51.8666441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8666486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8666541Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8666642Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8666851Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8666893Z graph_break [] 2025-12-04T09:45:51.8666966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8667013Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8667068Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8667167Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8667357Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8667397Z graph_break [] 2025-12-04T09:45:51.8667471Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8667516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8667572Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8667673Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8667865Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8667905Z graph_break [] 2025-12-04T09:45:51.8667982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8668025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8668082Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8668178Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8668383Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8668421Z graph_break [] 2025-12-04T09:45:51.8668497Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8668539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8668597Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8668693Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8668906Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8668944Z graph_break [] 2025-12-04T09:45:51.8669020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8669061Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8669121Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8669217Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8669414Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8669465Z graph_break [] 2025-12-04T09:45:51.8669542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8669584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8669642Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8669740Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8669933Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8669971Z graph_break [] 2025-12-04T09:45:51.8670047Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8670089Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8670156Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8670253Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8670445Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8670484Z graph_break [] 2025-12-04T09:45:51.8670559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8670602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8670658Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8670755Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8670951Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8670990Z graph_break [] 2025-12-04T09:45:51.8671064Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8671111Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8671165Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8671266Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8671457Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8671496Z graph_break [] 2025-12-04T09:45:51.8671569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8671626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8671680Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8671780Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8671968Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8672008Z graph_break [] 2025-12-04T09:45:51.8672081Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8672126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8672193Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8672291Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8672480Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8672517Z graph_break [] 2025-12-04T09:45:51.8672592Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8672633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8672690Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8672795Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8673024Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8673062Z graph_break [] 2025-12-04T09:45:51.8673136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8673177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8673232Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8673328Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8673529Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8673566Z graph_break [] 2025-12-04T09:45:51.8673642Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8673682Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8673738Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8673834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8674024Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8674061Z graph_break [] 2025-12-04T09:45:51.8674134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8674174Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8674231Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8674326Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8674519Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8674556Z graph_break [] 2025-12-04T09:45:51.8674630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8674672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8674726Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8674822Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8675027Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8675064Z graph_break [] 2025-12-04T09:45:51.8675138Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8675180Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8675235Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8675332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8675529Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8675567Z graph_break [] 2025-12-04T09:45:51.8675639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8675682Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8675737Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8675834Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8676024Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8676072Z graph_break [] 2025-12-04T09:45:51.8676144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:45:51.8676190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:45:51.8676244Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:45:51.8676343Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:45:51.8676532Z inductor [('triton_bundler_save_kernel', 8), ('async_compile_cache_miss', 2), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:45:51.8676571Z graph_break [] 2025-12-04T09:45:51.8676794Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_cuda_repro/inductor.test_cuda_repro-b0344b87bda3722c.xml - 2025-12-04T09:45:51.8676858Z =========================== short test summary info ============================ 2025-12-04T09:45:51.8677105Z FAILED [3.1813s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8677107Z 2025-12-04T09:45:51.8677162Z Mismatched elements: 6283264 / 44040192 (14.3%) 2025-12-04T09:45:51.8677257Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8677346Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8677348Z 2025-12-04T09:45:51.8677396Z The failure occurred for item [0] 2025-12-04T09:45:51.8677399Z 2025-12-04T09:45:51.8677474Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8677648Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8677651Z 2025-12-04T09:45:51.8677737Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8677845Z FAILED [0.3171s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8678026Z FAILED [0.2162s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8678031Z 2025-12-04T09:45:51.8678104Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8678255Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8678258Z 2025-12-04T09:45:51.8678354Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8678555Z FAILED [1.8778s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8678557Z 2025-12-04T09:45:51.8678611Z Mismatched elements: 37748736 / 44040192 (85.7%) 2025-12-04T09:45:51.8678701Z Greatest absolute difference: nan at index (0, 8, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8678788Z Greatest relative difference: nan at index (0, 8, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8678790Z 2025-12-04T09:45:51.8678836Z The failure occurred for item [0] 2025-12-04T09:45:51.8678840Z 2025-12-04T09:45:51.8678922Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8679092Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8679094Z 2025-12-04T09:45:51.8679180Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8679379Z FAILED [2.5206s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8679381Z 2025-12-04T09:45:51.8679436Z Mismatched elements: 6283264 / 44040192 (14.3%) 2025-12-04T09:45:51.8679524Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8679621Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8679623Z 2025-12-04T09:45:51.8679667Z The failure occurred for item [0] 2025-12-04T09:45:51.8679669Z 2025-12-04T09:45:51.8679743Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8679910Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8679912Z 2025-12-04T09:45:51.8679999Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8680203Z FAILED [1.8443s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8680204Z 2025-12-04T09:45:51.8680259Z Mismatched elements: 6291456 / 44040192 (14.3%) 2025-12-04T09:45:51.8680346Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8680433Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8680434Z 2025-12-04T09:45:51.8680480Z The failure occurred for item [0] 2025-12-04T09:45:51.8680482Z 2025-12-04T09:45:51.8680553Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8680722Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8680726Z 2025-12-04T09:45:51.8680809Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8681013Z FAILED [1.7981s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8681015Z 2025-12-04T09:45:51.8681069Z Mismatched elements: 22020096 / 44040192 (50.0%) 2025-12-04T09:45:51.8681161Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8681247Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8681249Z 2025-12-04T09:45:51.8681295Z The failure occurred for item [0] 2025-12-04T09:45:51.8681297Z 2025-12-04T09:45:51.8681367Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8681533Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8681562Z 2025-12-04T09:45:51.8681647Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8681842Z FAILED [5.4313s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8681844Z 2025-12-04T09:45:51.8681896Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8681989Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8682080Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8682082Z 2025-12-04T09:45:51.8682125Z The failure occurred for item [0] 2025-12-04T09:45:51.8682128Z 2025-12-04T09:45:51.8682212Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8682378Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8682381Z 2025-12-04T09:45:51.8682466Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8682662Z FAILED [1.8298s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8682666Z 2025-12-04T09:45:51.8682715Z Mismatched elements: 56832 / 44040192 (0.1%) 2025-12-04T09:45:51.8682816Z Greatest absolute difference: nan at index (0, 0, 20, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8682904Z Greatest relative difference: nan at index (0, 0, 20, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8682906Z 2025-12-04T09:45:51.8682987Z The failure occurred for item [0] 2025-12-04T09:45:51.8682989Z 2025-12-04T09:45:51.8683062Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8683229Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8683233Z 2025-12-04T09:45:51.8683317Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8683548Z FAILED [1.8259s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8683550Z 2025-12-04T09:45:51.8683605Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8683697Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8683782Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8683784Z 2025-12-04T09:45:51.8683830Z The failure occurred for item [0] 2025-12-04T09:45:51.8683832Z 2025-12-04T09:45:51.8683905Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8684072Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8684074Z 2025-12-04T09:45:51.8684159Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8684359Z FAILED [4.4375s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8684361Z 2025-12-04T09:45:51.8684412Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8684504Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8684593Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8684595Z 2025-12-04T09:45:51.8684639Z The failure occurred for item [0] 2025-12-04T09:45:51.8684642Z 2025-12-04T09:45:51.8684714Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8684880Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8684903Z 2025-12-04T09:45:51.8684987Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8685184Z FAILED [3.6453s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8685186Z 2025-12-04T09:45:51.8685236Z Mismatched elements: 2048 / 43739136 (0.0%) 2025-12-04T09:45:51.8685334Z Greatest absolute difference: nan at index (0, 24, 1760, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8685423Z Greatest relative difference: nan at index (0, 24, 1760, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8685426Z 2025-12-04T09:45:51.8685471Z The failure occurred for item [0] 2025-12-04T09:45:51.8685489Z 2025-12-04T09:45:51.8685561Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8685729Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8685732Z 2025-12-04T09:45:51.8685816Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8686018Z FAILED [4.1509s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8686019Z 2025-12-04T09:45:51.8686069Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8686178Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8686267Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8686269Z 2025-12-04T09:45:51.8686312Z The failure occurred for item [0] 2025-12-04T09:45:51.8686315Z 2025-12-04T09:45:51.8686391Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8686560Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8686562Z 2025-12-04T09:45:51.8686648Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8686856Z FAILED [3.6576s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8686858Z 2025-12-04T09:45:51.8686909Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8686998Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8687087Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8687089Z 2025-12-04T09:45:51.8687133Z The failure occurred for item [0] 2025-12-04T09:45:51.8687136Z 2025-12-04T09:45:51.8687208Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8687375Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8687378Z 2025-12-04T09:45:51.8687461Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8687657Z FAILED [2.4417s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8687659Z 2025-12-04T09:45:51.8687711Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8687803Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8687888Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8687890Z 2025-12-04T09:45:51.8687935Z The failure occurred for item [0] 2025-12-04T09:45:51.8687937Z 2025-12-04T09:45:51.8688008Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8688176Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8688188Z 2025-12-04T09:45:51.8688276Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8688472Z FAILED [1.7880s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8688474Z 2025-12-04T09:45:51.8688529Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8688616Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8688703Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8688705Z 2025-12-04T09:45:51.8688759Z The failure occurred for item [0] 2025-12-04T09:45:51.8688761Z 2025-12-04T09:45:51.8688834Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8688999Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8689002Z 2025-12-04T09:45:51.8689087Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8689285Z FAILED [3.6329s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8689287Z 2025-12-04T09:45:51.8689337Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8689437Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8689526Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8689529Z 2025-12-04T09:45:51.8689575Z The failure occurred for item [0] 2025-12-04T09:45:51.8689578Z 2025-12-04T09:45:51.8689649Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8689820Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8689823Z 2025-12-04T09:45:51.8689906Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8690110Z FAILED [2.6487s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8690112Z 2025-12-04T09:45:51.8690165Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8690255Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8690340Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8690341Z 2025-12-04T09:45:51.8690387Z The failure occurred for item [0] 2025-12-04T09:45:51.8690390Z 2025-12-04T09:45:51.8690460Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8690627Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8690630Z 2025-12-04T09:45:51.8690714Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8690909Z FAILED [1.8190s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8690911Z 2025-12-04T09:45:51.8690967Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8691056Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8691145Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8691147Z 2025-12-04T09:45:51.8691191Z The failure occurred for item [0] 2025-12-04T09:45:51.8691193Z 2025-12-04T09:45:51.8691266Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8691431Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8691444Z 2025-12-04T09:45:51.8691529Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8691724Z FAILED [3.6503s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8691726Z 2025-12-04T09:45:51.8691776Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8691866Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8691955Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8691957Z 2025-12-04T09:45:51.8692013Z The failure occurred for item [0] 2025-12-04T09:45:51.8692015Z 2025-12-04T09:45:51.8692086Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8692254Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8692257Z 2025-12-04T09:45:51.8692341Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8692541Z FAILED [1.7971s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8692543Z 2025-12-04T09:45:51.8692605Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8692693Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8692779Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8692780Z 2025-12-04T09:45:51.8692827Z The failure occurred for item [0] 2025-12-04T09:45:51.8692829Z 2025-12-04T09:45:51.8692899Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8693108Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8693111Z 2025-12-04T09:45:51.8693196Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8693420Z FAILED [2.5821s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8693422Z 2025-12-04T09:45:51.8693477Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8693564Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8693650Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8693652Z 2025-12-04T09:45:51.8693696Z The failure occurred for item [0] 2025-12-04T09:45:51.8693700Z 2025-12-04T09:45:51.8693772Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8693938Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8693941Z 2025-12-04T09:45:51.8694026Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8694223Z FAILED [3.6104s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8694227Z 2025-12-04T09:45:51.8694276Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8694366Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8694454Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8694456Z 2025-12-04T09:45:51.8694503Z The failure occurred for item [0] 2025-12-04T09:45:51.8694505Z 2025-12-04T09:45:51.8694576Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8694742Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8694756Z 2025-12-04T09:45:51.8694840Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8695038Z FAILED [1.7781s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8695041Z 2025-12-04T09:45:51.8695092Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8695181Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8695266Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8695269Z 2025-12-04T09:45:51.8695323Z The failure occurred for item [0] 2025-12-04T09:45:51.8695325Z 2025-12-04T09:45:51.8695398Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8695565Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8695568Z 2025-12-04T09:45:51.8695653Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8695847Z FAILED [2.7009s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8695859Z 2025-12-04T09:45:51.8695913Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8696000Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8696086Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8696088Z 2025-12-04T09:45:51.8696133Z The failure occurred for item [0] 2025-12-04T09:45:51.8696134Z 2025-12-04T09:45:51.8696207Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8696372Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8696376Z 2025-12-04T09:45:51.8696463Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8696670Z FAILED [3.5635s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8696673Z 2025-12-04T09:45:51.8696722Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8696814Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8696901Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8696904Z 2025-12-04T09:45:51.8696949Z The failure occurred for item [0] 2025-12-04T09:45:51.8696951Z 2025-12-04T09:45:51.8697021Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8697191Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8697193Z 2025-12-04T09:45:51.8697279Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8697476Z FAILED [1.7846s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8697479Z 2025-12-04T09:45:51.8697530Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8697620Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8697707Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8697710Z 2025-12-04T09:45:51.8697753Z The failure occurred for item [0] 2025-12-04T09:45:51.8697755Z 2025-12-04T09:45:51.8697833Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8697998Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8698012Z 2025-12-04T09:45:51.8698098Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8698292Z FAILED [1.7655s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8698294Z 2025-12-04T09:45:51.8698348Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8698436Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8698523Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8698535Z 2025-12-04T09:45:51.8698579Z The failure occurred for item [0] 2025-12-04T09:45:51.8698583Z 2025-12-04T09:45:51.8698655Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8698821Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8698824Z 2025-12-04T09:45:51.8698906Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8699103Z FAILED [4.4861s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8699115Z 2025-12-04T09:45:51.8699164Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8699254Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8699341Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8699344Z 2025-12-04T09:45:51.8699389Z The failure occurred for item [0] 2025-12-04T09:45:51.8699391Z 2025-12-04T09:45:51.8699464Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8699633Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8699635Z 2025-12-04T09:45:51.8699720Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8699927Z FAILED [1.7929s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8699930Z 2025-12-04T09:45:51.8699984Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8700071Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8700158Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8700160Z 2025-12-04T09:45:51.8700205Z The failure occurred for item [0] 2025-12-04T09:45:51.8700206Z 2025-12-04T09:45:51.8700279Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8700446Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8700448Z 2025-12-04T09:45:51.8700534Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8700731Z FAILED [1.7875s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8700733Z 2025-12-04T09:45:51.8700787Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8700874Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8700961Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8700963Z 2025-12-04T09:45:51.8701008Z The failure occurred for item [0] 2025-12-04T09:45:51.8701010Z 2025-12-04T09:45:51.8701081Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8701247Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8701260Z 2025-12-04T09:45:51.8701344Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8701541Z FAILED [4.5761s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8701544Z 2025-12-04T09:45:51.8701592Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8701683Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8701781Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8701783Z 2025-12-04T09:45:51.8701829Z The failure occurred for item [0] 2025-12-04T09:45:51.8701830Z 2025-12-04T09:45:51.8701901Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8702071Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8702074Z 2025-12-04T09:45:51.8702162Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8702357Z FAILED [1.8216s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8702369Z 2025-12-04T09:45:51.8702424Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8702512Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8702601Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8702603Z 2025-12-04T09:45:51.8702646Z The failure occurred for item [0] 2025-12-04T09:45:51.8702648Z 2025-12-04T09:45:51.8702720Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8702885Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8702887Z 2025-12-04T09:45:51.8703047Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8703245Z FAILED [1.7679s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8703249Z 2025-12-04T09:45:51.8703301Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8703389Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8703474Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8703476Z 2025-12-04T09:45:51.8703521Z The failure occurred for item [0] 2025-12-04T09:45:51.8703524Z 2025-12-04T09:45:51.8703594Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8703761Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8703764Z 2025-12-04T09:45:51.8703846Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8704042Z FAILED [3.5569s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8704045Z 2025-12-04T09:45:51.8704094Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8704185Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8704273Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8704274Z 2025-12-04T09:45:51.8704320Z The failure occurred for item [0] 2025-12-04T09:45:51.8704322Z 2025-12-04T09:45:51.8704393Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8704582Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8704584Z 2025-12-04T09:45:51.8704672Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8704868Z FAILED [1.7854s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8704871Z 2025-12-04T09:45:51.8704924Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8705011Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8705111Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8705113Z 2025-12-04T09:45:51.8705157Z The failure occurred for item [0] 2025-12-04T09:45:51.8705159Z 2025-12-04T09:45:51.8705232Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8705398Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8705400Z 2025-12-04T09:45:51.8705489Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8705684Z FAILED [2.7819s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8705710Z 2025-12-04T09:45:51.8705762Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8705851Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8705937Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8705939Z 2025-12-04T09:45:51.8705984Z The failure occurred for item [0] 2025-12-04T09:45:51.8705985Z 2025-12-04T09:45:51.8706056Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8706226Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8706228Z 2025-12-04T09:45:51.8706322Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8706518Z FAILED [3.5691s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8706521Z 2025-12-04T09:45:51.8706571Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8706665Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8706753Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8706757Z 2025-12-04T09:45:51.8706801Z The failure occurred for item [0] 2025-12-04T09:45:51.8706806Z 2025-12-04T09:45:51.8706880Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8707047Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8707049Z 2025-12-04T09:45:51.8707137Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8707330Z FAILED [1.7885s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8707332Z 2025-12-04T09:45:51.8707385Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8707472Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8707559Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8707561Z 2025-12-04T09:45:51.8707604Z The failure occurred for item [0] 2025-12-04T09:45:51.8707606Z 2025-12-04T09:45:51.8707678Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8707859Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8707862Z 2025-12-04T09:45:51.8707947Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8708145Z FAILED [1.7838s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8708148Z 2025-12-04T09:45:51.8708199Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8708287Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8708383Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8708385Z 2025-12-04T09:45:51.8708430Z The failure occurred for item [0] 2025-12-04T09:45:51.8708432Z 2025-12-04T09:45:51.8708503Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8708671Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8708673Z 2025-12-04T09:45:51.8708757Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8708953Z FAILED [4.6151s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8708965Z 2025-12-04T09:45:51.8709015Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8709106Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8709195Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8709197Z 2025-12-04T09:45:51.8709241Z The failure occurred for item [0] 2025-12-04T09:45:51.8709243Z 2025-12-04T09:45:51.8709315Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8709481Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8709482Z 2025-12-04T09:45:51.8709576Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8709769Z FAILED [1.7815s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8709772Z 2025-12-04T09:45:51.8709825Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8709913Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8710001Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8710003Z 2025-12-04T09:45:51.8710047Z The failure occurred for item [0] 2025-12-04T09:45:51.8710052Z 2025-12-04T09:45:51.8710123Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8710294Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8710296Z 2025-12-04T09:45:51.8710384Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8710579Z FAILED [1.7683s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8710582Z 2025-12-04T09:45:51.8710633Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8710722Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8710808Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8710809Z 2025-12-04T09:45:51.8710854Z The failure occurred for item [0] 2025-12-04T09:45:51.8710856Z 2025-12-04T09:45:51.8710927Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8711110Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8711112Z 2025-12-04T09:45:51.8711197Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8711394Z FAILED [3.9974s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8711396Z 2025-12-04T09:45:51.8711447Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8711536Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8711870Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8711872Z 2025-12-04T09:45:51.8711916Z The failure occurred for item [0] 2025-12-04T09:45:51.8711919Z 2025-12-04T09:45:51.8711991Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8712157Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8712159Z 2025-12-04T09:45:51.8712244Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8712437Z FAILED [2.8393s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8712450Z 2025-12-04T09:45:51.8712503Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8712590Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8712677Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8712679Z 2025-12-04T09:45:51.8712724Z The failure occurred for item [0] 2025-12-04T09:45:51.8712726Z 2025-12-04T09:45:51.8712799Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8713007Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8713009Z 2025-12-04T09:45:51.8713106Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8713301Z FAILED [1.7960s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8713304Z 2025-12-04T09:45:51.8713356Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8713444Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8713529Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8713531Z 2025-12-04T09:45:51.8713576Z The failure occurred for item [0] 2025-12-04T09:45:51.8713578Z 2025-12-04T09:45:51.8713648Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8713815Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8713817Z 2025-12-04T09:45:51.8713902Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8714097Z FAILED [3.5544s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8714100Z 2025-12-04T09:45:51.8714150Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8714239Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8714329Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8714331Z 2025-12-04T09:45:51.8714374Z The failure occurred for item [0] 2025-12-04T09:45:51.8714376Z 2025-12-04T09:45:51.8714448Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8714628Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8714630Z 2025-12-04T09:45:51.8714716Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8714911Z FAILED [1.7584s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8714916Z 2025-12-04T09:45:51.8714967Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8717494Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8717602Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8717604Z 2025-12-04T09:45:51.8717651Z The failure occurred for item [0] 2025-12-04T09:45:51.8717653Z 2025-12-04T09:45:51.8717725Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8717895Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8717897Z 2025-12-04T09:45:51.8717986Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8718188Z FAILED [1.7773s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8718203Z 2025-12-04T09:45:51.8718256Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8718347Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8718431Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8718433Z 2025-12-04T09:45:51.8718479Z The failure occurred for item [0] 2025-12-04T09:45:51.8718480Z 2025-12-04T09:45:51.8718553Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8718722Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8718724Z 2025-12-04T09:45:51.8718825Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8719020Z FAILED [4.6979s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8719023Z 2025-12-04T09:45:51.8719074Z Mismatched elements: 56832 / 43739136 (0.1%) 2025-12-04T09:45:51.8719166Z Greatest absolute difference: nan at index (0, 0, 560, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8719257Z Greatest relative difference: nan at index (0, 0, 560, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8719259Z 2025-12-04T09:45:51.8719302Z The failure occurred for item [0] 2025-12-04T09:45:51.8719304Z 2025-12-04T09:45:51.8719378Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8719547Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8719550Z 2025-12-04T09:45:51.8719637Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8719831Z FAILED [1.7819s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8719838Z 2025-12-04T09:45:51.8719890Z Mismatched elements: 43682304 / 44040192 (99.2%) 2025-12-04T09:45:51.8719980Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8720065Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8720067Z 2025-12-04T09:45:51.8720112Z The failure occurred for item [0] 2025-12-04T09:45:51.8720114Z 2025-12-04T09:45:51.8720200Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8720369Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8720372Z 2025-12-04T09:45:51.8720457Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8720655Z FAILED [1.7742s] inductor/test_cuda_repro.py::CudaReproTests::test_qwen2_7b_sdpa_input_alignment_requires_recompile - AssertionError: Tensor-likes are not close! 2025-12-04T09:45:51.8720658Z 2025-12-04T09:45:51.8720709Z Mismatched elements: 43739136 / 44040192 (99.3%) 2025-12-04T09:45:51.8720823Z Greatest absolute difference: nan at index (0, 0, 0, 0) (up to 1e-05 allowed) 2025-12-04T09:45:51.8720908Z Greatest relative difference: nan at index (0, 0, 0, 0) (up to 0.016 allowed) 2025-12-04T09:45:51.8720911Z 2025-12-04T09:45:51.8720955Z The failure occurred for item [0] 2025-12-04T09:45:51.8720957Z 2025-12-04T09:45:51.8721030Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8721197Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_qwen2_7b_sdpa_input_alignment_requires_recompile 2025-12-04T09:45:51.8721200Z 2025-12-04T09:45:51.8721289Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8721391Z FAILED [0.1633s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8721506Z FAILED [0.1447s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8721604Z FAILED [0.1454s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8721707Z FAILED [0.1441s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8721808Z FAILED [0.1450s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8721906Z FAILED [0.1442s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722003Z FAILED [0.1491s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722111Z FAILED [0.1450s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722208Z FAILED [0.1454s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722309Z FAILED [0.1473s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722407Z FAILED [0.1452s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722507Z FAILED [0.1457s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722604Z FAILED [0.1450s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722702Z FAILED [0.1472s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722801Z FAILED [0.1426s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8722897Z FAILED [0.1452s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723043Z FAILED [0.1485s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723140Z FAILED [0.1468s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723243Z FAILED [0.1460s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723343Z FAILED [0.1494s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723441Z FAILED [0.1443s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723538Z FAILED [0.1439s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723635Z FAILED [0.1407s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723769Z FAILED [0.1423s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723866Z FAILED [0.1433s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8723963Z FAILED [0.1429s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724061Z FAILED [0.1493s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724158Z FAILED [0.1467s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724256Z FAILED [0.1446s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724370Z FAILED [0.1430s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724468Z FAILED [0.1425s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724564Z FAILED [0.1417s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724663Z FAILED [0.1416s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724761Z FAILED [1.4032s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724857Z FAILED [0.1461s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8724955Z FAILED [0.1605s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725068Z FAILED [0.1457s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725166Z FAILED [0.1529s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725264Z FAILED [0.1516s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725365Z FAILED [0.1498s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725462Z FAILED [0.1553s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725561Z FAILED [0.1490s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725671Z FAILED [0.1499s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725770Z FAILED [0.1490s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725868Z FAILED [0.1591s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8725968Z FAILED [0.1555s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8726066Z FAILED [0.1474s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8726164Z FAILED [0.1461s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8726260Z FAILED [0.1498s] inductor/test_cuda_repro.py::CudaReproTests::test_repeated_masked_load 2025-12-04T09:45:51.8726442Z FAILED [0.0778s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8726444Z 2025-12-04T09:45:51.8726520Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8726672Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8726675Z 2025-12-04T09:45:51.8726761Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8726939Z FAILED [0.0786s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8726942Z 2025-12-04T09:45:51.8727015Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8727164Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8727179Z 2025-12-04T09:45:51.8727264Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8727441Z FAILED [0.0763s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8727444Z 2025-12-04T09:45:51.8727516Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8727667Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8727671Z 2025-12-04T09:45:51.8727754Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8727941Z FAILED [0.0787s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8727943Z 2025-12-04T09:45:51.8728015Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8728165Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8728167Z 2025-12-04T09:45:51.8728251Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8728428Z FAILED [0.0811s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8728441Z 2025-12-04T09:45:51.8728512Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8728661Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8728663Z 2025-12-04T09:45:51.8728748Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8728926Z FAILED [0.0781s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8728929Z 2025-12-04T09:45:51.8729000Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8729158Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8729161Z 2025-12-04T09:45:51.8729246Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8729422Z FAILED [0.0758s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8729424Z 2025-12-04T09:45:51.8729496Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8729643Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8729645Z 2025-12-04T09:45:51.8729732Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8729916Z FAILED [0.0791s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8729918Z 2025-12-04T09:45:51.8729991Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8730139Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8730142Z 2025-12-04T09:45:51.8730228Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8730404Z FAILED [0.0776s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8730407Z 2025-12-04T09:45:51.8730478Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8730626Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8730640Z 2025-12-04T09:45:51.8730723Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8730901Z FAILED [0.0761s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8730903Z 2025-12-04T09:45:51.8730975Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8731127Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8731130Z 2025-12-04T09:45:51.8731213Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8731399Z FAILED [0.0779s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8731401Z 2025-12-04T09:45:51.8731473Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8731621Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8731622Z 2025-12-04T09:45:51.8731707Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8731880Z FAILED [0.0781s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8731892Z 2025-12-04T09:45:51.8731964Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8732111Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8732114Z 2025-12-04T09:45:51.8732198Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8732374Z FAILED [0.0755s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8732378Z 2025-12-04T09:45:51.8732450Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8732611Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8732613Z 2025-12-04T09:45:51.8732696Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8732873Z FAILED [0.0786s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8732876Z 2025-12-04T09:45:51.8732989Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8733138Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8733140Z 2025-12-04T09:45:51.8733222Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8733399Z FAILED [0.0769s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8733401Z 2025-12-04T09:45:51.8733472Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8733619Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8733623Z 2025-12-04T09:45:51.8733710Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8733889Z FAILED [0.0775s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8733891Z 2025-12-04T09:45:51.8733962Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8734108Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8734147Z 2025-12-04T09:45:51.8734232Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8734409Z FAILED [0.0782s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8734411Z 2025-12-04T09:45:51.8734483Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8734631Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8734635Z 2025-12-04T09:45:51.8734717Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8734909Z FAILED [0.0825s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8734912Z 2025-12-04T09:45:51.8734982Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8735132Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8735135Z 2025-12-04T09:45:51.8735219Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8735400Z FAILED [0.0772s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8735427Z 2025-12-04T09:45:51.8735498Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8735646Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8735648Z 2025-12-04T09:45:51.8735732Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8735909Z FAILED [0.0771s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8735913Z 2025-12-04T09:45:51.8735984Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8736146Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8736148Z 2025-12-04T09:45:51.8736238Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8736414Z FAILED [0.0810s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8736416Z 2025-12-04T09:45:51.8736490Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8736637Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8736639Z 2025-12-04T09:45:51.8736723Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8736899Z FAILED [0.0779s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8736901Z 2025-12-04T09:45:51.8736974Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8737121Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8737125Z 2025-12-04T09:45:51.8737208Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8737386Z FAILED [0.0797s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8737388Z 2025-12-04T09:45:51.8737457Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8737605Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8737618Z 2025-12-04T09:45:51.8737702Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8737881Z FAILED [0.0845s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8737883Z 2025-12-04T09:45:51.8737953Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8738102Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8738104Z 2025-12-04T09:45:51.8738187Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8738372Z FAILED [0.0785s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8738374Z 2025-12-04T09:45:51.8738446Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8738595Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8738596Z 2025-12-04T09:45:51.8738683Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8738858Z FAILED [0.0779s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8738871Z 2025-12-04T09:45:51.8738943Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8739092Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8739095Z 2025-12-04T09:45:51.8739180Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8739355Z FAILED [0.0788s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8739359Z 2025-12-04T09:45:51.8739429Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8739587Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8739589Z 2025-12-04T09:45:51.8739672Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8739850Z FAILED [0.0779s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8739852Z 2025-12-04T09:45:51.8739922Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8740072Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8740074Z 2025-12-04T09:45:51.8740158Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8740336Z FAILED [0.0794s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8740338Z 2025-12-04T09:45:51.8740410Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8740559Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8740562Z 2025-12-04T09:45:51.8740646Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8740823Z FAILED [0.0792s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8740825Z 2025-12-04T09:45:51.8740897Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8741043Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8741057Z 2025-12-04T09:45:51.8741142Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8741321Z FAILED [0.0805s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8741323Z 2025-12-04T09:45:51.8741396Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8741544Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8741546Z 2025-12-04T09:45:51.8741640Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8741818Z FAILED [0.0773s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8741820Z 2025-12-04T09:45:51.8741890Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8742038Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8742040Z 2025-12-04T09:45:51.8742123Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8742298Z FAILED [0.0804s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8742310Z 2025-12-04T09:45:51.8742381Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8742529Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8742531Z 2025-12-04T09:45:51.8742614Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8742792Z FAILED [0.0771s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8742795Z 2025-12-04T09:45:51.8742866Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8743069Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8743071Z 2025-12-04T09:45:51.8743157Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8743332Z FAILED [0.0809s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8743334Z 2025-12-04T09:45:51.8743406Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8743552Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8743554Z 2025-12-04T09:45:51.8743640Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8743817Z FAILED [0.0793s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8743819Z 2025-12-04T09:45:51.8743891Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8744037Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8744041Z 2025-12-04T09:45:51.8744124Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8744300Z FAILED [0.0812s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8744302Z 2025-12-04T09:45:51.8744373Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8744519Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8744539Z 2025-12-04T09:45:51.8744623Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8744802Z FAILED [0.0834s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8744804Z 2025-12-04T09:45:51.8744874Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8745022Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8745025Z 2025-12-04T09:45:51.8745124Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8745311Z FAILED [0.0841s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8745313Z 2025-12-04T09:45:51.8745385Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8745532Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8745534Z 2025-12-04T09:45:51.8745620Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8745933Z FAILED [0.0772s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8745951Z 2025-12-04T09:45:51.8746024Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8746171Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8746173Z 2025-12-04T09:45:51.8746258Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8746437Z FAILED [0.0779s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8746442Z 2025-12-04T09:45:51.8746517Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8746686Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8746688Z 2025-12-04T09:45:51.8746772Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8746953Z FAILED [0.0811s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8746955Z 2025-12-04T09:45:51.8747027Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8747174Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8747176Z 2025-12-04T09:45:51.8747259Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8747436Z FAILED [0.0831s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8747438Z 2025-12-04T09:45:51.8747509Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8747657Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8747660Z 2025-12-04T09:45:51.8747745Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8747921Z FAILED [0.0784s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8747923Z 2025-12-04T09:45:51.8747995Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8748146Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8748159Z 2025-12-04T09:45:51.8748244Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8748421Z FAILED [0.0760s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8748423Z 2025-12-04T09:45:51.8748496Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8748641Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8748643Z 2025-12-04T09:45:51.8748737Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8748912Z FAILED [0.0798s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8748916Z 2025-12-04T09:45:51.8748988Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8749136Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8749138Z 2025-12-04T09:45:51.8749223Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8749400Z FAILED [0.0784s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8749412Z 2025-12-04T09:45:51.8749484Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8749633Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8749635Z 2025-12-04T09:45:51.8749718Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8749895Z FAILED [0.0785s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8749898Z 2025-12-04T09:45:51.8749969Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8750138Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8750140Z 2025-12-04T09:45:51.8750226Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8750406Z FAILED [0.0861s] inductor/test_cuda_repro.py::CudaReproTests::test_truediv_base_not_bitwise_equivalent - AssertionError: AssertionError not raised 2025-12-04T09:45:51.8750408Z 2025-12-04T09:45:51.8750482Z To execute this test, run the following from the base repo dir: 2025-12-04T09:45:51.8750628Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_cuda_repro.py CudaReproTests.test_truediv_base_not_bitwise_equivalent 2025-12-04T09:45:51.8750630Z 2025-12-04T09:45:51.8750714Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:45:51.8750786Z ================== 150 failed, 50 passed in 234.94s (0:03:54) ================== 2025-12-04T09:45:51.8750788Z 2025-12-04T09:45:51.8750954Z FINISHED PRINTING LOG FILE of inductor/test_cuda_repro 1/1 (test/test-reports/inductor.test_cuda_repro_1.1_d9bb6d59b17d8538_.log) 2025-12-04T09:45:51.8750956Z 2025-12-04T09:45:51.8751067Z Finished inductor/test_cuda_repro 1/1 ... [2025-12-04 09:45:51.605956][2222723.165657918], took 4.10min 2025-12-04T09:45:51.8751312Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:45:51.8751460Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:45:51.8751559Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:45:51.8751611Z Uploading artifacts took 0.00 seconds 2025-12-04T09:45:51.8751670Z inductor/test_cuda_repro 1/1 failed! 2025-12-04T09:45:51.8751778Z Running inductor/test_binary_folding 1/1 ... [2025-12-04 09:45:51.703046][2222723.26274539] 2025-12-04T09:45:51.8751829Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:45:51.8752201Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_binary_folding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:45:51.703348] 2025-12-04T09:45:58.6681044Z 2025-12-04T09:45:58.6686848Z inductor/test_binary_folding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_binary_folding_1.1_56debd3a3a94f003_.log 2025-12-04T09:45:58.6687581Z Running 0 items in this shard: 2025-12-04T09:45:58.6687786Z 2025-12-04T09:45:58.6688083Z Finished inductor/test_binary_folding 1/1 ... [2025-12-04 09:45:58.667759][2222730.227460537], took 0.12min 2025-12-04T09:45:58.6689004Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:45:58.7654982Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:45:58.7665813Z Running dynamo/test_activation_checkpointing 1/1 ... [2025-12-04 09:45:58.766419][2222730.326120772] 2025-12-04T09:45:58.7687911Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:45:58.7688461Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_activation_checkpointing.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:45:58.766708] 2025-12-04T09:46:05.7347121Z 2025-12-04T09:46:05.7347975Z dynamo/test_activation_checkpointing 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_activation_checkpointing_1.1_9e7027cae46940eb_.log 2025-12-04T09:46:05.7348548Z Running 0 items in this shard: 2025-12-04T09:46:05.7348660Z 2025-12-04T09:46:05.7349490Z Finished dynamo/test_activation_checkpointing 1/1 ... [2025-12-04 09:46:05.734416][2222737.29411946], took 0.12min 2025-12-04T09:46:05.7351263Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:46:05.8286702Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:46:05.8311338Z Running dynamo/test_ctx_manager 1/1 ... [2025-12-04 09:46:05.830943][2222737.390643131] 2025-12-04T09:46:05.8311693Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:46:05.8313727Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_ctx_manager.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:46:05.831213] 2025-12-04T09:46:12.9399972Z 2025-12-04T09:46:12.9400956Z dynamo/test_ctx_manager 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_ctx_manager_1.1_48bbd24825e11005_.log 2025-12-04T09:46:12.9401465Z Running 0 items in this shard: 2025-12-04T09:46:12.9401604Z 2025-12-04T09:46:12.9401790Z Finished dynamo/test_ctx_manager 1/1 ... [2025-12-04 09:46:12.939705][2222744.499406749], took 0.12min 2025-12-04T09:46:12.9411683Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:46:13.0354274Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:46:13.0364491Z Running inductor/test_inductor_freezing 1/1 ... [2025-12-04 09:46:13.036248][2222744.595947333] 2025-12-04T09:46:13.0369980Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:46:13.0370667Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_inductor_freezing.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:46:13.036546] 2025-12-04T09:47:13.5260746Z 2025-12-04T09:47:13.5261633Z PRINTING LOG FILE of inductor/test_inductor_freezing 1/1 (test/test-reports/inductor.test_inductor_freezing_1.1_3acbff2758ab88d1_.log) 2025-12-04T09:47:13.5263114Z Test results will be stored in test-reports/python-pytest/inductor.test_inductor_freezing/inductor.test_inductor_freezing-9bfd84d747de745e.xml 2025-12-04T09:47:13.5263633Z ============================= test session starts ============================== 2025-12-04T09:47:13.5264012Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:47:13.5264340Z cachedir: .pytest_cache 2025-12-04T09:47:13.5264707Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:47:13.5265121Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:47:13.5265319Z configfile: pytest.ini 2025-12-04T09:47:13.5265685Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:47:13.5266193Z collecting ... collected 48 items 2025-12-04T09:47:13.5266430Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:47:13.5282284Z Running 100 items in this shard: test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu, test/inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu 2025-12-04T09:47:13.5294042Z 2025-12-04T09:47:13.5294245Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [4.6693s] [ 1%] 2025-12-04T09:47:13.5294793Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5295273Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [2.1022s] [ 2%] 2025-12-04T09:47:13.5295679Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.3248s] [ 2%] 2025-12-04T09:47:13.5296080Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [2.6169s] [ 2%] 2025-12-04T09:47:13.5296493Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.3960s] [ 2%] 2025-12-04T09:47:13.5296894Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.2376s] [ 2%] 2025-12-04T09:47:13.5297298Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.3851s] [ 2%] 2025-12-04T09:47:13.5297698Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.2377s] [ 2%] 2025-12-04T09:47:13.5298098Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.7816s] [ 2%] 2025-12-04T09:47:13.5298499Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.6287s] [ 2%] 2025-12-04T09:47:13.5298920Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.7827s] [ 2%] 2025-12-04T09:47:13.5299341Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.8142s] [ 2%] 2025-12-04T09:47:13.5299744Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.2815s] [ 2%] 2025-12-04T09:47:13.5300142Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [2.0743s] [ 2%] 2025-12-04T09:47:13.5300562Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.7247s] [ 2%] 2025-12-04T09:47:13.5300964Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [1.7120s] [ 2%] 2025-12-04T09:47:13.5301366Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.8184s] [ 2%] 2025-12-04T09:47:13.5301772Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6920s] [ 2%] 2025-12-04T09:47:13.5302190Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6915s] [ 2%] 2025-12-04T09:47:13.5302590Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7079s] [ 2%] 2025-12-04T09:47:13.5303057Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7031s] [ 2%] 2025-12-04T09:47:13.5303458Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6822s] [ 2%] 2025-12-04T09:47:13.5303863Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7100s] [ 2%] 2025-12-04T09:47:13.5304284Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6815s] [ 2%] 2025-12-04T09:47:13.5304684Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7653s] [ 2%] 2025-12-04T09:47:13.5305090Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6818s] [ 2%] 2025-12-04T09:47:13.5305491Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.9584s] [ 2%] 2025-12-04T09:47:13.5305896Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6750s] [ 2%] 2025-12-04T09:47:13.5306296Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7027s] [ 2%] 2025-12-04T09:47:13.5306699Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6850s] [ 2%] 2025-12-04T09:47:13.5307114Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6761s] [ 2%] 2025-12-04T09:47:13.5307515Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6852s] [ 2%] 2025-12-04T09:47:13.5307914Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6840s] [ 2%] 2025-12-04T09:47:13.5308313Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6955s] [ 2%] 2025-12-04T09:47:13.5308731Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6893s] [ 2%] 2025-12-04T09:47:13.5309129Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6735s] [ 2%] 2025-12-04T09:47:13.5309528Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7050s] [ 2%] 2025-12-04T09:47:13.5309949Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6798s] [ 2%] 2025-12-04T09:47:13.5310354Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6897s] [ 2%] 2025-12-04T09:47:13.5310753Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7711s] [ 2%] 2025-12-04T09:47:13.5311152Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6819s] [ 2%] 2025-12-04T09:47:13.5311548Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7124s] [ 2%] 2025-12-04T09:47:13.5311973Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7190s] [ 2%] 2025-12-04T09:47:13.5312374Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7428s] [ 2%] 2025-12-04T09:47:13.5312772Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6890s] [ 2%] 2025-12-04T09:47:13.5313242Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6855s] [ 2%] 2025-12-04T09:47:13.5313668Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.6792s] [ 2%] 2025-12-04T09:47:13.5314066Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7117s] [ 2%] 2025-12-04T09:47:13.5314469Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7395s] [ 2%] 2025-12-04T09:47:13.5314869Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu <- test/inductor/test_torchinductor.py FAILED [0.7260s] [ 2%] 2025-12-04T09:47:13.5315350Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5315896Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5316440Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5316990Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5317533Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5318092Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0005s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5318641Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5319184Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5319740Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5320282Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5320823Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5321365Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5321919Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5322463Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5323139Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5323683Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5324227Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5324768Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5325307Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5325849Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5326389Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5326932Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5327471Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5328049Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5328590Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5329171Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5329715Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5330257Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5330797Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5332875Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5333496Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5334061Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5334635Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5335181Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5335728Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5336275Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5336815Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5337355Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5337894Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5338441Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5338982Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5339541Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5340080Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5340636Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5341175Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5341717Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5342266Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5342821Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5343409Z inductor/test_inductor_freezing.py::FreezingCpuTests::test_cpp_wrapper_cpu SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:47:13.5343698Z 2025-12-04T09:47:13.5343764Z =================================== FAILURES =================================== 2025-12-04T09:47:13.5343959Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5344140Z Traceback (most recent call last): 2025-12-04T09:47:13.5344377Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5344606Z return value(self) 2025-12-04T09:47:13.5344709Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5344920Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5345163Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5345403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5345645Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5345789Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5346038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5346313Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5346479Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5346572Z 2025-12-04T09:47:13.5346625Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5346836Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5347092Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5347233Z 2025-12-04T09:47:13.5347311Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5347576Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5347769Z 2025-12-04T09:47:13.5347859Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5348088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5348256Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5348397Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5348731Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5349086Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5349241Z graph_break [] 2025-12-04T09:47:13.5349427Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5349608Z Traceback (most recent call last): 2025-12-04T09:47:13.5349814Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5350013Z return value(self) 2025-12-04T09:47:13.5350120Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5350330Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5350571Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5350800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5351063Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5351206Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5351452Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5351727Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5351896Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5351988Z 2025-12-04T09:47:13.5352042Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5352250Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5352502Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5352656Z 2025-12-04T09:47:13.5352734Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5353045Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5353240Z 2025-12-04T09:47:13.5353327Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5353531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5353696Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5353833Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5354166Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5354515Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5354669Z graph_break [] 2025-12-04T09:47:13.5354803Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5354963Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5355099Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5355268Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5355612Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5355919Z graph_break [] 2025-12-04T09:47:13.5356062Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5356261Z Traceback (most recent call last): 2025-12-04T09:47:13.5356464Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5356662Z return value(self) 2025-12-04T09:47:13.5356765Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5356970Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5357207Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5357433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5357670Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5357828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5358075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5358350Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5358517Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5358611Z 2025-12-04T09:47:13.5358664Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5358873Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5359132Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5359289Z 2025-12-04T09:47:13.5359365Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5359630Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5359819Z 2025-12-04T09:47:13.5359911Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5360113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5360272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5360408Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5360749Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5361093Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5361244Z graph_break [] 2025-12-04T09:47:13.5361376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5361536Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5361666Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5361835Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5362178Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5362489Z graph_break [] 2025-12-04T09:47:13.5362621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5362782Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5362919Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5363132Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5363478Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5363786Z graph_break [] 2025-12-04T09:47:13.5363934Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5364112Z Traceback (most recent call last): 2025-12-04T09:47:13.5364317Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5364545Z return value(self) 2025-12-04T09:47:13.5364650Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5364859Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5365100Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5365330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5365574Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5365722Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5365992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5366269Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5366437Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5366533Z 2025-12-04T09:47:13.5366588Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5366801Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5367060Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5367206Z 2025-12-04T09:47:13.5367282Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5367561Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5367755Z 2025-12-04T09:47:13.5367844Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5368051Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5368213Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5368352Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5368684Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5369035Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5369207Z graph_break [] 2025-12-04T09:47:13.5369344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5369508Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5369642Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5369813Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5370158Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5370468Z graph_break [] 2025-12-04T09:47:13.5370602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5370765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5370900Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5371071Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5371414Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5371727Z graph_break [] 2025-12-04T09:47:13.5371864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5372028Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5372163Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5372334Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5372682Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5373057Z graph_break [] 2025-12-04T09:47:13.5373203Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5373382Z Traceback (most recent call last): 2025-12-04T09:47:13.5373588Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5373792Z return value(self) 2025-12-04T09:47:13.5373898Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5374108Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5374375Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5374605Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5374845Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5374995Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5375243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5375520Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5375689Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5375784Z 2025-12-04T09:47:13.5375868Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5376077Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5376332Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5376477Z 2025-12-04T09:47:13.5376556Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5376823Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5377020Z 2025-12-04T09:47:13.5377109Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5377313Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5377499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5377634Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5377963Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5378311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5378466Z graph_break [] 2025-12-04T09:47:13.5378605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5378767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5378902Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5379073Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5379420Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5379728Z graph_break [] 2025-12-04T09:47:13.5379863Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5380029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5380161Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5380330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5380674Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5380988Z graph_break [] 2025-12-04T09:47:13.5401039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5401217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5401355Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5401535Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5401881Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5402189Z graph_break [] 2025-12-04T09:47:13.5402325Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5402683Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5402817Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5403026Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5403369Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5403679Z graph_break [] 2025-12-04T09:47:13.5403828Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5404004Z Traceback (most recent call last): 2025-12-04T09:47:13.5404234Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5404433Z return value(self) 2025-12-04T09:47:13.5404533Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5404744Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5404980Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5405211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5405451Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5405595Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5405854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5406128Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5406293Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5406389Z 2025-12-04T09:47:13.5406443Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5406647Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5406901Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5407039Z 2025-12-04T09:47:13.5407115Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5407377Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5407568Z 2025-12-04T09:47:13.5407658Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5407861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5408018Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5408147Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5408473Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5408812Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5408961Z graph_break [] 2025-12-04T09:47:13.5409090Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5409245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5409403Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5409569Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5409906Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5410207Z graph_break [] 2025-12-04T09:47:13.5410337Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5410493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5410623Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5410804Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5411140Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5411448Z graph_break [] 2025-12-04T09:47:13.5411577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5411733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5411863Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5412028Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5412376Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5412679Z graph_break [] 2025-12-04T09:47:13.5412812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5413016Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5413143Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5413310Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5413647Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5414140Z graph_break [] 2025-12-04T09:47:13.5414269Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5414426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5414554Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5414720Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5415057Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5415354Z graph_break [] 2025-12-04T09:47:13.5415495Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5415666Z Traceback (most recent call last): 2025-12-04T09:47:13.5415867Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5416065Z return value(self) 2025-12-04T09:47:13.5416166Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5416371Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5416607Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5416835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5417069Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5417212Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5417455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5417757Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5417919Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5418008Z 2025-12-04T09:47:13.5418059Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5418264Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5418517Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5418654Z 2025-12-04T09:47:13.5418728Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5419007Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5419197Z 2025-12-04T09:47:13.5419287Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5419488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5419646Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5419774Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5420096Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5420441Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5420604Z graph_break [] 2025-12-04T09:47:13.5420734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5420892Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5421024Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5421191Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5421529Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5421833Z graph_break [] 2025-12-04T09:47:13.5421959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5422190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5422317Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5422482Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5422819Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5423168Z graph_break [] 2025-12-04T09:47:13.5423299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5423453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5423583Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5423750Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5424090Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5424451Z graph_break [] 2025-12-04T09:47:13.5424581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5424738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5424864Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5425029Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5425461Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5425766Z graph_break [] 2025-12-04T09:47:13.5425929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5426085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5426215Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5426382Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5426719Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5427021Z graph_break [] 2025-12-04T09:47:13.5427147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5427319Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5427449Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5427615Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5427949Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5428250Z graph_break [] 2025-12-04T09:47:13.5428395Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5428565Z Traceback (most recent call last): 2025-12-04T09:47:13.5428784Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5428980Z return value(self) 2025-12-04T09:47:13.5429083Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5429291Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5429529Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5429754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5429993Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5430137Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5430400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5430673Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5430837Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5430931Z 2025-12-04T09:47:13.5430984Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5431184Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5431436Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5431575Z 2025-12-04T09:47:13.5431649Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5431911Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5432103Z 2025-12-04T09:47:13.5432190Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5432391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5432547Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5432678Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5433062Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5433402Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5433550Z graph_break [] 2025-12-04T09:47:13.5433684Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5433842Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5433995Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5434159Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5434493Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5434795Z graph_break [] 2025-12-04T09:47:13.5434922Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5435076Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5435206Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5435386Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5435723Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5436024Z graph_break [] 2025-12-04T09:47:13.5436154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5436308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5436435Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5436601Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5436951Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5437264Z graph_break [] 2025-12-04T09:47:13.5437400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5437560Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5437691Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5437860Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5438203Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5438519Z graph_break [] 2025-12-04T09:47:13.5438653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5438815Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5438946Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5439114Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5439457Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5439761Z graph_break [] 2025-12-04T09:47:13.5439890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5440050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5440176Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5440338Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5440675Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5440982Z graph_break [] 2025-12-04T09:47:13.5441113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5441270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5441401Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5441568Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5441907Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5442227Z graph_break [] 2025-12-04T09:47:13.5442375Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5442548Z Traceback (most recent call last): 2025-12-04T09:47:13.5442749Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5442993Z return value(self) 2025-12-04T09:47:13.5443097Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5443307Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5443577Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5443808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5444048Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5444197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5444443Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5444721Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5444890Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5444998Z 2025-12-04T09:47:13.5445053Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5445260Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5445516Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5445659Z 2025-12-04T09:47:13.5445737Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5446002Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5446198Z 2025-12-04T09:47:13.5446288Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5446492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5446673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5446809Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5447137Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5447488Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5447643Z graph_break [] 2025-12-04T09:47:13.5447774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5447933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5448063Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5448233Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5448571Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5448878Z graph_break [] 2025-12-04T09:47:13.5449005Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5449164Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5449296Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5449464Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5449802Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5450108Z graph_break [] 2025-12-04T09:47:13.5450255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5450411Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5450543Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5450712Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5451050Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5451361Z graph_break [] 2025-12-04T09:47:13.5451488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5451658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5451787Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5451955Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5452294Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5452604Z graph_break [] 2025-12-04T09:47:13.5452732Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5452889Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5453077Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5453241Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5453583Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5453893Z graph_break [] 2025-12-04T09:47:13.5454023Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5454184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5454315Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5454480Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5454842Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5455155Z graph_break [] 2025-12-04T09:47:13.5455282Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5455442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5455570Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5455745Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5456085Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5456393Z graph_break [] 2025-12-04T09:47:13.5456519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5456679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5456809Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5456980Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5457317Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5457617Z graph_break [] 2025-12-04T09:47:13.5457761Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5457936Z Traceback (most recent call last): 2025-12-04T09:47:13.5458137Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5458353Z return value(self) 2025-12-04T09:47:13.5458457Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5458667Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5458904Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5459129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5459366Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5459510Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5459775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5460047Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5460214Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5460307Z 2025-12-04T09:47:13.5460363Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5460569Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5460827Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5460965Z 2025-12-04T09:47:13.5461040Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5461332Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5461524Z 2025-12-04T09:47:13.5461616Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5461823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5461981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5462111Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5462435Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5462791Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5462995Z graph_break [] 2025-12-04T09:47:13.5463125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5463286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5463413Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5463582Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5463927Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5464229Z graph_break [] 2025-12-04T09:47:13.5464358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5464515Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5464644Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5464810Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5465151Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5465461Z graph_break [] 2025-12-04T09:47:13.5465591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5465752Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5465880Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5466047Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5466383Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5466718Z graph_break [] 2025-12-04T09:47:13.5466849Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5467006Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5467132Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5467300Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5467651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5467957Z graph_break [] 2025-12-04T09:47:13.5468088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5468246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5468373Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5468544Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5468883Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5469189Z graph_break [] 2025-12-04T09:47:13.5469339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5469494Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5469621Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5469790Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5470125Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5470433Z graph_break [] 2025-12-04T09:47:13.5470564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5470716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5470857Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5471022Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5471360Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5471670Z graph_break [] 2025-12-04T09:47:13.5471800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5471953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5472082Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5472249Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5472588Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5472892Z graph_break [] 2025-12-04T09:47:13.5473060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5473210Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5473336Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5473502Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5473838Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5474141Z graph_break [] 2025-12-04T09:47:13.5474280Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5474470Z Traceback (most recent call last): 2025-12-04T09:47:13.5474668Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5474864Z return value(self) 2025-12-04T09:47:13.5474965Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5475171Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5475406Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5475630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5475864Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5476026Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5476269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5476539Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5476707Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5476796Z 2025-12-04T09:47:13.5476848Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5477052Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5477303Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5477459Z 2025-12-04T09:47:13.5477532Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5477792Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5477982Z 2025-12-04T09:47:13.5478071Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5478270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5478425Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5478557Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5478892Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5479232Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5479380Z graph_break [] 2025-12-04T09:47:13.5479507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5479659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5479786Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5479951Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5480287Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5480587Z graph_break [] 2025-12-04T09:47:13.5480717Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5480869Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5480995Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5481158Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5481492Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5481789Z graph_break [] 2025-12-04T09:47:13.5481916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5482068Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5482194Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5482373Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5482705Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5483062Z graph_break [] 2025-12-04T09:47:13.5483189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5483343Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5483471Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5483634Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5483997Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5484295Z graph_break [] 2025-12-04T09:47:13.5484420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5484575Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5484700Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5484866Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5485197Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5485542Z graph_break [] 2025-12-04T09:47:13.5485669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5485823Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5485947Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5486109Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5486444Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5486743Z graph_break [] 2025-12-04T09:47:13.5486884Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5487039Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5487165Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5487330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5487664Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5487969Z graph_break [] 2025-12-04T09:47:13.5488097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5488251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5488379Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5488541Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5488878Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5489176Z graph_break [] 2025-12-04T09:47:13.5489302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5489459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5489583Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5489746Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5490083Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5490400Z graph_break [] 2025-12-04T09:47:13.5490525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5490679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5490807Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5490968Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5491307Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5491604Z graph_break [] 2025-12-04T09:47:13.5491767Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5491940Z Traceback (most recent call last): 2025-12-04T09:47:13.5492137Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5492334Z return value(self) 2025-12-04T09:47:13.5492431Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5492637Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5492868Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5493150Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5493403Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5493543Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5493787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5494056Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5494219Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5494308Z 2025-12-04T09:47:13.5494361Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5494563Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5494835Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5494973Z 2025-12-04T09:47:13.5495052Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5495318Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5495509Z 2025-12-04T09:47:13.5495598Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5495804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5495963Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5496094Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5496414Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5496754Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5496906Z graph_break [] 2025-12-04T09:47:13.5497041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5497199Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5497330Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5497494Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5497832Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5498137Z graph_break [] 2025-12-04T09:47:13.5498271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5498450Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5498585Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5498757Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5499101Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5499409Z graph_break [] 2025-12-04T09:47:13.5499545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5499705Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5499854Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5500027Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5500368Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5500674Z graph_break [] 2025-12-04T09:47:13.5500808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5500968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5501101Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5501288Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5501629Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5501936Z graph_break [] 2025-12-04T09:47:13.5502071Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5502231Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5502363Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5502536Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5502889Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5503235Z graph_break [] 2025-12-04T09:47:13.5503369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5503532Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5503665Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5503837Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5504178Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5504484Z graph_break [] 2025-12-04T09:47:13.5504623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5504783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5504917Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5505089Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5505430Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5505740Z graph_break [] 2025-12-04T09:47:13.5505874Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5506038Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5506172Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5506341Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5506705Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5507013Z graph_break [] 2025-12-04T09:47:13.5507149Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5507308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5507442Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5507614Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5507982Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5508288Z graph_break [] 2025-12-04T09:47:13.5508425Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5508590Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5508723Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5508894Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5509234Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5509561Z graph_break [] 2025-12-04T09:47:13.5509696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5509861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5509996Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5510169Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5510507Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5510816Z graph_break [] 2025-12-04T09:47:13.5510964Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5511154Z Traceback (most recent call last): 2025-12-04T09:47:13.5511360Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5511568Z return value(self) 2025-12-04T09:47:13.5511674Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5511880Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5512122Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5512351Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5512592Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5512735Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5513034Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5513309Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5513474Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5513563Z 2025-12-04T09:47:13.5513622Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5513833Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5514089Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5514225Z 2025-12-04T09:47:13.5514308Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5514575Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5514768Z 2025-12-04T09:47:13.5514893Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5515100Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5515260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5515396Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5515723Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5516072Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5516224Z graph_break [] 2025-12-04T09:47:13.5516376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5516538Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5516672Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5516843Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5517195Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5517502Z graph_break [] 2025-12-04T09:47:13.5517637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5517814Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5517949Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5518122Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5518466Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5518772Z graph_break [] 2025-12-04T09:47:13.5518909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5519073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5519207Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5519393Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5519735Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5520049Z graph_break [] 2025-12-04T09:47:13.5520184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5520345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5520480Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5520652Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5520995Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5521305Z graph_break [] 2025-12-04T09:47:13.5521440Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5521604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5521738Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5521912Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5522261Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5522571Z graph_break [] 2025-12-04T09:47:13.5522866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5523072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5523243Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5523415Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5523761Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5524068Z graph_break [] 2025-12-04T09:47:13.5524206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5524365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5524496Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5524682Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5525022Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5525331Z graph_break [] 2025-12-04T09:47:13.5525464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5525623Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5525756Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5525928Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5526290Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5526599Z graph_break [] 2025-12-04T09:47:13.5526737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5526901Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5527036Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5527209Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5527552Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5527875Z graph_break [] 2025-12-04T09:47:13.5528011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5528174Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5528309Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5528480Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5528824Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5529132Z graph_break [] 2025-12-04T09:47:13.5529268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5529433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5529568Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5529741Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5530082Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5530394Z graph_break [] 2025-12-04T09:47:13.5530529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5530690Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5530826Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5531000Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5531342Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5531663Z graph_break [] 2025-12-04T09:47:13.5531814Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5531990Z Traceback (most recent call last): 2025-12-04T09:47:13.5532195Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5532400Z return value(self) 2025-12-04T09:47:13.5532506Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5532717Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5533015Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5533245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5533485Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5533633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5533878Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5534154Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5534322Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5534414Z 2025-12-04T09:47:13.5534495Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5534702Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5534961Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5535099Z 2025-12-04T09:47:13.5535180Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5535448Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5535639Z 2025-12-04T09:47:13.5535733Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5535940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5536119Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5536257Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5536585Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5536934Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5537089Z graph_break [] 2025-12-04T09:47:13.5537227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5537387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5537522Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5537693Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5538043Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5538351Z graph_break [] 2025-12-04T09:47:13.5538487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5538650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5538785Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5538956Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5539297Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5539604Z graph_break [] 2025-12-04T09:47:13.5539755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5539915Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5540048Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5540222Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5540562Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5540877Z graph_break [] 2025-12-04T09:47:13.5541012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5541187Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5541323Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5541494Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5541835Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5542147Z graph_break [] 2025-12-04T09:47:13.5542283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5542443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5543002Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5543173Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5543514Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5543819Z graph_break [] 2025-12-04T09:47:13.5543952Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5544111Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5544245Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5544416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5548888Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5549213Z graph_break [] 2025-12-04T09:47:13.5549346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5549504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5549634Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5549799Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5550133Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5550433Z graph_break [] 2025-12-04T09:47:13.5550560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5550714Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5550844Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5551007Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5551343Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5551638Z graph_break [] 2025-12-04T09:47:13.5551769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5551922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5552047Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5552208Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5552561Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5552860Z graph_break [] 2025-12-04T09:47:13.5553040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5553192Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5553320Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5553483Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5553843Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5554139Z graph_break [] 2025-12-04T09:47:13.5554264Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5554420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5554547Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5554711Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5555041Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5555349Z graph_break [] 2025-12-04T09:47:13.5555476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5555629Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5555757Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5555919Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5556253Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5556563Z graph_break [] 2025-12-04T09:47:13.5556713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5556866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5556989Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5557156Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5557491Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5557790Z graph_break [] 2025-12-04T09:47:13.5557928Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5558095Z Traceback (most recent call last): 2025-12-04T09:47:13.5558297Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5558494Z return value(self) 2025-12-04T09:47:13.5558592Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5558796Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5559029Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5559256Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5559490Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5559629Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5559873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5560142Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5560305Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5560410Z 2025-12-04T09:47:13.5560465Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5560669Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5560918Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5560920Z 2025-12-04T09:47:13.5560997Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5561152Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5561154Z 2025-12-04T09:47:13.5561256Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5561332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5561373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5561432Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5561664Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5561742Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5561780Z graph_break [] 2025-12-04T09:47:13.5561872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5561913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5561969Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5562041Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5562271Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5562310Z graph_break [] 2025-12-04T09:47:13.5562384Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5562426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5562498Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5562570Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5562800Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5562843Z graph_break [] 2025-12-04T09:47:13.5562919Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5563007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5563062Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5563134Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5563360Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5563401Z graph_break [] 2025-12-04T09:47:13.5563474Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5563515Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5563570Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5563644Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5563867Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5563907Z graph_break [] 2025-12-04T09:47:13.5563980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5564051Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5564106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5564178Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5564402Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5564442Z graph_break [] 2025-12-04T09:47:13.5564513Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5564556Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5564627Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5564702Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5564931Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5564970Z graph_break [] 2025-12-04T09:47:13.5565044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5565086Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5565143Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5565215Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5565459Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5565497Z graph_break [] 2025-12-04T09:47:13.5565571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5565612Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5565669Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5565741Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5565981Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5566018Z graph_break [] 2025-12-04T09:47:13.5566094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5566137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5566194Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5566267Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5566497Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5566534Z graph_break [] 2025-12-04T09:47:13.5566611Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5566653Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5566709Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5566781Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5567007Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5567045Z graph_break [] 2025-12-04T09:47:13.5567119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5567163Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5567217Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5567288Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5567511Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5567563Z graph_break [] 2025-12-04T09:47:13.5567637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5567680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5567735Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5567808Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5568045Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5568084Z graph_break [] 2025-12-04T09:47:13.5568156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5568200Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5568256Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5568330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5568557Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5568607Z graph_break [] 2025-12-04T09:47:13.5568679Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5568721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5568776Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5568852Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5569077Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5569117Z graph_break [] 2025-12-04T09:47:13.5569201Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5569263Z Traceback (most recent call last): 2025-12-04T09:47:13.5569384Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5569424Z return value(self) 2025-12-04T09:47:13.5569460Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5569609Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5569663Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5569802Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5569862Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5569908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5570071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5570143Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5570200Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5570203Z 2025-12-04T09:47:13.5570254Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5570371Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5570468Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5570471Z 2025-12-04T09:47:13.5570547Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5570699Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5570701Z 2025-12-04T09:47:13.5570791Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5570883Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5570927Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5570984Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5571213Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5571289Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5571327Z graph_break [] 2025-12-04T09:47:13.5571413Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5571454Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5571510Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5571581Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5571807Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5571844Z graph_break [] 2025-12-04T09:47:13.5571917Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5571980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5572037Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5572109Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5572334Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5572371Z graph_break [] 2025-12-04T09:47:13.5572443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5572486Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5572542Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5572626Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5572855Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5572893Z graph_break [] 2025-12-04T09:47:13.5573011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5573052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5573109Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5573181Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5573407Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5573445Z graph_break [] 2025-12-04T09:47:13.5573521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5573564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5573618Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5573692Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5573915Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5573953Z graph_break [] 2025-12-04T09:47:13.5574026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5574069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5574122Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5574222Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5574447Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5574484Z graph_break [] 2025-12-04T09:47:13.5574558Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5574601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5574656Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5574744Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5574969Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5575008Z graph_break [] 2025-12-04T09:47:13.5575081Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5575122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5575177Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5575251Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5575476Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5575529Z graph_break [] 2025-12-04T09:47:13.5575602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5575646Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5575700Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5575774Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5576001Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5576051Z graph_break [] 2025-12-04T09:47:13.5576125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5576167Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5576227Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5576299Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5576528Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5576564Z graph_break [] 2025-12-04T09:47:13.5576639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5576681Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5576737Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5576807Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5577032Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5577070Z graph_break [] 2025-12-04T09:47:13.5577144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5577185Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5577243Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5577315Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5577539Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5577589Z graph_break [] 2025-12-04T09:47:13.5577661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5577704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5577763Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5577834Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5578060Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5578108Z graph_break [] 2025-12-04T09:47:13.5578182Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5578226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5578280Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5578353Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5578580Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5578620Z graph_break [] 2025-12-04T09:47:13.5578691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5578748Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5578802Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5578875Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5579099Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5579140Z graph_break [] 2025-12-04T09:47:13.5579225Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5579274Z Traceback (most recent call last): 2025-12-04T09:47:13.5579406Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5579448Z return value(self) 2025-12-04T09:47:13.5579484Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5579631Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5579681Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5579822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5579883Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5579930Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5580088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5580165Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5580219Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5580221Z 2025-12-04T09:47:13.5580277Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5580392Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5580496Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5580498Z 2025-12-04T09:47:13.5580571Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5580729Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5580731Z 2025-12-04T09:47:13.5580818Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5580893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5580946Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5581003Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5581229Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5581302Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5581342Z graph_break [] 2025-12-04T09:47:13.5581414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5581472Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5581528Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5581603Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5581828Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5581868Z graph_break [] 2025-12-04T09:47:13.5581940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5581983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5582036Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5582122Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5582348Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5582387Z graph_break [] 2025-12-04T09:47:13.5582459Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5582502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5582558Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5582633Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5582870Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5582911Z graph_break [] 2025-12-04T09:47:13.5583023Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5583069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5583124Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5583198Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5583424Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5583462Z graph_break [] 2025-12-04T09:47:13.5583536Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5583577Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5583635Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5583707Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5583935Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5583972Z graph_break [] 2025-12-04T09:47:13.5584046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5584087Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5584142Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5584213Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5584466Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5584503Z graph_break [] 2025-12-04T09:47:13.5584577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5584620Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5584675Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5584746Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5584994Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5585031Z graph_break [] 2025-12-04T09:47:13.5585106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5585148Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5585202Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5585275Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5585501Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5585555Z graph_break [] 2025-12-04T09:47:13.5585628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5585671Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5585729Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5585803Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5586027Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5586068Z graph_break [] 2025-12-04T09:47:13.5586152Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5586197Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5586252Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5586330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5586557Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5586597Z graph_break [] 2025-12-04T09:47:13.5586670Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5586713Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5586768Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5586843Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5587068Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5587106Z graph_break [] 2025-12-04T09:47:13.5587179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5587221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5587275Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5587350Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5587575Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5587628Z graph_break [] 2025-12-04T09:47:13.5587700Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5587744Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5587801Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5587872Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5588097Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5588135Z graph_break [] 2025-12-04T09:47:13.5588222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5588264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5588321Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5588392Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5588621Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5588659Z graph_break [] 2025-12-04T09:47:13.5588733Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5588786Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5588841Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5588911Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5589136Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5589172Z graph_break [] 2025-12-04T09:47:13.5589244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5589286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5589343Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5589415Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5589649Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5589688Z graph_break [] 2025-12-04T09:47:13.5589776Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5589824Z Traceback (most recent call last): 2025-12-04T09:47:13.5589946Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5589985Z return value(self) 2025-12-04T09:47:13.5590024Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5590168Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5590222Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5590364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5590424Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5590470Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5590630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5590704Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5590758Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5590760Z 2025-12-04T09:47:13.5590815Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5590928Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5591039Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5591041Z 2025-12-04T09:47:13.5591114Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5591265Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5591267Z 2025-12-04T09:47:13.5591356Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5591431Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5591471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5591529Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5591763Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5591839Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5591877Z graph_break [] 2025-12-04T09:47:13.5591948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5591991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5592045Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5592117Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5592358Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5592397Z graph_break [] 2025-12-04T09:47:13.5592472Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5592516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5592571Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5592645Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5592877Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5592917Z graph_break [] 2025-12-04T09:47:13.5593085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5593132Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5593187Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5593260Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5593485Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5593523Z graph_break [] 2025-12-04T09:47:13.5593597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5593641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5593695Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5593771Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5593996Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5594036Z graph_break [] 2025-12-04T09:47:13.5594108Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5594152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5594207Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5594279Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5594506Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5594569Z graph_break [] 2025-12-04T09:47:13.5594643Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5594684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5594740Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5594812Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5595053Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5595091Z graph_break [] 2025-12-04T09:47:13.5595165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5595207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5595262Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5595334Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5595559Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5595621Z graph_break [] 2025-12-04T09:47:13.5595695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5595736Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5595792Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5595863Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5596090Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5596127Z graph_break [] 2025-12-04T09:47:13.5596201Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5596241Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5596319Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5596390Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5596623Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5596662Z graph_break [] 2025-12-04T09:47:13.5596737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5596780Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5596833Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5596906Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5597133Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5597171Z graph_break [] 2025-12-04T09:47:13.5597243Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5597287Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5597342Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5597415Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5597640Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5597677Z graph_break [] 2025-12-04T09:47:13.5597749Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5597808Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5597862Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5597936Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5598159Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5598198Z graph_break [] 2025-12-04T09:47:13.5598270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5598313Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5598377Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5598452Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5598678Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5598717Z graph_break [] 2025-12-04T09:47:13.5598792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5598834Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5598889Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5598971Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5599197Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5599234Z graph_break [] 2025-12-04T09:47:13.5599311Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5599352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5599409Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5599481Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5599717Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5599754Z graph_break [] 2025-12-04T09:47:13.5599830Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5599870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5599926Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5599997Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5600225Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5600262Z graph_break [] 2025-12-04T09:47:13.5600336Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5600376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5600434Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5600506Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5600732Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5600769Z graph_break [] 2025-12-04T09:47:13.5600856Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5600903Z Traceback (most recent call last): 2025-12-04T09:47:13.5601021Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5601060Z return value(self) 2025-12-04T09:47:13.5601112Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5601259Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5601311Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5601449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5601508Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5601555Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5601713Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5601799Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5601853Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5601855Z 2025-12-04T09:47:13.5601908Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5602022Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5602119Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5602122Z 2025-12-04T09:47:13.5602196Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5602346Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5602358Z 2025-12-04T09:47:13.5602444Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5602519Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5602561Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5602619Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5602848Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5602922Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5603000Z graph_break [] 2025-12-04T09:47:13.5603091Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5603135Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5603191Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5603263Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5603487Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5603525Z graph_break [] 2025-12-04T09:47:13.5603598Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5603641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5603694Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5603765Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5603988Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5604028Z graph_break [] 2025-12-04T09:47:13.5604100Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5604141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5604196Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5604270Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5604496Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5604559Z graph_break [] 2025-12-04T09:47:13.5604630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5604674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5604728Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5604800Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5605025Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5605064Z graph_break [] 2025-12-04T09:47:13.5605150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5605191Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5605245Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5605317Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5605545Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5605581Z graph_break [] 2025-12-04T09:47:13.5605655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5605710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5605766Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5605836Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5606061Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5606098Z graph_break [] 2025-12-04T09:47:13.5606174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5606215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5606271Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5606356Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5606585Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5606625Z graph_break [] 2025-12-04T09:47:13.5606698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5606739Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5606795Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5606865Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5607090Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5607127Z graph_break [] 2025-12-04T09:47:13.5607200Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5607243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5607298Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5607371Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5607595Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5607635Z graph_break [] 2025-12-04T09:47:13.5607706Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5607749Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5607818Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5607891Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5608116Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5608156Z graph_break [] 2025-12-04T09:47:13.5608229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5608270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5608324Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5608408Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5608633Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5608671Z graph_break [] 2025-12-04T09:47:13.5608743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5608784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5608838Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5608911Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5609148Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5609185Z graph_break [] 2025-12-04T09:47:13.5609260Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5609302Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5609355Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5609427Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5609669Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5609705Z graph_break [] 2025-12-04T09:47:13.5609779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5609820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5609876Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5609947Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5610171Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5610208Z graph_break [] 2025-12-04T09:47:13.5610280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5610322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5610377Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5610449Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5610672Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5610709Z graph_break [] 2025-12-04T09:47:13.5610782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5610822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5610879Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5610949Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5611174Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5611224Z graph_break [] 2025-12-04T09:47:13.5611300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5611342Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5611397Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5611469Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5611702Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5611740Z graph_break [] 2025-12-04T09:47:13.5611812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5611855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5611910Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5611983Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5612213Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5612262Z graph_break [] 2025-12-04T09:47:13.5612347Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5612395Z Traceback (most recent call last): 2025-12-04T09:47:13.5612514Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5612556Z return value(self) 2025-12-04T09:47:13.5612591Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5612736Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5612787Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5612964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5613047Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5613094Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5613251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5613324Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5613377Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5613379Z 2025-12-04T09:47:13.5613433Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5613548Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5613646Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5613649Z 2025-12-04T09:47:13.5613723Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5613872Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5613874Z 2025-12-04T09:47:13.5613961Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5614034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5614077Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5614132Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5614364Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5614435Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5614494Z graph_break [] 2025-12-04T09:47:13.5614566Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5614608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5614663Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5614734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5614960Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5614999Z graph_break [] 2025-12-04T09:47:13.5615085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5615127Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5615182Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5615254Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5615478Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5615517Z graph_break [] 2025-12-04T09:47:13.5615589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5615631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5615701Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5615773Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5615997Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5616033Z graph_break [] 2025-12-04T09:47:13.5616106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5616147Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5616202Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5616273Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5616507Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5616545Z graph_break [] 2025-12-04T09:47:13.5616618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5616658Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5616714Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5616784Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5617008Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5617045Z graph_break [] 2025-12-04T09:47:13.5617118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5617159Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5617214Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5617284Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5617509Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5617546Z graph_break [] 2025-12-04T09:47:13.5617619Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5617660Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5617714Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5617798Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5618022Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5618059Z graph_break [] 2025-12-04T09:47:13.5618131Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5618173Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5618227Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5618299Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5618534Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5618571Z graph_break [] 2025-12-04T09:47:13.5618644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5618685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5618738Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5618810Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5619032Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5619082Z graph_break [] 2025-12-04T09:47:13.5619154Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5619196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5619249Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5619321Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5619545Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5619584Z graph_break [] 2025-12-04T09:47:13.5619665Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5619707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5619762Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5619833Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5620058Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5620095Z graph_break [] 2025-12-04T09:47:13.5620168Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5620208Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5620264Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5620335Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5620561Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5620598Z graph_break [] 2025-12-04T09:47:13.5620671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5620712Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5620767Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5620838Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5621061Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5621108Z graph_break [] 2025-12-04T09:47:13.5621181Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5621223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5621278Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5621348Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5621574Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5621611Z graph_break [] 2025-12-04T09:47:13.5621697Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5621738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5621793Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5621865Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5622097Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5622134Z graph_break [] 2025-12-04T09:47:13.5622206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5622264Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5622319Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5622390Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5622614Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5622652Z graph_break [] 2025-12-04T09:47:13.5622724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5622766Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5622820Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5622902Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5623172Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5623210Z graph_break [] 2025-12-04T09:47:13.5623281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5623323Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5623378Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5623450Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5623675Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5623713Z graph_break [] 2025-12-04T09:47:13.5623787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5623829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5623882Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5623955Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5624182Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5624220Z graph_break [] 2025-12-04T09:47:13.5624303Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5624352Z Traceback (most recent call last): 2025-12-04T09:47:13.5624494Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5624534Z return value(self) 2025-12-04T09:47:13.5624568Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5624714Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5624765Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5624903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5624962Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5625005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5625182Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5625254Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5625311Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5625314Z 2025-12-04T09:47:13.5625365Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5625483Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5625580Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5625598Z 2025-12-04T09:47:13.5625672Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5625820Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5625823Z 2025-12-04T09:47:13.5625911Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5625985Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5626027Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5626082Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5626322Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5626395Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5626432Z graph_break [] 2025-12-04T09:47:13.5626505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5626546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5626601Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5626672Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5626899Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5626936Z graph_break [] 2025-12-04T09:47:13.5627009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5627050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5627106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5627177Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5627402Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5627439Z graph_break [] 2025-12-04T09:47:13.5627513Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5627554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5627609Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5627679Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5627918Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5627955Z graph_break [] 2025-12-04T09:47:13.5628028Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5628069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5628126Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5628197Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5628435Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5628472Z graph_break [] 2025-12-04T09:47:13.5628545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5628588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5628643Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5628715Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5628939Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5628987Z graph_break [] 2025-12-04T09:47:13.5629058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5629102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5629156Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5629229Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5629453Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5629491Z graph_break [] 2025-12-04T09:47:13.5629563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5629615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5629670Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5629742Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5629968Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5630007Z graph_break [] 2025-12-04T09:47:13.5630079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5630123Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5630176Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5630250Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5630475Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5630516Z graph_break [] 2025-12-04T09:47:13.5630588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5630633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5630688Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5630763Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5630989Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5631026Z graph_break [] 2025-12-04T09:47:13.5631112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5631153Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5631210Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5631281Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5631508Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5631546Z graph_break [] 2025-12-04T09:47:13.5631620Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5631674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5631730Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5631801Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5632027Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5632065Z graph_break [] 2025-12-04T09:47:13.5632140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5632182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5632251Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5632323Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5632548Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5632585Z graph_break [] 2025-12-04T09:47:13.5632657Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5632701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5632758Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5632829Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5633118Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5633161Z graph_break [] 2025-12-04T09:47:13.5633235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5633279Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5633333Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5633407Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5633631Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5633672Z graph_break [] 2025-12-04T09:47:13.5633744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5633789Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5633846Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5633920Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5634146Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5634185Z graph_break [] 2025-12-04T09:47:13.5634259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5634303Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5634357Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5634456Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5634681Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5634721Z graph_break [] 2025-12-04T09:47:13.5634793Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5634838Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5634892Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5634965Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5635213Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5635251Z graph_break [] 2025-12-04T09:47:13.5635324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5635369Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5635426Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5635497Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5635728Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5635791Z graph_break [] 2025-12-04T09:47:13.5635867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5635911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5635968Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5636039Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5636263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5636301Z graph_break [] 2025-12-04T09:47:13.5636392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5636434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5636492Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5636564Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5636791Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5636828Z graph_break [] 2025-12-04T09:47:13.5636916Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5636963Z Traceback (most recent call last): 2025-12-04T09:47:13.5637084Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5637123Z return value(self) 2025-12-04T09:47:13.5637161Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5637305Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5637358Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5637496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5637556Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5637601Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5637763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5637838Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5637904Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5637906Z 2025-12-04T09:47:13.5637961Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5638077Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5638174Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5638177Z 2025-12-04T09:47:13.5638249Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5638398Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5638400Z 2025-12-04T09:47:13.5638497Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5638571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5638613Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5638669Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5638897Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5638970Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5639006Z graph_break [] 2025-12-04T09:47:13.5639093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5639134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5639189Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5639260Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5639485Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5639525Z graph_break [] 2025-12-04T09:47:13.5639596Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5639639Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5639706Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5639779Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5640007Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5640047Z graph_break [] 2025-12-04T09:47:13.5640121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5640164Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5640217Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5640289Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5640513Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5640551Z graph_break [] 2025-12-04T09:47:13.5640624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5640666Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5640720Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5640790Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5641013Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5641051Z graph_break [] 2025-12-04T09:47:13.5641122Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5641178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5641232Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5641303Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5641527Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5641565Z graph_break [] 2025-12-04T09:47:13.5641639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5641680Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5641744Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5641816Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5642041Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5642078Z graph_break [] 2025-12-04T09:47:13.5642151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5642193Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5642249Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5642331Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5642556Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5642593Z graph_break [] 2025-12-04T09:47:13.5642666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5642707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5642762Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5642833Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5643137Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5643174Z graph_break [] 2025-12-04T09:47:13.5643249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5643290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5643347Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5643418Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5643646Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5643684Z graph_break [] 2025-12-04T09:47:13.5643760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5643801Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5643858Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5643931Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5644158Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5644198Z graph_break [] 2025-12-04T09:47:13.5644271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5644316Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5644371Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5644446Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5644693Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5644733Z graph_break [] 2025-12-04T09:47:13.5644806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5644850Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5644907Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5644982Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5645222Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5645263Z graph_break [] 2025-12-04T09:47:13.5645335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5645380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5645435Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5645509Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5645740Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5645798Z graph_break [] 2025-12-04T09:47:13.5645871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5645913Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5645969Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5646045Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5646270Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5646310Z graph_break [] 2025-12-04T09:47:13.5646386Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5646437Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5646494Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5646566Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5646795Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5646833Z graph_break [] 2025-12-04T09:47:13.5646907Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5646948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5647007Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5647081Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5647309Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5647347Z graph_break [] 2025-12-04T09:47:13.5647423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5647466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5647524Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5647597Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5647828Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5647865Z graph_break [] 2025-12-04T09:47:13.5647964Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5648007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5648065Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5648138Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5648363Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5648403Z graph_break [] 2025-12-04T09:47:13.5648476Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5648531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5648587Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5648661Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5648886Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5648926Z graph_break [] 2025-12-04T09:47:13.5648999Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5649044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5649111Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5649185Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5649414Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5649455Z graph_break [] 2025-12-04T09:47:13.5649529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5649572Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5649629Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5649703Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5649939Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5649982Z graph_break [] 2025-12-04T09:47:13.5650067Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5650117Z Traceback (most recent call last): 2025-12-04T09:47:13.5650236Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5650280Z return value(self) 2025-12-04T09:47:13.5650317Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5650466Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5650517Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5650656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5650717Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5650764Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5650923Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5650997Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5651052Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5651054Z 2025-12-04T09:47:13.5651106Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5651226Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5651322Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5651337Z 2025-12-04T09:47:13.5651414Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5651564Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5651566Z 2025-12-04T09:47:13.5651655Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5651729Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5651773Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5651830Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5652068Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5652141Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5652181Z graph_break [] 2025-12-04T09:47:13.5652254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5652297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5652353Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5652428Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5652667Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5652704Z graph_break [] 2025-12-04T09:47:13.5652783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5652824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5652883Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5653007Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5653238Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5653298Z graph_break [] 2025-12-04T09:47:13.5653375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5653420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5653477Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5653550Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5653782Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5653818Z graph_break [] 2025-12-04T09:47:13.5653892Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5653935Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5653992Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5654063Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5654290Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5654327Z graph_break [] 2025-12-04T09:47:13.5654402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5654444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5654502Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5654573Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5654799Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5654857Z graph_break [] 2025-12-04T09:47:13.5654930Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5654975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5655030Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5655107Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5655330Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5655382Z graph_break [] 2025-12-04T09:47:13.5655455Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5655500Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5655556Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5655632Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5655864Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5655903Z graph_break [] 2025-12-04T09:47:13.5655990Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5656034Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5656088Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5656161Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5656386Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5656426Z graph_break [] 2025-12-04T09:47:13.5656498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5656543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5656608Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5656683Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5656907Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5656948Z graph_break [] 2025-12-04T09:47:13.5657020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5657064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5657118Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5657191Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5657420Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5657458Z graph_break [] 2025-12-04T09:47:13.5657533Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5657576Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5657634Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5657708Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5657937Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5657975Z graph_break [] 2025-12-04T09:47:13.5658050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5658105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5658163Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5658234Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5658461Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5658500Z graph_break [] 2025-12-04T09:47:13.5658574Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5658615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5658684Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5658756Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5658983Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5659020Z graph_break [] 2025-12-04T09:47:13.5659094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5659137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5659194Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5659266Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5659511Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5659553Z graph_break [] 2025-12-04T09:47:13.5659627Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5659672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5659726Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5659802Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5660042Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5660083Z graph_break [] 2025-12-04T09:47:13.5660156Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5660202Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5660256Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5660330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5660554Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5660592Z graph_break [] 2025-12-04T09:47:13.5660667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5660711Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5660767Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5660841Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5661064Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5661105Z graph_break [] 2025-12-04T09:47:13.5661179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5661223Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5661277Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5661351Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5661576Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5662254Z graph_break [] 2025-12-04T09:47:13.5662330Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5662373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5662431Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5662504Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5662747Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5662785Z graph_break [] 2025-12-04T09:47:13.5662859Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5662902Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5663019Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5663090Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5663317Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5663379Z graph_break [] 2025-12-04T09:47:13.5663453Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5663495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5663552Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5663625Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5663853Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5663893Z graph_break [] 2025-12-04T09:47:13.5663968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5664029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5664088Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5664160Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5664392Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5664431Z graph_break [] 2025-12-04T09:47:13.5664522Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5664569Z Traceback (most recent call last): 2025-12-04T09:47:13.5664688Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5664731Z return value(self) 2025-12-04T09:47:13.5664767Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5664915Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5664968Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5665109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5665169Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5665214Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5665373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5665448Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5665501Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5665503Z 2025-12-04T09:47:13.5665556Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5665689Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5665791Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5665793Z 2025-12-04T09:47:13.5665867Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5666021Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5666023Z 2025-12-04T09:47:13.5666111Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5666199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5666242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5666301Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5666534Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5666607Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5666646Z graph_break [] 2025-12-04T09:47:13.5666719Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5666775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5666831Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5666904Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5667128Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5667168Z graph_break [] 2025-12-04T09:47:13.5667241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5667286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5667340Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5667425Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5667651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5667694Z graph_break [] 2025-12-04T09:47:13.5667766Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5667809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5667863Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5667937Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5668236Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5668291Z graph_break [] 2025-12-04T09:47:13.5668399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5678975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5679056Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5679137Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5679367Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5679408Z graph_break [] 2025-12-04T09:47:13.5679487Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5679531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5679588Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5679716Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5679947Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5679984Z graph_break [] 2025-12-04T09:47:13.5680059Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5680102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5680159Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5680248Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5680478Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5680517Z graph_break [] 2025-12-04T09:47:13.5680592Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5680633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5680689Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5680762Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5680989Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5681046Z graph_break [] 2025-12-04T09:47:13.5681121Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5681164Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5681218Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5681289Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5681516Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5681566Z graph_break [] 2025-12-04T09:47:13.5681639Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5681681Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5681738Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5681809Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5682036Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5682073Z graph_break [] 2025-12-04T09:47:13.5682145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5682189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5682244Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5682318Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5682547Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5682586Z graph_break [] 2025-12-04T09:47:13.5682658Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5682701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5682757Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5682829Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5683096Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5683155Z graph_break [] 2025-12-04T09:47:13.5683227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5683269Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5683325Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5683396Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5683624Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5683685Z graph_break [] 2025-12-04T09:47:13.5683759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5683799Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5683854Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5683926Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5684152Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5684188Z graph_break [] 2025-12-04T09:47:13.5684260Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5684316Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5684371Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5684443Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5684671Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5684706Z graph_break [] 2025-12-04T09:47:13.5684782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5684824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5684881Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5684966Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5685191Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5685232Z graph_break [] 2025-12-04T09:47:13.5685304Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5685347Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5685401Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5685474Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5685700Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5685740Z graph_break [] 2025-12-04T09:47:13.5685812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5685855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5685911Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5685984Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5686211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5686250Z graph_break [] 2025-12-04T09:47:13.5686322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5686364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5686433Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5686509Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5686736Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5686776Z graph_break [] 2025-12-04T09:47:13.5686848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5686889Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5686944Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5687038Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5687264Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5687303Z graph_break [] 2025-12-04T09:47:13.5687376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5687419Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5687475Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5687546Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5687785Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5687821Z graph_break [] 2025-12-04T09:47:13.5687896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5687936Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5687992Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5688065Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5688305Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5688342Z graph_break [] 2025-12-04T09:47:13.5688419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5688462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5688518Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5688590Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5688817Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5688852Z graph_break [] 2025-12-04T09:47:13.5688927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5688969Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5689027Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5689099Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5689324Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5689363Z graph_break [] 2025-12-04T09:47:13.5689450Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5689497Z Traceback (most recent call last): 2025-12-04T09:47:13.5689626Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5689668Z return value(self) 2025-12-04T09:47:13.5689705Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5689869Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5689923Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5690068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5690129Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5690177Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5690338Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5690414Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5690480Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5690483Z 2025-12-04T09:47:13.5690539Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5690658Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5690758Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5690761Z 2025-12-04T09:47:13.5690838Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5690994Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5691006Z 2025-12-04T09:47:13.5691095Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5691173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5691214Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5691273Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5691501Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5691577Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5691614Z graph_break [] 2025-12-04T09:47:13.5691696Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5691739Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5691794Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5691868Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5692095Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5692135Z graph_break [] 2025-12-04T09:47:13.5692206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5692249Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5692303Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5692377Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5692606Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5692643Z graph_break [] 2025-12-04T09:47:13.5692716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5692758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5692812Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5692885Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5693168Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5693228Z graph_break [] 2025-12-04T09:47:13.5693300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5693343Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5693398Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5693470Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5693695Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5693735Z graph_break [] 2025-12-04T09:47:13.5693829Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5693874Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5693928Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5693999Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5694227Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5694267Z graph_break [] 2025-12-04T09:47:13.5694340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5694380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5694452Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5694524Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5694754Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5694791Z graph_break [] 2025-12-04T09:47:13.5694864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5694905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5694960Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5695032Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5695270Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5695309Z graph_break [] 2025-12-04T09:47:13.5695383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5695425Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5695481Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5695554Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5695780Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5695817Z graph_break [] 2025-12-04T09:47:13.5695890Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5695933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5695988Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5696059Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5696286Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5696473Z graph_break [] 2025-12-04T09:47:13.5696545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5696587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5696642Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5696734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5696963Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5697001Z graph_break [] 2025-12-04T09:47:13.5697073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5697117Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5697170Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5697242Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5697480Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5697517Z graph_break [] 2025-12-04T09:47:13.5697591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5697635Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5697688Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5697761Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5697983Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5698036Z graph_break [] 2025-12-04T09:47:13.5698109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5698154Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5698208Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5698280Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5698503Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5698542Z graph_break [] 2025-12-04T09:47:13.5698625Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5698667Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5698725Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5698797Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5699025Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5699061Z graph_break [] 2025-12-04T09:47:13.5699135Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5699176Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5699233Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5699305Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5699533Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5699573Z graph_break [] 2025-12-04T09:47:13.5699646Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5699685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5699741Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5699813Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5700039Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5700095Z graph_break [] 2025-12-04T09:47:13.5700169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5700210Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5700265Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5700338Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5700566Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5700603Z graph_break [] 2025-12-04T09:47:13.5700689Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5700733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5700786Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5700859Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5701083Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5701120Z graph_break [] 2025-12-04T09:47:13.5701193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5701250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5701303Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5701375Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5701601Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5701638Z graph_break [] 2025-12-04T09:47:13.5701712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5701754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5701809Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5701890Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5702116Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5702158Z graph_break [] 2025-12-04T09:47:13.5702231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5702274Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5702327Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5702399Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5702622Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5702661Z graph_break [] 2025-12-04T09:47:13.5702736Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5702779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5702832Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5702907Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5703200Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5703236Z graph_break [] 2025-12-04T09:47:13.5703308Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5703349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5703432Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5703504Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5703729Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5703767Z graph_break [] 2025-12-04T09:47:13.5703841Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5703881Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5703938Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5704035Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5704259Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5704296Z graph_break [] 2025-12-04T09:47:13.5704383Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5704429Z Traceback (most recent call last): 2025-12-04T09:47:13.5704551Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5704590Z return value(self) 2025-12-04T09:47:13.5704644Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5704791Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5704845Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5704987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5705048Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5705093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5705257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5705330Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5705396Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5705398Z 2025-12-04T09:47:13.5705452Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5705569Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5705667Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5705670Z 2025-12-04T09:47:13.5705745Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5705898Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5705901Z 2025-12-04T09:47:13.5705988Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5706064Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5706104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5706164Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5706389Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5706465Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5706503Z graph_break [] 2025-12-04T09:47:13.5706580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5706622Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5706678Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5706749Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5706992Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5707032Z graph_break [] 2025-12-04T09:47:13.5707104Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5707146Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5707200Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5707274Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5707511Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5707552Z graph_break [] 2025-12-04T09:47:13.5707624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5707666Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5707719Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5707791Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5708016Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5708067Z graph_break [] 2025-12-04T09:47:13.5708140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5708182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5708238Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5708311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5708537Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5708577Z graph_break [] 2025-12-04T09:47:13.5708648Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5708701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5708756Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5708829Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5709055Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5709092Z graph_break [] 2025-12-04T09:47:13.5709164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5709206Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5709259Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5709333Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5709559Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5709595Z graph_break [] 2025-12-04T09:47:13.5709668Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5709708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5709762Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5709833Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5710057Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5710093Z graph_break [] 2025-12-04T09:47:13.5710181Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5710221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5710276Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5710348Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5710572Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5710609Z graph_break [] 2025-12-04T09:47:13.5710682Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5710737Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5710793Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5710864Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5711092Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5711128Z graph_break [] 2025-12-04T09:47:13.5711202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5711242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5711311Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5711381Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5711608Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5711646Z graph_break [] 2025-12-04T09:47:13.5711718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5711760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5711814Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5711886Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5712132Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5712170Z graph_break [] 2025-12-04T09:47:13.5712242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5712283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5712338Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5712410Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5712632Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5712670Z graph_break [] 2025-12-04T09:47:13.5712741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5712783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5712837Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5712909Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5713189Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5713227Z graph_break [] 2025-12-04T09:47:13.5713300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5713341Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5713395Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5713489Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5713714Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5713752Z graph_break [] 2025-12-04T09:47:13.5713825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5713866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5713921Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5713992Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5714237Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5714273Z graph_break [] 2025-12-04T09:47:13.5714347Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5714388Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5714442Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5714514Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5714741Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5714791Z graph_break [] 2025-12-04T09:47:13.5714864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5714905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5714961Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5715032Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5715256Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5715293Z graph_break [] 2025-12-04T09:47:13.5715379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5715419Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5715476Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5715547Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5715772Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5715808Z graph_break [] 2025-12-04T09:47:13.5715881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5715921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5715977Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5716053Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5716277Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5716315Z graph_break [] 2025-12-04T09:47:13.5716386Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5716428Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5716481Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5716555Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5716778Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5716831Z graph_break [] 2025-12-04T09:47:13.5716903Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5716944Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5716999Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5717071Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5717296Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5717332Z graph_break [] 2025-12-04T09:47:13.5717419Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5717461Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5717515Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5717586Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5717813Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5717850Z graph_break [] 2025-12-04T09:47:13.5717921Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5717977Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5718031Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5718102Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5718326Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5718361Z graph_break [] 2025-12-04T09:47:13.5718434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5718475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5718530Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5718611Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5718837Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5718874Z graph_break [] 2025-12-04T09:47:13.5718946Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5718986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5719042Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5719113Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5719338Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5719375Z graph_break [] 2025-12-04T09:47:13.5719461Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5719507Z Traceback (most recent call last): 2025-12-04T09:47:13.5719628Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5719667Z return value(self) 2025-12-04T09:47:13.5719703Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5719848Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5719901Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5720039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5720099Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5720157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5720315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5720388Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5720443Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5720446Z 2025-12-04T09:47:13.5720499Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5720615Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5720722Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5720724Z 2025-12-04T09:47:13.5720799Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5720949Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5720952Z 2025-12-04T09:47:13.5721038Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5721112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5721153Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5721209Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5721445Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5721519Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5721556Z graph_break [] 2025-12-04T09:47:13.5721629Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5721670Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5721724Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5721796Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5722032Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5722069Z graph_break [] 2025-12-04T09:47:13.5722143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5722183Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5722238Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5722310Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5722537Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5722576Z graph_break [] 2025-12-04T09:47:13.5722650Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5722691Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5722745Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5722818Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5723085Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5723123Z graph_break [] 2025-12-04T09:47:13.5723195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5723237Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5723291Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5723362Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5723614Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5723652Z graph_break [] 2025-12-04T09:47:13.5723724Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5723765Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5723820Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5723892Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5724137Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5724174Z graph_break [] 2025-12-04T09:47:13.5724246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5724289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5724342Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5724414Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5724644Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5724702Z graph_break [] 2025-12-04T09:47:13.5724776Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5724817Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5724875Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5724945Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5725170Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5725207Z graph_break [] 2025-12-04T09:47:13.5725280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5725335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5725390Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5725461Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5725688Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5725724Z graph_break [] 2025-12-04T09:47:13.5725797Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5725836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5725891Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5725963Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5726188Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5726224Z graph_break [] 2025-12-04T09:47:13.5726297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5726338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5726394Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5726465Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5726695Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5726731Z graph_break [] 2025-12-04T09:47:13.5726818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5726859Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5726914Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5726986Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5727210Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5727248Z graph_break [] 2025-12-04T09:47:13.5727319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5727372Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5727426Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5727498Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5727723Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5727762Z graph_break [] 2025-12-04T09:47:13.5727835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5727876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5727940Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5728013Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5728238Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5728275Z graph_break [] 2025-12-04T09:47:13.5728346Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5728387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5728442Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5728514Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5728755Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5728794Z graph_break [] 2025-12-04T09:47:13.5728866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5728908Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5728963Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5729035Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5729259Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5729296Z graph_break [] 2025-12-04T09:47:13.5729369Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5729410Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5729465Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5729537Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5729765Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5729801Z graph_break [] 2025-12-04T09:47:13.5729875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5729917Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5729973Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5730044Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5730291Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5730327Z graph_break [] 2025-12-04T09:47:13.5730402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5730443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5730499Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5730571Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5730813Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5730849Z graph_break [] 2025-12-04T09:47:13.5730924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5730966Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5731022Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5731095Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5731320Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5731370Z graph_break [] 2025-12-04T09:47:13.5731441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5731485Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5731539Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5731612Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5731836Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5731875Z graph_break [] 2025-12-04T09:47:13.5731960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5732005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5732058Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5732130Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5732355Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5732394Z graph_break [] 2025-12-04T09:47:13.5732467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5732510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5732565Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5732637Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5732863Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5732901Z graph_break [] 2025-12-04T09:47:13.5733021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5733063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5733117Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5733193Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5733416Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5733477Z graph_break [] 2025-12-04T09:47:13.5733552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5733592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5733649Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5733720Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5733947Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5733984Z graph_break [] 2025-12-04T09:47:13.5734081Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5734122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5734179Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5734249Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5734476Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5734512Z graph_break [] 2025-12-04T09:47:13.5734585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5734640Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5734696Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5734767Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5734994Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5735030Z graph_break [] 2025-12-04T09:47:13.5735114Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5735162Z Traceback (most recent call last): 2025-12-04T09:47:13.5735282Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5735332Z return value(self) 2025-12-04T09:47:13.5735369Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5735513Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5735567Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5735704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5735766Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5735813Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5735971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5736047Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5736101Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5736103Z 2025-12-04T09:47:13.5736156Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5736274Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5736373Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5736378Z 2025-12-04T09:47:13.5736451Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5736604Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5736607Z 2025-12-04T09:47:13.5736695Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5736767Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5736823Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5736880Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5737106Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5737182Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5737220Z graph_break [] 2025-12-04T09:47:13.5737293Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5737333Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5737409Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5737481Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5737709Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5737748Z graph_break [] 2025-12-04T09:47:13.5737820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5737866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5737920Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5737993Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5738230Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5738270Z graph_break [] 2025-12-04T09:47:13.5738342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5738386Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5738440Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5738514Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5738750Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5738789Z graph_break [] 2025-12-04T09:47:13.5738860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5738903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5738958Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5739031Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5739257Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5739297Z graph_break [] 2025-12-04T09:47:13.5739371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5739414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5739468Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5739540Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5739764Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5739801Z graph_break [] 2025-12-04T09:47:13.5739875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5739916Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5739972Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5740043Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5740271Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5740321Z graph_break [] 2025-12-04T09:47:13.5740396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5740437Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5740495Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5740567Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5740804Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5740841Z graph_break [] 2025-12-04T09:47:13.5740917Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5740956Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5741013Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5741085Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5741315Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5741361Z graph_break [] 2025-12-04T09:47:13.5741434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5741473Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5741531Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5741603Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5741828Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5741866Z graph_break [] 2025-12-04T09:47:13.5741939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5741991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5742046Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5742120Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5742344Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5742382Z graph_break [] 2025-12-04T09:47:13.5742459Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5742500Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5742555Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5742629Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5742857Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5742894Z graph_break [] 2025-12-04T09:47:13.5743015Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5743060Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5743115Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5743188Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5743412Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5743451Z graph_break [] 2025-12-04T09:47:13.5743523Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5743592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5743646Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5743720Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5743945Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5743985Z graph_break [] 2025-12-04T09:47:13.5744058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5744122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5744177Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5744252Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5744478Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5744516Z graph_break [] 2025-12-04T09:47:13.5744590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5744630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5744685Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5744771Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5745001Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5745038Z graph_break [] 2025-12-04T09:47:13.5745113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5745155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5745212Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5745282Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5745521Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5745559Z graph_break [] 2025-12-04T09:47:13.5745634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5745674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5745731Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5745804Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5746033Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5746071Z graph_break [] 2025-12-04T09:47:13.5746143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5746184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5746244Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5746314Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5746541Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5746578Z graph_break [] 2025-12-04T09:47:13.5746651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5746693Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5746746Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5746821Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5747062Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5747099Z graph_break [] 2025-12-04T09:47:13.5747171Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5747216Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5747271Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5747345Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5747580Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5747620Z graph_break [] 2025-12-04T09:47:13.5747692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5747736Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5747789Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5747863Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5748088Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5748140Z graph_break [] 2025-12-04T09:47:13.5748211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5748253Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5748309Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5748382Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5748608Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5748646Z graph_break [] 2025-12-04T09:47:13.5748730Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5748771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5748827Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5748899Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5749126Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5749161Z graph_break [] 2025-12-04T09:47:13.5749235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5749276Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5749332Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5749403Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5749629Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5749665Z graph_break [] 2025-12-04T09:47:13.5749739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5749781Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5749835Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5749906Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5750134Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5750192Z graph_break [] 2025-12-04T09:47:13.5750266Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5750308Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5750364Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5750436Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5750665Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5750702Z graph_break [] 2025-12-04T09:47:13.5750785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5750828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5750882Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5750954Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5751180Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5751219Z graph_break [] 2025-12-04T09:47:13.5751304Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5751363Z Traceback (most recent call last): 2025-12-04T09:47:13.5751481Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5751521Z return value(self) 2025-12-04T09:47:13.5751556Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5751702Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5751754Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5751892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5751954Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5752001Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5752170Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5752246Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5752299Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5752302Z 2025-12-04T09:47:13.5752360Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5752476Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5752578Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5752580Z 2025-12-04T09:47:13.5752653Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5752806Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5752808Z 2025-12-04T09:47:13.5752897Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5753012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5753055Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5753113Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5753343Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5753416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5753456Z graph_break [] 2025-12-04T09:47:13.5753528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5753595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5753651Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5753724Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5753949Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5753988Z graph_break [] 2025-12-04T09:47:13.5754060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5754107Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5754162Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5754251Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5754479Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5754517Z graph_break [] 2025-12-04T09:47:13.5754590Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5754632Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5754686Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5754758Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5754999Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5755039Z graph_break [] 2025-12-04T09:47:13.5755112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5755153Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5755209Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5755281Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5755522Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5755559Z graph_break [] 2025-12-04T09:47:13.5755634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5755675Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5755729Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5755802Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5756029Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5756066Z graph_break [] 2025-12-04T09:47:13.5756143Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5756183Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5756239Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5756311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5756540Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5756577Z graph_break [] 2025-12-04T09:47:13.5756651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5756692Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5756748Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5756820Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5757047Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5757096Z graph_break [] 2025-12-04T09:47:13.5757169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5757211Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5757267Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5757340Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5757574Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5757613Z graph_break [] 2025-12-04T09:47:13.5757685Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5757726Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5757781Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5757855Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5758080Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5758131Z graph_break [] 2025-12-04T09:47:13.5758203Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5758246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5758300Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5758373Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5758599Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5758637Z graph_break [] 2025-12-04T09:47:13.5758709Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5758753Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5758817Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5758889Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5759115Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5759154Z graph_break [] 2025-12-04T09:47:13.5759227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5759270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5759324Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5759396Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5759622Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5759657Z graph_break [] 2025-12-04T09:47:13.5759731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5759772Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5759827Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5759900Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5760124Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5760162Z graph_break [] 2025-12-04T09:47:13.5760236Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5760289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5760343Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5760416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5760642Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5760679Z graph_break [] 2025-12-04T09:47:13.5760752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5760793Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5760858Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5760929Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5761156Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5761194Z graph_break [] 2025-12-04T09:47:13.5761270Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5761310Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5761367Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5761452Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5761677Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5761718Z graph_break [] 2025-12-04T09:47:13.5761789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5761830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5761885Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5761956Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5762276Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5762317Z graph_break [] 2025-12-04T09:47:13.5762391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5762433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5762488Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5762562Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5762785Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5762824Z graph_break [] 2025-12-04T09:47:13.5762895Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5762969Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5763026Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5763098Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5763322Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5763360Z graph_break [] 2025-12-04T09:47:13.5763434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5763475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5763528Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5763602Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5763850Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5763891Z graph_break [] 2025-12-04T09:47:13.5763964Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5764008Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5764062Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5764135Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5764377Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5764414Z graph_break [] 2025-12-04T09:47:13.5764491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5764534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5764588Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5764658Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5764886Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5764941Z graph_break [] 2025-12-04T09:47:13.5765016Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5765056Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5765115Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5765189Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5765415Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5765453Z graph_break [] 2025-12-04T09:47:13.5765544Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5765585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5765641Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5765716Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5765944Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5765981Z graph_break [] 2025-12-04T09:47:13.5766055Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5766097Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5766151Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5766223Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5766452Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5766490Z graph_break [] 2025-12-04T09:47:13.5766563Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5766604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5766658Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5766730Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5766956Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5767010Z graph_break [] 2025-12-04T09:47:13.5767080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5767123Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5767177Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5767250Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5767473Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5767512Z graph_break [] 2025-12-04T09:47:13.5767595Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5767638Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5767693Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5767766Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5767989Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5768030Z graph_break [] 2025-12-04T09:47:13.5768114Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5768160Z Traceback (most recent call last): 2025-12-04T09:47:13.5768289Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5768329Z return value(self) 2025-12-04T09:47:13.5768365Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5768516Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5768568Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5768709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5768769Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5768814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5768987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5769060Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5769114Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5769117Z 2025-12-04T09:47:13.5769170Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5769286Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5769382Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5769385Z 2025-12-04T09:47:13.5769459Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5769609Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5769612Z 2025-12-04T09:47:13.5769700Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5769772Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5769815Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5769871Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5770100Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5770174Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5770211Z graph_break [] 2025-12-04T09:47:13.5770284Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5770323Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5770394Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5770466Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5770696Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5770733Z graph_break [] 2025-12-04T09:47:13.5770806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5770845Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5770902Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5770985Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5771210Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5771247Z graph_break [] 2025-12-04T09:47:13.5771319Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5771361Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5771419Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5771490Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5771728Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5771764Z graph_break [] 2025-12-04T09:47:13.5771837Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5771877Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5771933Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5772004Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5772243Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5772279Z graph_break [] 2025-12-04T09:47:13.5772353Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5772394Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5772450Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5772521Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5772748Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5772784Z graph_break [] 2025-12-04T09:47:13.5772855Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5772897Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5772989Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5773064Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5773288Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5773329Z graph_break [] 2025-12-04T09:47:13.5773400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5773440Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5773495Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5773567Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5773791Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5773855Z graph_break [] 2025-12-04T09:47:13.5773928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5773970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5774025Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5774099Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5774336Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5774373Z graph_break [] 2025-12-04T09:47:13.5774448Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5774492Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5774548Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5774622Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5774848Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5774906Z graph_break [] 2025-12-04T09:47:13.5774978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5775018Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5775072Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5775145Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5775372Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5775409Z graph_break [] 2025-12-04T09:47:13.5775483Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5775522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5775592Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5775664Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5775890Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5775928Z graph_break [] 2025-12-04T09:47:13.5776004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5776045Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5776101Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5776173Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5776399Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5776437Z graph_break [] 2025-12-04T09:47:13.5776511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5776552Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5776608Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5776680Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5776908Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5776945Z graph_break [] 2025-12-04T09:47:13.5777017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5777074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5777128Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5777202Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5777425Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5777463Z graph_break [] 2025-12-04T09:47:13.5777536Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5777577Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5777641Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5777715Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5777939Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5777977Z graph_break [] 2025-12-04T09:47:13.5778050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5778092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5778146Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5778228Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5778454Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5778493Z graph_break [] 2025-12-04T09:47:13.5778564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5778606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5778662Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5778737Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5778974Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5779012Z graph_break [] 2025-12-04T09:47:13.5779084Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5779126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5779181Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5779256Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5779482Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5779519Z graph_break [] 2025-12-04T09:47:13.5779591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5779631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5779688Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5779760Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5779987Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5780023Z graph_break [] 2025-12-04T09:47:13.5780097Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5780139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5780194Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5780264Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5780502Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5780539Z graph_break [] 2025-12-04T09:47:13.5780611Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5780651Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5780708Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5780778Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5781015Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5781053Z graph_break [] 2025-12-04T09:47:13.5781128Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5781169Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5781226Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5781297Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5781523Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5781572Z graph_break [] 2025-12-04T09:47:13.5781645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5781685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5781743Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5781816Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5782043Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5782083Z graph_break [] 2025-12-04T09:47:13.5782155Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5782206Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5782260Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5782333Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5782558Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5782596Z graph_break [] 2025-12-04T09:47:13.5782667Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5782710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5782765Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5782839Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5783100Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5783138Z graph_break [] 2025-12-04T09:47:13.5783210Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5783255Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5783309Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5783383Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5783608Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5783645Z graph_break [] 2025-12-04T09:47:13.5783742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5783782Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5783837Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5783909Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5784141Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5784179Z graph_break [] 2025-12-04T09:47:13.5784251Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5784312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5784367Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5784439Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5784666Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5784703Z graph_break [] 2025-12-04T09:47:13.5784779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5784820Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5784896Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5784967Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5785195Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5785231Z graph_break [] 2025-12-04T09:47:13.5785316Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5785361Z Traceback (most recent call last): 2025-12-04T09:47:13.5785482Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5785521Z return value(self) 2025-12-04T09:47:13.5785559Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5785717Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5785772Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5785910Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5785971Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5786017Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5786177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5786251Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5786306Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5786308Z 2025-12-04T09:47:13.5786362Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5786478Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5786578Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5786581Z 2025-12-04T09:47:13.5786655Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5786809Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5786811Z 2025-12-04T09:47:13.5786898Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5786971Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5787013Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5787083Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5787312Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5787387Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5787425Z graph_break [] 2025-12-04T09:47:13.5787499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5787541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5787597Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5787692Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5787919Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5787957Z graph_break [] 2025-12-04T09:47:13.5788029Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5788073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5788127Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5788199Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5788438Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5788477Z graph_break [] 2025-12-04T09:47:13.5788553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5788595Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5788649Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5788720Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5788955Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5788992Z graph_break [] 2025-12-04T09:47:13.5789065Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5789109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5789164Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5789238Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5789462Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5789499Z graph_break [] 2025-12-04T09:47:13.5789570Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5789612Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5789666Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5789740Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5789965Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5790007Z graph_break [] 2025-12-04T09:47:13.5790080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5790120Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5790177Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5790249Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5790479Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5790529Z graph_break [] 2025-12-04T09:47:13.5790603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5790645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5790700Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5790773Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5791008Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5791044Z graph_break [] 2025-12-04T09:47:13.5791119Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5791160Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5791216Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5791289Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5791516Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5791552Z graph_break [] 2025-12-04T09:47:13.5791638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5791678Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5791734Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5791807Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5792032Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5792070Z graph_break [] 2025-12-04T09:47:13.5792144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5792185Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5792251Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5792324Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5792548Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5792587Z graph_break [] 2025-12-04T09:47:13.5792662Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5792704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5792760Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5792837Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5793123Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5793162Z graph_break [] 2025-12-04T09:47:13.5793235Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5793281Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5793334Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5793407Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5793634Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5793673Z graph_break [] 2025-12-04T09:47:13.5793744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5793811Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5793866Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5793938Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5794162Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5794200Z graph_break [] 2025-12-04T09:47:13.5794271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5794312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5794382Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5794456Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5794682Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5794719Z graph_break [] 2025-12-04T09:47:13.5794792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5794833Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5794892Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5794977Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5795202Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5795243Z graph_break [] 2025-12-04T09:47:13.5795316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5795358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5795412Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5795485Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5798029Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5798071Z graph_break [] 2025-12-04T09:47:13.5798145Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5798189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5798244Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5798315Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5798547Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5798584Z graph_break [] 2025-12-04T09:47:13.5798658Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5798699Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5798754Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5798826Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5799052Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5799091Z graph_break [] 2025-12-04T09:47:13.5799164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5799207Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5799261Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5799334Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5799559Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5799610Z graph_break [] 2025-12-04T09:47:13.5799683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5799725Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5799779Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5799851Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5800088Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5800125Z graph_break [] 2025-12-04T09:47:13.5800196Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5800241Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5800294Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5800366Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5800592Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5800642Z graph_break [] 2025-12-04T09:47:13.5800713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5800755Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5800809Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5800882Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5801107Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5801146Z graph_break [] 2025-12-04T09:47:13.5801218Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5801269Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5801324Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5801397Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5801623Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5801658Z graph_break [] 2025-12-04T09:47:13.5801734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5801775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5801829Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5801902Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5802127Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5802163Z graph_break [] 2025-12-04T09:47:13.5802236Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5802277Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5802331Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5802403Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5802630Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5802666Z graph_break [] 2025-12-04T09:47:13.5802761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5802802Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5802857Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5802983Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5803208Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5803245Z graph_break [] 2025-12-04T09:47:13.5803317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5803378Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5803433Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5803504Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5803729Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5803766Z graph_break [] 2025-12-04T09:47:13.5803838Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5803879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5803933Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5804022Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5804247Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5804284Z graph_break [] 2025-12-04T09:47:13.5804355Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5804397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5804452Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5804524Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5804775Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5804813Z graph_break [] 2025-12-04T09:47:13.5804885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5804926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5804979Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5805053Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5805278Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5805315Z graph_break [] 2025-12-04T09:47:13.5805400Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5805447Z Traceback (most recent call last): 2025-12-04T09:47:13.5805569Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5805609Z return value(self) 2025-12-04T09:47:13.5805645Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5805793Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5805844Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5805987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5806048Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5806093Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5806281Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5806355Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5806411Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5806413Z 2025-12-04T09:47:13.5806465Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5806584Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5806681Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5806684Z 2025-12-04T09:47:13.5806768Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5806920Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5806922Z 2025-12-04T09:47:13.5807010Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5807083Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5807125Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5807181Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5807408Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5807494Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5807531Z graph_break [] 2025-12-04T09:47:13.5807604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5807647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5807700Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5807774Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5808001Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5808046Z graph_break [] 2025-12-04T09:47:13.5808120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5808163Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5808217Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5808288Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5808512Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5808548Z graph_break [] 2025-12-04T09:47:13.5808621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5808663Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5808717Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5808787Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5809012Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5809048Z graph_break [] 2025-12-04T09:47:13.5809120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5809160Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5809215Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5809285Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5809510Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5809558Z graph_break [] 2025-12-04T09:47:13.5809631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5809672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5809727Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5809798Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5810021Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5810069Z graph_break [] 2025-12-04T09:47:13.5810141Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5810182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5810236Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5810309Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5810535Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5810571Z graph_break [] 2025-12-04T09:47:13.5810653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5810694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5810748Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5810819Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5811044Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5811082Z graph_break [] 2025-12-04T09:47:13.5811153Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5811194Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5811257Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5811330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5811553Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5811590Z graph_break [] 2025-12-04T09:47:13.5811661Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5811704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5811758Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5811829Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5812053Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5812091Z graph_break [] 2025-12-04T09:47:13.5812164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5812205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5812261Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5812332Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5812559Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5812597Z graph_break [] 2025-12-04T09:47:13.5812669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5812724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5812778Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5812849Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5813110Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5813147Z graph_break [] 2025-12-04T09:47:13.5813219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5813259Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5813331Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5813402Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5813627Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5813664Z graph_break [] 2025-12-04T09:47:13.5813737Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5813779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5813834Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5813905Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5814149Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5814185Z graph_break [] 2025-12-04T09:47:13.5814258Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5814299Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5814354Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5814426Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5814673Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5814710Z graph_break [] 2025-12-04T09:47:13.5814782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5814824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5814877Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5814948Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5815171Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5815208Z graph_break [] 2025-12-04T09:47:13.5815280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5815321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5815374Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5815447Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5815669Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5815706Z graph_break [] 2025-12-04T09:47:13.5815777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5815819Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5815873Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5815944Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5816168Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5816222Z graph_break [] 2025-12-04T09:47:13.5816294Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5816335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5816389Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5816461Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5816697Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5816734Z graph_break [] 2025-12-04T09:47:13.5816806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5816846Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5816903Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5816974Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5817201Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5817248Z graph_break [] 2025-12-04T09:47:13.5817320Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5817361Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5817416Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5817488Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5817715Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5817752Z graph_break [] 2025-12-04T09:47:13.5817825Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5817866Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5817936Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5818008Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5818233Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5818269Z graph_break [] 2025-12-04T09:47:13.5818344Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5818385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5818440Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5818511Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5818738Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5818776Z graph_break [] 2025-12-04T09:47:13.5818848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5818890Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5818944Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5819016Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5819242Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5819279Z graph_break [] 2025-12-04T09:47:13.5819350Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5819404Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5819457Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5819530Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5819753Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5819791Z graph_break [] 2025-12-04T09:47:13.5819862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5819903Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5819966Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5820038Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5820263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5820300Z graph_break [] 2025-12-04T09:47:13.5820374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5820415Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5820469Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5820552Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5820776Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5820813Z graph_break [] 2025-12-04T09:47:13.5820885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5820926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5820981Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5821054Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5821289Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5821326Z graph_break [] 2025-12-04T09:47:13.5821398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5821438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5821493Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5821565Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5821787Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5821824Z graph_break [] 2025-12-04T09:47:13.5821896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5821936Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5821991Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5822062Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5822287Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5822323Z graph_break [] 2025-12-04T09:47:13.5822396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5822436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5822490Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5822561Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5822801Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5822838Z graph_break [] 2025-12-04T09:47:13.5822911Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5822989Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5823045Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5823116Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5823363Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5823400Z graph_break [] 2025-12-04T09:47:13.5823486Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5823534Z Traceback (most recent call last): 2025-12-04T09:47:13.5823655Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5823695Z return value(self) 2025-12-04T09:47:13.5823730Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5823877Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5823943Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5824083Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5824142Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5824188Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5824347Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5824423Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5824475Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5824477Z 2025-12-04T09:47:13.5824530Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5824658Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5824758Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5824762Z 2025-12-04T09:47:13.5824835Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5824989Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5824991Z 2025-12-04T09:47:13.5825079Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5825150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5825194Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5825249Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5825474Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5825547Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5825588Z graph_break [] 2025-12-04T09:47:13.5825658Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5825700Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5825756Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5825828Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5826051Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5826113Z graph_break [] 2025-12-04T09:47:13.5826184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5826226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5826280Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5826352Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5826580Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5826631Z graph_break [] 2025-12-04T09:47:13.5826704Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5826745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5826800Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5826873Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5827098Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5827135Z graph_break [] 2025-12-04T09:47:13.5827206Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5827274Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5827329Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5827400Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5827628Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5827664Z graph_break [] 2025-12-04T09:47:13.5827738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5827778Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5827833Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5827916Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5828141Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5828177Z graph_break [] 2025-12-04T09:47:13.5828249Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5828292Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5828346Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5828417Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5828645Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5828682Z graph_break [] 2025-12-04T09:47:13.5828756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5828796Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5828851Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5828922Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5829147Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5829183Z graph_break [] 2025-12-04T09:47:13.5829256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5829296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5829367Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5829438Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5829665Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5829704Z graph_break [] 2025-12-04T09:47:13.5829775Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5829816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5829870Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5829951Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5830177Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5830216Z graph_break [] 2025-12-04T09:47:13.5830289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5830331Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5830384Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5830459Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5830695Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5830731Z graph_break [] 2025-12-04T09:47:13.5830803Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5830845Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5830901Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5830973Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5831208Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5831245Z graph_break [] 2025-12-04T09:47:13.5831318Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5831360Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5831414Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5831487Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5831711Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5831748Z graph_break [] 2025-12-04T09:47:13.5831820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5831861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5831916Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5831988Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5832211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5832247Z graph_break [] 2025-12-04T09:47:13.5832321Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5832363Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5832419Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5832491Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5832715Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5832765Z graph_break [] 2025-12-04T09:47:13.5832839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5832880Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5832968Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5833042Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5833290Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5833328Z graph_break [] 2025-12-04T09:47:13.5833402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5833442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5833500Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5833576Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5833805Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5833865Z graph_break [] 2025-12-04T09:47:13.5833939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5833982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5834038Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5834114Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5834344Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5834383Z graph_break [] 2025-12-04T09:47:13.5834457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5834498Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5834566Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5834639Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5834866Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5834904Z graph_break [] 2025-12-04T09:47:13.5834979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5835021Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5835077Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5835151Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5835377Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5835414Z graph_break [] 2025-12-04T09:47:13.5835486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5835528Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5835583Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5835656Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5835884Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5835921Z graph_break [] 2025-12-04T09:47:13.5835993Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5836059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5836113Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5836187Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5836415Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5836452Z graph_break [] 2025-12-04T09:47:13.5836528Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5836569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5836636Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5836708Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5836936Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5836975Z graph_break [] 2025-12-04T09:47:13.5837050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5837090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5837145Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5837228Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5837455Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5837492Z graph_break [] 2025-12-04T09:47:13.5837565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5837605Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5837661Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5837734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5837969Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5838006Z graph_break [] 2025-12-04T09:47:13.5838080Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5838121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5838176Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5838248Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5838474Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5838512Z graph_break [] 2025-12-04T09:47:13.5838584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5838626Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5838680Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5838752Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5838975Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5839013Z graph_break [] 2025-12-04T09:47:13.5839085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5839128Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5839182Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5839254Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5839492Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5839529Z graph_break [] 2025-12-04T09:47:13.5839602Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5839644Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5839698Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5839770Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5840011Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5840048Z graph_break [] 2025-12-04T09:47:13.5840120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5840164Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5840219Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5840290Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5840517Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5840568Z graph_break [] 2025-12-04T09:47:13.5840642Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5840682Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5840738Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5840809Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5841033Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5841070Z graph_break [] 2025-12-04T09:47:13.5841144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5841197Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5841255Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5841328Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5841554Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5841591Z graph_break [] 2025-12-04T09:47:13.5841664Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5841704Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5841761Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5841833Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5842058Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5842095Z graph_break [] 2025-12-04T09:47:13.5842181Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5842228Z Traceback (most recent call last): 2025-12-04T09:47:13.5842348Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5842386Z return value(self) 2025-12-04T09:47:13.5842423Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5842569Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5842621Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5842772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5842832Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5842879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5843087Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5843163Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5843216Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5843219Z 2025-12-04T09:47:13.5843274Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5843411Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5843511Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5843514Z 2025-12-04T09:47:13.5843588Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5843738Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5843740Z 2025-12-04T09:47:13.5843827Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5843900Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5843958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5844014Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5844240Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5844314Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5844351Z graph_break [] 2025-12-04T09:47:13.5844423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5844466Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5844521Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5844604Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5844833Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5844873Z graph_break [] 2025-12-04T09:47:13.5844944Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5844987Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5845041Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5845112Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5845337Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5845375Z graph_break [] 2025-12-04T09:47:13.5845447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5845489Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5845544Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5845616Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5845841Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5845880Z graph_break [] 2025-12-04T09:47:13.5845951Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5845994Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5846063Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5846137Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5846365Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5846403Z graph_break [] 2025-12-04T09:47:13.5846475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5846518Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5846572Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5846654Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5846879Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5846918Z graph_break [] 2025-12-04T09:47:13.5846991Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5847032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5847088Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5847159Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5847398Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5847434Z graph_break [] 2025-12-04T09:47:13.5847509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5847550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5847605Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5847676Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5847911Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5847948Z graph_break [] 2025-12-04T09:47:13.5848021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5848063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5848118Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5848189Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5848416Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5848454Z graph_break [] 2025-12-04T09:47:13.5848526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5848568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5848624Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5848695Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5848920Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5848957Z graph_break [] 2025-12-04T09:47:13.5849031Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5849071Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5849129Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5849202Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5849425Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5849476Z graph_break [] 2025-12-04T09:47:13.5849549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5849591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5849644Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5849718Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5849955Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5849993Z graph_break [] 2025-12-04T09:47:13.5850067Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5850109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5850162Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5850235Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5850461Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5850500Z graph_break [] 2025-12-04T09:47:13.5850585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5850627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5850682Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5850758Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5850982Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5851021Z graph_break [] 2025-12-04T09:47:13.5851092Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5851134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5851198Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5851270Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5851496Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5851532Z graph_break [] 2025-12-04T09:47:13.5851606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5851647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5851701Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5851773Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5852000Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5852037Z graph_break [] 2025-12-04T09:47:13.5852111Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5852154Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5852210Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5852282Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5852508Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5852545Z graph_break [] 2025-12-04T09:47:13.5852617Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5852677Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5852731Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5852802Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5853066Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5853104Z graph_break [] 2025-12-04T09:47:13.5853177Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5853219Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5853292Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5853364Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5853591Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5853630Z graph_break [] 2025-12-04T09:47:13.5853701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5853744Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5853799Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5853887Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5854113Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5854154Z graph_break [] 2025-12-04T09:47:13.5854226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5854267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5854321Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5854395Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5854632Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5854672Z graph_break [] 2025-12-04T09:47:13.5854744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5854785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5854839Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5854911Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5855136Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5855174Z graph_break [] 2025-12-04T09:47:13.5855247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5855290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5855344Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5855416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5855639Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5855677Z graph_break [] 2025-12-04T09:47:13.5855748Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5855791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5855846Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5855917Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5856162Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5856198Z graph_break [] 2025-12-04T09:47:13.5856271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5856312Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5856368Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5856440Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5856679Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5856716Z graph_break [] 2025-12-04T09:47:13.5856789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5856830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5856885Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5856955Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5857180Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5857227Z graph_break [] 2025-12-04T09:47:13.5857301Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5857341Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5857397Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5857470Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5857694Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5857732Z graph_break [] 2025-12-04T09:47:13.5857804Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5857855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5857911Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5857982Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5858213Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5858250Z graph_break [] 2025-12-04T09:47:13.5858322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5858364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5858418Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5858490Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5858715Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5858751Z graph_break [] 2025-12-04T09:47:13.5858823Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5858867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5858921Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5858993Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5859219Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5859256Z graph_break [] 2025-12-04T09:47:13.5859340Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5859382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5859435Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5859508Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5859733Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5859771Z graph_break [] 2025-12-04T09:47:13.5859842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5859895Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5859950Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5860022Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5860247Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5860285Z graph_break [] 2025-12-04T09:47:13.5860359Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5860400Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5860466Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5860537Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5860763Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5860800Z graph_break [] 2025-12-04T09:47:13.5860873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5860914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5860971Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5861041Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5861278Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5861315Z graph_break [] 2025-12-04T09:47:13.5861401Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5861447Z Traceback (most recent call last): 2025-12-04T09:47:13.5861567Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5861606Z return value(self) 2025-12-04T09:47:13.5861642Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5861787Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5861840Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5861978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5862039Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5862084Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5862245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5862318Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5862372Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5862374Z 2025-12-04T09:47:13.5862426Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5862543Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5862641Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5862657Z 2025-12-04T09:47:13.5862731Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5862881Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5862883Z 2025-12-04T09:47:13.5863003Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5863077Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5863119Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5863175Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5863421Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5863495Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5863532Z graph_break [] 2025-12-04T09:47:13.5863605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5863646Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5863702Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5863774Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5864023Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5864060Z graph_break [] 2025-12-04T09:47:13.5864135Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5864175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5864231Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5864302Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5864527Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5864583Z graph_break [] 2025-12-04T09:47:13.5864655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5864698Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5864752Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5864824Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5865052Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5865089Z graph_break [] 2025-12-04T09:47:13.5865159Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5865203Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5865257Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5865329Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5865555Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5865595Z graph_break [] 2025-12-04T09:47:13.5865666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5865707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5865761Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5865834Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5866060Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5866112Z graph_break [] 2025-12-04T09:47:13.5866185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5866227Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5866281Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5866354Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5866577Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5866624Z graph_break [] 2025-12-04T09:47:13.5866698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5866739Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5866793Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5866865Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5867091Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5867127Z graph_break [] 2025-12-04T09:47:13.5867212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5867252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5867307Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5867378Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5867605Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5867642Z graph_break [] 2025-12-04T09:47:13.5867714Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5867755Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5867821Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5867893Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5868120Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5868157Z graph_break [] 2025-12-04T09:47:13.5868231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5868272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5868327Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5868398Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5868628Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5868665Z graph_break [] 2025-12-04T09:47:13.5868738Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5868779Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5868835Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5868907Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5869133Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5869170Z graph_break [] 2025-12-04T09:47:13.5869242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5869297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5869351Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5869423Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5869646Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5869684Z graph_break [] 2025-12-04T09:47:13.5869755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5869797Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5869862Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5869934Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5870161Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5870200Z graph_break [] 2025-12-04T09:47:13.5870272Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5870314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5870368Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5870441Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5870678Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5870715Z graph_break [] 2025-12-04T09:47:13.5870787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5870829Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5870883Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5870957Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5871197Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5871233Z graph_break [] 2025-12-04T09:47:13.5871306Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5871348Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5871402Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5871473Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5871699Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5871735Z graph_break [] 2025-12-04T09:47:13.5871808Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5871848Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5871904Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5871977Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5872206Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5872244Z graph_break [] 2025-12-04T09:47:13.5872316Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5872358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5872414Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5872484Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5872708Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5872757Z graph_break [] 2025-12-04T09:47:13.5872831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5872872Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5872968Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5873039Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5873281Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5873319Z graph_break [] 2025-12-04T09:47:13.5873390Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5873431Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5873487Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5873561Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5873787Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5873844Z graph_break [] 2025-12-04T09:47:13.5873915Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5873958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5874012Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5874086Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5874313Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5874351Z graph_break [] 2025-12-04T09:47:13.5874423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5874476Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5874531Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5874603Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5874827Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5874864Z graph_break [] 2025-12-04T09:47:13.5874936Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5874979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5875033Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5875106Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5875332Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5875369Z graph_break [] 2025-12-04T09:47:13.5875442Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5875484Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5875539Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5875610Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5875837Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5875873Z graph_break [] 2025-12-04T09:47:13.5875947Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5876001Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5876056Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5876128Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5876354Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5876391Z graph_break [] 2025-12-04T09:47:13.5876463Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5876517Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5876572Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5876643Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5876869Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5876907Z graph_break [] 2025-12-04T09:47:13.5876981Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5877022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5877078Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5877167Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5877395Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5877434Z graph_break [] 2025-12-04T09:47:13.5877507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5877548Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5877604Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5877675Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5877911Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5877949Z graph_break [] 2025-12-04T09:47:13.5878022Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5878063Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5878117Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5878190Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5878413Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5878454Z graph_break [] 2025-12-04T09:47:13.5878525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5878568Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5878623Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5878696Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5878920Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5878958Z graph_break [] 2025-12-04T09:47:13.5879030Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5879072Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5879126Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5879201Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5879438Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5879475Z graph_break [] 2025-12-04T09:47:13.5879547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5879593Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5879646Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5879718Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5879958Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5879995Z graph_break [] 2025-12-04T09:47:13.5880068Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5880109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5880164Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5880235Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5880460Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5880515Z graph_break [] 2025-12-04T09:47:13.5880588Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5880628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5880690Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5880761Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5880988Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5881026Z graph_break [] 2025-12-04T09:47:13.5881123Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5881169Z Traceback (most recent call last): 2025-12-04T09:47:13.5881291Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5881331Z return value(self) 2025-12-04T09:47:13.5881368Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5881512Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5881566Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5881704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5881764Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5881811Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5881973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5882046Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5882100Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5882103Z 2025-12-04T09:47:13.5882155Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5882270Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5882370Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5882373Z 2025-12-04T09:47:13.5882445Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5882595Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5882610Z 2025-12-04T09:47:13.5882697Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5882770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5882813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5882869Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5883144Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5883218Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5883278Z graph_break [] 2025-12-04T09:47:13.5883355Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5883397Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5883453Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5883526Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5883756Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5883792Z graph_break [] 2025-12-04T09:47:13.5883866Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5883928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5883984Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5884056Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5884284Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5884321Z graph_break [] 2025-12-04T09:47:13.5884395Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5884438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5884493Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5884576Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5884804Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5884842Z graph_break [] 2025-12-04T09:47:13.5884913Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5884955Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5885012Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5885084Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5885310Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5885348Z graph_break [] 2025-12-04T09:47:13.5885421Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5885464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5885518Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5885590Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5885815Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5885852Z graph_break [] 2025-12-04T09:47:13.5885924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5885966Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5886043Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5886116Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5886343Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5886380Z graph_break [] 2025-12-04T09:47:13.5886454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5886495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5886550Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5886634Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5886860Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5886897Z graph_break [] 2025-12-04T09:47:13.5886969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5887011Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5887066Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5887136Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5887374Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5887410Z graph_break [] 2025-12-04T09:47:13.5887485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5887526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5887581Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5887655Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5887889Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5887926Z graph_break [] 2025-12-04T09:47:13.5888000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5888042Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5888096Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5888167Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5888398Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5888435Z graph_break [] 2025-12-04T09:47:13.5888506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5888549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5888602Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5888676Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5888899Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5888936Z graph_break [] 2025-12-04T09:47:13.5889007Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5889050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5889106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5889177Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5889400Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5889451Z graph_break [] 2025-12-04T09:47:13.5889523Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5889565Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5889619Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5889692Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5889932Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5889969Z graph_break [] 2025-12-04T09:47:13.5890042Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5890083Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5890137Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5890211Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5890438Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5890490Z graph_break [] 2025-12-04T09:47:13.5890564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5890606Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5890661Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5890734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5890962Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5891001Z graph_break [] 2025-12-04T09:47:13.5891073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5891115Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5891180Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5891252Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5891481Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5891518Z graph_break [] 2025-12-04T09:47:13.5891591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5891633Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5891689Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5891760Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5891995Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5892031Z graph_break [] 2025-12-04T09:47:13.5892104Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5892147Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5892202Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5892273Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5892498Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5892535Z graph_break [] 2025-12-04T09:47:13.5892607Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5892668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5892724Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5892795Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5893133Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5893172Z graph_break [] 2025-12-04T09:47:13.5893244Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5893286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5893366Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5893439Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5893663Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5893702Z graph_break [] 2025-12-04T09:47:13.5893774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5893815Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5893869Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5893966Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5894193Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5894231Z graph_break [] 2025-12-04T09:47:13.5894304Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5894347Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5894400Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5894477Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5894713Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5894756Z graph_break [] 2025-12-04T09:47:13.5894831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5894872Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5894927Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5895002Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5895227Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5895267Z graph_break [] 2025-12-04T09:47:13.5895342Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5895382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5895437Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5895508Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5895733Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5895770Z graph_break [] 2025-12-04T09:47:13.5895843Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5895883Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5895938Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5896009Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5896262Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5896300Z graph_break [] 2025-12-04T09:47:13.5896373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5896416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5896473Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5896544Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5896779Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5896816Z graph_break [] 2025-12-04T09:47:13.5896888Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5896929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5896984Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5897055Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5897280Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5897327Z graph_break [] 2025-12-04T09:47:13.5897401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5897442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5897501Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5897574Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5897797Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5897836Z graph_break [] 2025-12-04T09:47:13.5897908Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5897959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5898014Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5898087Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5898313Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5898352Z graph_break [] 2025-12-04T09:47:13.5898424Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5898465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5898520Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5898593Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5898817Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5898855Z graph_break [] 2025-12-04T09:47:13.5898928Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5898969Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5899023Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5899096Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5899320Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5899359Z graph_break [] 2025-12-04T09:47:13.5899443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5899485Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5899538Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5899615Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5899839Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5899877Z graph_break [] 2025-12-04T09:47:13.5899949Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5900003Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5900059Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5900132Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5900360Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5900396Z graph_break [] 2025-12-04T09:47:13.5900470Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5900512Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5900584Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5900655Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5900881Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5900918Z graph_break [] 2025-12-04T09:47:13.5900991Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5901033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5901089Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5901159Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5901392Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5901430Z graph_break [] 2025-12-04T09:47:13.5901517Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5901563Z Traceback (most recent call last): 2025-12-04T09:47:13.5901687Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5901729Z return value(self) 2025-12-04T09:47:13.5901766Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5901913Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5901967Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5902111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5902170Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5902215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5902376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5902452Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5902505Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5902508Z 2025-12-04T09:47:13.5902561Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5902676Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5902774Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5902799Z 2025-12-04T09:47:13.5902872Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5903068Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5903070Z 2025-12-04T09:47:13.5903157Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5903231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5903273Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5903330Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5903580Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5903655Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5903692Z graph_break [] 2025-12-04T09:47:13.5903765Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5903807Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5903863Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5903935Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5904177Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5904216Z graph_break [] 2025-12-04T09:47:13.5904293Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5904334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5904388Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5904462Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5904698Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5904739Z graph_break [] 2025-12-04T09:47:13.5904812Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5904856Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5904912Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5904985Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5905212Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5905249Z graph_break [] 2025-12-04T09:47:13.5905321Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5905365Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5905420Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5905494Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5905721Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5905759Z graph_break [] 2025-12-04T09:47:13.5905831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5905873Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5905929Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5906002Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5906230Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5906281Z graph_break [] 2025-12-04T09:47:13.5906354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5906395Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5906450Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5906522Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5906761Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5906797Z graph_break [] 2025-12-04T09:47:13.5906871Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5906911Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5906969Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5907042Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5907271Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5907321Z graph_break [] 2025-12-04T09:47:13.5907393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5907435Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5907492Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5907565Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5907790Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5907829Z graph_break [] 2025-12-04T09:47:13.5907901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5907943Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5908009Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5908082Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5908309Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5908347Z graph_break [] 2025-12-04T09:47:13.5908422Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5908464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5908519Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5908591Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5908820Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5908859Z graph_break [] 2025-12-04T09:47:13.5908932Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5908976Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5909031Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5909105Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5909332Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5909371Z graph_break [] 2025-12-04T09:47:13.5909443Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5909500Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5909554Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5909626Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5909852Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5909889Z graph_break [] 2025-12-04T09:47:13.5909962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5910005Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5910071Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5910144Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5910367Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5910405Z graph_break [] 2025-12-04T09:47:13.5910479Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5910519Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5910575Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5910657Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5910881Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5910920Z graph_break [] 2025-12-04T09:47:13.5910992Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5911032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5911087Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5911160Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5911397Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5911434Z graph_break [] 2025-12-04T09:47:13.5911507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5911548Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5911603Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5911675Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5911906Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5911944Z graph_break [] 2025-12-04T09:47:13.5912018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5912058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5912115Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5912186Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5912410Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5912448Z graph_break [] 2025-12-04T09:47:13.5912522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5912563Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5912619Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5912692Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5912985Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5913024Z graph_break [] 2025-12-04T09:47:13.5913096Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5913137Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5913193Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5913266Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5913513Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5913553Z graph_break [] 2025-12-04T09:47:13.5913626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5913669Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5913724Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5916109Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5916346Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5916413Z graph_break [] 2025-12-04T09:47:13.5916485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5916527Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5916585Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5916658Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5916880Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5916923Z graph_break [] 2025-12-04T09:47:13.5916994Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5917051Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5917106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5917178Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5917404Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5917444Z graph_break [] 2025-12-04T09:47:13.5917518Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5917559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5917613Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5917685Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5917912Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5917948Z graph_break [] 2025-12-04T09:47:13.5918020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5918064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5918119Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5918190Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5918416Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5918452Z graph_break [] 2025-12-04T09:47:13.5918543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5918583Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5918638Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5918711Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5918934Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5918973Z graph_break [] 2025-12-04T09:47:13.5919046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5919099Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5919155Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5919225Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5919450Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5919489Z graph_break [] 2025-12-04T09:47:13.5919562Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5919604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5919671Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5919743Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5919970Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5920006Z graph_break [] 2025-12-04T09:47:13.5920078Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5920120Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5920176Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5920248Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5920494Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5920532Z graph_break [] 2025-12-04T09:47:13.5920603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5920645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5920698Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5920771Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5920994Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5921033Z graph_break [] 2025-12-04T09:47:13.5921105Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5921147Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5921202Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5921273Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5921496Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5921533Z graph_break [] 2025-12-04T09:47:13.5921605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5921647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5921701Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5921773Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5922015Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5922052Z graph_break [] 2025-12-04T09:47:13.5922126Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5922168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5922223Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5922294Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5922577Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5922614Z graph_break [] 2025-12-04T09:47:13.5922688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5922730Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5922784Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5922855Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5923121Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5923175Z graph_break [] 2025-12-04T09:47:13.5923248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5923291Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5923346Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5923417Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5923640Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5923679Z graph_break [] 2025-12-04T09:47:13.5923770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5923812Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5923868Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5923941Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5924165Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5924203Z graph_break [] 2025-12-04T09:47:13.5924274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5924315Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5924370Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5924442Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5924665Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5924705Z graph_break [] 2025-12-04T09:47:13.5924790Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5924837Z Traceback (most recent call last): 2025-12-04T09:47:13.5924960Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5925000Z return value(self) 2025-12-04T09:47:13.5925036Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5925182Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5925258Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5925400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5925462Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5925508Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5925667Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5925741Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5925795Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5925798Z 2025-12-04T09:47:13.5925865Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5925981Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5926080Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5926083Z 2025-12-04T09:47:13.5926158Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5926312Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5926314Z 2025-12-04T09:47:13.5926404Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5926490Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5926533Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5926588Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5926912Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5926985Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5927023Z graph_break [] 2025-12-04T09:47:13.5927094Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5927136Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5927201Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5927273Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5927498Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5927537Z graph_break [] 2025-12-04T09:47:13.5927609Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5927653Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5927707Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5927780Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5928003Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5928041Z graph_break [] 2025-12-04T09:47:13.5928112Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5928155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5928211Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5928282Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5928512Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5928549Z graph_break [] 2025-12-04T09:47:13.5928621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5928676Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5928731Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5928802Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5929026Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5929064Z graph_break [] 2025-12-04T09:47:13.5929136Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5929177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5929241Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5929314Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5929539Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5929576Z graph_break [] 2025-12-04T09:47:13.5929648Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5929690Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5929745Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5929817Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5930053Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5930090Z graph_break [] 2025-12-04T09:47:13.5930162Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5930203Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5930259Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5930332Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5930569Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5930608Z graph_break [] 2025-12-04T09:47:13.5930679Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5930722Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5930776Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5930847Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5931074Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5931111Z graph_break [] 2025-12-04T09:47:13.5931185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5931226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5931280Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5931353Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5931578Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5931616Z graph_break [] 2025-12-04T09:47:13.5931688Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5931731Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5931785Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5931857Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5932085Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5932136Z graph_break [] 2025-12-04T09:47:13.5932208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5932250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5932305Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5932378Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5932611Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5932649Z graph_break [] 2025-12-04T09:47:13.5932721Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5932762Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5932818Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5932889Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5933161Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5933233Z graph_break [] 2025-12-04T09:47:13.5933308Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5933350Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5933404Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5933475Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5933699Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5933738Z graph_break [] 2025-12-04T09:47:13.5933810Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5933870Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5933926Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5933997Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5934225Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5934260Z graph_break [] 2025-12-04T09:47:13.5934334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5934375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5934431Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5934503Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5934730Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5934766Z graph_break [] 2025-12-04T09:47:13.5934839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5934880Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5934935Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5935007Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5935234Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5935271Z graph_break [] 2025-12-04T09:47:13.5935343Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5935412Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5935465Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5935538Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5935761Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5935798Z graph_break [] 2025-12-04T09:47:13.5935869Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5935923Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5935978Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5936049Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5936273Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5936311Z graph_break [] 2025-12-04T09:47:13.5936383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5936425Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5936479Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5936563Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5936787Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5936825Z graph_break [] 2025-12-04T09:47:13.5936896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5936939Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5936994Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5937065Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5937300Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5937338Z graph_break [] 2025-12-04T09:47:13.5937410Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5937451Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5937507Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5937579Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5937801Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5937838Z graph_break [] 2025-12-04T09:47:13.5937909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5937951Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5938006Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5938077Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5938302Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5938338Z graph_break [] 2025-12-04T09:47:13.5938411Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5938451Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5938508Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5938578Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5938818Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5938854Z graph_break [] 2025-12-04T09:47:13.5938925Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5938969Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5939024Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5939095Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5939328Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5939366Z graph_break [] 2025-12-04T09:47:13.5939437Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5939479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5939533Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5939605Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5939829Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5939878Z graph_break [] 2025-12-04T09:47:13.5939949Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5939991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5940046Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5940118Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5940346Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5940384Z graph_break [] 2025-12-04T09:47:13.5940465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5940509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5940562Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5940636Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5940860Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5940897Z graph_break [] 2025-12-04T09:47:13.5940968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5941009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5941063Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5941135Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5941358Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5941395Z graph_break [] 2025-12-04T09:47:13.5941467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5941509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5941562Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5941635Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5941858Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5941907Z graph_break [] 2025-12-04T09:47:13.5941979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5942020Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5942075Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5942146Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5942372Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5942409Z graph_break [] 2025-12-04T09:47:13.5942492Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5942534Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5942588Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5942659Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5942883Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5942920Z graph_break [] 2025-12-04T09:47:13.5943044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5943109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5943164Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5943236Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5943463Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5943499Z graph_break [] 2025-12-04T09:47:13.5943571Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5943613Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5943668Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5943738Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5943976Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5944016Z graph_break [] 2025-12-04T09:47:13.5944088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5944129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5944185Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5944257Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5944483Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5944521Z graph_break [] 2025-12-04T09:47:13.5944593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5944636Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5944691Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5944764Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5944989Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5945026Z graph_break [] 2025-12-04T09:47:13.5945098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5945141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5945194Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5945284Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5945508Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5945545Z graph_break [] 2025-12-04T09:47:13.5945618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5945660Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5945714Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5945786Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5946030Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5946068Z graph_break [] 2025-12-04T09:47:13.5946155Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5946201Z Traceback (most recent call last): 2025-12-04T09:47:13.5946321Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5946360Z return value(self) 2025-12-04T09:47:13.5946395Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5946555Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5946608Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5946748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5946807Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5946852Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5947011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5947086Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5947140Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5947152Z 2025-12-04T09:47:13.5947204Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5947320Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5947418Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5947420Z 2025-12-04T09:47:13.5947494Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5947643Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5947646Z 2025-12-04T09:47:13.5947733Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5947806Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5947848Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5947904Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5948129Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5948204Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5948240Z graph_break [] 2025-12-04T09:47:13.5948314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5948355Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5948410Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5948480Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5948705Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5948770Z graph_break [] 2025-12-04T09:47:13.5948844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5948885Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5948940Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5949012Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5949247Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5949284Z graph_break [] 2025-12-04T09:47:13.5949357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5949398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5949454Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5949525Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5949751Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5949798Z graph_break [] 2025-12-04T09:47:13.5949870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5949912Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5949966Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5950038Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5950263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5950301Z graph_break [] 2025-12-04T09:47:13.5950372Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5950414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5950478Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5950551Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5950776Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5950813Z graph_break [] 2025-12-04T09:47:13.5950885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5950926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5950980Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5951051Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5951277Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5951314Z graph_break [] 2025-12-04T09:47:13.5951384Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5951427Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5951481Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5951553Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5951776Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5951814Z graph_break [] 2025-12-04T09:47:13.5951884Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5951940Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5951994Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5952066Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5952291Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5952329Z graph_break [] 2025-12-04T09:47:13.5952401Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5952442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5952507Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5952579Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5952802Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5952839Z graph_break [] 2025-12-04T09:47:13.5952913Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5952995Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5953050Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5953145Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5953371Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5953408Z graph_break [] 2025-12-04T09:47:13.5953480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5953520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5953576Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5953647Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5953892Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5953929Z graph_break [] 2025-12-04T09:47:13.5954004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5954044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5954099Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5954171Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5954397Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5954434Z graph_break [] 2025-12-04T09:47:13.5954506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5954547Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5954602Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5954673Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5954898Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5954934Z graph_break [] 2025-12-04T09:47:13.5955006Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5955047Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5955101Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5955172Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5955411Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5955450Z graph_break [] 2025-12-04T09:47:13.5955521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5955564Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5955618Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5955688Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5955932Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5955969Z graph_break [] 2025-12-04T09:47:13.5956041Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5956084Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5956137Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5956208Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5956434Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5956481Z graph_break [] 2025-12-04T09:47:13.5956553Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5956594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5956649Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5956721Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5956944Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5956981Z graph_break [] 2025-12-04T09:47:13.5957063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5957105Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5957160Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5957232Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5957455Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5957492Z graph_break [] 2025-12-04T09:47:13.5957564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5957604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5957659Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5957731Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5957956Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5957992Z graph_break [] 2025-12-04T09:47:13.5958066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5958110Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5958165Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5958236Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5958462Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5958515Z graph_break [] 2025-12-04T09:47:13.5958587Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5958628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5958683Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5958754Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5958980Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5959017Z graph_break [] 2025-12-04T09:47:13.5959098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5959140Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5959193Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5959265Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5959488Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5959526Z graph_break [] 2025-12-04T09:47:13.5959597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5959639Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5959705Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5959776Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5960000Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5960037Z graph_break [] 2025-12-04T09:47:13.5960109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5960152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5960206Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5960278Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5960514Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5960552Z graph_break [] 2025-12-04T09:47:13.5960624Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5960666Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5960720Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5960791Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5961014Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5961052Z graph_break [] 2025-12-04T09:47:13.5961124Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5961165Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5961220Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5961291Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5961517Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5961554Z graph_break [] 2025-12-04T09:47:13.5961627Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5961668Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5961722Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5961804Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5962029Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5962065Z graph_break [] 2025-12-04T09:47:13.5962139Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5962180Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5962234Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5962304Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5962543Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5962580Z graph_break [] 2025-12-04T09:47:13.5962653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5962694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5962748Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5962820Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5963081Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5963136Z graph_break [] 2025-12-04T09:47:13.5963209Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5963252Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5963307Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5963377Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5963604Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5963642Z graph_break [] 2025-12-04T09:47:13.5963728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5963770Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5963825Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5963897Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5964122Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5964160Z graph_break [] 2025-12-04T09:47:13.5964231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5964274Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5964328Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5964400Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5964625Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5964662Z graph_break [] 2025-12-04T09:47:13.5964734Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5964775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5964829Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5964901Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5965125Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5965184Z graph_break [] 2025-12-04T09:47:13.5965255Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5965298Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5965352Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5965424Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5965651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5965687Z graph_break [] 2025-12-04T09:47:13.5965774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5965816Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5965871Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5965941Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5966168Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5966206Z graph_break [] 2025-12-04T09:47:13.5966278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5966330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5966386Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5966457Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5966680Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5966717Z graph_break [] 2025-12-04T09:47:13.5966791Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5966833Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5966887Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5966969Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5967193Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5967230Z graph_break [] 2025-12-04T09:47:13.5967302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5967343Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5967399Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5967470Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5967693Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5967731Z graph_break [] 2025-12-04T09:47:13.5967817Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5967864Z Traceback (most recent call last): 2025-12-04T09:47:13.5967983Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5968023Z return value(self) 2025-12-04T09:47:13.5968059Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5968207Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5968258Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5968396Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5968455Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5968513Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5968670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5968744Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5968797Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5968800Z 2025-12-04T09:47:13.5968853Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5968967Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5969077Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5969079Z 2025-12-04T09:47:13.5969152Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5969302Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5969308Z 2025-12-04T09:47:13.5969394Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5969467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5969509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5969565Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5969804Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5969876Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5969917Z graph_break [] 2025-12-04T09:47:13.5969989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5970030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5970086Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5970158Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5970399Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5970437Z graph_break [] 2025-12-04T09:47:13.5970509Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5970550Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5970605Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5970679Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5970902Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5970940Z graph_break [] 2025-12-04T09:47:13.5971012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5971053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5971108Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5971181Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5971406Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5971445Z graph_break [] 2025-12-04T09:47:13.5971517Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5971559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5971613Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5971686Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5971924Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5971961Z graph_break [] 2025-12-04T09:47:13.5972034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5972074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5972130Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5972200Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5972437Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5972474Z graph_break [] 2025-12-04T09:47:13.5972546Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5972588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5972644Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5972715Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5973005Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5973068Z graph_break [] 2025-12-04T09:47:13.5973141Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5973182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5973240Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5973311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5973539Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5973576Z graph_break [] 2025-12-04T09:47:13.5973649Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5973710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5973765Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5973836Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5974063Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5974103Z graph_break [] 2025-12-04T09:47:13.5974174Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5974215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5974269Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5974342Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5974567Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5974604Z graph_break [] 2025-12-04T09:47:13.5974676Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5974721Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5974777Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5974849Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5975072Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5975109Z graph_break [] 2025-12-04T09:47:13.5975198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5975240Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5975294Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5975366Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5975589Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5975627Z graph_break [] 2025-12-04T09:47:13.5975698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5975756Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5975810Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5975882Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5976107Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5976145Z graph_break [] 2025-12-04T09:47:13.5976219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5976260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5976328Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5976399Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5976623Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5976659Z graph_break [] 2025-12-04T09:47:13.5976732Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5976775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5976831Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5976902Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5977136Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5977174Z graph_break [] 2025-12-04T09:47:13.5977246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5977286Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5977340Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5977411Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5977637Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5977674Z graph_break [] 2025-12-04T09:47:13.5977748Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5977791Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5977845Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5977916Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5978141Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5978177Z graph_break [] 2025-12-04T09:47:13.5978250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5978291Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5978345Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5978417Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5978654Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5978693Z graph_break [] 2025-12-04T09:47:13.5978764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5978806Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5978863Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5978934Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5979171Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5979210Z graph_break [] 2025-12-04T09:47:13.5979281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5979324Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5979377Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5979449Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5979673Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5979725Z graph_break [] 2025-12-04T09:47:13.5979796Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5979839Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5979892Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5979965Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5980187Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5980226Z graph_break [] 2025-12-04T09:47:13.5980313Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5980356Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5980411Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5980486Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5980709Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5980746Z graph_break [] 2025-12-04T09:47:13.5980820Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5980860Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5980916Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5980986Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5981211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5981248Z graph_break [] 2025-12-04T09:47:13.5981321Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5981361Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5981415Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5981487Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5981716Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5981767Z graph_break [] 2025-12-04T09:47:13.5981839Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5981880Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5981935Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5982007Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5982231Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5982266Z graph_break [] 2025-12-04T09:47:13.5982354Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5982396Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5982452Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5982523Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5982752Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5982789Z graph_break [] 2025-12-04T09:47:13.5982861Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5982921Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5983027Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5983099Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5983326Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5983363Z graph_break [] 2025-12-04T09:47:13.5983435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5983477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5983531Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5983621Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5983848Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5983887Z graph_break [] 2025-12-04T09:47:13.5983958Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5984000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5984055Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5984127Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5984350Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5984388Z graph_break [] 2025-12-04T09:47:13.5984459Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5984501Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5984555Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5984627Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5984851Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5984888Z graph_break [] 2025-12-04T09:47:13.5984959Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5985000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5985054Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5985150Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5985377Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5985413Z graph_break [] 2025-12-04T09:47:13.5985486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5985526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5985580Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5985667Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5985892Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5985929Z graph_break [] 2025-12-04T09:47:13.5986001Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5986042Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5986096Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5986167Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5986390Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5986442Z graph_break [] 2025-12-04T09:47:13.5986515Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5986556Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5986611Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5986681Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5986906Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5986955Z graph_break [] 2025-12-04T09:47:13.5987027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5987069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5987123Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5987194Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5987423Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5987460Z graph_break [] 2025-12-04T09:47:13.5987531Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5987574Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5987627Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5987699Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5987923Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5987961Z graph_break [] 2025-12-04T09:47:13.5988032Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5988074Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5988128Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5988201Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5988424Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5988475Z graph_break [] 2025-12-04T09:47:13.5988548Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5988591Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5988645Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5988718Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5988941Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5991484Z graph_break [] 2025-12-04T09:47:13.5991559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5991603Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5991657Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5991732Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5991962Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5991999Z graph_break [] 2025-12-04T09:47:13.5992072Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5992115Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5992169Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5992240Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5992494Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5992531Z graph_break [] 2025-12-04T09:47:13.5992619Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.5992667Z Traceback (most recent call last): 2025-12-04T09:47:13.5992802Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.5992845Z return value(self) 2025-12-04T09:47:13.5992880Z ^^^^^^^^^^^ 2025-12-04T09:47:13.5993076Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.5993132Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.5993271Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.5993332Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.5993377Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.5993536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.5993610Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.5993664Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.5993669Z 2025-12-04T09:47:13.5993720Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.5993836Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.5993934Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.5993936Z 2025-12-04T09:47:13.5994010Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.5994161Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.5994164Z 2025-12-04T09:47:13.5994254Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.5994352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5994395Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5994450Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5994680Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5994754Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5994791Z graph_break [] 2025-12-04T09:47:13.5994864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5994920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5995044Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5995116Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5995340Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5995380Z graph_break [] 2025-12-04T09:47:13.5995454Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5995495Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5995552Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5995623Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5995849Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5995888Z graph_break [] 2025-12-04T09:47:13.5995962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5996002Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5996059Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5996130Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5996375Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5996412Z graph_break [] 2025-12-04T09:47:13.5996485Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5996525Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5996581Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5996652Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5996878Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5996915Z graph_break [] 2025-12-04T09:47:13.5996989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5997029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5997086Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5997159Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5997384Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5997421Z graph_break [] 2025-12-04T09:47:13.5997493Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5997535Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5997589Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5997660Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5997898Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5997935Z graph_break [] 2025-12-04T09:47:13.5998008Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5998050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5998103Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5998174Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5998414Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5998471Z graph_break [] 2025-12-04T09:47:13.5998542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5998586Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5998639Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5998713Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5998936Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5998974Z graph_break [] 2025-12-04T09:47:13.5999046Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5999087Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5999145Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5999217Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5999443Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5999482Z graph_break [] 2025-12-04T09:47:13.5999565Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.5999608Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.5999663Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.5999734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.5999958Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.5999995Z graph_break [] 2025-12-04T09:47:13.6000069Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6000111Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6000166Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6000237Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6000462Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6000498Z graph_break [] 2025-12-04T09:47:13.6000574Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6000615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6000669Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6000741Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6000965Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6001015Z graph_break [] 2025-12-04T09:47:13.6001087Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6001128Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6001183Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6001254Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6001483Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6001521Z graph_break [] 2025-12-04T09:47:13.6001603Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6001662Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6001717Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6001788Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6002014Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6002052Z graph_break [] 2025-12-04T09:47:13.6002125Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6002168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6002220Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6002292Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6002516Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6002555Z graph_break [] 2025-12-04T09:47:13.6002627Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6002669Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6002724Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6002796Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6003072Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6003112Z graph_break [] 2025-12-04T09:47:13.6003185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6003226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6003283Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6003356Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6003580Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6003618Z graph_break [] 2025-12-04T09:47:13.6003691Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6003732Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6003787Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6003858Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6004082Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6004120Z graph_break [] 2025-12-04T09:47:13.6004195Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6004235Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6004290Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6004383Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6004608Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6004646Z graph_break [] 2025-12-04T09:47:13.6004720Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6004760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6004817Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6004887Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6005140Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6005178Z graph_break [] 2025-12-04T09:47:13.6005252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6005293Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6005350Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6005421Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6005646Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6005685Z graph_break [] 2025-12-04T09:47:13.6005761Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6005803Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6005858Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6005929Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6006157Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6006195Z graph_break [] 2025-12-04T09:47:13.6006279Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6006321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6006374Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6006447Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6006669Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6006708Z graph_break [] 2025-12-04T09:47:13.6006780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6006822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6006876Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6006948Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6007178Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6007217Z graph_break [] 2025-12-04T09:47:13.6007289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6007332Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6007389Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6007461Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6007685Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6007734Z graph_break [] 2025-12-04T09:47:13.6007805Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6007848Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6007903Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6007976Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6008200Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6008236Z graph_break [] 2025-12-04T09:47:13.6008332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6008373Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6008428Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6008500Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6008725Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6008761Z graph_break [] 2025-12-04T09:47:13.6008835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6008876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6008930Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6009000Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6009227Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6009264Z graph_break [] 2025-12-04T09:47:13.6009339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6009380Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6009434Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6009515Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6009741Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6009777Z graph_break [] 2025-12-04T09:47:13.6009850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6009891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6009947Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6010019Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6010244Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6010282Z graph_break [] 2025-12-04T09:47:13.6010355Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6010396Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6010450Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6010523Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6010750Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6010787Z graph_break [] 2025-12-04T09:47:13.6010860Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6010902Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6010979Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6011051Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6011278Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6011317Z graph_break [] 2025-12-04T09:47:13.6011389Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6011431Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6011486Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6011571Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6011807Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6011845Z graph_break [] 2025-12-04T09:47:13.6011917Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6011959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6012014Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6012085Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6012307Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6012344Z graph_break [] 2025-12-04T09:47:13.6012417Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6012459Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6012514Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6012586Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6012826Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6012863Z graph_break [] 2025-12-04T09:47:13.6012974Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6013014Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6013070Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6013140Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6013366Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6013405Z graph_break [] 2025-12-04T09:47:13.6013478Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6013519Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6013573Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6013644Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6013868Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6013904Z graph_break [] 2025-12-04T09:47:13.6013976Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6014016Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6014072Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6014143Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6014370Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6014429Z graph_break [] 2025-12-04T09:47:13.6014503Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6014545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6014600Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6014671Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6014911Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6014963Z graph_break [] 2025-12-04T09:47:13.6015034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6015077Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6015132Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6015204Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6015428Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6015465Z graph_break [] 2025-12-04T09:47:13.6015549Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6015596Z Traceback (most recent call last): 2025-12-04T09:47:13.6015714Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6015756Z return value(self) 2025-12-04T09:47:13.6015791Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6015938Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6015989Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6016129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6016201Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6016248Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6016405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6016478Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6016531Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6016533Z 2025-12-04T09:47:13.6016586Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6016702Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6016799Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6016802Z 2025-12-04T09:47:13.6016875Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6017025Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6017027Z 2025-12-04T09:47:13.6017114Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6017186Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6017228Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6017284Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6017518Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6017591Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6017641Z graph_break [] 2025-12-04T09:47:13.6017712Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6017754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6017809Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6017881Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6018106Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6018143Z graph_break [] 2025-12-04T09:47:13.6018224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6018279Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6018333Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6018406Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6018631Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6018671Z graph_break [] 2025-12-04T09:47:13.6018743Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6018784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6018839Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6018909Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6019133Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6019170Z graph_break [] 2025-12-04T09:47:13.6019242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6019284Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6019340Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6019411Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6019645Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6019683Z graph_break [] 2025-12-04T09:47:13.6019756Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6019797Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6019853Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6019925Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6020150Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6020187Z graph_break [] 2025-12-04T09:47:13.6020262Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6020303Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6020358Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6020428Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6020651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6020688Z graph_break [] 2025-12-04T09:47:13.6020762Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6020804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6020859Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6020944Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6021172Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6021209Z graph_break [] 2025-12-04T09:47:13.6021280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6021322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6021376Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6021447Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6021682Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6021733Z graph_break [] 2025-12-04T09:47:13.6021805Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6021847Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6021901Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6021974Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6022200Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6022237Z graph_break [] 2025-12-04T09:47:13.6022309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6022351Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6022406Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6022478Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6022701Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6022741Z graph_break [] 2025-12-04T09:47:13.6022829Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6022872Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6022964Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6023037Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6023263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6023301Z graph_break [] 2025-12-04T09:47:13.6023374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6023416Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6023471Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6023543Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6023766Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6023804Z graph_break [] 2025-12-04T09:47:13.6023875Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6023916Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6023971Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6024044Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6024267Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6024327Z graph_break [] 2025-12-04T09:47:13.6024399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6024442Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6024497Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6024568Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6024794Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6024830Z graph_break [] 2025-12-04T09:47:13.6024917Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6024972Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6025027Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6025098Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6025327Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6025366Z graph_break [] 2025-12-04T09:47:13.6025439Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6025480Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6025533Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6025606Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6025831Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6025870Z graph_break [] 2025-12-04T09:47:13.6025942Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6025985Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6026040Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6026124Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6026349Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6026386Z graph_break [] 2025-12-04T09:47:13.6026457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6026501Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6026556Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6026627Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6026850Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6026888Z graph_break [] 2025-12-04T09:47:13.6026960Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6027002Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6027055Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6027127Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6027353Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6027391Z graph_break [] 2025-12-04T09:47:13.6027462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6027504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6027573Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6027645Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6027872Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6027910Z graph_break [] 2025-12-04T09:47:13.6027982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6028022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6028080Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6028161Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6028398Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6028435Z graph_break [] 2025-12-04T09:47:13.6028508Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6028548Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6028603Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6028674Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6028897Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6028933Z graph_break [] 2025-12-04T09:47:13.6029009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6029052Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6029107Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6029179Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6029418Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6029454Z graph_break [] 2025-12-04T09:47:13.6029526Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6029566Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6029621Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6029691Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6029917Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6029955Z graph_break [] 2025-12-04T09:47:13.6030027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6030069Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6030123Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6030195Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6030419Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6030457Z graph_break [] 2025-12-04T09:47:13.6030529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6030572Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6030626Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6030699Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6030925Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6030976Z graph_break [] 2025-12-04T09:47:13.6031050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6031092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6031145Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6031217Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6031455Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6031509Z graph_break [] 2025-12-04T09:47:13.6031580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6031621Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6031676Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6031749Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6031973Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6032012Z graph_break [] 2025-12-04T09:47:13.6032085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6032126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6032180Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6032255Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6032479Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6032518Z graph_break [] 2025-12-04T09:47:13.6032591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6032631Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6032696Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6032767Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6033025Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6033061Z graph_break [] 2025-12-04T09:47:13.6033137Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6033178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6033233Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6033304Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6033533Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6033571Z graph_break [] 2025-12-04T09:47:13.6033645Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6033685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6033740Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6033810Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6034036Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6034073Z graph_break [] 2025-12-04T09:47:13.6036341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6036419Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6036478Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6036550Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6036778Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6036815Z graph_break [] 2025-12-04T09:47:13.6036887Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6036928Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6036999Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6037098Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6037324Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6037366Z graph_break [] 2025-12-04T09:47:13.6037438Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6037480Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6037534Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6037605Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6037827Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6037866Z graph_break [] 2025-12-04T09:47:13.6037939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6037981Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6038035Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6038109Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6038347Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6038386Z graph_break [] 2025-12-04T09:47:13.6038457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6038499Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6038553Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6038625Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6038853Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6038889Z graph_break [] 2025-12-04T09:47:13.6038963Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6039004Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6039058Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6039131Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6039357Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6039393Z graph_break [] 2025-12-04T09:47:13.6039465Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6039509Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6039564Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6039634Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6039857Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6039906Z graph_break [] 2025-12-04T09:47:13.6039979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6040020Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6040075Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6040147Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6040384Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6040432Z graph_break [] 2025-12-04T09:47:13.6040504Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6040546Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6040601Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6040672Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6040897Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6040934Z graph_break [] 2025-12-04T09:47:13.6041020Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6041068Z Traceback (most recent call last): 2025-12-04T09:47:13.6041191Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6041233Z return value(self) 2025-12-04T09:47:13.6041268Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6041418Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6041470Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6041613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6041684Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6041730Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6041891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6041965Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6042018Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6042021Z 2025-12-04T09:47:13.6042077Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6042194Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6042291Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6042295Z 2025-12-04T09:47:13.6042368Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6042521Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6042522Z 2025-12-04T09:47:13.6042609Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6042683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6042724Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6042780Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6043044Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6043118Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6043182Z graph_break [] 2025-12-04T09:47:13.6043254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6043296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6043351Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6043423Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6043651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6043689Z graph_break [] 2025-12-04T09:47:13.6043780Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6043849Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6043903Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6043975Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6044201Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6044238Z graph_break [] 2025-12-04T09:47:13.6044309Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6044351Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6044405Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6044476Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6044700Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6044738Z graph_break [] 2025-12-04T09:47:13.6044809Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6044851Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6044905Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6044989Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6045214Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6045250Z graph_break [] 2025-12-04T09:47:13.6045323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6045364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6045421Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6045492Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6045717Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6045754Z graph_break [] 2025-12-04T09:47:13.6045828Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6045868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6045925Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6045995Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6046219Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6046256Z graph_break [] 2025-12-04T09:47:13.6046328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6046368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6046436Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6046507Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6046732Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6046768Z graph_break [] 2025-12-04T09:47:13.6046840Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6046881Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6046935Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6047016Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6047253Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6047291Z graph_break [] 2025-12-04T09:47:13.6047363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6047405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6047459Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6047530Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6047753Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6047790Z graph_break [] 2025-12-04T09:47:13.6047862Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6047905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6047958Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6048029Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6048253Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6048299Z graph_break [] 2025-12-04T09:47:13.6048371Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6048413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6048467Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6048539Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6048763Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6048801Z graph_break [] 2025-12-04T09:47:13.6048872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6048914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6048967Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6049038Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6049262Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6049299Z graph_break [] 2025-12-04T09:47:13.6049372Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6049413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6049468Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6049541Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6049765Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6049819Z graph_break [] 2025-12-04T09:47:13.6049892Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6049933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6049987Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6050058Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6050283Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6050362Z graph_break [] 2025-12-04T09:47:13.6050434Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6050475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6050529Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6050601Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6050825Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6050862Z graph_break [] 2025-12-04T09:47:13.6050935Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6050975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6051030Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6051100Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6051328Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6051365Z graph_break [] 2025-12-04T09:47:13.6051436Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6051477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6051544Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6051616Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6051840Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6051876Z graph_break [] 2025-12-04T09:47:13.6051947Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6051991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6052045Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6052118Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6052342Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6052379Z graph_break [] 2025-12-04T09:47:13.6052452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6052493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6052546Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6052618Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6052845Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6052883Z graph_break [] 2025-12-04T09:47:13.6053003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6053073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6053127Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6053201Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6053426Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6053463Z graph_break [] 2025-12-04T09:47:13.6053534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6053576Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6053650Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6053737Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6053960Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6053998Z graph_break [] 2025-12-04T09:47:13.6054070Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6054112Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6054166Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6054236Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6054460Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6054496Z graph_break [] 2025-12-04T09:47:13.6054569Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6054610Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6054665Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6054736Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6054984Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6055021Z graph_break [] 2025-12-04T09:47:13.6055093Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6055134Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6055188Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6055259Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6055488Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6055525Z graph_break [] 2025-12-04T09:47:13.6055599Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6055639Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6055694Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6055765Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6055990Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6056026Z graph_break [] 2025-12-04T09:47:13.6056098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6056139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6056196Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6056267Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6056492Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6058143Z graph_break [] 2025-12-04T09:47:13.6058215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6058257Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6058311Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6058383Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6058624Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6058672Z graph_break [] 2025-12-04T09:47:13.6058744Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6058785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6058840Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6058912Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6059139Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6059176Z graph_break [] 2025-12-04T09:47:13.6059248Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6059290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6059344Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6059417Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6059642Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6059681Z graph_break [] 2025-12-04T09:47:13.6059753Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6059794Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6059859Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6059932Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6060156Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6060191Z graph_break [] 2025-12-04T09:47:13.6060265Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6060306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6060361Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6060431Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6060658Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6060695Z graph_break [] 2025-12-04T09:47:13.6060769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6060809Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6060864Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6060935Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6061162Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6061199Z graph_break [] 2025-12-04T09:47:13.6061271Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6061326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6061381Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6061452Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6061678Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6061715Z graph_break [] 2025-12-04T09:47:13.6061787Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6061828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6061906Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6061977Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6062202Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6062240Z graph_break [] 2025-12-04T09:47:13.6062312Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6062354Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6062408Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6062480Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6062703Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6062741Z graph_break [] 2025-12-04T09:47:13.6062813Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6062855Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6062909Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6063020Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6063264Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6063302Z graph_break [] 2025-12-04T09:47:13.6063373Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6063414Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6063468Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6063542Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6063769Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6063807Z graph_break [] 2025-12-04T09:47:13.6063878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6063919Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6063974Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6064046Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6064269Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6064306Z graph_break [] 2025-12-04T09:47:13.6064380Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6064422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6064477Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6064548Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6064796Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6064832Z graph_break [] 2025-12-04T09:47:13.6064905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6064946Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6065001Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6065071Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6065311Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6065361Z graph_break [] 2025-12-04T09:47:13.6065433Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6065475Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6065529Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6065601Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6065826Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6065862Z graph_break [] 2025-12-04T09:47:13.6065934Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6065975Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6066031Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6066103Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6066328Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6066365Z graph_break [] 2025-12-04T09:47:13.6066460Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6066507Z Traceback (most recent call last): 2025-12-04T09:47:13.6066629Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6066668Z return value(self) 2025-12-04T09:47:13.6066704Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6066853Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6066905Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6067046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6067105Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6067151Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6067311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6067385Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6067439Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6067441Z 2025-12-04T09:47:13.6067495Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6067610Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6067706Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6067710Z 2025-12-04T09:47:13.6067784Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6067935Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6067949Z 2025-12-04T09:47:13.6068036Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6068109Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6068152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6068208Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6068434Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6068507Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6068556Z graph_break [] 2025-12-04T09:47:13.6068638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6068681Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6068736Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6068809Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6069039Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6069076Z graph_break [] 2025-12-04T09:47:13.6069147Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6069189Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6069242Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6069315Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6069542Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6069581Z graph_break [] 2025-12-04T09:47:13.6069654Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6069695Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6069748Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6069836Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6070059Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6070096Z graph_break [] 2025-12-04T09:47:13.6070167Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6070209Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6070264Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6070336Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6070559Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6070597Z graph_break [] 2025-12-04T09:47:13.6070673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6070714Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6070768Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6070841Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6071068Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6071105Z graph_break [] 2025-12-04T09:47:13.6071176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6071217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6071286Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6071356Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6071583Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6071620Z graph_break [] 2025-12-04T09:47:13.6071692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6071733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6071788Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6071881Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6072107Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6072144Z graph_break [] 2025-12-04T09:47:13.6072216Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6072258Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6072313Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6072384Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6072609Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6072645Z graph_break [] 2025-12-04T09:47:13.6072718Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6072761Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6072817Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6072888Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6073181Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6073220Z graph_break [] 2025-12-04T09:47:13.6073292Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6073336Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6073390Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6073462Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6073689Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6073729Z graph_break [] 2025-12-04T09:47:13.6073800Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6073842Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6073896Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6073968Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6074193Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6074230Z graph_break [] 2025-12-04T09:47:13.6074300Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6074344Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6074399Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6074471Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6074694Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6074753Z graph_break [] 2025-12-04T09:47:13.6074826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6074867Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6074922Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6074993Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6075234Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6075284Z graph_break [] 2025-12-04T09:47:13.6075357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6075398Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6075454Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6075525Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6075750Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6075786Z graph_break [] 2025-12-04T09:47:13.6075858Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6075899Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6075953Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6076025Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6076250Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6076287Z graph_break [] 2025-12-04T09:47:13.6076359Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6076399Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6076474Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6076546Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6076771Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6076807Z graph_break [] 2025-12-04T09:47:13.6076881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6076922Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6076978Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6077049Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6077274Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6077312Z graph_break [] 2025-12-04T09:47:13.6077383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6077426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6077480Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6077551Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6077775Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6077812Z graph_break [] 2025-12-04T09:47:13.6077885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6077939Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6077993Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6078066Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6078289Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6078326Z graph_break [] 2025-12-04T09:47:13.6078397Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6078438Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6078504Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6078587Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6078813Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6078851Z graph_break [] 2025-12-04T09:47:13.6078923Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6078966Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6079020Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6079093Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6079318Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6079356Z graph_break [] 2025-12-04T09:47:13.6079428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6079469Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6079522Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6079595Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6079829Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6079866Z graph_break [] 2025-12-04T09:47:13.6079939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6079979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6080034Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6080106Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6080332Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6080369Z graph_break [] 2025-12-04T09:47:13.6080441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6080481Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6080536Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6080606Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6080832Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6080868Z graph_break [] 2025-12-04T09:47:13.6080940Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6080982Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6081037Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6081107Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6081344Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6081382Z graph_break [] 2025-12-04T09:47:13.6081457Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6081497Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6081553Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6081623Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6081861Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6081908Z graph_break [] 2025-12-04T09:47:13.6081980Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6082023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6082077Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6082148Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6082373Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6082410Z graph_break [] 2025-12-04T09:47:13.6082481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6082522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6082576Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6082649Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6082875Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6082913Z graph_break [] 2025-12-04T09:47:13.6083026Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6083082Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6083137Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6083210Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6083434Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6083474Z graph_break [] 2025-12-04T09:47:13.6083547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6083590Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6083644Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6083716Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6083939Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6083976Z graph_break [] 2025-12-04T09:47:13.6084048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6084089Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6084143Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6084214Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6084440Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6084476Z graph_break [] 2025-12-04T09:47:13.6084572Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6084613Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6084667Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6084740Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6084967Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6085004Z graph_break [] 2025-12-04T09:47:13.6085076Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6085152Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6085207Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6085278Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6085502Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6085540Z graph_break [] 2025-12-04T09:47:13.6085615Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6085657Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6085713Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6085783Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6086007Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6086044Z graph_break [] 2025-12-04T09:47:13.6086116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6086161Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6086215Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6086286Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6086521Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6086558Z graph_break [] 2025-12-04T09:47:13.6086630Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6086672Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6086726Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6086800Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6087025Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6087063Z graph_break [] 2025-12-04T09:47:13.6087134Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6087176Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6087231Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6087303Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6087526Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6087563Z graph_break [] 2025-12-04T09:47:13.6087637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6087678Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6087732Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6087819Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6088043Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6088080Z graph_break [] 2025-12-04T09:47:13.6088152Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6088193Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6088247Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6088318Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6088555Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6088608Z graph_break [] 2025-12-04T09:47:13.6088683Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6088723Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6088777Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6088849Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6089078Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6089115Z graph_break [] 2025-12-04T09:47:13.6089189Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6089230Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6089287Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6089358Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6089582Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6089619Z graph_break [] 2025-12-04T09:47:13.6089701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6089743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6089798Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6089869Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6090094Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6090131Z graph_break [] 2025-12-04T09:47:13.6090205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6090245Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6090302Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6090373Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6090602Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6090640Z graph_break [] 2025-12-04T09:47:13.6090726Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6090774Z Traceback (most recent call last): 2025-12-04T09:47:13.6090894Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6090934Z return value(self) 2025-12-04T09:47:13.6090969Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6091114Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6091177Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6091315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6091374Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6091420Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6091579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6091653Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6091708Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6091710Z 2025-12-04T09:47:13.6091773Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6091899Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6091998Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6092003Z 2025-12-04T09:47:13.6092077Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6092228Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6092231Z 2025-12-04T09:47:13.6092317Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6092390Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6092433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6092488Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6092720Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6092794Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6092832Z graph_break [] 2025-12-04T09:47:13.6092906Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6093010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6093079Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6093153Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6093377Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6093414Z graph_break [] 2025-12-04T09:47:13.6093486Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6093530Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6093584Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6093656Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6093882Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6093920Z graph_break [] 2025-12-04T09:47:13.6093991Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6094032Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6094086Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6094157Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6094381Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6094420Z graph_break [] 2025-12-04T09:47:13.6094491Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6094557Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6094612Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6094684Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6094910Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6094947Z graph_break [] 2025-12-04T09:47:13.6095020Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6095060Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6095131Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6095215Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6095438Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6095476Z graph_break [] 2025-12-04T09:47:13.6095547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6095589Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6095645Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6095716Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6095939Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6095978Z graph_break [] 2025-12-04T09:47:13.6096050Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6096091Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6096146Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6096217Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6096451Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6096488Z graph_break [] 2025-12-04T09:47:13.6096560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6096602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6096657Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6096728Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6096957Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6096994Z graph_break [] 2025-12-04T09:47:13.6097066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6097108Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6097162Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6097235Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6097457Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6097494Z graph_break [] 2025-12-04T09:47:13.6097564Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6097609Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6097662Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6097734Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6097970Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6098007Z graph_break [] 2025-12-04T09:47:13.6098079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6098122Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6098176Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6098247Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6098479Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6098526Z graph_break [] 2025-12-04T09:47:13.6098597Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6098641Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6098695Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6098768Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6098997Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6099034Z graph_break [] 2025-12-04T09:47:13.6099105Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6099146Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6099200Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6099274Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6099497Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6099534Z graph_break [] 2025-12-04T09:47:13.6099606Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6099656Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6099711Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6099782Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6100007Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6100043Z graph_break [] 2025-12-04T09:47:13.6100117Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6100159Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6100213Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6100285Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6100510Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6100546Z graph_break [] 2025-12-04T09:47:13.6100620Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6100661Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6100716Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6100788Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6101013Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6101050Z graph_break [] 2025-12-04T09:47:13.6101137Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6101178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6101233Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6101304Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6101529Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6101566Z graph_break [] 2025-12-04T09:47:13.6101636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6101694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6101759Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6101831Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6102054Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6102093Z graph_break [] 2025-12-04T09:47:13.6102164Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6102206Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6102260Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6102331Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6102556Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6102594Z graph_break [] 2025-12-04T09:47:13.6102666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6102708Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6102763Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6102834Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6103119Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6103157Z graph_break [] 2025-12-04T09:47:13.6103229Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6103270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6103323Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6103396Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6103621Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6103658Z graph_break [] 2025-12-04T09:47:13.6103731Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6103771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6103826Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6103897Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6104122Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6104158Z graph_break [] 2025-12-04T09:47:13.6104231Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6104273Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6104327Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6104398Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6104647Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6104683Z graph_break [] 2025-12-04T09:47:13.6104755Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6104796Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6104851Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6104921Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6105159Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6105209Z graph_break [] 2025-12-04T09:47:13.6105281Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6105323Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6105378Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6105450Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6105675Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6105712Z graph_break [] 2025-12-04T09:47:13.6105784Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6105825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6106001Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6106074Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6106297Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6106335Z graph_break [] 2025-12-04T09:47:13.6106420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6106463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6106516Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6106588Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6106813Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6106852Z graph_break [] 2025-12-04T09:47:13.6106923Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6106964Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6107019Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6107090Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6107315Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6107352Z graph_break [] 2025-12-04T09:47:13.6107423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6107465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6107518Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6107593Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6107817Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6107867Z graph_break [] 2025-12-04T09:47:13.6107939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6107980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6108037Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6108109Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6108333Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6108370Z graph_break [] 2025-12-04T09:47:13.6108452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6108503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6108558Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6108629Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6108857Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6108896Z graph_break [] 2025-12-04T09:47:13.6108968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6109009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6109063Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6109134Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6109360Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6109397Z graph_break [] 2025-12-04T09:47:13.6109468Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6109510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6109564Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6109649Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6109875Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6109911Z graph_break [] 2025-12-04T09:47:13.6109984Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6110025Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6110081Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6110154Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6110378Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6110416Z graph_break [] 2025-12-04T09:47:13.6110490Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6110531Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6110585Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6110657Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6110880Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6110920Z graph_break [] 2025-12-04T09:47:13.6110991Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6111033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6111086Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6111178Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6111401Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6111439Z graph_break [] 2025-12-04T09:47:13.6111510Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6111551Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6111604Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6111692Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6111927Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6111966Z graph_break [] 2025-12-04T09:47:13.6112038Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6112079Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6112135Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6112206Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6112430Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6112467Z graph_break [] 2025-12-04T09:47:13.6112542Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6112584Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6112640Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6112711Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6112967Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6113029Z graph_break [] 2025-12-04T09:47:13.6113102Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6113143Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6113198Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6113268Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6113494Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6113532Z graph_break [] 2025-12-04T09:47:13.6113604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6113645Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6113700Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6113771Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6113995Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6114031Z graph_break [] 2025-12-04T09:47:13.6114103Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6114143Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6114199Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6114271Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6114496Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6114569Z graph_break [] 2025-12-04T09:47:13.6114642Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6114684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6114740Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6114812Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6115035Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6115088Z graph_break [] 2025-12-04T09:47:13.6115175Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6115217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6115271Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6115344Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6115567Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6115604Z graph_break [] 2025-12-04T09:47:13.6115688Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6115736Z Traceback (most recent call last): 2025-12-04T09:47:13.6115854Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6115894Z return value(self) 2025-12-04T09:47:13.6115931Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6116077Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6116129Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6116270Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6116329Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6116385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6116544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6116617Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6116670Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6116672Z 2025-12-04T09:47:13.6116725Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6116842Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6116940Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6116942Z 2025-12-04T09:47:13.6117017Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6117168Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6117170Z 2025-12-04T09:47:13.6117257Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6117332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6117376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6117432Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6117659Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6117732Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6117770Z graph_break [] 2025-12-04T09:47:13.6117842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6117897Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6117950Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6118023Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6118247Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6118284Z graph_break [] 2025-12-04T09:47:13.6118357Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6118412Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6118476Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6118549Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6118775Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6118816Z graph_break [] 2025-12-04T09:47:13.6118889Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6118930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6118985Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6119056Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6119282Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6119320Z graph_break [] 2025-12-04T09:47:13.6119393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6119434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6119491Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6119562Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6119797Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6119834Z graph_break [] 2025-12-04T09:47:13.6119908Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6119950Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6120005Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6120077Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6120305Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6120342Z graph_break [] 2025-12-04T09:47:13.6120414Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6120456Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6120513Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6120585Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6120816Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6120853Z graph_break [] 2025-12-04T09:47:13.6120927Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6120970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6121026Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6121097Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6121335Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6121372Z graph_break [] 2025-12-04T09:47:13.6121444Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6121488Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6121542Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6121613Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6121849Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6121896Z graph_break [] 2025-12-04T09:47:13.6121968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6122012Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6122068Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6122141Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6122366Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6122404Z graph_break [] 2025-12-04T09:47:13.6122475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6122518Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6122572Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6122646Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6122872Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6122911Z graph_break [] 2025-12-04T09:47:13.6123049Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6123092Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6123146Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6123218Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6123444Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6123481Z graph_break [] 2025-12-04T09:47:13.6123554Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6123594Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6123649Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6123723Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6123949Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6123986Z graph_break [] 2025-12-04T09:47:13.6124058Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6124098Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6124153Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6124224Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6124451Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6124509Z graph_break [] 2025-12-04T09:47:13.6124582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6124623Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6124680Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6124751Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6124975Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6125011Z graph_break [] 2025-12-04T09:47:13.6125096Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6125151Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6125205Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6125276Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6125503Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6125542Z graph_break [] 2025-12-04T09:47:13.6125614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6125655Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6125708Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6125780Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6126004Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6126042Z graph_break [] 2025-12-04T09:47:13.6126113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6126157Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6126210Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6126283Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6126521Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6126559Z graph_break [] 2025-12-04T09:47:13.6126632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6126673Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6126729Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6126803Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6127027Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6127065Z graph_break [] 2025-12-04T09:47:13.6127137Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6127179Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6127232Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6127304Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6127526Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6127564Z graph_break [] 2025-12-04T09:47:13.6127638Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6127679Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6127734Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6127818Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6128043Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6128079Z graph_break [] 2025-12-04T09:47:13.6128151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6128192Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6128247Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6128317Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6128565Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6128601Z graph_break [] 2025-12-04T09:47:13.6128675Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6128716Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6128771Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6128843Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6129072Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6129107Z graph_break [] 2025-12-04T09:47:13.6129179Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6129221Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6129276Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6129347Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6129572Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6129609Z graph_break [] 2025-12-04T09:47:13.6129693Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6129735Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6129789Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6129860Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6130086Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6130126Z graph_break [] 2025-12-04T09:47:13.6130198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6130242Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6130297Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6130370Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6130596Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6130633Z graph_break [] 2025-12-04T09:47:13.6130706Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6130747Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6130803Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6130877Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6131101Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6131156Z graph_break [] 2025-12-04T09:47:13.6131227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6131272Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6131326Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6131397Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6131622Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6131659Z graph_break [] 2025-12-04T09:47:13.6131751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6131795Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6131849Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6131925Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6132150Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6132186Z graph_break [] 2025-12-04T09:47:13.6132257Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6132297Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6132353Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6132423Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6132651Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6132687Z graph_break [] 2025-12-04T09:47:13.6132759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6132800Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6132857Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6132980Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6133207Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6133243Z graph_break [] 2025-12-04T09:47:13.6133314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6133357Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6133413Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6133484Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6133709Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6133746Z graph_break [] 2025-12-04T09:47:13.6133821Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6133862Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6133916Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6133987Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6134211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6134252Z graph_break [] 2025-12-04T09:47:13.6134323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6134364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6134445Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6134518Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6134743Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6134783Z graph_break [] 2025-12-04T09:47:13.6134854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6134896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6134951Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6135037Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6135274Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6135312Z graph_break [] 2025-12-04T09:47:13.6135383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6135425Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6135479Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6135551Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6135774Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6135811Z graph_break [] 2025-12-04T09:47:13.6135886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6135930Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6135985Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6136056Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6136290Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6136329Z graph_break [] 2025-12-04T09:47:13.6136400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6136443Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6136497Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6136569Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6136797Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6136833Z graph_break [] 2025-12-04T09:47:13.6136907Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6136949Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6137004Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6137075Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6137300Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6137337Z graph_break [] 2025-12-04T09:47:13.6137409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6137449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6137506Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6137578Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6137806Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6137854Z graph_break [] 2025-12-04T09:47:13.6137929Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6137970Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6138025Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6138096Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6138334Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6138389Z graph_break [] 2025-12-04T09:47:13.6138462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6138502Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6138556Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6138628Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6138855Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6138891Z graph_break [] 2025-12-04T09:47:13.6138963Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6139004Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6139057Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6139130Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6139356Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6139394Z graph_break [] 2025-12-04T09:47:13.6139467Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6139510Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6139574Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6139646Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6139870Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6139907Z graph_break [] 2025-12-04T09:47:13.6139979Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6140021Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6140074Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6140148Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6140373Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6140411Z graph_break [] 2025-12-04T09:47:13.6140483Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6140526Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6140581Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6140652Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6140877Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6140916Z graph_break [] 2025-12-04T09:47:13.6141002Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6141060Z Traceback (most recent call last): 2025-12-04T09:47:13.6141179Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6141218Z return value(self) 2025-12-04T09:47:13.6141256Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6141402Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6141454Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6141591Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6141651Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6141721Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6141883Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6141955Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6142010Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6142013Z 2025-12-04T09:47:13.6142064Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6142182Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6142278Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6142281Z 2025-12-04T09:47:13.6142355Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6142505Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6142509Z 2025-12-04T09:47:13.6142596Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6142669Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6142713Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6142768Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6143062Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6143136Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6143173Z graph_break [] 2025-12-04T09:47:13.6143247Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6143289Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6143343Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6143416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6143640Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6143678Z graph_break [] 2025-12-04T09:47:13.6143751Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6143794Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6143850Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6143922Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6144146Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6144182Z graph_break [] 2025-12-04T09:47:13.6144256Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6144296Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6144353Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6144449Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6144678Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6144714Z graph_break [] 2025-12-04T09:47:13.6144788Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6144828Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6144883Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6144954Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6145193Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6145244Z graph_break [] 2025-12-04T09:47:13.6145318Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6145360Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6145414Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6145488Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6145709Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6145746Z graph_break [] 2025-12-04T09:47:13.6145817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6145861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6145916Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6145987Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6146210Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6146249Z graph_break [] 2025-12-04T09:47:13.6146331Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6146375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6146428Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6146500Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6146725Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6146763Z graph_break [] 2025-12-04T09:47:13.6146836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6146878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6146933Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6147005Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6147230Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6147269Z graph_break [] 2025-12-04T09:47:13.6147341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6147382Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6147436Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6147508Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6147732Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6147781Z graph_break [] 2025-12-04T09:47:13.6147854Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6147896Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6147950Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6148021Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6148243Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6148280Z graph_break [] 2025-12-04T09:47:13.6148361Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6148413Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6148472Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6148543Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6148771Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6148807Z graph_break [] 2025-12-04T09:47:13.6148879Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6148919Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6148974Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6149044Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6149267Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6149304Z graph_break [] 2025-12-04T09:47:13.6149379Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6149420Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6149475Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6149556Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6149779Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6149816Z graph_break [] 2025-12-04T09:47:13.6149887Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6149929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6149986Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6150059Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6150282Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6150320Z graph_break [] 2025-12-04T09:47:13.6150392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6150434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6150488Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6150559Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6150788Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6150826Z graph_break [] 2025-12-04T09:47:13.6150897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6150939Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6151006Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6151078Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6151303Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6151342Z graph_break [] 2025-12-04T09:47:13.6151415Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6151458Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6151512Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6151602Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6151837Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6151873Z graph_break [] 2025-12-04T09:47:13.6151945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6151986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6152041Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6152112Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6152338Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6152374Z graph_break [] 2025-12-04T09:47:13.6152449Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6152491Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6152545Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6152617Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6152845Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6152890Z graph_break [] 2025-12-04T09:47:13.6153017Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6153058Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6153114Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6153185Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6153409Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6153447Z graph_break [] 2025-12-04T09:47:13.6155360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6155403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6155459Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6155530Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6155758Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6155794Z graph_break [] 2025-12-04T09:47:13.6155867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6155910Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6155966Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6156039Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6156263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6156334Z graph_break [] 2025-12-04T09:47:13.6156407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6156449Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6156503Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6156574Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6156797Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6156867Z graph_break [] 2025-12-04T09:47:13.6156939Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6156980Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6157034Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6157108Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6157332Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6157370Z graph_break [] 2025-12-04T09:47:13.6157440Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6157482Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6157536Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6157608Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6157835Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6157874Z graph_break [] 2025-12-04T09:47:13.6157945Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6157986Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6158053Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6158127Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6158354Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6158390Z graph_break [] 2025-12-04T09:47:13.6158464Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6158507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6158561Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6158632Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6158860Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6158896Z graph_break [] 2025-12-04T09:47:13.6158969Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6159009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6159064Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6159134Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6159358Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6159395Z graph_break [] 2025-12-04T09:47:13.6159466Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6159522Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6159577Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6159647Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6159870Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6159906Z graph_break [] 2025-12-04T09:47:13.6159978Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6160019Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6160085Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6160169Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6160396Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6160435Z graph_break [] 2025-12-04T09:47:13.6160507Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6160549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6160603Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6160674Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6160898Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6160936Z graph_break [] 2025-12-04T09:47:13.6161008Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6161050Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6161103Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6161176Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6161412Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6161450Z graph_break [] 2025-12-04T09:47:13.6161522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6161563Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6161617Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6161688Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6161911Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6161951Z graph_break [] 2025-12-04T09:47:13.6162022Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6162064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6162117Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6162189Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6162414Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6162452Z graph_break [] 2025-12-04T09:47:13.6162524Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6162566Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6162621Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6162693Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6162917Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6163011Z graph_break [] 2025-12-04T09:47:13.6163085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6163126Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6163180Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6163251Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6163495Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6163546Z graph_break [] 2025-12-04T09:47:13.6163619Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6163659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6163717Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6163788Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6164015Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6164051Z graph_break [] 2025-12-04T09:47:13.6164123Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6164164Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6164218Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6164290Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6164517Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6164555Z graph_break [] 2025-12-04T09:47:13.6164628Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6164684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6164740Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6164812Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6165035Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6165072Z graph_break [] 2025-12-04T09:47:13.6165144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6165186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6165240Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6165311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6165535Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6165572Z graph_break [] 2025-12-04T09:47:13.6165643Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6165684Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6165737Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6165808Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6166033Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6166071Z graph_break [] 2025-12-04T09:47:13.6166142Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6166208Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6166262Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6166336Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6166563Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6166600Z graph_break [] 2025-12-04T09:47:13.6166671Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6166723Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6166788Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6166860Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6167083Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6167120Z graph_break [] 2025-12-04T09:47:13.6167193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6167233Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6167288Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6167359Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6167583Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6167620Z graph_break [] 2025-12-04T09:47:13.6167692Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6167733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6167788Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6167859Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6168095Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6168131Z graph_break [] 2025-12-04T09:47:13.6168205Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6168246Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6168301Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6168373Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6168602Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6168639Z graph_break [] 2025-12-04T09:47:13.6168725Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6168771Z Traceback (most recent call last): 2025-12-04T09:47:13.6168895Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6168935Z return value(self) 2025-12-04T09:47:13.6168971Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6169116Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6169169Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6169310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6169372Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6169417Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6169593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6169667Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6169721Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6169724Z 2025-12-04T09:47:13.6169777Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6169892Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6169990Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6169992Z 2025-12-04T09:47:13.6170075Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6170236Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6170239Z 2025-12-04T09:47:13.6170325Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6170400Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6170441Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6170498Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6170723Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6170796Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6170833Z graph_break [] 2025-12-04T09:47:13.6170905Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6170948Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6171002Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6171074Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6171299Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6171347Z graph_break [] 2025-12-04T09:47:13.6171420Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6171462Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6171516Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6171588Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6171817Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6171854Z graph_break [] 2025-12-04T09:47:13.6171926Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6171968Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6172022Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6172093Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6172319Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6172356Z graph_break [] 2025-12-04T09:47:13.6172427Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6172468Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6172524Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6172597Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6172821Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6172872Z graph_break [] 2025-12-04T09:47:13.6172986Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6173029Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6173084Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6173155Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6173378Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6173436Z graph_break [] 2025-12-04T09:47:13.6173521Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6173562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6173617Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6173688Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6173914Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6173950Z graph_break [] 2025-12-04T09:47:13.6174021Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6174062Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6174116Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6174186Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6174411Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6174448Z graph_break [] 2025-12-04T09:47:13.6174522Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6174563Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6174618Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6174708Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6174933Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6174969Z graph_break [] 2025-12-04T09:47:13.6175043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6175085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6175140Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6175211Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6175436Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6175474Z graph_break [] 2025-12-04T09:47:13.6175546Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6175587Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6175641Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6175712Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6175935Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6175973Z graph_break [] 2025-12-04T09:47:13.6176044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6176085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6176154Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6176226Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6176452Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6176489Z graph_break [] 2025-12-04T09:47:13.6176560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6176602Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6176655Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6176752Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6176975Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6177013Z graph_break [] 2025-12-04T09:47:13.6177085Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6177127Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6177180Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6177251Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6177474Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6177513Z graph_break [] 2025-12-04T09:47:13.6177585Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6177627Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6177682Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6177753Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6177997Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6178034Z graph_break [] 2025-12-04T09:47:13.6178106Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6178147Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6178201Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6178272Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6178499Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6178536Z graph_break [] 2025-12-04T09:47:13.6178608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6178650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6178704Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6178775Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6178999Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6179035Z graph_break [] 2025-12-04T09:47:13.6179108Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6179149Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6179204Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6179275Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6179499Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6179550Z graph_break [] 2025-12-04T09:47:13.6179623Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6179664Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6179718Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6179789Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6180026Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6180073Z graph_break [] 2025-12-04T09:47:13.6180144Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6180186Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6180241Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6180312Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6180539Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6180576Z graph_break [] 2025-12-04T09:47:13.6180647Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6180688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6180742Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6180815Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6181041Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6181078Z graph_break [] 2025-12-04T09:47:13.6181150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6181191Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6181255Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6181327Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6181551Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6181588Z graph_break [] 2025-12-04T09:47:13.6181660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6181702Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6181756Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6181828Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6182053Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6182090Z graph_break [] 2025-12-04T09:47:13.6182165Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6182205Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6182259Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6182330Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6182555Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6182592Z graph_break [] 2025-12-04T09:47:13.6182663Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6182717Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6182772Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6182843Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6183101Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6183139Z graph_break [] 2025-12-04T09:47:13.6183210Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6183250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6183345Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6183416Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6183640Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6183679Z graph_break [] 2025-12-04T09:47:13.6183752Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6183792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6183847Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6183918Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6184145Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6184182Z graph_break [] 2025-12-04T09:47:13.6184254Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6184295Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6184349Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6184423Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6184668Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6184706Z graph_break [] 2025-12-04T09:47:13.6184777Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6184819Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6184873Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6184945Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6185170Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6185207Z graph_break [] 2025-12-04T09:47:13.6185278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6185320Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6185374Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6185446Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6185670Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6185707Z graph_break [] 2025-12-04T09:47:13.6185779Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6185821Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6185875Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6185947Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6186187Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6186225Z graph_break [] 2025-12-04T09:47:13.6186297Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6186338Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6186392Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6186464Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6186698Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6186745Z graph_break [] 2025-12-04T09:47:13.6186817Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6186859Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6186913Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6186984Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6187210Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6187246Z graph_break [] 2025-12-04T09:47:13.6187318Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6187359Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6187414Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6187486Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6187709Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6187746Z graph_break [] 2025-12-04T09:47:13.6187818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6187868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6187924Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6187994Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6188222Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6188261Z graph_break [] 2025-12-04T09:47:13.6188334Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6188374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6188429Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6188500Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6188725Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6188763Z graph_break [] 2025-12-04T09:47:13.6188835Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6188876Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6188930Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6189002Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6189228Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6189265Z graph_break [] 2025-12-04T09:47:13.6189349Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6189391Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6189444Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6189517Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6189741Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6189778Z graph_break [] 2025-12-04T09:47:13.6189850Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6189920Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6189975Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6190047Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6190273Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6190310Z graph_break [] 2025-12-04T09:47:13.6190383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6190425Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6190479Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6190551Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6190774Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6190813Z graph_break [] 2025-12-04T09:47:13.6190886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6190927Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6190982Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6191053Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6191287Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6191323Z graph_break [] 2025-12-04T09:47:13.6191396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6191436Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6191491Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6191563Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6191786Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6191823Z graph_break [] 2025-12-04T09:47:13.6191896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6191938Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6191992Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6192063Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6192288Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6192324Z graph_break [] 2025-12-04T09:47:13.6192399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6192440Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6192495Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6192578Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6192805Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6192841Z graph_break [] 2025-12-04T09:47:13.6192914Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6193013Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6193068Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6193140Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6193376Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6193426Z graph_break [] 2025-12-04T09:47:13.6193499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6193541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6193595Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6193667Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6193890Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6193927Z graph_break [] 2025-12-04T09:47:13.6193998Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6194041Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6194096Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6194167Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6194391Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6194430Z graph_break [] 2025-12-04T09:47:13.6194520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6194562Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6194615Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6194686Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6194910Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6194948Z graph_break [] 2025-12-04T09:47:13.6195033Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6195080Z Traceback (most recent call last): 2025-12-04T09:47:13.6195200Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6195239Z return value(self) 2025-12-04T09:47:13.6195274Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6195420Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6195473Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6195610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6195670Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6195715Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6195876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6195949Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6196018Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6196020Z 2025-12-04T09:47:13.6196072Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6196189Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6196287Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6196289Z 2025-12-04T09:47:13.6196362Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6196511Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6196513Z 2025-12-04T09:47:13.6196611Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6196694Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6196738Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6196795Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6197021Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6197095Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6197141Z graph_break [] 2025-12-04T09:47:13.6197295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6197463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6197598Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6197763Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6198117Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6198425Z graph_break [] 2025-12-04T09:47:13.6198552Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6198706Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6198842Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6199010Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6199349Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6199650Z graph_break [] 2025-12-04T09:47:13.6199778Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6199931Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6200056Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6200217Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6200552Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6200861Z graph_break [] 2025-12-04T09:47:13.6200998Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6201155Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6201291Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6201460Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6201807Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6202109Z graph_break [] 2025-12-04T09:47:13.6202237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6202464Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6202648Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6202879Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6203263Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6203560Z graph_break [] 2025-12-04T09:47:13.6203695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6203847Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6204002Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6204176Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6204509Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6204806Z graph_break [] 2025-12-04T09:47:13.6204933Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6205085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6205210Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6205371Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6205702Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6206002Z graph_break [] 2025-12-04T09:47:13.6206129Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6206280Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6206403Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6206566Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6206918Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6207214Z graph_break [] 2025-12-04T09:47:13.6207339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6207489Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6207615Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6207775Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6208113Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6208407Z graph_break [] 2025-12-04T09:47:13.6208534Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6208685Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6208810Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6208972Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6209313Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6209615Z graph_break [] 2025-12-04T09:47:13.6209742Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6209897Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6210020Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6210181Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6210539Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6210839Z graph_break [] 2025-12-04T09:47:13.6210964Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6211115Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6211238Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6211402Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6211755Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6212059Z graph_break [] 2025-12-04T09:47:13.6212188Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6212343Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6212467Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6212629Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6213012Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6213305Z graph_break [] 2025-12-04T09:47:13.6213430Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6213580Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6213705Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6213866Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6214197Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6214495Z graph_break [] 2025-12-04T09:47:13.6214621Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6214792Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6214915Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6215076Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6215406Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6215704Z graph_break [] 2025-12-04T09:47:13.6215832Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6215983Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6216106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6216268Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6216603Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6216901Z graph_break [] 2025-12-04T09:47:13.6217027Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6217178Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6217304Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6217465Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6217798Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6218095Z graph_break [] 2025-12-04T09:47:13.6218250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6218403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6218526Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6218690Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6219025Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6219322Z graph_break [] 2025-12-04T09:47:13.6219447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6219614Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6219755Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6219918Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6220249Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6220548Z graph_break [] 2025-12-04T09:47:13.6220673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6220824Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6220947Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6221108Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6221442Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6221744Z graph_break [] 2025-12-04T09:47:13.6221870Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6222020Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6222147Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6222308Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6222649Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6222984Z graph_break [] 2025-12-04T09:47:13.6223110Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6223260Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6223382Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6223546Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6223977Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6224271Z graph_break [] 2025-12-04T09:47:13.6224396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6224547Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6224670Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6224832Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6225162Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6225457Z graph_break [] 2025-12-04T09:47:13.6225582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6225733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6225856Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6226016Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6226383Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6226681Z graph_break [] 2025-12-04T09:47:13.6226807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6226960Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6227083Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6227244Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6227593Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6227906Z graph_break [] 2025-12-04T09:47:13.6228034Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6228188Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6228311Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6228474Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6228805Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6229098Z graph_break [] 2025-12-04T09:47:13.6229223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6229375Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6229500Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6229661Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6229994Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6230290Z graph_break [] 2025-12-04T09:47:13.6230441Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6230592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6230716Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6230879Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6231214Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6231511Z graph_break [] 2025-12-04T09:47:13.6231636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6231787Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6231914Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6232076Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6232408Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6232703Z graph_break [] 2025-12-04T09:47:13.6232829Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6233028Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6233150Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6233312Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6233645Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6233961Z graph_break [] 2025-12-04T09:47:13.6234086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6234236Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6234362Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6234524Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6234853Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6235146Z graph_break [] 2025-12-04T09:47:13.6235295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6235471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6235593Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6235753Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6236089Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6236385Z graph_break [] 2025-12-04T09:47:13.6236511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6236662Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6236785Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6236946Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6237278Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6237573Z graph_break [] 2025-12-04T09:47:13.6237698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6237849Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6237973Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6238152Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6238480Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6238774Z graph_break [] 2025-12-04T09:47:13.6238901Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6239053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6239180Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6239345Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6239674Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6239970Z graph_break [] 2025-12-04T09:47:13.6240099Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6240251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6240374Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6240534Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6240868Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6241164Z graph_break [] 2025-12-04T09:47:13.6241289Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6241440Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6241563Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6241749Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6242077Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6242374Z graph_break [] 2025-12-04T09:47:13.6242499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6242650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6242773Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6243009Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6243358Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6243657Z graph_break [] 2025-12-04T09:47:13.6243782Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6243936Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6244061Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6244220Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6244551Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6244847Z graph_break [] 2025-12-04T09:47:13.6244975Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6245129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6245252Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6245413Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6245751Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6246067Z graph_break [] 2025-12-04T09:47:13.6246193Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6246343Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6246471Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6246633Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6246971Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6247269Z graph_break [] 2025-12-04T09:47:13.6247396Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6247548Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6247671Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6247831Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6248164Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6248460Z graph_break [] 2025-12-04T09:47:13.6248586Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6248739Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6248865Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6249029Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6249360Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6249669Z graph_break [] 2025-12-04T09:47:13.6249798Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6249950Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6250073Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6250234Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6250566Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6250873Z graph_break [] 2025-12-04T09:47:13.6251010Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6251161Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6251285Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6251448Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6251781Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6252076Z graph_break [] 2025-12-04T09:47:13.6252202Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6252352Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6252474Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6252635Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6253020Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6253320Z graph_break [] 2025-12-04T09:47:13.6253450Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6253601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6253724Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6253906Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6254237Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6254533Z graph_break [] 2025-12-04T09:47:13.6254659Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6254813Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6254936Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6255098Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6255430Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6255729Z graph_break [] 2025-12-04T09:47:13.6255869Z ________________ FreezingCpuTests.test_conv_with_as_strided_cpu ________________ 2025-12-04T09:47:13.6256036Z Traceback (most recent call last): 2025-12-04T09:47:13.6256232Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:47:13.6256425Z return value(self) 2025-12-04T09:47:13.6256521Z ^^^^^^^^^^^ 2025-12-04T09:47:13.6256726Z File "/var/lib/jenkins/pytorch/test/inductor/test_inductor_freezing.py", line 789, in test_conv_with_as_strided 2025-12-04T09:47:13.6256961Z self.assertEqual(foo(mod, x), mod_eager) 2025-12-04T09:47:13.6257185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:47:13.6257435Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:47:13.6257574Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:47:13.6257815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:47:13.6258083Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:47:13.6258242Z AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6258330Z 2025-12-04T09:47:13.6258383Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6258583Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6258846Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6258997Z 2025-12-04T09:47:13.6259072Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6259327Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6259519Z 2025-12-04T09:47:13.6259606Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6259805Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6259959Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6260085Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6260404Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6260741Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6260887Z graph_break [] 2025-12-04T09:47:13.6261016Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6261168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6261295Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6261455Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6261798Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6262098Z graph_break [] 2025-12-04T09:47:13.6262223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6262374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6262499Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6262662Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6263125Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6263421Z graph_break [] 2025-12-04T09:47:13.6263547Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6263699Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6263828Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6263988Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6264319Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6264615Z graph_break [] 2025-12-04T09:47:13.6264741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6264893Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6265016Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6265180Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6265534Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6265829Z graph_break [] 2025-12-04T09:47:13.6265954Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6266104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6266228Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6266388Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6266737Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6267047Z graph_break [] 2025-12-04T09:47:13.6267172Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6267326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6267452Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6267613Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6267943Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6268236Z graph_break [] 2025-12-04T09:47:13.6268362Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6268514Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6268642Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6268802Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6269134Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6269429Z graph_break [] 2025-12-04T09:47:13.6269582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6269733Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6269857Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6270016Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6270346Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6270647Z graph_break [] 2025-12-04T09:47:13.6270773Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6270924Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6271048Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6271209Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6271542Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6271839Z graph_break [] 2025-12-04T09:47:13.6271964Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6272114Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6272237Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6272398Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6272728Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6273088Z graph_break [] 2025-12-04T09:47:13.6273213Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6273364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6273489Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6273648Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6273979Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6274274Z graph_break [] 2025-12-04T09:47:13.6274423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6274586Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6274711Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6274872Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6275205Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6275500Z graph_break [] 2025-12-04T09:47:13.6275625Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6275775Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6275897Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6276056Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6276388Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6276683Z graph_break [] 2025-12-04T09:47:13.6276807Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6276958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6277081Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6277240Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6277582Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6277878Z graph_break [] 2025-12-04T09:47:13.6278004Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6278154Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6278279Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6278442Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6278774Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6279072Z graph_break [] 2025-12-04T09:47:13.6279197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6279349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6279472Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6279633Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6279962Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6280261Z graph_break [] 2025-12-04T09:47:13.6280388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6280539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6280663Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6283619Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6283958Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6284256Z graph_break [] 2025-12-04T09:47:13.6284384Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6284537Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6284663Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6284826Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6285211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6285505Z graph_break [] 2025-12-04T09:47:13.6285634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6285785Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6285909Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6286070Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6286403Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6286697Z graph_break [] 2025-12-04T09:47:13.6286822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6286979Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6287103Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6287261Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6287592Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6287885Z graph_break [] 2025-12-04T09:47:13.6288025Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6288177Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6288300Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6288458Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6288790Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6289085Z graph_break [] 2025-12-04T09:47:13.6289215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6289366Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6289489Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6289647Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6289976Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6290269Z graph_break [] 2025-12-04T09:47:13.6290393Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6290543Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6290666Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6290831Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6291165Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6291487Z graph_break [] 2025-12-04T09:47:13.6291614Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6291767Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6291890Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6292048Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6292376Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6292671Z graph_break [] 2025-12-04T09:47:13.6292822Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6293023Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6293146Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6293311Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6293642Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6293936Z graph_break [] 2025-12-04T09:47:13.6294061Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6294211Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6294334Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6294493Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6294826Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6295122Z graph_break [] 2025-12-04T09:47:13.6295252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6295401Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6295524Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6295704Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6296033Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6296326Z graph_break [] 2025-12-04T09:47:13.6296449Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6296601Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6296725Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6296884Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6297211Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6297504Z graph_break [] 2025-12-04T09:47:13.6297632Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6297780Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6297904Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6298063Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6298391Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6298685Z graph_break [] 2025-12-04T09:47:13.6298809Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6298958Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6299110Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6299269Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6299602Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6299893Z graph_break [] 2025-12-04T09:47:13.6300018Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6300168Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6300290Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6300474Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6300827Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6301128Z graph_break [] 2025-12-04T09:47:13.6301252Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6301401Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6301458Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6301530Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6301754Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6301792Z graph_break [] 2025-12-04T09:47:13.6301867Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6301909Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6301964Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6302035Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6302278Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6302315Z graph_break [] 2025-12-04T09:47:13.6302388Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6302429Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6302484Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6302554Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6302782Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6302820Z graph_break [] 2025-12-04T09:47:13.6302893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6302992Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6303047Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6303121Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6303347Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6303383Z graph_break [] 2025-12-04T09:47:13.6303456Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6303496Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6303553Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6303623Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6303846Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6303908Z graph_break [] 2025-12-04T09:47:13.6303982Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6304024Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6304078Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6304150Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6304389Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6304440Z graph_break [] 2025-12-04T09:47:13.6304511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6304553Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6304607Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6304678Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6304902Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6304939Z graph_break [] 2025-12-04T09:47:13.6305011Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6305053Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6305106Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6305177Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6305401Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6305441Z graph_break [] 2025-12-04T09:47:13.6305512Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6305553Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6305632Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6305704Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6305926Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6305963Z graph_break [] 2025-12-04T09:47:13.6306035Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6306077Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6306131Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6306203Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6306429Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6306467Z graph_break [] 2025-12-04T09:47:13.6306539Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6306579Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6306633Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6306703Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6306929Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6306966Z graph_break [] 2025-12-04T09:47:13.6307039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6307096Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6307150Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6307220Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6307442Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6307478Z graph_break [] 2025-12-04T09:47:13.6307551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6307592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6307659Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6307740Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6307964Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6308001Z graph_break [] 2025-12-04T09:47:13.6308075Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6308116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6308172Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6308242Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6308463Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6308503Z graph_break [] 2025-12-04T09:47:13.6308574Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6308615Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6308668Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6308740Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6308978Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6309016Z graph_break [] 2025-12-04T09:47:13.6309087Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6309129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6309183Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6309254Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6309478Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6309516Z graph_break [] 2025-12-04T09:47:13.6309587Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6309628Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6309682Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6309753Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6309974Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6310012Z graph_break [] 2025-12-04T09:47:13.6310086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:47:13.6310129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:47:13.6310182Z stats [('calls_captured', 5), ('unique_graphs', 1)] 2025-12-04T09:47:13.6310253Z aot_autograd [('total', 1), ('autograd_cache_bypass', 1), ('ok', 1)] 2025-12-04T09:47:13.6310488Z inductor [('extern_calls', 2), ('mkldnn_conv_weight_pack_matcher_count', 1), ('mkldnn_conv_weight_pack_matcher_nodes', 1), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_bypass', 1)] 2025-12-04T09:47:13.6310526Z graph_break [] 2025-12-04T09:47:13.6310772Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_inductor_freezing/inductor.test_inductor_freezing-9bfd84d747de745e.xml - 2025-12-04T09:47:13.6310833Z =========================== short test summary info ============================ 2025-12-04T09:47:13.6311040Z FAILED [4.6693s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6311063Z 2025-12-04T09:47:13.6311116Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6311234Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6311333Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6311336Z 2025-12-04T09:47:13.6311412Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6311565Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6311567Z 2025-12-04T09:47:13.6311656Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6311837Z FAILED [2.1022s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6311839Z 2025-12-04T09:47:13.6311892Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6312007Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6312103Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6312106Z 2025-12-04T09:47:13.6312179Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6312326Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6312338Z 2025-12-04T09:47:13.6312424Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6312600Z FAILED [1.3248s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6312602Z 2025-12-04T09:47:13.6312653Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6312766Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6312862Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6312864Z 2025-12-04T09:47:13.6312972Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6313121Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6313124Z 2025-12-04T09:47:13.6313209Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6313385Z FAILED [2.6169s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6313388Z 2025-12-04T09:47:13.6313439Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6313552Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6313647Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6313650Z 2025-12-04T09:47:13.6313721Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6313867Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6313893Z 2025-12-04T09:47:13.6313977Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6314156Z FAILED [1.3960s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6314158Z 2025-12-04T09:47:13.6314208Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6314321Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6314415Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6314460Z 2025-12-04T09:47:13.6314531Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6314678Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6314681Z 2025-12-04T09:47:13.6314764Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6314942Z FAILED [1.2376s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6314944Z 2025-12-04T09:47:13.6314994Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6315107Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6315202Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6315204Z 2025-12-04T09:47:13.6315277Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6315423Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6315425Z 2025-12-04T09:47:13.6315509Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6315687Z FAILED [1.3851s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6315690Z 2025-12-04T09:47:13.6315753Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6315866Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6315959Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6315961Z 2025-12-04T09:47:13.6316032Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6316179Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6316182Z 2025-12-04T09:47:13.6316266Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6316442Z FAILED [1.2377s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6316445Z 2025-12-04T09:47:13.6316497Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6316608Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6316704Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6316706Z 2025-12-04T09:47:13.6316776Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6316923Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6316927Z 2025-12-04T09:47:13.6317011Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6317190Z FAILED [1.7816s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6317205Z 2025-12-04T09:47:13.6317256Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6317371Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6317466Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6317468Z 2025-12-04T09:47:13.6317538Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6317684Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6317687Z 2025-12-04T09:47:13.6317781Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6317968Z FAILED [1.6287s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6317970Z 2025-12-04T09:47:13.6318022Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6318134Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6318229Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6318231Z 2025-12-04T09:47:13.6318302Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6318449Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6318451Z 2025-12-04T09:47:13.6318534Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6318712Z FAILED [1.7827s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6318715Z 2025-12-04T09:47:13.6318765Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6318879Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6318972Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6318974Z 2025-12-04T09:47:13.6319057Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6319203Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6319207Z 2025-12-04T09:47:13.6319290Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6319467Z FAILED [1.8142s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6319470Z 2025-12-04T09:47:13.6319520Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6319632Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6319727Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6319729Z 2025-12-04T09:47:13.6319800Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6319947Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6319950Z 2025-12-04T09:47:13.6320034Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6320211Z FAILED [1.2815s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6320213Z 2025-12-04T09:47:13.6320266Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6320377Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6320472Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6320490Z 2025-12-04T09:47:13.6320562Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6320709Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6320711Z 2025-12-04T09:47:13.6320796Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6320972Z FAILED [2.0743s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6320974Z 2025-12-04T09:47:13.6321025Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6321149Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6321254Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6321256Z 2025-12-04T09:47:13.6321329Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6321477Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6321479Z 2025-12-04T09:47:13.6321563Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6321742Z FAILED [1.7247s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6321744Z 2025-12-04T09:47:13.6321795Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6321907Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6322002Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6322004Z 2025-12-04T09:47:13.6322075Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6322221Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6322223Z 2025-12-04T09:47:13.6322315Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6322492Z FAILED [1.7120s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6322494Z 2025-12-04T09:47:13.6322544Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6322656Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6322750Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6322754Z 2025-12-04T09:47:13.6322824Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6323021Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6323024Z 2025-12-04T09:47:13.6323107Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6323285Z FAILED [0.8184s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6323287Z 2025-12-04T09:47:13.6323337Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6323449Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6323544Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6323545Z 2025-12-04T09:47:13.6323619Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6323765Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6323767Z 2025-12-04T09:47:13.6323878Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6324054Z FAILED [0.6920s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6324057Z 2025-12-04T09:47:13.6324107Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6324219Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6324312Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6324314Z 2025-12-04T09:47:13.6324386Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6324561Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6324563Z 2025-12-04T09:47:13.6324649Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6324827Z FAILED [0.6915s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6324829Z 2025-12-04T09:47:13.6324881Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6324992Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6325085Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6325087Z 2025-12-04T09:47:13.6325157Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6325306Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6325308Z 2025-12-04T09:47:13.6325392Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6325569Z FAILED [0.7079s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6325572Z 2025-12-04T09:47:13.6325623Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6325748Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6325844Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6325846Z 2025-12-04T09:47:13.6325916Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6326062Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6326064Z 2025-12-04T09:47:13.6326148Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6326325Z FAILED [0.7031s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6326328Z 2025-12-04T09:47:13.6326378Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6326493Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6326587Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6326589Z 2025-12-04T09:47:13.6326659Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6326805Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6326807Z 2025-12-04T09:47:13.6326891Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6327068Z FAILED [0.6822s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6327070Z 2025-12-04T09:47:13.6327120Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6327251Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6327345Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6327347Z 2025-12-04T09:47:13.6327418Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6327563Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6327566Z 2025-12-04T09:47:13.6327649Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6327843Z FAILED [0.7100s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6327858Z 2025-12-04T09:47:13.6327908Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6328021Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6328115Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6328117Z 2025-12-04T09:47:13.6328189Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6328335Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6328337Z 2025-12-04T09:47:13.6328420Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6328598Z FAILED [0.6815s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6328601Z 2025-12-04T09:47:13.6328652Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6328763Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6328858Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6328860Z 2025-12-04T09:47:13.6328931Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6329085Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6329087Z 2025-12-04T09:47:13.6329171Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6329347Z FAILED [0.7653s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6329349Z 2025-12-04T09:47:13.6329401Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6329513Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6329607Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6329610Z 2025-12-04T09:47:13.6329680Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6329827Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6329829Z 2025-12-04T09:47:13.6329913Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6330092Z FAILED [0.6818s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6330094Z 2025-12-04T09:47:13.6330146Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6330258Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6330353Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6330355Z 2025-12-04T09:47:13.6330425Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6330584Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6330586Z 2025-12-04T09:47:13.6330669Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6330845Z FAILED [0.9584s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6330847Z 2025-12-04T09:47:13.6330897Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6331009Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6331124Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6331126Z 2025-12-04T09:47:13.6331198Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6331345Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6331348Z 2025-12-04T09:47:13.6331431Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6331609Z FAILED [0.6750s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6331611Z 2025-12-04T09:47:13.6331661Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6331772Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6331866Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6331869Z 2025-12-04T09:47:13.6331940Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6332087Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6332090Z 2025-12-04T09:47:13.6332174Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6332361Z FAILED [0.7027s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6332364Z 2025-12-04T09:47:13.6332414Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6332526Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6332619Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6332620Z 2025-12-04T09:47:13.6332692Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6332838Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6332840Z 2025-12-04T09:47:13.6332923Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6333160Z FAILED [0.6850s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6333163Z 2025-12-04T09:47:13.6333214Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6333326Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6333420Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6333422Z 2025-12-04T09:47:13.6333492Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6333639Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6333641Z 2025-12-04T09:47:13.6333725Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6333925Z FAILED [0.6761s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6333927Z 2025-12-04T09:47:13.6333978Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6334090Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6334184Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6334186Z 2025-12-04T09:47:13.6334256Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6334414Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6334430Z 2025-12-04T09:47:13.6334513Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6334690Z FAILED [0.6852s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6334693Z 2025-12-04T09:47:13.6334745Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6334857Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6334952Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6334954Z 2025-12-04T09:47:13.6335023Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6335171Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6335173Z 2025-12-04T09:47:13.6335258Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6335435Z FAILED [0.6840s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6335438Z 2025-12-04T09:47:13.6335487Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6335600Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6335705Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6335707Z 2025-12-04T09:47:13.6335778Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6335924Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6335925Z 2025-12-04T09:47:13.6336010Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6336190Z FAILED [0.6955s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6336192Z 2025-12-04T09:47:13.6336242Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6336355Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6336450Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6336452Z 2025-12-04T09:47:13.6336524Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6336670Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6336672Z 2025-12-04T09:47:13.6336756Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6336933Z FAILED [0.6893s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6336936Z 2025-12-04T09:47:13.6336988Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6337099Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6337206Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6337208Z 2025-12-04T09:47:13.6337280Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6337426Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6337427Z 2025-12-04T09:47:13.6337511Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6337686Z FAILED [0.6735s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6337708Z 2025-12-04T09:47:13.6337759Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6337870Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6337963Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6337966Z 2025-12-04T09:47:13.6338036Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6338184Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6338185Z 2025-12-04T09:47:13.6338269Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6338447Z FAILED [0.7050s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6338449Z 2025-12-04T09:47:13.6338500Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6338614Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6338709Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6338712Z 2025-12-04T09:47:13.6338782Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6338929Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6338948Z 2025-12-04T09:47:13.6339032Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6339208Z FAILED [0.6798s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6339210Z 2025-12-04T09:47:13.6339260Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6339373Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6339467Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6339469Z 2025-12-04T09:47:13.6339541Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6339688Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6339691Z 2025-12-04T09:47:13.6339775Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6339952Z FAILED [0.6897s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6339954Z 2025-12-04T09:47:13.6340005Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6340116Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6340210Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6340213Z 2025-12-04T09:47:13.6340284Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6340428Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6340445Z 2025-12-04T09:47:13.6340530Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6340709Z FAILED [0.7711s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6340711Z 2025-12-04T09:47:13.6340762Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6340875Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6340968Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6340990Z 2025-12-04T09:47:13.6341062Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6341207Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6341211Z 2025-12-04T09:47:13.6341294Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6341473Z FAILED [0.6819s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6341475Z 2025-12-04T09:47:13.6341525Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6341636Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6341730Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6341732Z 2025-12-04T09:47:13.6341803Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6341950Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6341952Z 2025-12-04T09:47:13.6342035Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6342211Z FAILED [0.7124s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6342213Z 2025-12-04T09:47:13.6342275Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6342387Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6342481Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6342483Z 2025-12-04T09:47:13.6342553Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6342701Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6342703Z 2025-12-04T09:47:13.6342786Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6343005Z FAILED [0.7190s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6343008Z 2025-12-04T09:47:13.6343059Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6343173Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6343267Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6343270Z 2025-12-04T09:47:13.6343340Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6343486Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6343490Z 2025-12-04T09:47:13.6343572Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6343749Z FAILED [0.7428s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6343767Z 2025-12-04T09:47:13.6343818Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6343931Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6344024Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6344025Z 2025-12-04T09:47:13.6344096Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6344241Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6344243Z 2025-12-04T09:47:13.6344346Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6344536Z FAILED [0.6890s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6344539Z 2025-12-04T09:47:13.6344590Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6344702Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6344796Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6344798Z 2025-12-04T09:47:13.6344869Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6345014Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6345016Z 2025-12-04T09:47:13.6345100Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6345276Z FAILED [0.6855s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6345278Z 2025-12-04T09:47:13.6345329Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6345439Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6345536Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6345538Z 2025-12-04T09:47:13.6345621Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6345767Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6345769Z 2025-12-04T09:47:13.6345852Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6346031Z FAILED [0.6792s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6346033Z 2025-12-04T09:47:13.6346084Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6346196Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6346291Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6346293Z 2025-12-04T09:47:13.6346363Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6346511Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6346512Z 2025-12-04T09:47:13.6346595Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6346775Z FAILED [0.7117s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6346777Z 2025-12-04T09:47:13.6346830Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6346941Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6347036Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6347051Z 2025-12-04T09:47:13.6347122Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6347269Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6347271Z 2025-12-04T09:47:13.6347354Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6347531Z FAILED [0.7395s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6347533Z 2025-12-04T09:47:13.6347583Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6347705Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6347811Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6347813Z 2025-12-04T09:47:13.6347886Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6348031Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6348034Z 2025-12-04T09:47:13.6348117Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6348294Z FAILED [0.7260s] inductor/test_inductor_freezing.py::FreezingCpuTests::test_conv_with_as_strided_cpu - AssertionError: Tensor-likes are not close! 2025-12-04T09:47:13.6348296Z 2025-12-04T09:47:13.6348346Z Mismatched elements: 1574636 / 1769472 (89.0%) 2025-12-04T09:47:13.6348461Z Greatest absolute difference: 3.915588855743408 at index (0, 166, 0, 0, 8, 2) (up to 1e-05 allowed) 2025-12-04T09:47:13.6348555Z Greatest relative difference: inf at index (0, 40, 0, 0, 7, 0) (up to 1.3e-06 allowed) 2025-12-04T09:47:13.6348557Z 2025-12-04T09:47:13.6348628Z To execute this test, run the following from the base repo dir: 2025-12-04T09:47:13.6348773Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_inductor_freezing.py FreezingCpuTests.test_conv_with_as_strided_cpu 2025-12-04T09:47:13.6348775Z 2025-12-04T09:47:13.6348869Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:47:13.6348935Z ======================= 50 failed, 50 skipped in 54.13s ======================== 2025-12-04T09:47:13.6348938Z 2025-12-04T09:47:13.6349127Z FINISHED PRINTING LOG FILE of inductor/test_inductor_freezing 1/1 (test/test-reports/inductor.test_inductor_freezing_1.1_3acbff2758ab88d1_.log) 2025-12-04T09:47:13.6349129Z 2025-12-04T09:47:13.6349251Z Finished inductor/test_inductor_freezing 1/1 ... [2025-12-04 09:47:13.528767][2222805.088470672], took 1.01min 2025-12-04T09:47:13.6349491Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:47:13.6349599Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:47:13.6349698Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:47:13.6349749Z Uploading artifacts took 0.00 seconds 2025-12-04T09:47:13.6349803Z inductor/test_inductor_freezing 1/1 failed! 2025-12-04T09:47:13.6349891Z Running dynamo/test_repros 1/1 ... [2025-12-04 09:47:13.623133][2222805.182833176] 2025-12-04T09:47:13.6349941Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:47:13.6350301Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_repros.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:47:13.623441] 2025-12-04T09:47:51.0710169Z 2025-12-04T09:47:51.0711057Z dynamo/test_repros 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_repros_1.1_2482bcf65cfdf406_.log 2025-12-04T09:47:51.0750038Z Running 350 items in this shard: test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_create_rand_mask_from_inputs, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_aggressively_write_assert, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_dont_dce_rand, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_get_parameter_dtype, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_graph_break_unsupported_fake, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename, test/dynamo/test_repros.py::ReproTests::test_relative_import_no_modulename 2025-12-04T09:47:51.0781270Z 2025-12-04T09:47:51.0781383Z Finished dynamo/test_repros 1/1 ... [2025-12-04 09:47:51.070898][2222842.630601046], took 0.62min 2025-12-04T09:47:51.0781778Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:47:51.1675475Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:47:51.1690930Z Running dynamo/test_misc 1/1 ... [2025-12-04 09:47:51.168701][2222842.72840118] 2025-12-04T09:47:51.1691123Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:47:51.1692770Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_misc.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:47:51.169052] 2025-12-04T09:47:54.8337357Z 2025-12-04T09:47:54.8338415Z dynamo/test_misc 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_misc_1.1_62b10c1a68364f89_.log 2025-12-04T09:47:54.8339187Z Running 0 items in this shard: 2025-12-04T09:47:54.8339454Z 2025-12-04T09:47:54.8339747Z Finished dynamo/test_misc 1/1 ... [2025-12-04 09:47:54.833426][2222846.39312957], took 0.06min 2025-12-04T09:47:54.8340767Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:47:54.9277916Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:47:54.9292801Z Running inductor/test_mmdecomp 1/1 ... [2025-12-04 09:47:54.928956][2222846.488656098] 2025-12-04T09:47:54.9293057Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:47:54.9295017Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_mmdecomp.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:47:54.929310] 2025-12-04T09:48:00.3838360Z 2025-12-04T09:48:00.3839405Z inductor/test_mmdecomp 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_mmdecomp_1.1_ee9a4ca72afc7f91_.log 2025-12-04T09:48:00.3840214Z Running 0 items in this shard: 2025-12-04T09:48:00.3840436Z 2025-12-04T09:48:00.3840751Z Finished inductor/test_mmdecomp 1/1 ... [2025-12-04 09:48:00.383590][2222851.943291068], took 0.09min 2025-12-04T09:48:00.3846611Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:48:00.4757344Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:48:00.4768717Z Running inductor/test_perf 1/1 ... [2025-12-04 09:48:00.476455][2222852.036154749] 2025-12-04T09:48:00.4769280Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:48:00.4770201Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_perf.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:48:00.476754] 2025-12-04T09:48:05.7868398Z 2025-12-04T09:48:05.7869349Z inductor/test_perf 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_perf_1.1_647de60421b38fe6_.log 2025-12-04T09:48:05.7869855Z Running 0 items in this shard: 2025-12-04T09:48:05.7869990Z 2025-12-04T09:48:05.7870240Z Finished inductor/test_perf 1/1 ... [2025-12-04 09:48:05.786508][2222857.346208605], took 0.09min 2025-12-04T09:48:05.7874253Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:48:05.8793738Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:48:05.8799905Z Running inductor/test_snode_runtime 1/1 ... [2025-12-04 09:48:05.879801][2222857.439501219] 2025-12-04T09:48:05.8800248Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:48:05.8804894Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_snode_runtime.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:48:05.880082] 2025-12-04T09:48:11.5890103Z 2025-12-04T09:48:11.5891194Z inductor/test_snode_runtime 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_snode_runtime_1.1_a5c3a47bf9b51f8b_.log 2025-12-04T09:48:11.5891625Z Running 0 items in this shard: 2025-12-04T09:48:11.5891704Z 2025-12-04T09:48:11.5891843Z Finished inductor/test_snode_runtime 1/1 ... [2025-12-04 09:48:11.588717][2222863.148417999], took 0.10min 2025-12-04T09:48:11.5896937Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:48:11.6806719Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:48:11.6816579Z Running inductor/test_flex_attention 2/4 ... [2025-12-04 09:48:11.681264][2222863.240964731] 2025-12-04T09:48:11.6816995Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:48:11.6817930Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_flex_attention.py', '--shard-id=2', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:48:11.681570] 2025-12-04T09:49:14.7584380Z 2025-12-04T09:49:14.7585644Z inductor/test_flex_attention 2/4 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_flex_attention_2.4_f6e140abd562c441_.log 2025-12-04T09:49:14.7616760Z Running 100 items in this shard: test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_flex_attention_stride_ordering_mode_paged_attention_permute_order3_shape1_cuda, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16, test/inductor/test_flex_attention.py::TestFlexAttentionCUDA::test_return_aux_deprecation_warnings_cuda_float16 2025-12-04T09:49:14.7634675Z 2025-12-04T09:49:14.7634802Z Finished inductor/test_flex_attention 2/4 ... [2025-12-04 09:49:14.758110][2222926.317811645], took 1.05min 2025-12-04T09:49:14.7635208Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:49:14.8536644Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:49:14.8545925Z Running inductor/test_halide 1/1 ... [2025-12-04 09:49:14.854403][2222926.414102248] 2025-12-04T09:49:14.8546161Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:49:14.8550053Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_halide.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:49:14.854727] 2025-12-04T09:49:20.4485181Z 2025-12-04T09:49:20.4486331Z inductor/test_halide 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_halide_1.1_5c75d5faf6e6886c_.log 2025-12-04T09:49:20.4487774Z 2025-12-04T09:49:20.4488089Z Finished inductor/test_halide 1/1 ... [2025-12-04 09:49:20.448158][2222932.007859857], took 0.09min 2025-12-04T09:49:20.4489448Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:49:20.5513430Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:49:20.5531684Z Running inductor/test_torchinductor_strided_blocks 1/1 ... [2025-12-04 09:49:20.552994][2222932.112692462] 2025-12-04T09:49:20.5531943Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:49:20.5543139Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_torchinductor_strided_blocks.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:49:20.553332] 2025-12-04T09:50:18.8242753Z 2025-12-04T09:50:18.8244151Z PRINTING LOG FILE of inductor/test_torchinductor_strided_blocks 1/1 (test/test-reports/inductor.test_torchinductor_strided_blocks_1.1_2aff58254eebd8c0_.log) 2025-12-04T09:50:18.8245505Z Test results will be stored in test-reports/python-pytest/inductor.test_torchinductor_strided_blocks/inductor.test_torchinductor_strided_blocks-1ddd9dcd46a5f51c.xml 2025-12-04T09:50:18.8246328Z ============================= test session starts ============================== 2025-12-04T09:50:18.8246853Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:50:18.8252482Z cachedir: .pytest_cache 2025-12-04T09:50:18.8253102Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:50:18.8253526Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:50:18.8253741Z configfile: pytest.ini 2025-12-04T09:50:18.8254155Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:50:18.8254590Z collecting ... collected 302 items 2025-12-04T09:50:18.8255130Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:50:18.8293842Z Running 200 items in this shard: test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda, test/inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda 2025-12-04T09:50:18.8329375Z 2025-12-04T09:50:18.8329617Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0004s] (requires triton CPU backend) [ 0%] 2025-12-04T09:50:18.8330106Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.6492s] [ 1%] 2025-12-04T09:50:18.8330700Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:29.724000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8331137Z FAILED [0.5422s] [ 1%] 2025-12-04T09:50:18.8331516Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0003s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8332081Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8332578Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8333112Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8333601Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8334091Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8334580Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8335099Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8335590Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8336083Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8336575Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8337064Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8337554Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8338041Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8338531Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8339026Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8339517Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8340024Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8340513Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8341014Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8341518Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8342008Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8342498Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8343031Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8343523Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8344016Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8344508Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8345026Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8345515Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8346006Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8346501Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8358773Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8359291Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8359791Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8360295Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8360806Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8361352Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8361846Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8362338Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8362867Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8363432Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8363931Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8364429Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8364926Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8365425Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8365924Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8366443Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8366941Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8367439Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8367942Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestCPU::test_2d_reductions_mixed_indexing_reduction_op0_cpu SKIPPED [0.0001s] (requires triton CPU backend) [ 2%] 2025-12-04T09:50:18.8368406Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3618s] [ 2%] 2025-12-04T09:50:18.8368832Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3359s] [ 2%] 2025-12-04T09:50:18.8369255Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3347s] [ 2%] 2025-12-04T09:50:18.8369673Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.5639s] [ 2%] 2025-12-04T09:50:18.8370095Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3347s] [ 2%] 2025-12-04T09:50:18.8370518Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.5021s] [ 2%] 2025-12-04T09:50:18.8370952Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3269s] [ 2%] 2025-12-04T09:50:18.8371375Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3294s] [ 2%] 2025-12-04T09:50:18.8371795Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3310s] [ 2%] 2025-12-04T09:50:18.8372216Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3507s] [ 2%] 2025-12-04T09:50:18.8372645Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4173s] [ 2%] 2025-12-04T09:50:18.8373113Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.8935s] [ 2%] 2025-12-04T09:50:18.8373527Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4388s] [ 2%] 2025-12-04T09:50:18.8373945Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3319s] [ 2%] 2025-12-04T09:50:18.8374360Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.1950s] [ 2%] 2025-12-04T09:50:18.8374774Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.5356s] [ 2%] 2025-12-04T09:50:18.8375202Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3376s] [ 2%] 2025-12-04T09:50:18.8375621Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.5812s] [ 2%] 2025-12-04T09:50:18.8376056Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3318s] [ 2%] 2025-12-04T09:50:18.8376470Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3393s] [ 2%] 2025-12-04T09:50:18.8376882Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3309s] [ 2%] 2025-12-04T09:50:18.8377298Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4480s] [ 2%] 2025-12-04T09:50:18.8377712Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3356s] [ 2%] 2025-12-04T09:50:18.8378126Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4743s] [ 2%] 2025-12-04T09:50:18.8378545Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4676s] [ 2%] 2025-12-04T09:50:18.8378961Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3301s] [ 2%] 2025-12-04T09:50:18.8379374Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.8129s] [ 2%] 2025-12-04T09:50:18.8379792Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3285s] [ 2%] 2025-12-04T09:50:18.8380381Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.5820s] [ 2%] 2025-12-04T09:50:18.8380822Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.1333s] [ 2%] 2025-12-04T09:50:18.8381237Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.3715s] [ 2%] 2025-12-04T09:50:18.8381653Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4204s] [ 2%] 2025-12-04T09:50:18.8382071Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3342s] [ 2%] 2025-12-04T09:50:18.8382529Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.0195s] [ 2%] 2025-12-04T09:50:18.8382999Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [1.3914s] [ 2%] 2025-12-04T09:50:18.8383419Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3251s] [ 2%] 2025-12-04T09:50:18.8383834Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3241s] [ 2%] 2025-12-04T09:50:18.8384250Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3314s] [ 2%] 2025-12-04T09:50:18.8384669Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3214s] [ 2%] 2025-12-04T09:50:18.8385085Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3471s] [ 2%] 2025-12-04T09:50:18.8385502Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3465s] [ 2%] 2025-12-04T09:50:18.8385936Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3692s] [ 2%] 2025-12-04T09:50:18.8386353Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3470s] [ 2%] 2025-12-04T09:50:18.8386768Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3576s] [ 2%] 2025-12-04T09:50:18.8387191Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.4080s] [ 2%] 2025-12-04T09:50:18.8387615Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3445s] [ 2%] 2025-12-04T09:50:18.8388045Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3438s] [ 2%] 2025-12-04T09:50:18.8388473Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3480s] [ 2%] 2025-12-04T09:50:18.8388898Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_2d_reductions_mixed_indexing_reduction_op0_cuda PASSED [0.3227s] [ 2%] 2025-12-04T09:50:18.8389496Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:54.141000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8389943Z PASSED [0.4549s] [ 2%] 2025-12-04T09:50:18.8390368Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:54.597000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8390815Z PASSED [0.4547s] [ 2%] 2025-12-04T09:50:18.8391234Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:55.052000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8391661Z PASSED [0.4381s] [ 2%] 2025-12-04T09:50:18.8392087Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:55.492000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8392528Z PASSED [0.4449s] [ 2%] 2025-12-04T09:50:18.8393005Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:55.938000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8393439Z PASSED [0.4444s] [ 2%] 2025-12-04T09:50:18.8393854Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:56.383000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8394283Z FAILED [0.4492s] [ 2%] 2025-12-04T09:50:18.8394694Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:56.834000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8395124Z PASSED [0.4511s] [ 2%] 2025-12-04T09:50:18.8395555Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:57.286000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8395987Z PASSED [0.4475s] [ 2%] 2025-12-04T09:50:18.8396400Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:57.735000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8396827Z FAILED [0.4436s] [ 2%] 2025-12-04T09:50:18.8397243Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:58.180000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8397679Z PASSED [0.4522s] [ 2%] 2025-12-04T09:50:18.8398096Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:58.634000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8398529Z FAILED [0.4423s] [ 2%] 2025-12-04T09:50:18.8398943Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:59.078000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8399375Z FAILED [0.4488s] [ 2%] 2025-12-04T09:50:18.8399789Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:59.528000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8400234Z PASSED [0.4467s] [ 2%] 2025-12-04T09:50:18.8400648Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:49:59.976000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8401082Z FAILED [0.4571s] [ 2%] 2025-12-04T09:50:18.8401510Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:00.434000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8401953Z PASSED [0.8520s] [ 2%] 2025-12-04T09:50:18.8402372Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:01.288000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8402804Z FAILED [0.4522s] [ 2%] 2025-12-04T09:50:18.8403274Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:01.742000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8403704Z PASSED [0.4445s] [ 2%] 2025-12-04T09:50:18.8404121Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:02.187000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8404555Z PASSED [0.4440s] [ 2%] 2025-12-04T09:50:18.8404970Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:02.633000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8405403Z FAILED [0.4489s] [ 2%] 2025-12-04T09:50:18.8405834Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:03.083000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8406268Z PASSED [0.4506s] [ 2%] 2025-12-04T09:50:18.8406683Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:03.535000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8407114Z PASSED [0.4449s] [ 2%] 2025-12-04T09:50:18.8407532Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:03.981000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8407964Z PASSED [0.4497s] [ 2%] 2025-12-04T09:50:18.8408380Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:04.432000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8408810Z PASSED [0.4464s] [ 2%] 2025-12-04T09:50:18.8409225Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:04.879000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8409657Z PASSED [0.4567s] [ 2%] 2025-12-04T09:50:18.8410089Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:05.337000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8410522Z FAILED [0.4537s] [ 2%] 2025-12-04T09:50:18.8410936Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:05.792000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8411366Z PASSED [0.4436s] [ 2%] 2025-12-04T09:50:18.8411797Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:06.237000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8412250Z FAILED [0.4445s] [ 2%] 2025-12-04T09:50:18.8412658Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:06.683000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8413135Z PASSED [0.4451s] [ 2%] 2025-12-04T09:50:18.8413548Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:07.129000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8413977Z PASSED [0.4476s] [ 2%] 2025-12-04T09:50:18.8414387Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:07.578000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8414811Z PASSED [0.4464s] [ 2%] 2025-12-04T09:50:18.8415232Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:08.026000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8415656Z FAILED [0.4587s] [ 2%] 2025-12-04T09:50:18.8416063Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:08.486000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8416486Z PASSED [0.4521s] [ 2%] 2025-12-04T09:50:18.8416894Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:08.939000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8417322Z PASSED [0.4575s] [ 2%] 2025-12-04T09:50:18.8417730Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:09.398000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8418152Z FAILED [0.4496s] [ 2%] 2025-12-04T09:50:18.8418563Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:09.849000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8418989Z PASSED [0.4482s] [ 2%] 2025-12-04T09:50:18.8419397Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:10.299000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8419844Z PASSED [0.4499s] [ 2%] 2025-12-04T09:50:18.8420254Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:10.750000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8420678Z PASSED [0.4369s] [ 2%] 2025-12-04T09:50:18.8421100Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:11.188000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8421537Z PASSED [0.4518s] [ 2%] 2025-12-04T09:50:18.8421945Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:11.641000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8422372Z PASSED [0.4500s] [ 2%] 2025-12-04T09:50:18.8422779Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:12.093000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8423241Z FAILED [0.4581s] [ 2%] 2025-12-04T09:50:18.8423655Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:12.552000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8424080Z PASSED [0.4477s] [ 2%] 2025-12-04T09:50:18.8424502Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:13.001000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8424926Z PASSED [0.4456s] [ 2%] 2025-12-04T09:50:18.8425333Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:13.448000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8425755Z PASSED [0.8731s] [ 2%] 2025-12-04T09:50:18.8426164Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:14.322000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8426593Z PASSED [0.4482s] [ 2%] 2025-12-04T09:50:18.8427001Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:14.773000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8427422Z PASSED [0.4503s] [ 2%] 2025-12-04T09:50:18.8427827Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:15.224000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8428250Z PASSED [0.4397s] [ 2%] 2025-12-04T09:50:18.8428661Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:15.665000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8429300Z PASSED [0.4663s] [ 2%] 2025-12-04T09:50:18.8429707Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:16.132000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8430133Z PASSED [0.4438s] [ 2%] 2025-12-04T09:50:18.8430555Z inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda <- test/inductor/test_torchinductor.py W1204 09:50:16.578000 170510 site-packages/torch/_dynamo/debug_utils.py:591] no save_dir specified, will generate random data 2025-12-04T09:50:18.8430990Z FAILED [0.4457s] [ 2%] 2025-12-04T09:50:18.8431344Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0002s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8431956Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8432566Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8433214Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8433824Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0002s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8434446Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8435050Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8435654Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8436260Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8437085Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8437690Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8438295Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8438900Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8439528Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8440133Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8440756Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8441373Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8442059Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8442660Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8443314Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8443916Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8444522Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8445154Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8445762Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8446373Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8446980Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8447588Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8448198Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8448802Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8449405Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8450031Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8450632Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8451257Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8451874Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8452483Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8453139Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8453750Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8454354Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8454978Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8455580Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8456188Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8456793Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8457397Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8457998Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8458604Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8459211Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8459832Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8460436Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8461051Z inductor/test_torchinductor_strided_blocks.py::TritonTensorDescriptorTestCUDA::test_2d_reductions_mixed_indexing_reduction_op0_cuda SKIPPED [0.0001s] (Requires Triton CUDA backend and CUDA compute capability >= 9.0) [ 2%] 2025-12-04T09:50:18.8461385Z 2025-12-04T09:50:18.8461453Z =================================== FAILURES =================================== 2025-12-04T09:50:18.8461660Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8461844Z Traceback (most recent call last): 2025-12-04T09:50:18.8462053Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8462257Z return value(self) 2025-12-04T09:50:18.8462363Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8462604Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8462864Z self._run_and_compare( 2025-12-04T09:50:18.8463142Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8463401Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8463620Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8463818Z raise self.failureException(msg) 2025-12-04T09:50:18.8463956Z AssertionError: False is not true 2025-12-04T09:50:18.8464036Z 2025-12-04T09:50:18.8464119Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8464453Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8464690Z 2025-12-04T09:50:18.8464788Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8465000Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8465167Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8465308Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8465514Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8466044Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8466505Z graph_break [] 2025-12-04T09:50:18.8466644Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8466961Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8467283Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8467510Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8467699Z Traceback (most recent call last): 2025-12-04T09:50:18.8467903Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8468102Z return value(self) 2025-12-04T09:50:18.8468225Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8468455Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8468706Z self._run_and_compare( 2025-12-04T09:50:18.8468927Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8469183Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8469391Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8469582Z raise self.failureException(msg) 2025-12-04T09:50:18.8469718Z AssertionError: False is not true 2025-12-04T09:50:18.8469830Z 2025-12-04T09:50:18.8469909Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8470225Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8470467Z 2025-12-04T09:50:18.8470557Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8470768Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8470932Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8471071Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8471271Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8471798Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8472253Z graph_break [] 2025-12-04T09:50:18.8472390Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8472704Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8473071Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8473274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8473434Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8473569Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8473768Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8474319Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8474803Z graph_break [] 2025-12-04T09:50:18.8474939Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8475250Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8475567Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8475774Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8475933Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8476065Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8476262Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8476817Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8477321Z graph_break [] 2025-12-04T09:50:18.8477457Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8477766Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8478082Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8478299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8478471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8478604Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8478800Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8479342Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8479821Z graph_break [] 2025-12-04T09:50:18.8479952Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8480257Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8480572Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8480769Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8480924Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8481054Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8481245Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8481797Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8482275Z graph_break [] 2025-12-04T09:50:18.8482404Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8482708Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8483070Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8483268Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8483421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8483551Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8483744Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8484284Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8484762Z graph_break [] 2025-12-04T09:50:18.8484891Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8485196Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8485528Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8485725Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8485879Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8486009Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8486205Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8486760Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8487256Z graph_break [] 2025-12-04T09:50:18.8487387Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8487692Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8488006Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8488229Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8488413Z Traceback (most recent call last): 2025-12-04T09:50:18.8488612Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8488805Z return value(self) 2025-12-04T09:50:18.8488906Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8489143Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8489398Z self._run_and_compare( 2025-12-04T09:50:18.8489618Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8489871Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8490087Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8490274Z raise self.failureException(msg) 2025-12-04T09:50:18.8490404Z AssertionError: False is not true 2025-12-04T09:50:18.8490484Z 2025-12-04T09:50:18.8490559Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8490872Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8491107Z 2025-12-04T09:50:18.8491198Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8491399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8491556Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8491687Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8491880Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8492397Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8492846Z graph_break [] 2025-12-04T09:50:18.8493019Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8493326Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8493643Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8493840Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8494009Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8494138Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8494332Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8494878Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8495357Z graph_break [] 2025-12-04T09:50:18.8495521Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8495826Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8496140Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8496335Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8496490Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8496621Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8496812Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8497353Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8497835Z graph_break [] 2025-12-04T09:50:18.8497969Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8498275Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8498602Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8498799Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8498953Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8499083Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8499273Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8499819Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8500296Z graph_break [] 2025-12-04T09:50:18.8500425Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8500730Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8501044Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8501241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8501396Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8501525Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8501721Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8502264Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8502755Z graph_break [] 2025-12-04T09:50:18.8502887Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8503235Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8503546Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8503762Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8503931Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8504060Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8504251Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8504793Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8505273Z graph_break [] 2025-12-04T09:50:18.8505403Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8505709Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8506023Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8506219Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8506374Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8506504Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8506696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8507248Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8507728Z graph_break [] 2025-12-04T09:50:18.8507854Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8508163Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8508475Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8508673Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8508827Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8508955Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8509147Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8509687Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8510165Z graph_break [] 2025-12-04T09:50:18.8510295Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8510599Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8510925Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8511120Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8511275Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8511404Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8511595Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8512146Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8512633Z graph_break [] 2025-12-04T09:50:18.8512761Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8513107Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8513419Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8513615Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8513770Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8513901Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8514093Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8514640Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8515121Z graph_break [] 2025-12-04T09:50:18.8515249Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8515566Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8515879Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8516101Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8516285Z Traceback (most recent call last): 2025-12-04T09:50:18.8516486Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8516684Z return value(self) 2025-12-04T09:50:18.8516784Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8517020Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8517273Z self._run_and_compare( 2025-12-04T09:50:18.8517495Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8517747Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8517946Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8518132Z raise self.failureException(msg) 2025-12-04T09:50:18.8518261Z AssertionError: False is not true 2025-12-04T09:50:18.8518340Z 2025-12-04T09:50:18.8518416Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8518727Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8518969Z 2025-12-04T09:50:18.8519058Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8519274Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8519430Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8519560Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8519752Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8520267Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8520717Z graph_break [] 2025-12-04T09:50:18.8520882Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8521187Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8521502Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8521698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8521853Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8521982Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8522174Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8522715Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8523236Z graph_break [] 2025-12-04T09:50:18.8523366Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8523672Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8523999Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8524197Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8524350Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8524477Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8524669Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8525211Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8525693Z graph_break [] 2025-12-04T09:50:18.8525822Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8526128Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8526441Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8526637Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8526789Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8526917Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8527110Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8527653Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8528144Z graph_break [] 2025-12-04T09:50:18.8528275Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8528579Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8528889Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8529101Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8529270Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8529399Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8529590Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8530133Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8530609Z graph_break [] 2025-12-04T09:50:18.8530738Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8531040Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8531354Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8531549Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8531701Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8531830Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8532024Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8532577Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8533099Z graph_break [] 2025-12-04T09:50:18.8533228Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8533532Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8533847Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8534043Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8534196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8534325Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8534518Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8535061Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8535541Z graph_break [] 2025-12-04T09:50:18.8535671Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8535975Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8536308Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8536506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8536659Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8536787Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8536977Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8537540Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8538035Z graph_break [] 2025-12-04T09:50:18.8538164Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8538469Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8538781Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8538977Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8539129Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8539256Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8539446Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8539985Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8540464Z graph_break [] 2025-12-04T09:50:18.8540591Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8540907Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8541219Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8541415Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8541567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8541694Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8541888Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8542432Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8542910Z graph_break [] 2025-12-04T09:50:18.8543075Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8543377Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8543686Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8543881Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8544033Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8544160Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8544350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8544911Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8545385Z graph_break [] 2025-12-04T09:50:18.8545514Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8545817Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8546155Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8546352Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8546504Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8546635Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8546824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8547369Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8547847Z graph_break [] 2025-12-04T09:50:18.8547975Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8548282Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8548595Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8548819Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8549002Z Traceback (most recent call last): 2025-12-04T09:50:18.8549214Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8549408Z return value(self) 2025-12-04T09:50:18.8549507Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8549741Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8549994Z self._run_and_compare( 2025-12-04T09:50:18.8550214Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8550465Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8550664Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8550850Z raise self.failureException(msg) 2025-12-04T09:50:18.8550979Z AssertionError: False is not true 2025-12-04T09:50:18.8551058Z 2025-12-04T09:50:18.8551133Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8551438Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8551674Z 2025-12-04T09:50:18.8551762Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8551962Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8552116Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8552246Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8552440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8552998Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8553476Z graph_break [] 2025-12-04T09:50:18.8553606Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8553913Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8554226Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8554438Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8554613Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8554741Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8554932Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8555474Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8555950Z graph_break [] 2025-12-04T09:50:18.8556078Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8556382Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8556695Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8556892Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8557044Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8557173Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8557364Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8557920Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8558397Z graph_break [] 2025-12-04T09:50:18.8558527Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8558831Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8559143Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8559339Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8559493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8559621Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8559813Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8560357Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8560834Z graph_break [] 2025-12-04T09:50:18.8560963Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8561266Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8561592Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8561791Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8561949Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8562077Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8562269Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8562821Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8563345Z graph_break [] 2025-12-04T09:50:18.8563474Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8563781Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8564093Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8564290Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8564444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8564573Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8564766Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8565315Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8565797Z graph_break [] 2025-12-04T09:50:18.8565927Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8566248Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8566561Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8566757Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8566910Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8567039Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8567233Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8567772Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8568250Z graph_break [] 2025-12-04T09:50:18.8568380Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8568682Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8568994Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8569190Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8569345Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8569473Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8569664Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8570229Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8570712Z graph_break [] 2025-12-04T09:50:18.8570839Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8571144Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8571487Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8571684Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8571836Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8571964Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8572158Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8572700Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8573209Z graph_break [] 2025-12-04T09:50:18.8573339Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8573643Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8573954Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8574151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8574306Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8574434Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8574643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8575182Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8575662Z graph_break [] 2025-12-04T09:50:18.8575792Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8576096Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8576407Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8576605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8576760Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8576900Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8577093Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8577633Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8578109Z graph_break [] 2025-12-04T09:50:18.8578239Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8578558Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8578871Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8579066Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8579219Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8579348Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8579541Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8580111Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8580601Z graph_break [] 2025-12-04T09:50:18.8580733Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8581041Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8581352Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8584384Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8584545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8584681Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8584883Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8585431Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8585961Z graph_break [] 2025-12-04T09:50:18.8586096Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8586405Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8586721Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8586950Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8587138Z Traceback (most recent call last): 2025-12-04T09:50:18.8587344Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8587543Z return value(self) 2025-12-04T09:50:18.8587647Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8587887Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8588144Z self._run_and_compare( 2025-12-04T09:50:18.8588370Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8588625Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8588832Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8589022Z raise self.failureException(msg) 2025-12-04T09:50:18.8589155Z AssertionError: False is not true 2025-12-04T09:50:18.8589240Z 2025-12-04T09:50:18.8589317Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8589628Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8589888Z 2025-12-04T09:50:18.8589980Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8590183Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8590340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8590473Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8590662Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8591189Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8591647Z graph_break [] 2025-12-04T09:50:18.8591775Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8592081Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8592395Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8592591Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8592742Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8592867Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8593103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8593654Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8594135Z graph_break [] 2025-12-04T09:50:18.8594262Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8594597Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8594908Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8595100Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8595254Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8595379Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8595574Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8596112Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8596591Z graph_break [] 2025-12-04T09:50:18.8596720Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8597022Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8597329Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8597525Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8597678Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8597805Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8597994Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8598558Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8599033Z graph_break [] 2025-12-04T09:50:18.8599160Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8599461Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8599796Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8599989Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8600141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8600267Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8600457Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8601000Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8601473Z graph_break [] 2025-12-04T09:50:18.8601600Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8601903Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8602213Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8602407Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8602558Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8602684Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8602887Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8603465Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8603941Z graph_break [] 2025-12-04T09:50:18.8604067Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8604368Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8604678Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8604872Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8605022Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8605147Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8605336Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8605873Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8606351Z graph_break [] 2025-12-04T09:50:18.8606477Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8606797Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8607108Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8607302Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8607453Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8607578Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8607769Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8608322Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8608811Z graph_break [] 2025-12-04T09:50:18.8608937Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8609238Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8609548Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8609740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8609891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8610017Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8610207Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8610746Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8611241Z graph_break [] 2025-12-04T09:50:18.8611368Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8611667Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8611975Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8612169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8612321Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8612446Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8612638Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8613213Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8613687Z graph_break [] 2025-12-04T09:50:18.8613814Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8614115Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8614425Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8614618Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8614768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8614915Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8615103Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8615637Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8616112Z graph_break [] 2025-12-04T09:50:18.8616238Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8616575Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8616883Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8617079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8617228Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8617353Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8617542Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8618079Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8618555Z graph_break [] 2025-12-04T09:50:18.8618680Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8618983Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8619293Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8619500Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8619652Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8619777Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8619966Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8620504Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8620981Z graph_break [] 2025-12-04T09:50:18.8621106Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8621409Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8621719Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8621910Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8622059Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8622183Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8622372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8622908Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8623432Z graph_break [] 2025-12-04T09:50:18.8623556Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8623856Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8624166Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8624358Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8624507Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8624649Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8624853Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8625394Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8625870Z graph_break [] 2025-12-04T09:50:18.8625995Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8626298Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8626605Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8626824Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8627009Z Traceback (most recent call last): 2025-12-04T09:50:18.8627205Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8627399Z return value(self) 2025-12-04T09:50:18.8627496Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8627728Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8627990Z self._run_and_compare( 2025-12-04T09:50:18.8628212Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8628460Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8628657Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8628840Z raise self.failureException(msg) 2025-12-04T09:50:18.8628968Z AssertionError: False is not true 2025-12-04T09:50:18.8629047Z 2025-12-04T09:50:18.8629121Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8629424Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8629659Z 2025-12-04T09:50:18.8629749Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8629946Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8630097Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8630223Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8630411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8630925Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8631370Z graph_break [] 2025-12-04T09:50:18.8631496Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8631813Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8632122Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8632314Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8632463Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8632588Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8632774Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8633366Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8633854Z graph_break [] 2025-12-04T09:50:18.8633979Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8634281Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8634591Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8634783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8634931Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8635056Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8635246Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8635783Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8636275Z graph_break [] 2025-12-04T09:50:18.8636401Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8636698Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8637006Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8637199Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8637349Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8637473Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8637661Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8638197Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8638675Z graph_break [] 2025-12-04T09:50:18.8638801Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8639102Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8639413Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8639605Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8639754Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8639892Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8640080Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8640619Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8641091Z graph_break [] 2025-12-04T09:50:18.8641216Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8641539Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8641846Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8642040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8642190Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8642314Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8642503Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8643101Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8643577Z graph_break [] 2025-12-04T09:50:18.8643702Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8644002Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8644312Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8644520Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8644670Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8644796Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8644982Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8645521Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8645993Z graph_break [] 2025-12-04T09:50:18.8646118Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8646417Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8646724Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8646916Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8647064Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8647188Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8647375Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8647911Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8648398Z graph_break [] 2025-12-04T09:50:18.8648523Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8648824Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8649131Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8649323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8649471Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8649617Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8649818Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8650357Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8650831Z graph_break [] 2025-12-04T09:50:18.8650957Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8651257Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8651567Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8651759Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8651910Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8652035Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8652223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8652779Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8653289Z graph_break [] 2025-12-04T09:50:18.8653415Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8653717Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8654025Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8654215Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8654366Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8654491Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8654678Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8655219Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8655694Z graph_break [] 2025-12-04T09:50:18.8655820Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8656123Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8656431Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8656641Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8656790Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8656914Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8657102Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8657654Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8658140Z graph_break [] 2025-12-04T09:50:18.8658265Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8658564Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8658872Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8659064Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8659214Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8659338Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8659526Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8660067Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8660542Z graph_break [] 2025-12-04T09:50:18.8660669Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8660985Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8661293Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8661488Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8661638Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8661764Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8661955Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8662493Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8663000Z graph_break [] 2025-12-04T09:50:18.8663125Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8663425Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8663732Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8663924Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8664073Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8664198Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8664388Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8664926Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8665419Z graph_break [] 2025-12-04T09:50:18.8665545Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8665845Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8666152Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8666242Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8666298Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8666355Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8666454Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8666856Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8666894Z graph_break [] 2025-12-04T09:50:18.8666966Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8667156Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8667240Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8667315Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8667358Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8667415Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8667517Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8667934Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8667971Z graph_break [] 2025-12-04T09:50:18.8668046Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8668238Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8668322Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8668425Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8668476Z Traceback (most recent call last): 2025-12-04T09:50:18.8668598Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8668637Z return value(self) 2025-12-04T09:50:18.8668674Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8668849Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8668893Z self._run_and_compare( 2025-12-04T09:50:18.8669045Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8669110Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8669211Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8669275Z raise self.failureException(msg) 2025-12-04T09:50:18.8669321Z AssertionError: False is not true 2025-12-04T09:50:18.8669324Z 2025-12-04T09:50:18.8669399Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8669599Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8669601Z 2025-12-04T09:50:18.8669691Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8669764Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8669806Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8669883Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8669983Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8670357Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8670395Z graph_break [] 2025-12-04T09:50:18.8670469Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8670659Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8670745Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8670818Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8670861Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8670916Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8671015Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8671432Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8671471Z graph_break [] 2025-12-04T09:50:18.8671545Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8671739Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8671824Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8671897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8671940Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8671997Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8672097Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8672503Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8672541Z graph_break [] 2025-12-04T09:50:18.8672614Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8672806Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8672889Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8673019Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8673060Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8673117Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8673215Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8673637Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8673689Z graph_break [] 2025-12-04T09:50:18.8673764Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8673953Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8674039Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8674113Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8674154Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8674211Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8674310Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8674712Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8674749Z graph_break [] 2025-12-04T09:50:18.8674823Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8675027Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8675112Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8675184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8675227Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8675282Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8675381Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8675787Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8675826Z graph_break [] 2025-12-04T09:50:18.8675901Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8676090Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8676174Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8676246Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8676290Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8676345Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8676444Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8676844Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8676896Z graph_break [] 2025-12-04T09:50:18.8676969Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8677160Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8677244Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8677329Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8677381Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8677437Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8677535Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8677942Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8677982Z graph_break [] 2025-12-04T09:50:18.8678055Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8678244Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8678328Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8678402Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8678444Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8678501Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8678597Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8679015Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8679053Z graph_break [] 2025-12-04T09:50:18.8679127Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8679316Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8679400Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8679475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8679516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8679573Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8679671Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8680078Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8680116Z graph_break [] 2025-12-04T09:50:18.8680189Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8680376Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8680472Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8680545Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8680588Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8680644Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8680743Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8681158Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8681638Z graph_break [] 2025-12-04T09:50:18.8681713Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8681902Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8681986Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8682060Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8682102Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8682158Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8682258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8682664Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8682703Z graph_break [] 2025-12-04T09:50:18.8682786Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8683019Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8683103Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8683176Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8683217Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8683275Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8683374Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8683778Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8683817Z graph_break [] 2025-12-04T09:50:18.8683889Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8684081Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8684164Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8684241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8684282Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8684339Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8684456Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8684862Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8684899Z graph_break [] 2025-12-04T09:50:18.8684974Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8685173Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8685270Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8685341Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8685385Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8685441Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8685540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8685942Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8685979Z graph_break [] 2025-12-04T09:50:18.8686053Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8686241Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8686327Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8686399Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8686441Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8686515Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8686617Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8687021Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8687060Z graph_break [] 2025-12-04T09:50:18.8687132Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8687323Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8687408Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8687481Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8687523Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8687580Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8687678Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8688081Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8688131Z graph_break [] 2025-12-04T09:50:18.8688203Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8688394Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8688477Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8688551Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8688592Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8688649Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8688759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8689171Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8689209Z graph_break [] 2025-12-04T09:50:18.8689282Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8689470Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8689553Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8689626Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8689669Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8689727Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8689824Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8690241Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8690279Z graph_break [] 2025-12-04T09:50:18.8690352Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8690541Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8690626Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8690699Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8690745Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8690800Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8690899Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8691301Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8691337Z graph_break [] 2025-12-04T09:50:18.8691411Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8691599Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8691684Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8691781Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8691843Z Traceback (most recent call last): 2025-12-04T09:50:18.8691963Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8692004Z return value(self) 2025-12-04T09:50:18.8692039Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8692215Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8692257Z self._run_and_compare( 2025-12-04T09:50:18.8692411Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8692484Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8692596Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8692645Z raise self.failureException(msg) 2025-12-04T09:50:18.8692692Z AssertionError: False is not true 2025-12-04T09:50:18.8692695Z 2025-12-04T09:50:18.8692770Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8693010Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8693012Z 2025-12-04T09:50:18.8693106Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8693180Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8693222Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8693278Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8693376Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8693750Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8693789Z graph_break [] 2025-12-04T09:50:18.8693876Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8694067Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8694152Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8694226Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8694267Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8694325Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8694423Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8694828Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8694867Z graph_break [] 2025-12-04T09:50:18.8694939Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8695129Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8695211Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8695287Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8695328Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8695384Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8695496Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8695898Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8695935Z graph_break [] 2025-12-04T09:50:18.8696008Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8696207Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8696305Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8696377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8696422Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8696476Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8696576Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8696979Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8697015Z graph_break [] 2025-12-04T09:50:18.8697091Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8697280Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8697365Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8697436Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8697479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8697544Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8697644Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8698046Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8698086Z graph_break [] 2025-12-04T09:50:18.8698159Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8698349Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8698434Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8698506Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8698549Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8698604Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8698704Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8699107Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8699159Z graph_break [] 2025-12-04T09:50:18.8699232Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8699424Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8699507Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8699580Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8699622Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8699679Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8699786Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8700204Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8700242Z graph_break [] 2025-12-04T09:50:18.8700315Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8700504Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8700587Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8700660Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8700702Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8700758Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8700854Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8701270Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8701308Z graph_break [] 2025-12-04T09:50:18.8701381Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8701570Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8701655Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8701728Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8701771Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8701826Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8701925Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8702330Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8702366Z graph_break [] 2025-12-04T09:50:18.8702439Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8702629Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8702714Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8702785Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8702840Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8702895Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8703037Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8703443Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8703481Z graph_break [] 2025-12-04T09:50:18.8703570Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8703773Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8703858Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8703931Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8703974Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8704029Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8704128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8704531Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8704569Z graph_break [] 2025-12-04T09:50:18.8704642Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8704832Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8704929Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8705003Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8705043Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8705100Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8705197Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8705605Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8705644Z graph_break [] 2025-12-04T09:50:18.8705716Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8705906Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8705989Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8706063Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8706104Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8706160Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8706258Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8706663Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8706714Z graph_break [] 2025-12-04T09:50:18.8706787Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8706975Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8707060Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8707132Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8707184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8707249Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8707348Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8707756Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8707793Z graph_break [] 2025-12-04T09:50:18.8707866Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8708054Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8708138Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8708211Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8708253Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8708308Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8708407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8708817Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8708855Z graph_break [] 2025-12-04T09:50:18.8708927Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8709219Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8709303Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8709376Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8709418Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8709475Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8709575Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8709981Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8710018Z graph_break [] 2025-12-04T09:50:18.8710093Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8710281Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8710379Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8710452Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8710494Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8710551Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8710648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8711062Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8711108Z graph_break [] 2025-12-04T09:50:18.8711181Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8711373Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8711456Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8711529Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8711569Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8711625Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8711723Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8712135Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8712175Z graph_break [] 2025-12-04T09:50:18.8712252Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8712452Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8712540Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8712613Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8712660Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8712716Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8712818Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8713255Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8713297Z graph_break [] 2025-12-04T09:50:18.8713374Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8713563Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8713649Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8713722Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8713772Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8713829Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8713930Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8714350Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8714390Z graph_break [] 2025-12-04T09:50:18.8714462Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8714650Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8714753Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8714842Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8714884Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8714943Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8715042Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8715448Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8715490Z graph_break [] 2025-12-04T09:50:18.8715563Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8715757Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8715842Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8715920Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8715962Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8716021Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8716133Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8716537Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8716575Z graph_break [] 2025-12-04T09:50:18.8716653Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8716846Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8716933Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8717013Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8717057Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8717117Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8717214Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8717618Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8717658Z graph_break [] 2025-12-04T09:50:18.8717734Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8717934Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8718024Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8718098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8718143Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8718199Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8718302Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8718718Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8718771Z graph_break [] 2025-12-04T09:50:18.8718847Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8719038Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8719124Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8719198Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8719243Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8719300Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8719403Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8719804Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8719846Z graph_break [] 2025-12-04T09:50:18.8719928Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8720120Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8720205Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8720283Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8720326Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8720384Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8720482Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8720889Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8720930Z graph_break [] 2025-12-04T09:50:18.8721005Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8721197Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8721283Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8721388Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8721435Z Traceback (most recent call last): 2025-12-04T09:50:18.8721572Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8721612Z return value(self) 2025-12-04T09:50:18.8721651Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8721829Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8721875Z self._run_and_compare( 2025-12-04T09:50:18.8722026Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8722095Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8722204Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8722267Z raise self.failureException(msg) 2025-12-04T09:50:18.8722314Z AssertionError: False is not true 2025-12-04T09:50:18.8722316Z 2025-12-04T09:50:18.8722394Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8722594Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8722601Z 2025-12-04T09:50:18.8722691Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8722770Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8722812Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8722872Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8723013Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8723393Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8723433Z graph_break [] 2025-12-04T09:50:18.8723510Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8723717Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8723804Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8723878Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8723924Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8723980Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8724083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8724492Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8724533Z graph_break [] 2025-12-04T09:50:18.8724607Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8724798Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8724883Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8724956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8725003Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8725058Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8725159Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8725575Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8725617Z graph_break [] 2025-12-04T09:50:18.8725690Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8725882Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8725980Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8726068Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8726110Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8726170Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8726270Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8726682Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8726723Z graph_break [] 2025-12-04T09:50:18.8726796Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8726991Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8727075Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8727153Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8727196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8727254Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8727367Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8727773Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8727812Z graph_break [] 2025-12-04T09:50:18.8727889Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8728078Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8728167Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8728241Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8728284Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8728344Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8728442Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8728855Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8728894Z graph_break [] 2025-12-04T09:50:18.8728970Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8729177Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8729265Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8729338Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8729383Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8729438Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8729538Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8729954Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8730005Z graph_break [] 2025-12-04T09:50:18.8730080Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8730273Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8730359Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8730432Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8730477Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8730533Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8730635Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8731047Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8731088Z graph_break [] 2025-12-04T09:50:18.8731170Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8731361Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8731444Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8731517Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8731559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8731616Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8731714Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8732120Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8732162Z graph_break [] 2025-12-04T09:50:18.8732235Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8732430Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8732514Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8732593Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8732637Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8732707Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8732805Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8733246Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8733284Z graph_break [] 2025-12-04T09:50:18.8733360Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8733561Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8733664Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8733739Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8733784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8733839Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8733941Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8734348Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8734390Z graph_break [] 2025-12-04T09:50:18.8734468Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8734657Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8734745Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8734831Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8734878Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8734935Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8735041Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8735445Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8735486Z graph_break [] 2025-12-04T09:50:18.8735557Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8735748Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8735837Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8735909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8735954Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8736010Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8736113Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8736516Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8736573Z graph_break [] 2025-12-04T09:50:18.8736647Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8736839Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8736923Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8736998Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8737040Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8737101Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8737223Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8737631Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8737673Z graph_break [] 2025-12-04T09:50:18.8737746Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8737938Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8738023Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8738098Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8738141Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8738199Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8738298Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8738716Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8738755Z graph_break [] 2025-12-04T09:50:18.8738832Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8739021Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8739110Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8739184Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8739229Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8739288Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8739390Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8739796Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8739834Z graph_break [] 2025-12-04T09:50:18.8739910Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8740101Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8740190Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8740275Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8740320Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8740376Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8740479Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8740882Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8740955Z graph_break [] 2025-12-04T09:50:18.8741028Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8741218Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8741303Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8741377Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8741421Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8741477Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8741578Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8741981Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8742020Z graph_break [] 2025-12-04T09:50:18.8742093Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8742284Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8742387Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8742462Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8742503Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8742561Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8742658Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8743097Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8743137Z graph_break [] 2025-12-04T09:50:18.8743210Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8743403Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8743486Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8743559Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8743599Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8743660Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8743759Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8744161Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8744219Z graph_break [] 2025-12-04T09:50:18.8744293Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8744481Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8744567Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8744653Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8744710Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8744765Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8744865Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8745269Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8745306Z graph_break [] 2025-12-04T09:50:18.8745380Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8745569Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8745654Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8745726Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8745768Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8745824Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8745923Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8746337Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8746377Z graph_break [] 2025-12-04T09:50:18.8746450Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8746643Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8746726Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8746801Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8746844Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8746901Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8747001Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8747401Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8747440Z graph_break [] 2025-12-04T09:50:18.8747513Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8747703Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8747798Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8747873Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8747914Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8747971Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8748067Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8748478Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8748527Z graph_break [] 2025-12-04T09:50:18.8748603Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8748793Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8748877Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8748950Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8748991Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8749048Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8749144Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8749553Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8749590Z graph_break [] 2025-12-04T09:50:18.8749667Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8749866Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8749953Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8750025Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8750068Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8750124Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8750224Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8750626Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8750664Z graph_break [] 2025-12-04T09:50:18.8750739Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8750927Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8751015Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8751088Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8751132Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8751187Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8751286Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8751700Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8751738Z graph_break [] 2025-12-04T09:50:18.8751812Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8752020Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8752117Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8752227Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8752283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8752371Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8754719Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8755139Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8755179Z graph_break [] 2025-12-04T09:50:18.8755257Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8755453Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8755539Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8755644Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8755692Z Traceback (most recent call last): 2025-12-04T09:50:18.8755849Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8755891Z return value(self) 2025-12-04T09:50:18.8755930Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8756108Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8756154Z self._run_and_compare( 2025-12-04T09:50:18.8756308Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8756377Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8756480Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8756534Z raise self.failureException(msg) 2025-12-04T09:50:18.8756585Z AssertionError: False is not true 2025-12-04T09:50:18.8756588Z 2025-12-04T09:50:18.8756666Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8756870Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8756872Z 2025-12-04T09:50:18.8756962Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8757039Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8757082Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8757141Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8757242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8757621Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8757677Z graph_break [] 2025-12-04T09:50:18.8757753Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8757944Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8758030Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8758116Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8758175Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8758230Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8758331Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8758745Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8758784Z graph_break [] 2025-12-04T09:50:18.8758858Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8759048Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8759134Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8759207Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8759250Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8759307Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8759407Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8759823Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8759863Z graph_break [] 2025-12-04T09:50:18.8759935Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8760127Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8760213Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8760288Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8760330Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8760387Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8760492Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8760896Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8760934Z graph_break [] 2025-12-04T09:50:18.8761005Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8761193Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8761290Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8761364Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8761405Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8761462Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8761562Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8761975Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8762027Z graph_break [] 2025-12-04T09:50:18.8762101Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8762291Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8762374Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8762447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8762488Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8762544Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8762642Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8763101Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8763140Z graph_break [] 2025-12-04T09:50:18.8763213Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8763416Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8763501Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8763573Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8763614Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8763669Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8763770Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8764173Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8764211Z graph_break [] 2025-12-04T09:50:18.8764284Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8764472Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8764556Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8764631Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8764674Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8764731Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8764830Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8765252Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8765291Z graph_break [] 2025-12-04T09:50:18.8765362Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8765573Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8765670Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8765741Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8765784Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8765839Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8765938Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8766339Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8766377Z graph_break [] 2025-12-04T09:50:18.8766450Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8766639Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8766722Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8766798Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8766840Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8766905Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8767005Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8767408Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8767446Z graph_break [] 2025-12-04T09:50:18.8767518Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8767706Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8767790Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8767864Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8767905Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8767961Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8768058Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8768461Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8768499Z graph_break [] 2025-12-04T09:50:18.8768586Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8768775Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8768860Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8768934Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8768977Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8769032Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8769141Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8769556Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8769594Z graph_break [] 2025-12-04T09:50:18.8769668Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8769855Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8769940Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8770012Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8770055Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8770111Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8770210Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8770620Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8770659Z graph_break [] 2025-12-04T09:50:18.8770731Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8770921Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8771003Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8771079Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8771121Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8771175Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8771273Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8771676Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8771713Z graph_break [] 2025-12-04T09:50:18.8771786Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8771976Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8772060Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8772132Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8772184Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8772240Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8772338Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8772740Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8772776Z graph_break [] 2025-12-04T09:50:18.8772858Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8773100Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8773185Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8773259Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8773300Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8773359Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8773458Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8773862Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8773900Z graph_break [] 2025-12-04T09:50:18.8773973Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8774161Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8774246Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8774332Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8774376Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8774431Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8774529Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8774929Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8774968Z graph_break [] 2025-12-04T09:50:18.8775044Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8775235Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8775320Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8775392Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8775433Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8775488Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8775587Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8775989Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8776042Z graph_break [] 2025-12-04T09:50:18.8776114Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8776304Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8776386Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8776459Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8776501Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8776582Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8776680Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8777083Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8777122Z graph_break [] 2025-12-04T09:50:18.8777195Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8777384Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8777468Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8777543Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8777585Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8777640Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8777738Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8778151Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8778188Z graph_break [] 2025-12-04T09:50:18.8778261Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8778450Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8778535Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8778608Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8778650Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8778705Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8778804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8779208Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8779245Z graph_break [] 2025-12-04T09:50:18.8779319Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8779509Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8779613Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8779684Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8779726Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8779782Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8779880Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8780297Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8780345Z graph_break [] 2025-12-04T09:50:18.8780418Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8780606Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8780690Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8780762Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8780804Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8780859Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8780958Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8781369Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8781408Z graph_break [] 2025-12-04T09:50:18.8781480Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8781679Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8781763Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8781836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8781877Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8781933Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8782031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8782437Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8782475Z graph_break [] 2025-12-04T09:50:18.8782549Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8782738Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8782821Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8782893Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8782978Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8783035Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8783132Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8783540Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8783593Z graph_break [] 2025-12-04T09:50:18.8783666Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8783854Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8783953Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8784040Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8784080Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8784136Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8784237Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8784639Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8784676Z graph_break [] 2025-12-04T09:50:18.8784749Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8784938Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8785025Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8785096Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8785139Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8785194Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8785305Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8785712Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8785750Z graph_break [] 2025-12-04T09:50:18.8785825Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8786013Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8786097Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8786169Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8786212Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8786267Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8786366Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8786768Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8786806Z graph_break [] 2025-12-04T09:50:18.8786878Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8787079Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8787164Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8787237Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8787278Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8787334Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8787431Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8787845Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8787892Z graph_break [] 2025-12-04T09:50:18.8787964Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8788154Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8788238Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8788310Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8788351Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8788407Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8788506Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8788911Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8788948Z graph_break [] 2025-12-04T09:50:18.8789030Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8789218Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8789302Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8789374Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8789417Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8789474Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8789572Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8789980Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8790016Z graph_break [] 2025-12-04T09:50:18.8790089Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8790277Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8790362Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8790435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8790478Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8790532Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8790643Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8791043Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8791080Z graph_break [] 2025-12-04T09:50:18.8791152Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8791348Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8791444Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8791541Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8791591Z Traceback (most recent call last): 2025-12-04T09:50:18.8791713Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8791753Z return value(self) 2025-12-04T09:50:18.8791790Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8791966Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8792010Z self._run_and_compare( 2025-12-04T09:50:18.8792162Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8792227Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8792330Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8792378Z raise self.failureException(msg) 2025-12-04T09:50:18.8792424Z AssertionError: False is not true 2025-12-04T09:50:18.8792427Z 2025-12-04T09:50:18.8792503Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8792718Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8792720Z 2025-12-04T09:50:18.8792810Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8792885Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8792926Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8793028Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8793128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8793504Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8793542Z graph_break [] 2025-12-04T09:50:18.8793617Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8793810Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8793894Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8793968Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8794010Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8794069Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8794168Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8794577Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8794632Z graph_break [] 2025-12-04T09:50:18.8794706Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8794895Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8794998Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8795087Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8795132Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8795188Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8795288Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8795694Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8795730Z graph_break [] 2025-12-04T09:50:18.8795804Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8795995Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8796080Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8796151Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8796196Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8796252Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8796362Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8796766Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8796804Z graph_break [] 2025-12-04T09:50:18.8796877Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8797067Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8797152Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8797224Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8797268Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8797324Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8797423Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8797824Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8797861Z graph_break [] 2025-12-04T09:50:18.8797933Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8798136Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8798223Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8798295Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8798335Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8798392Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8798492Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8798907Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8798955Z graph_break [] 2025-12-04T09:50:18.8799026Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8799217Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8799300Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8799375Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8799417Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8799473Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8799571Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8799976Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8800015Z graph_break [] 2025-12-04T09:50:18.8800101Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8800292Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8800377Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8800449Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8800493Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8800549Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8800648Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8801055Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8801091Z graph_break [] 2025-12-04T09:50:18.8801167Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8801357Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8801442Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8801516Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8801558Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8801613Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8801722Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8802126Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8802165Z graph_break [] 2025-12-04T09:50:18.8802238Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8802437Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8802532Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8802604Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8802647Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8802702Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8802804Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8803242Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8803282Z graph_break [] 2025-12-04T09:50:18.8803356Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8803544Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8803629Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8803701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8803758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8803815Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8803914Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8804320Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8804360Z graph_break [] 2025-12-04T09:50:18.8804433Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8804624Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8804708Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8804781Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8804822Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8804876Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8804974Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8805375Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8805427Z graph_break [] 2025-12-04T09:50:18.8805501Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8805689Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8805774Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8805845Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8805887Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8805941Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8806053Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8806477Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8806515Z graph_break [] 2025-12-04T09:50:18.8806589Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8806776Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8806860Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8806931Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8806974Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8807029Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8807128Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8807540Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8807578Z graph_break [] 2025-12-04T09:50:18.8807650Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8807840Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8807927Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8808001Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8808043Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8808099Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8808198Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8808604Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8808642Z graph_break [] 2025-12-04T09:50:18.8808713Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8808901Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8808984Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8809073Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8809114Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8809169Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8809267Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8809672Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8809720Z graph_break [] 2025-12-04T09:50:18.8809803Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8809993Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8810077Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8810150Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8810192Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8810247Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8810346Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8810751Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8810788Z graph_break [] 2025-12-04T09:50:18.8810861Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8811050Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8811148Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8811222Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8811265Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8811320Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8811418Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8811823Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8811860Z graph_break [] 2025-12-04T09:50:18.8811935Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8812124Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8812207Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8812280Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8812322Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8812377Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8812480Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8812886Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8812975Z graph_break [] 2025-12-04T09:50:18.8813048Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8813238Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8813321Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8813408Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8813467Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8813522Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8813620Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8814023Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8814061Z graph_break [] 2025-12-04T09:50:18.8814133Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8814322Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8814405Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8814480Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8814520Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8814579Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8814680Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8815099Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8815136Z graph_break [] 2025-12-04T09:50:18.8815209Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8815400Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8815483Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8815560Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8815604Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8815659Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8815757Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8816160Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8816199Z graph_break [] 2025-12-04T09:50:18.8816274Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8816463Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8816561Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8816634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8816677Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8816731Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8816831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8817244Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8817290Z graph_break [] 2025-12-04T09:50:18.8817363Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8817554Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8817639Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8817713Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8817758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8817812Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8817912Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8818317Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8818357Z graph_break [] 2025-12-04T09:50:18.8818429Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8818629Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8818714Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8818789Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8818830Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8818888Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8818988Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8819391Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8819430Z graph_break [] 2025-12-04T09:50:18.8819501Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8819690Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8819773Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8819848Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8819891Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8819946Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8820043Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8820459Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8820497Z graph_break [] 2025-12-04T09:50:18.8820570Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8820758Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8820875Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8820948Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8820990Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8821047Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8821145Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8821551Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8821589Z graph_break [] 2025-12-04T09:50:18.8821661Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8821852Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8821937Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8822009Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8822051Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8822105Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8822216Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8822620Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8822658Z graph_break [] 2025-12-04T09:50:18.8822731Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8822919Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8823042Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8823115Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8823157Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8823212Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8823309Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8823711Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8823750Z graph_break [] 2025-12-04T09:50:18.8823821Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8824028Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8824112Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8824185Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8824226Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8824284Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8824382Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8824803Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8824854Z graph_break [] 2025-12-04T09:50:18.8824926Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8825118Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8825201Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8825273Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8825314Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8825371Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8825470Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8825874Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8825926Z graph_break [] 2025-12-04T09:50:18.8826000Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8826188Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8826272Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8826345Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8826387Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8826442Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8826540Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8826945Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8826982Z graph_break [] 2025-12-04T09:50:18.8827055Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8827246Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8827332Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8827405Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8827448Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8827518Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8827618Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8828022Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8828059Z graph_break [] 2025-12-04T09:50:18.8828144Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8828341Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8828426Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8828499Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8828541Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8828597Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8828696Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8829100Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8829138Z graph_break [] 2025-12-04T09:50:18.8829211Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8829400Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8829483Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8829566Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8829607Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8829662Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8829760Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8830161Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8830200Z graph_break [] 2025-12-04T09:50:18.8830273Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8830463Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8830546Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8830645Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8830691Z Traceback (most recent call last): 2025-12-04T09:50:18.8830812Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8830851Z return value(self) 2025-12-04T09:50:18.8830888Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8831063Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8831105Z self._run_and_compare( 2025-12-04T09:50:18.8831268Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8831333Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8831434Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8831483Z raise self.failureException(msg) 2025-12-04T09:50:18.8831529Z AssertionError: False is not true 2025-12-04T09:50:18.8831531Z 2025-12-04T09:50:18.8831605Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8831801Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8831824Z 2025-12-04T09:50:18.8831914Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8831988Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8832030Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8832085Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8832183Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8832560Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8832598Z graph_break [] 2025-12-04T09:50:18.8832672Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8832863Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8832990Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8833064Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8833107Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8833161Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8833274Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8833681Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8833720Z graph_break [] 2025-12-04T09:50:18.8833793Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8833982Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8834068Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8834140Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8834182Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8834236Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8834335Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8834736Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8834774Z graph_break [] 2025-12-04T09:50:18.8834846Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8835058Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8835142Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8835216Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8835257Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8835313Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8835411Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8835830Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8835880Z graph_break [] 2025-12-04T09:50:18.8835952Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8836142Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8836225Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8836299Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8836340Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8836397Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8836495Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8836896Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8836943Z graph_break [] 2025-12-04T09:50:18.8837017Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8837206Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8837291Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8837363Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8837407Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8837463Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8837561Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8837968Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8838005Z graph_break [] 2025-12-04T09:50:18.8838078Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8838267Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8838353Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8838426Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8838468Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8838534Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8838633Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8839036Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8839074Z graph_break [] 2025-12-04T09:50:18.8839155Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8839354Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8839439Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8839511Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8839554Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8839610Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8839710Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8840113Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8840151Z graph_break [] 2025-12-04T09:50:18.8840222Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8840411Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8840495Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8840577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8840619Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8840675Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8840772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8841173Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8841212Z graph_break [] 2025-12-04T09:50:18.8841284Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8841475Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8841559Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8841634Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8841675Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8841733Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8841831Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8842238Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8842286Z graph_break [] 2025-12-04T09:50:18.8842359Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8842548Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8842632Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8842703Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8842746Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8842810Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8842920Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8843360Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8843397Z graph_break [] 2025-12-04T09:50:18.8843470Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8843657Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8843742Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8843814Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8843858Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8843913Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8844012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8844426Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8844465Z graph_break [] 2025-12-04T09:50:18.8844536Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8844729Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8844815Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8844886Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8844929Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8844984Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8845083Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8845484Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8845522Z graph_break [] 2025-12-04T09:50:18.8845594Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8845784Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8845868Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8845956Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8845997Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8846054Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8846151Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8846573Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8846623Z graph_break [] 2025-12-04T09:50:18.8846695Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8846886Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8846970Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8847044Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8847085Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8847141Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8847238Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8847643Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8847681Z graph_break [] 2025-12-04T09:50:18.8847755Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8847961Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8848047Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8848118Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8848161Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8848215Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8848314Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8848718Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8848756Z graph_break [] 2025-12-04T09:50:18.8848829Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8849016Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8849100Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8849171Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8849213Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8849269Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8849368Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8849773Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8849823Z graph_break [] 2025-12-04T09:50:18.8849895Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8850086Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8850170Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8850263Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8850305Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8850361Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8850460Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8850863Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8850901Z graph_break [] 2025-12-04T09:50:18.8850973Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8851162Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8851246Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8851317Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8851359Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8851416Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8851522Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8851927Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8851965Z graph_break [] 2025-12-04T09:50:18.8852038Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8852229Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8852312Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8852387Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8852428Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8852485Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8852583Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8853028Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8853066Z graph_break [] 2025-12-04T09:50:18.8853138Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8853326Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8853426Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8853498Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8853542Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8853597Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8853694Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8854113Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8854164Z graph_break [] 2025-12-04T09:50:18.8854237Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8854426Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8854509Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8854581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8854623Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8854678Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8854777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8855180Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8855218Z graph_break [] 2025-12-04T09:50:18.8855302Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8855492Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8855575Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8855647Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8855689Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8855746Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8855843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8856246Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8856284Z graph_break [] 2025-12-04T09:50:18.8856355Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8856543Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8856626Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8856698Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8856740Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8856795Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8856903Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8857305Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8857341Z graph_break [] 2025-12-04T09:50:18.8857414Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8857612Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8857711Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8857783Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8857825Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8857881Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8857979Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8858387Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8858424Z graph_break [] 2025-12-04T09:50:18.8858498Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8858687Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8858773Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8858844Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8858886Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8858951Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8859050Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8859451Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8859490Z graph_break [] 2025-12-04T09:50:18.8859563Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8859752Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8859836Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8859909Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8859951Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8860005Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8860104Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8860516Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8860570Z graph_break [] 2025-12-04T09:50:18.8860641Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8860831Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8860914Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8860986Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8861028Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8861083Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8861190Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8861613Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8861652Z graph_break [] 2025-12-04T09:50:18.8861725Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8861913Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8861995Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8862067Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8862109Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8862166Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8862263Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8862681Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8862719Z graph_break [] 2025-12-04T09:50:18.8862792Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8863013Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8863099Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8863173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8863215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8863270Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8863367Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8863769Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8863806Z graph_break [] 2025-12-04T09:50:18.8863879Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8864066Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8864151Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8864223Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8864283Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8864338Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8864440Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8864842Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8864879Z graph_break [] 2025-12-04T09:50:18.8864965Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8865167Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8865251Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8865324Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8865367Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8865422Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8865519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8865919Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8865958Z graph_break [] 2025-12-04T09:50:18.8866030Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8866220Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8866316Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8866391Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8866432Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8866488Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8866586Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8866988Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8867027Z graph_break [] 2025-12-04T09:50:18.8867099Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8867291Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8867373Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8867447Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8867488Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8867543Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8867641Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8868047Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8868096Z graph_break [] 2025-12-04T09:50:18.8868169Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8868357Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8868441Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8868515Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8868577Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8868634Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8868732Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8869138Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8869174Z graph_break [] 2025-12-04T09:50:18.8869248Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8869435Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8869520Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8869592Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8869634Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8869688Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8869788Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8870199Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8870237Z graph_break [] 2025-12-04T09:50:18.8870310Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8870498Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8870583Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8870655Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8870699Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8870753Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8870852Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8871251Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8871288Z graph_break [] 2025-12-04T09:50:18.8871361Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8871549Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8871643Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8871716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8871758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8871813Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8871910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8872323Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8872372Z graph_break [] 2025-12-04T09:50:18.8872443Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8872634Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8872718Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8872792Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8872833Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8872888Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8873028Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8873432Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8873470Z graph_break [] 2025-12-04T09:50:18.8873543Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8873746Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8873832Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8873902Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8873945Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8874000Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8874098Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8874501Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8874538Z graph_break [] 2025-12-04T09:50:18.8874612Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8874799Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8874884Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8874957Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8875000Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8875055Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8875153Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8875571Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8875608Z graph_break [] 2025-12-04T09:50:18.8875680Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8875868Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8875972Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8876082Z ______ TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda _______ 2025-12-04T09:50:18.8876130Z Traceback (most recent call last): 2025-12-04T09:50:18.8876252Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor.py", line 14842, in new_test 2025-12-04T09:50:18.8876292Z return value(self) 2025-12-04T09:50:18.8876327Z ^^^^^^^^^^^ 2025-12-04T09:50:18.8876504Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 391, in test_broadcast_with_singleton_dims 2025-12-04T09:50:18.8876545Z self._run_and_compare( 2025-12-04T09:50:18.8876698Z File "/var/lib/jenkins/pytorch/test/inductor/test_torchinductor_strided_blocks.py", line 159, in _run_and_compare 2025-12-04T09:50:18.8876761Z self.assertTrue(torch.allclose(ref, actual, **tol)) 2025-12-04T09:50:18.8876864Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:50:18.8876912Z raise self.failureException(msg) 2025-12-04T09:50:18.8876958Z AssertionError: False is not true 2025-12-04T09:50:18.8876961Z 2025-12-04T09:50:18.8877035Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8877234Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8877236Z 2025-12-04T09:50:18.8877334Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8877409Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8877450Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8877506Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8877603Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8877979Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_miss', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8878018Z graph_break [] 2025-12-04T09:50:18.8878091Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8878282Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8878366Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8878438Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8878479Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8878535Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8878632Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8879040Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8879088Z graph_break [] 2025-12-04T09:50:18.8879162Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8879350Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8879434Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8879505Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8879567Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8879623Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8879721Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8880129Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8880165Z graph_break [] 2025-12-04T09:50:18.8880239Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8880427Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8880511Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8880584Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8880625Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8880680Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8880779Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8881195Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8881233Z graph_break [] 2025-12-04T09:50:18.8881305Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8881495Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8881580Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8881651Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8881694Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8881749Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8881848Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8882252Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8882289Z graph_break [] 2025-12-04T09:50:18.8882362Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8882550Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8882644Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8882716Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8882758Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8882813Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8882910Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8883366Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8883416Z graph_break [] 2025-12-04T09:50:18.8883487Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8883679Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8883763Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8883836Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8883877Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8883933Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8884031Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8884439Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8884477Z graph_break [] 2025-12-04T09:50:18.8884549Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8884749Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8884833Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8884904Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8884947Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8885001Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8885100Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8885511Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8885548Z graph_break [] 2025-12-04T09:50:18.8885621Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8885809Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8885893Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8885966Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8886008Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8886062Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8886160Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8886577Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8886615Z graph_break [] 2025-12-04T09:50:18.8886686Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8886875Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8886971Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8887052Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8887094Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8887150Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8887248Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8887654Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8887691Z graph_break [] 2025-12-04T09:50:18.8887762Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8887952Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8888036Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8888110Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8888150Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8888206Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8888313Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8888717Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8888756Z graph_break [] 2025-12-04T09:50:18.8888828Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8889018Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8889101Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8889173Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8889215Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8889271Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8889372Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8889776Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8889813Z graph_break [] 2025-12-04T09:50:18.8889886Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8890092Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8890177Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8890250Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8890292Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8890346Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8890445Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8890857Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8890904Z graph_break [] 2025-12-04T09:50:18.8890976Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8891166Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8891250Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8891322Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8891364Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8891418Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8891519Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8891920Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8891967Z graph_break [] 2025-12-04T09:50:18.8892040Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8892228Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8892310Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8892383Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8892426Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8892481Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8892578Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8893018Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8893056Z graph_break [] 2025-12-04T09:50:18.8893128Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8893316Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8893400Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8893475Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8893516Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8893591Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8893689Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8894095Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8894132Z graph_break [] 2025-12-04T09:50:18.8894205Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8894408Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8894504Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8894577Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8894618Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8894674Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8894772Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8895176Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8895214Z graph_break [] 2025-12-04T09:50:18.8895286Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8895473Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8895558Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8895644Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8895688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8895743Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8895840Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8896242Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8896279Z graph_break [] 2025-12-04T09:50:18.8896352Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8896539Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8896623Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8896695Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8896737Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8896792Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8896889Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8897290Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8897340Z graph_break [] 2025-12-04T09:50:18.8897412Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8897604Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8897687Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8897760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8897801Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8897869Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8897977Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8898377Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8898416Z graph_break [] 2025-12-04T09:50:18.8898488Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8898677Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8898759Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8898832Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8898873Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8898929Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8899026Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8899439Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8899476Z graph_break [] 2025-12-04T09:50:18.8899549Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8899739Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8899825Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8899897Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8899938Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8899995Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8900092Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8900497Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8900533Z graph_break [] 2025-12-04T09:50:18.8900606Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8900797Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8900881Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8900965Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8901007Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8901063Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8901162Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8901578Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8901625Z graph_break [] 2025-12-04T09:50:18.8901700Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8901890Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8901975Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8902048Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8902090Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8902145Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8902242Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8902645Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8902683Z graph_break [] 2025-12-04T09:50:18.8902756Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8902982Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8903087Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8903160Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8903202Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8903257Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8903354Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8903758Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8903796Z graph_break [] 2025-12-04T09:50:18.8903868Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8904058Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8904140Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8904212Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8904253Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8904310Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8904408Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8904811Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8904862Z graph_break [] 2025-12-04T09:50:18.8904935Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8905124Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8905207Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8905291Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8905347Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8905402Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8905499Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8905905Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8905942Z graph_break [] 2025-12-04T09:50:18.8906015Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8906204Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8906288Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8906360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8906403Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8906458Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8906556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8906966Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8907005Z graph_break [] 2025-12-04T09:50:18.8907079Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8907268Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8907351Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8907423Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8907465Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8907521Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8907620Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8908029Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8908068Z graph_break [] 2025-12-04T09:50:18.8908139Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8908328Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8908423Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8908496Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8908539Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8908596Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8908694Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8909111Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8909910Z graph_break [] 2025-12-04T09:50:18.8909983Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8910173Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8910255Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8910328Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8910368Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8910424Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8910523Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8910932Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8910970Z graph_break [] 2025-12-04T09:50:18.8911053Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8911241Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8911325Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8911398Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8911439Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8911496Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8911593Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8911996Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8912033Z graph_break [] 2025-12-04T09:50:18.8912106Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8912294Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8912381Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8912455Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8912500Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8912555Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8912653Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8913117Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8913178Z graph_break [] 2025-12-04T09:50:18.8915108Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8915338Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8915441Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8915514Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8915559Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8915615Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8915715Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8916123Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8916163Z graph_break [] 2025-12-04T09:50:18.8916237Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8916431Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8916515Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8916589Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8916630Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8916700Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8916799Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8917205Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8917247Z graph_break [] 2025-12-04T09:50:18.8917320Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8917509Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8917592Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8917666Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8917707Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8917762Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8917859Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8918263Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8918301Z graph_break [] 2025-12-04T09:50:18.8918390Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8918582Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8918667Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8918740Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8918783Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8918837Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8918948Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8919366Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8919405Z graph_break [] 2025-12-04T09:50:18.8919479Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8919668Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8919754Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8919826Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8919868Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8919925Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8920023Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8920434Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8920473Z graph_break [] 2025-12-04T09:50:18.8920545Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8920735Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8920821Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8920895Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8920938Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8920996Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8921098Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8921502Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8921539Z graph_break [] 2025-12-04T09:50:18.8921611Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8921801Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8921885Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8921957Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8922011Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8922067Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8922164Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8922567Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8922604Z graph_break [] 2025-12-04T09:50:18.8922686Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8922888Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8923010Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8923086Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8923128Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8923184Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8923282Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8923686Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8923724Z graph_break [] 2025-12-04T09:50:18.8923796Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8923985Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8924069Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8924153Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8924197Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8924252Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8924350Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8924753Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8924791Z graph_break [] 2025-12-04T09:50:18.8924863Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8925052Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8925136Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8925208Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8925251Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8925305Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8925404Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8925809Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8925861Z graph_break [] 2025-12-04T09:50:18.8925934Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8926122Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8926205Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8926278Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8926334Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8926401Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8926499Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8926900Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8926939Z graph_break [] 2025-12-04T09:50:18.8927011Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8927202Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8927285Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8927360Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8927400Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8927457Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8927556Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8927971Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8928009Z graph_break [] 2025-12-04T09:50:18.8928081Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8928272Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8928355Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8928428Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8928470Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8928526Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8928624Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8929026Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8929063Z graph_break [] 2025-12-04T09:50:18.8929136Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8929326Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8929430Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8929501Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8929545Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8929600Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8929699Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8930116Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8930162Z graph_break [] 2025-12-04T09:50:18.8930236Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8930425Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8930510Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8930582Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8930624Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8930678Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8930777Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8931179Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8931219Z graph_break [] 2025-12-04T09:50:18.8931291Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8931491Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8931574Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8931647Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8931688Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8931744Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8931843Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8932246Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8932284Z graph_break [] 2025-12-04T09:50:18.8932357Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8932546Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8932628Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8932701Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:18.8932743Z frames [('total', 1), ('ok', 1)] 2025-12-04T09:50:18.8932799Z stats [('calls_captured', 8), ('unique_graphs', 1)] 2025-12-04T09:50:18.8932896Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:18.8933357Z inductor [('triton_bundler_save_kernel', 32), ('benchmarking.InductorBenchmarker.benchmark', 4), ('benchmarking.InductorBenchmarker.benchmark_gpu', 4), ('async_compile_cache_miss', 2), ('pattern_matcher_count', 1), ('pattern_matcher_nodes', 1), ('fxgraph_cache_miss', 1), ('async_compile_cache_hit', 1), ('triton_bundler_save_static_autotuner', 1)] 2025-12-04T09:50:18.8933394Z graph_break [] 2025-12-04T09:50:18.8933467Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:50:18.8933657Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/debug_utils.py:620: UserWarning: could not load None, generating random data instead 2025-12-04T09:50:18.8933752Z warn_once(f"could not load {storage_hash}, generating random data instead") 2025-12-04T09:50:18.8934038Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor_strided_blocks/inductor.test_torchinductor_strided_blocks-1ddd9dcd46a5f51c.xml - 2025-12-04T09:50:18.8934100Z =========================== short test summary info ============================ 2025-12-04T09:50:18.8934324Z FAILED [0.5422s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8934327Z 2025-12-04T09:50:18.8934403Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8934604Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8934606Z 2025-12-04T09:50:18.8934693Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8934908Z FAILED [0.4492s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8934911Z 2025-12-04T09:50:18.8934984Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8935180Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8935182Z 2025-12-04T09:50:18.8935281Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8935492Z FAILED [0.4436s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8935494Z 2025-12-04T09:50:18.8935565Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8935761Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8935764Z 2025-12-04T09:50:18.8935849Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8936059Z FAILED [0.4423s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8936062Z 2025-12-04T09:50:18.8936133Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8936327Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8936329Z 2025-12-04T09:50:18.8936412Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8936624Z FAILED [0.4488s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8936627Z 2025-12-04T09:50:18.8936697Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8936890Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8936906Z 2025-12-04T09:50:18.8936990Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8937203Z FAILED [0.4571s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8937206Z 2025-12-04T09:50:18.8937276Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8937470Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8937471Z 2025-12-04T09:50:18.8937565Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8937785Z FAILED [0.4522s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8937788Z 2025-12-04T09:50:18.8937859Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8938053Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8938055Z 2025-12-04T09:50:18.8938139Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8938349Z FAILED [0.4489s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8938351Z 2025-12-04T09:50:18.8938424Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8938617Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8938620Z 2025-12-04T09:50:18.8938704Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8938916Z FAILED [0.4537s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8938929Z 2025-12-04T09:50:18.8939000Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8939195Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8939197Z 2025-12-04T09:50:18.8939280Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8939493Z FAILED [0.4445s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8939496Z 2025-12-04T09:50:18.8939566Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8939762Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8939764Z 2025-12-04T09:50:18.8939850Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8940059Z FAILED [0.4587s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8940061Z 2025-12-04T09:50:18.8940132Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8940329Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8940332Z 2025-12-04T09:50:18.8940417Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8940627Z FAILED [0.4496s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8940642Z 2025-12-04T09:50:18.8940714Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8940908Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8940910Z 2025-12-04T09:50:18.8940994Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8941206Z FAILED [0.4581s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8941228Z 2025-12-04T09:50:18.8941299Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8941493Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8941496Z 2025-12-04T09:50:18.8941581Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8941794Z FAILED [0.4457s] inductor/test_torchinductor_strided_blocks.py::TritonBlockPointerTestGPU::test_broadcast_with_singleton_dims_cuda - AssertionError: False is not true 2025-12-04T09:50:18.8941797Z 2025-12-04T09:50:18.8941867Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:18.8942061Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_torchinductor_strided_blocks.py TritonBlockPointerTestGPU.test_broadcast_with_singleton_dims_cuda 2025-12-04T09:50:18.8942063Z 2025-12-04T09:50:18.8942148Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:18.8942222Z ================= 14 failed, 86 passed, 100 skipped in 49.33s ================== 2025-12-04T09:50:18.8942224Z 2025-12-04T09:50:18.8942436Z FINISHED PRINTING LOG FILE of inductor/test_torchinductor_strided_blocks 1/1 (test/test-reports/inductor.test_torchinductor_strided_blocks_1.1_2aff58254eebd8c0_.log) 2025-12-04T09:50:18.8942439Z 2025-12-04T09:50:18.8942593Z Finished inductor/test_torchinductor_strided_blocks 1/1 ... [2025-12-04 09:50:18.825771][2222990.385473429], took 0.97min 2025-12-04T09:50:18.8942831Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:18.9211428Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:18.9223846Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:50:18.9223904Z Uploading artifacts took 0.00 seconds 2025-12-04T09:50:18.9224049Z inductor/test_torchinductor_strided_blocks 1/1 failed! 2025-12-04T09:50:18.9229474Z Running inductor/test_deterministic 1/3 ... [2025-12-04 09:50:18.922653][2222990.482352332] 2025-12-04T09:50:18.9229592Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:18.9231468Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_deterministic.py', '--shard-id=1', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:18.922995] 2025-12-04T09:50:24.3205509Z 2025-12-04T09:50:24.3211742Z inductor/test_deterministic 1/3 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_deterministic_1.3_a904b02a19694b00_.log 2025-12-04T09:50:24.3212084Z Running 0 items in this shard: 2025-12-04T09:50:24.3212169Z 2025-12-04T09:50:24.3212332Z Finished inductor/test_deterministic 1/3 ... [2025-12-04 09:50:24.320266][2222995.87996914], took 0.09min 2025-12-04T09:50:24.3212760Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:24.4155407Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:24.4172397Z Running dynamo/test_aot_autograd 1/1 ... [2025-12-04 09:50:24.416617][2222995.976316944] 2025-12-04T09:50:24.4173717Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:24.4174307Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_aot_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:24.416903] 2025-12-04T09:50:27.1556236Z 2025-12-04T09:50:27.1557848Z dynamo/test_aot_autograd 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_aot_autograd_1.1_93dd16401683d7d6_.log 2025-12-04T09:50:27.1558266Z Running 0 items in this shard: 2025-12-04T09:50:27.1558346Z 2025-12-04T09:50:27.1558467Z Finished dynamo/test_aot_autograd 1/1 ... [2025-12-04 09:50:27.155377][2222998.715079612], took 0.05min 2025-12-04T09:50:27.1562218Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:27.2529524Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:27.2545495Z Running inductor/test_triton_kernels 1/1 ... [2025-12-04 09:50:27.254368][2222998.814067658] 2025-12-04T09:50:27.2545721Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:27.2549322Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_triton_kernels.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:27.254647] 2025-12-04T09:50:38.3624473Z 2025-12-04T09:50:38.3625327Z PRINTING LOG FILE of inductor/test_triton_kernels 1/1 (test/test-reports/inductor.test_triton_kernels_1.1_c8118b3a4e514def_.log) 2025-12-04T09:50:38.3626174Z Test results will be stored in test-reports/python-pytest/inductor.test_triton_kernels/inductor.test_triton_kernels-592f2cd89f566f44.xml 2025-12-04T09:50:38.3627155Z ============================= test session starts ============================== 2025-12-04T09:50:38.3627584Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:50:38.3627953Z cachedir: .pytest_cache 2025-12-04T09:50:38.3628381Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:50:38.3628848Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:50:38.3629098Z configfile: pytest.ini 2025-12-04T09:50:38.3629532Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:50:38.3629990Z collecting ... collected 366 items 2025-12-04T09:50:38.3630268Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:50:38.3638704Z Running 50 items in this shard: test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass, test/inductor/test_triton_kernels.py::CustomOpTests::test_subclass 2025-12-04T09:50:38.3645478Z 2025-12-04T09:50:38.3645631Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.8950s] [ 2%] 2025-12-04T09:50:38.3645969Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass FAILED [0.1338s] [ 2%] 2025-12-04T09:50:38.3646308Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0565s] [ 2%] 2025-12-04T09:50:38.3646644Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0548s] [ 2%] 2025-12-04T09:50:38.3646976Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0544s] [ 2%] 2025-12-04T09:50:38.3647300Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0549s] [ 2%] 2025-12-04T09:50:38.3647620Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0545s] [ 2%] 2025-12-04T09:50:38.3647876Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0544s] [ 2%] 2025-12-04T09:50:38.3648134Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0545s] [ 2%] 2025-12-04T09:50:38.3648390Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0546s] [ 2%] 2025-12-04T09:50:38.3648647Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0536s] [ 2%] 2025-12-04T09:50:38.3648906Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0543s] [ 2%] 2025-12-04T09:50:38.3649162Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0528s] [ 2%] 2025-12-04T09:50:38.3649419Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0528s] [ 2%] 2025-12-04T09:50:38.3649701Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0539s] [ 2%] 2025-12-04T09:50:38.3649960Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0530s] [ 2%] 2025-12-04T09:50:38.3650218Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.3071s] [ 2%] 2025-12-04T09:50:38.3650474Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0546s] [ 2%] 2025-12-04T09:50:38.3650730Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0570s] [ 2%] 2025-12-04T09:50:38.3650986Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0559s] [ 2%] 2025-12-04T09:50:38.3651283Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0554s] [ 2%] 2025-12-04T09:50:38.3651542Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0565s] [ 2%] 2025-12-04T09:50:38.3651798Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0557s] [ 2%] 2025-12-04T09:50:38.3652058Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0549s] [ 2%] 2025-12-04T09:50:38.3652316Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0569s] [ 2%] 2025-12-04T09:50:38.3652574Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0557s] [ 2%] 2025-12-04T09:50:38.3652829Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0580s] [ 2%] 2025-12-04T09:50:38.3653123Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0580s] [ 2%] 2025-12-04T09:50:38.3653385Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0560s] [ 2%] 2025-12-04T09:50:38.3653643Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0559s] [ 2%] 2025-12-04T09:50:38.3653905Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0559s] [ 2%] 2025-12-04T09:50:38.3654164Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0563s] [ 2%] 2025-12-04T09:50:38.3654420Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0553s] [ 2%] 2025-12-04T09:50:38.3654693Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0550s] [ 2%] 2025-12-04T09:50:38.3654951Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0553s] [ 2%] 2025-12-04T09:50:38.3655208Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0550s] [ 2%] 2025-12-04T09:50:38.3655464Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0554s] [ 2%] 2025-12-04T09:50:38.3655721Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0556s] [ 2%] 2025-12-04T09:50:38.3655981Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0541s] [ 2%] 2025-12-04T09:50:38.3656237Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0541s] [ 2%] 2025-12-04T09:50:38.3656496Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0545s] [ 2%] 2025-12-04T09:50:38.3656753Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0554s] [ 2%] 2025-12-04T09:50:38.3657014Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0544s] [ 2%] 2025-12-04T09:50:38.3657272Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0546s] [ 2%] 2025-12-04T09:50:38.3657514Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0583s] [ 2%] 2025-12-04T09:50:38.3657747Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0551s] [ 2%] 2025-12-04T09:50:38.3657980Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0543s] [ 2%] 2025-12-04T09:50:38.3658213Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0555s] [ 2%] 2025-12-04T09:50:38.3658444Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0563s] [ 2%] 2025-12-04T09:50:38.3658693Z inductor/test_triton_kernels.py::CustomOpTests::test_subclass PASSED [0.0552s] [ 2%] 2025-12-04T09:50:38.3658828Z 2025-12-04T09:50:38.3658887Z =================================== FAILURES =================================== 2025-12-04T09:50:38.3659059Z _________________________ CustomOpTests.test_subclass __________________________ 2025-12-04T09:50:38.3659221Z Traceback (most recent call last): 2025-12-04T09:50:38.3659430Z File "/var/lib/jenkins/pytorch/test/inductor/test_triton_kernels.py", line 3723, in test_subclass 2025-12-04T09:50:38.3659644Z self.assertEqual(out.a, expected.a) 2025-12-04T09:50:38.3659897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_dynamo/test_case.py", line 113, in assertEqual 2025-12-04T09:50:38.3660153Z return super().assertEqual(x, y, *args, **kwargs) 2025-12-04T09:50:38.3660296Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T09:50:38.3660538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:50:38.3660812Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:50:38.3660976Z AssertionError: Tensor-likes are not close! 2025-12-04T09:50:38.3661065Z 2025-12-04T09:50:38.3661116Z Mismatched elements: 3 / 3 (100.0%) 2025-12-04T09:50:38.3661297Z Greatest absolute difference: 3.6203970909118652 at index (0,) (up to 1e-05 allowed) 2025-12-04T09:50:38.3661531Z Greatest relative difference: 2.2396645545959473 at index (0,) (up to 1.3e-06 allowed) 2025-12-04T09:50:38.3661668Z 2025-12-04T09:50:38.3661745Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:38.3661978Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_triton_kernels.py CustomOpTests.test_subclass 2025-12-04T09:50:38.3662136Z 2025-12-04T09:50:38.3662229Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:38.3662435Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:38.3662612Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:50:38.3662755Z inductor [('fxgraph_cache_miss', 1)] 2025-12-04T09:50:38.3663012Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:38.3663190Z graph_break [] 2025-12-04T09:50:38.3663323Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:50:38.3663493Z stats [('calls_captured', 1), ('unique_graphs', 1)] 2025-12-04T09:50:38.3663685Z aot_autograd [('total', 1), ('autograd_cache_miss', 1), ('autograd_cache_saved', 1), ('ok', 1)] 2025-12-04T09:50:38.3663865Z inductor [('fxgraph_cache_miss', 1)] 2025-12-04T09:50:38.3663983Z graph_break [] 2025-12-04T09:50:38.3664267Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_triton_kernels/inductor.test_triton_kernels-592f2cd89f566f44.xml - 2025-12-04T09:50:38.3664584Z =========================== short test summary info ============================ 2025-12-04T09:50:38.3664843Z FAILED [0.1338s] inductor/test_triton_kernels.py::CustomOpTests::test_subclass - AssertionError: Tensor-likes are not close! 2025-12-04T09:50:38.3665030Z 2025-12-04T09:50:38.3665079Z Mismatched elements: 3 / 3 (100.0%) 2025-12-04T09:50:38.3665256Z Greatest absolute difference: 3.6203970909118652 at index (0,) (up to 1e-05 allowed) 2025-12-04T09:50:38.3665489Z Greatest relative difference: 2.2396645545959473 at index (0,) (up to 1.3e-06 allowed) 2025-12-04T09:50:38.3665624Z 2025-12-04T09:50:38.3665701Z To execute this test, run the following from the base repo dir: 2025-12-04T09:50:38.3665931Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_triton_kernels.py CustomOpTests.test_subclass 2025-12-04T09:50:38.3666088Z 2025-12-04T09:50:38.3666177Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:50:38.3666363Z ========================= 1 failed, 49 passed in 4.39s ========================= 2025-12-04T09:50:38.3666491Z 2025-12-04T09:50:38.3666665Z FINISHED PRINTING LOG FILE of inductor/test_triton_kernels 1/1 (test/test-reports/inductor.test_triton_kernels_1.1_c8118b3a4e514def_.log) 2025-12-04T09:50:38.3666870Z 2025-12-04T09:50:38.3666989Z Finished inductor/test_triton_kernels 1/1 ... [2025-12-04 09:50:38.362015][2223009.92171512], took 0.19min 2025-12-04T09:50:38.3667374Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:38.4577525Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:38.4590058Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:50:38.4590546Z Uploading artifacts took 0.00 seconds 2025-12-04T09:50:38.4590783Z inductor/test_triton_kernels 1/1 failed! 2025-12-04T09:50:38.4591116Z Running dynamo/test_fake_distributed 1/1 ... [2025-12-04 09:50:38.458722][2223010.018421281] 2025-12-04T09:50:38.4591496Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:38.4592306Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_fake_distributed.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:38.459047] 2025-12-04T09:50:40.8401353Z 2025-12-04T09:50:40.8403306Z dynamo/test_fake_distributed 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_fake_distributed_1.1_e3c29c2894d4719d_.log 2025-12-04T09:50:40.8404002Z Running 0 items in this shard: 2025-12-04T09:50:40.8404173Z 2025-12-04T09:50:40.8404501Z Finished dynamo/test_fake_distributed 1/1 ... [2025-12-04 09:50:40.839816][2223012.399517249], took 0.04min 2025-12-04T09:50:40.8407789Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:40.9386082Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:40.9404434Z Running inductor/test_triton_extension_backend 1/1 ... [2025-12-04 09:50:40.939587][2223012.499288184] 2025-12-04T09:50:40.9404815Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:40.9405661Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_triton_extension_backend.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:40.939892] 2025-12-04T09:50:47.8424083Z 2025-12-04T09:50:47.8424916Z inductor/test_triton_extension_backend 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_triton_extension_backend_1.1_77afc403e321a309_.log 2025-12-04T09:50:47.8425442Z Running 0 items in this shard: 2025-12-04T09:50:47.8425572Z 2025-12-04T09:50:47.8425770Z Finished inductor/test_triton_extension_backend 1/1 ... [2025-12-04 09:50:47.842092][2223019.401792217], took 0.12min 2025-12-04T09:50:47.8432038Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:47.9397347Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:47.9407035Z Running dynamo/test_streams 1/1 ... [2025-12-04 09:50:47.940548][2223019.500247808] 2025-12-04T09:50:47.9407310Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:47.9409943Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'dynamo/test_streams.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:47.940839] 2025-12-04T09:50:50.2074452Z 2025-12-04T09:50:50.2074945Z dynamo/test_streams 1/1 was successful, full logs can be found in artifacts with path test/test-reports/dynamo.test_streams_1.1_85980027b13fbe23_.log 2025-12-04T09:50:50.2075476Z Running 0 items in this shard: 2025-12-04T09:50:50.2075623Z 2025-12-04T09:50:50.2075838Z Finished dynamo/test_streams 1/1 ... [2025-12-04 09:50:50.207156][2223021.766859176], took 0.04min 2025-12-04T09:50:50.2081288Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:50.3026667Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:50.3038728Z Running inductor/test_padding 1/1 ... [2025-12-04 09:50:50.303604][2223021.863303876] 2025-12-04T09:50:50.3039158Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:50.3040905Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_padding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:50.303946] 2025-12-04T09:50:56.2329467Z 2025-12-04T09:50:56.2330721Z inductor/test_padding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_padding_1.1_af63b4e489a3fc9f_.log 2025-12-04T09:50:56.2331533Z Running 0 items in this shard: 2025-12-04T09:50:56.2331751Z 2025-12-04T09:50:56.2332069Z Finished inductor/test_padding 1/1 ... [2025-12-04 09:50:56.232677][2223027.792379031], took 0.10min 2025-12-04T09:50:56.2336703Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:50:56.3281728Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:50:56.3296875Z Running export/test_retraceability 1/1 ... [2025-12-04 09:50:56.329487][2223027.889186345] 2025-12-04T09:50:56.3297354Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:50:56.3303416Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_retraceability.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:50:56.329803] 2025-12-04T09:51:06.4281782Z 2025-12-04T09:51:06.4283219Z export/test_retraceability 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_retraceability_1.1_01e6773dfa98e846_.log 2025-12-04T09:51:06.4284101Z Running 0 items in this shard: 2025-12-04T09:51:06.4284337Z 2025-12-04T09:51:06.4284678Z Finished export/test_retraceability 1/1 ... [2025-12-04 09:51:06.427882][2223037.987582473], took 0.17min 2025-12-04T09:51:06.4290218Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:51:06.5255110Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:51:06.5267325Z Running inductor/test_metrics 1/1 ... [2025-12-04 09:51:06.526583][2223038.086283946] 2025-12-04T09:51:06.5267763Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:51:06.5270842Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_metrics.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:51:06.526894] 2025-12-04T09:51:13.5329887Z 2025-12-04T09:51:13.5330626Z inductor/test_metrics 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_metrics_1.1_1e48bd5585daad7b_.log 2025-12-04T09:51:13.5330951Z Running 0 items in this shard: 2025-12-04T09:51:13.5331743Z 2025-12-04T09:51:13.5331860Z Finished inductor/test_metrics 1/1 ... [2025-12-04 09:51:13.532641][2223045.092342654], took 0.12min 2025-12-04T09:51:13.5337083Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:51:13.6270917Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:51:13.6280077Z Running export/test_cpp_serdes 1/1 ... [2025-12-04 09:51:13.627844][2223045.187544253] 2025-12-04T09:51:13.6280288Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:51:13.6282636Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'export/test_cpp_serdes.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:51:13.628128] 2025-12-04T09:51:21.2081371Z 2025-12-04T09:51:21.2082452Z export/test_cpp_serdes 1/1 was successful, full logs can be found in artifacts with path test/test-reports/export.test_cpp_serdes_1.1_decb29bde446304d_.log 2025-12-04T09:51:21.2083317Z Running 0 items in this shard: 2025-12-04T09:51:21.2083528Z 2025-12-04T09:51:21.2083809Z Finished export/test_cpp_serdes 1/1 ... [2025-12-04 09:51:21.207891][2223052.767590734], took 0.13min 2025-12-04T09:51:21.2092143Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:51:21.3030841Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:51:21.3042549Z Running inductor/test_benchmark_fusion 1/1 ... [2025-12-04 09:51:21.304075][2223052.863774967] 2025-12-04T09:51:21.3043057Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:51:21.3046375Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_benchmark_fusion.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:51:21.304408] 2025-12-04T09:56:14.1900597Z 2025-12-04T09:56:14.1902784Z PRINTING LOG FILE of inductor/test_benchmark_fusion 1/1 (test/test-reports/inductor.test_benchmark_fusion_1.1_8bc5215c8b38b324_.log) 2025-12-04T09:56:14.1903677Z Test results will be stored in test-reports/python-pytest/inductor.test_benchmark_fusion/inductor.test_benchmark_fusion-a2b230cc22b80f43.xml 2025-12-04T09:56:14.1904173Z ============================= test session starts ============================== 2025-12-04T09:56:14.1904570Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:56:14.1904917Z cachedir: .pytest_cache 2025-12-04T09:56:14.1905317Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:56:14.1905751Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:56:14.1905959Z configfile: pytest.ini 2025-12-04T09:56:14.1906364Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:56:14.1906778Z collecting ... collected 16 items 2025-12-04T09:56:14.1907027Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:56:14.1925754Z Running 100 items in this shard: test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code, test/inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code 2025-12-04T09:56:14.1940279Z 2025-12-04T09:56:14.1940481Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [6.7901s] [ 1%] 2025-12-04T09:56:14.1941020Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:51:36.090000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1941664Z E1204 09:51:36.090000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1942151Z E1204 09:51:36.090000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1942463Z E1204 09:51:36.126000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1942971Z E1204 09:51:36.126000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1943430Z E1204 09:51:36.126000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1943641Z PASSED [2.1372s] [ 2%] 2025-12-04T09:56:14.1943905Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6066s] [ 2%] 2025-12-04T09:56:14.1944330Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.9462s] [ 2%] 2025-12-04T09:56:14.1944750Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5540s] [ 2%] 2025-12-04T09:56:14.1945166Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.3825s] [ 2%] 2025-12-04T09:56:14.1945581Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.4143s] [ 2%] 2025-12-04T09:56:14.1945997Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.4851s] [ 2%] 2025-12-04T09:56:14.1946410Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.0472s] [ 2%] 2025-12-04T09:56:14.1946848Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8122s] [ 2%] 2025-12-04T09:56:14.1947261Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.0270s] [ 2%] 2025-12-04T09:56:14.1947678Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.2387s] [ 2%] 2025-12-04T09:56:14.1948135Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [4.0200s] [ 2%] 2025-12-04T09:56:14.1948568Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5793s] [ 2%] 2025-12-04T09:56:14.1948989Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5898s] [ 2%] 2025-12-04T09:56:14.1949406Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6090s] [ 2%] 2025-12-04T09:56:14.1949820Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5781s] [ 2%] 2025-12-04T09:56:14.1950238Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5968s] [ 2%] 2025-12-04T09:56:14.1950683Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.9912s] [ 2%] 2025-12-04T09:56:14.1951106Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8403s] [ 2%] 2025-12-04T09:56:14.1951526Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.9391s] [ 2%] 2025-12-04T09:56:14.1951960Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8892s] [ 2%] 2025-12-04T09:56:14.1952377Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [4.2490s] [ 2%] 2025-12-04T09:56:14.1952796Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8579s] [ 2%] 2025-12-04T09:56:14.1953259Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.6057s] [ 2%] 2025-12-04T09:56:14.1953677Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8509s] [ 2%] 2025-12-04T09:56:14.1954099Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8592s] [ 2%] 2025-12-04T09:56:14.1954519Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.5252s] [ 2%] 2025-12-04T09:56:14.1954939Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.7604s] [ 2%] 2025-12-04T09:56:14.1955356Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.7563s] [ 2%] 2025-12-04T09:56:14.1955777Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.5864s] [ 2%] 2025-12-04T09:56:14.1956212Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.7085s] [ 2%] 2025-12-04T09:56:14.1956630Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.4558s] [ 2%] 2025-12-04T09:56:14.1957046Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5832s] [ 2%] 2025-12-04T09:56:14.1957469Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5884s] [ 2%] 2025-12-04T09:56:14.1957907Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5795s] [ 2%] 2025-12-04T09:56:14.1958341Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5975s] [ 2%] 2025-12-04T09:56:14.1958757Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6030s] [ 2%] 2025-12-04T09:56:14.1959175Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6283s] [ 2%] 2025-12-04T09:56:14.1959595Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6224s] [ 2%] 2025-12-04T09:56:14.1960013Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8527s] [ 2%] 2025-12-04T09:56:14.1960432Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.6601s] [ 2%] 2025-12-04T09:56:14.1960850Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.9563s] [ 2%] 2025-12-04T09:56:14.1961283Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5117s] [ 2%] 2025-12-04T09:56:14.1961703Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5205s] [ 2%] 2025-12-04T09:56:14.1962123Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5874s] [ 2%] 2025-12-04T09:56:14.1962544Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8924s] [ 2%] 2025-12-04T09:56:14.1963005Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [3.8276s] [ 2%] 2025-12-04T09:56:14.1963423Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.6128s] [ 2%] 2025-12-04T09:56:14.1963846Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5667s] [ 2%] 2025-12-04T09:56:14.1964261Z inductor/test_benchmark_fusion.py::BenchmarkFusionGpuTest::test_tield_kernel_fusion_cuda <- test/inductor/test_torchinductor.py PASSED [2.5932s] [ 2%] 2025-12-04T09:56:14.1964790Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:12.055000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1965425Z E1204 09:54:12.055000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1965904Z E1204 09:54:12.055000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1966220Z E1204 09:54:12.094000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1966698Z E1204 09:54:12.094000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1967182Z E1204 09:54:12.094000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1967409Z PASSED [1.9292s] [ 2%] 2025-12-04T09:56:14.1967772Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:13.991000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1968398Z E1204 09:54:13.991000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1968857Z E1204 09:54:13.991000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1969176Z E1204 09:54:14.029000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1969653Z E1204 09:54:14.029000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1970118Z E1204 09:54:14.029000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1970329Z PASSED [1.4665s] [ 2%] 2025-12-04T09:56:14.1970705Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:15.466000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1971328Z E1204 09:54:15.466000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1971786Z E1204 09:54:15.466000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1972099Z E1204 09:54:15.504000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1972575Z E1204 09:54:15.504000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1973080Z E1204 09:54:15.504000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1973290Z PASSED [1.4798s] [ 2%] 2025-12-04T09:56:14.1973649Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:16.978000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1974278Z E1204 09:54:16.978000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1974737Z E1204 09:54:16.978000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1975066Z E1204 09:54:17.017000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1975544Z E1204 09:54:17.017000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1976003Z E1204 09:54:17.017000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1976320Z W1204 09:54:18.746000 189568 site-packages/torch/_inductor/utils.py:1361] on error, temporary cache dir kept at /tmp/tmp0wrdnsnr 2025-12-04T09:56:14.1976583Z FAILED [2.4244s] [ 2%] 2025-12-04T09:56:14.1976942Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:19.461000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1977572Z E1204 09:54:19.461000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1978033Z E1204 09:54:19.461000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1978345Z E1204 09:54:19.498000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1978826Z E1204 09:54:19.498000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1979285Z E1204 09:54:19.498000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1979498Z PASSED [3.4736s] [ 2%] 2025-12-04T09:56:14.1979870Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:22.841000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1980493Z E1204 09:54:22.841000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1980955Z E1204 09:54:22.841000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1981268Z E1204 09:54:22.879000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1981746Z E1204 09:54:22.879000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1982205Z E1204 09:54:22.879000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1982414Z PASSED [2.8323s] [ 2%] 2025-12-04T09:56:14.1982772Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:25.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1983432Z E1204 09:54:25.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1983889Z E1204 09:54:25.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1984199Z E1204 09:54:25.725000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1984708Z E1204 09:54:25.725000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1985164Z E1204 09:54:25.725000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1985375Z PASSED [1.7101s] [ 2%] 2025-12-04T09:56:14.1985750Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:27.779000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1986391Z E1204 09:54:27.779000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1986848Z E1204 09:54:27.779000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1987163Z E1204 09:54:27.818000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1987639Z E1204 09:54:27.818000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1988097Z E1204 09:54:27.818000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1988308Z PASSED [3.1312s] [ 2%] 2025-12-04T09:56:14.1988669Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:30.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1989309Z E1204 09:54:30.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1989767Z E1204 09:54:30.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1990077Z E1204 09:54:30.622000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1990559Z E1204 09:54:30.622000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1991016Z E1204 09:54:30.622000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1991228Z PASSED [3.5388s] [ 2%] 2025-12-04T09:56:14.1991588Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:34.067000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1992215Z E1204 09:54:34.067000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1992674Z E1204 09:54:34.067000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1993032Z E1204 09:54:34.104000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1993506Z E1204 09:54:34.104000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1993982Z E1204 09:54:34.104000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1994192Z PASSED [1.5413s] [ 2%] 2025-12-04T09:56:14.1994553Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:35.649000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1995192Z E1204 09:54:35.649000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1995668Z E1204 09:54:35.649000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1995980Z E1204 09:54:35.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1996458Z E1204 09:54:35.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1996916Z E1204 09:54:35.688000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1997123Z PASSED [2.9611s] [ 2%] 2025-12-04T09:56:14.1997482Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:38.565000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1998107Z E1204 09:54:38.565000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1998582Z E1204 09:54:38.565000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.1998898Z E1204 09:54:38.602000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.1999371Z E1204 09:54:38.602000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.1999832Z E1204 09:54:38.602000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2000040Z PASSED [1.4525s] [ 2%] 2025-12-04T09:56:14.2000398Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:40.015000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2001020Z E1204 09:54:40.015000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2001477Z E1204 09:54:40.015000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2001787Z E1204 09:54:40.052000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2002260Z E1204 09:54:40.052000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2002726Z E1204 09:54:40.052000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2002969Z PASSED [1.6057s] [ 2%] 2025-12-04T09:56:14.2003326Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:41.774000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2003943Z E1204 09:54:41.774000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2004414Z E1204 09:54:41.774000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2004735Z E1204 09:54:41.813000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2005207Z E1204 09:54:41.813000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2005660Z E1204 09:54:41.813000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2005865Z PASSED [1.7022s] [ 2%] 2025-12-04T09:56:14.2006218Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:43.334000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2006840Z E1204 09:54:43.334000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2007293Z E1204 09:54:43.334000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2007612Z E1204 09:54:43.379000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2008081Z E1204 09:54:43.379000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2008533Z E1204 09:54:43.379000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2008735Z PASSED [3.5696s] [ 2%] 2025-12-04T09:56:14.2009091Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:46.914000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2009716Z E1204 09:54:46.914000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2010173Z E1204 09:54:46.914000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2010480Z E1204 09:54:46.955000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2010951Z E1204 09:54:46.955000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2011408Z E1204 09:54:46.955000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2011613Z PASSED [2.8480s] [ 2%] 2025-12-04T09:56:14.2011987Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:49.745000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2012604Z E1204 09:54:49.745000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2013101Z E1204 09:54:49.745000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2013428Z E1204 09:54:49.782000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2013910Z E1204 09:54:49.782000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2014367Z E1204 09:54:49.782000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2014571Z PASSED [1.4937s] [ 2%] 2025-12-04T09:56:14.2014926Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:51.241000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2015549Z E1204 09:54:51.241000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2016002Z E1204 09:54:51.241000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2016306Z E1204 09:54:51.279000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2016801Z E1204 09:54:51.279000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2017257Z E1204 09:54:51.279000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2017459Z PASSED [1.6725s] [ 2%] 2025-12-04T09:56:14.2017812Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:52.894000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2018430Z E1204 09:54:52.894000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2018883Z E1204 09:54:52.894000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2019188Z E1204 09:54:52.929000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2019659Z E1204 09:54:52.929000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2020118Z E1204 09:54:52.929000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2020324Z PASSED [1.4103s] [ 2%] 2025-12-04T09:56:14.2020684Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:54.437000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2021324Z E1204 09:54:54.437000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2021776Z E1204 09:54:54.437000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2022082Z E1204 09:54:54.480000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2029442Z E1204 09:54:54.480000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2029935Z E1204 09:54:54.480000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2030150Z PASSED [3.2071s] [ 2%] 2025-12-04T09:56:14.2030522Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:57.520000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2031192Z E1204 09:54:57.520000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2031654Z E1204 09:54:57.520000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2031971Z E1204 09:54:57.556000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2032452Z E1204 09:54:57.556000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2032967Z E1204 09:54:57.556000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2033180Z PASSED [1.6651s] [ 2%] 2025-12-04T09:56:14.2033540Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:54:59.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2034164Z E1204 09:54:59.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2034626Z E1204 09:54:59.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2034939Z E1204 09:54:59.245000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2035417Z E1204 09:54:59.245000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2035874Z E1204 09:54:59.245000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2036083Z PASSED [3.1714s] [ 2%] 2025-12-04T09:56:14.2036441Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:02.852000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2037066Z E1204 09:55:02.852000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2037550Z E1204 09:55:02.852000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2037855Z E1204 09:55:02.891000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2038324Z E1204 09:55:02.891000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2038792Z E1204 09:55:02.891000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2039011Z PASSED [3.3694s] [ 2%] 2025-12-04T09:56:14.2039364Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:05.755000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2039983Z E1204 09:55:05.755000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2040438Z E1204 09:55:05.755000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2040744Z E1204 09:55:05.797000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2041217Z E1204 09:55:05.797000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2041670Z E1204 09:55:05.797000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2041876Z PASSED [2.8335s] [ 2%] 2025-12-04T09:56:14.2042247Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:08.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2042870Z E1204 09:55:08.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2043373Z E1204 09:55:08.584000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2043681Z E1204 09:55:08.623000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2044152Z E1204 09:55:08.623000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2044606Z E1204 09:55:08.623000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2044812Z PASSED [2.9581s] [ 2%] 2025-12-04T09:56:14.2045168Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:11.560000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2045791Z E1204 09:55:11.560000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2046249Z E1204 09:55:11.560000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2046575Z E1204 09:55:11.598000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2047046Z E1204 09:55:11.598000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2047498Z E1204 09:55:11.598000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2047701Z PASSED [2.9249s] [ 2%] 2025-12-04T09:56:14.2048090Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:14.464000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2048724Z E1204 09:55:14.464000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2049181Z E1204 09:55:14.464000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2049491Z E1204 09:55:14.503000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2049962Z E1204 09:55:14.503000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2050417Z E1204 09:55:14.503000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2050623Z PASSED [3.0734s] [ 2%] 2025-12-04T09:56:14.2050976Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:17.569000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2051630Z E1204 09:55:17.569000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2052088Z E1204 09:55:17.569000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2052395Z E1204 09:55:17.611000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2052868Z E1204 09:55:17.611000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2053348Z E1204 09:55:17.611000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2053552Z PASSED [2.9388s] [ 2%] 2025-12-04T09:56:14.2053909Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:20.476000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2054529Z E1204 09:55:20.476000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2054987Z E1204 09:55:20.476000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2055295Z E1204 09:55:20.514000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2055784Z E1204 09:55:20.514000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2056236Z E1204 09:55:20.514000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2056438Z PASSED [1.5016s] [ 2%] 2025-12-04T09:56:14.2056793Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:21.977000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2057444Z E1204 09:55:21.977000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2057901Z E1204 09:55:21.977000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2058208Z E1204 09:55:22.014000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2058678Z E1204 09:55:22.014000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2059132Z E1204 09:55:22.014000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2059339Z PASSED [2.6247s] [ 2%] 2025-12-04T09:56:14.2059694Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:25.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2060326Z E1204 09:55:25.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2060780Z E1204 09:55:25.207000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2061087Z E1204 09:55:25.246000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2061561Z E1204 09:55:25.246000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2062014Z E1204 09:55:25.246000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2062220Z PASSED [2.3073s] [ 2%] 2025-12-04T09:56:14.2062574Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:26.933000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2063244Z E1204 09:55:26.933000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2063700Z E1204 09:55:26.933000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2064009Z E1204 09:55:26.971000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2064480Z E1204 09:55:26.971000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2064959Z E1204 09:55:26.971000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2065163Z PASSED [1.5552s] [ 2%] 2025-12-04T09:56:14.2065516Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:28.486000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2066148Z E1204 09:55:28.486000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2066615Z E1204 09:55:28.486000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2066924Z E1204 09:55:28.524000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2067400Z E1204 09:55:28.524000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2067851Z E1204 09:55:28.524000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2068055Z PASSED [1.6235s] [ 2%] 2025-12-04T09:56:14.2068409Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:30.125000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2069031Z E1204 09:55:30.125000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2069485Z E1204 09:55:30.125000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2069807Z E1204 09:55:30.164000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2070278Z E1204 09:55:30.164000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2070735Z E1204 09:55:30.164000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2070939Z PASSED [1.5989s] [ 2%] 2025-12-04T09:56:14.2071294Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:31.695000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2071916Z E1204 09:55:31.695000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2072368Z E1204 09:55:31.695000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2072679Z E1204 09:55:31.733000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2073188Z E1204 09:55:31.733000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2073641Z E1204 09:55:31.733000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2073866Z PASSED [1.5301s] [ 2%] 2025-12-04T09:56:14.2074220Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:33.251000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2074835Z E1204 09:55:33.251000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2075314Z E1204 09:55:33.251000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2075642Z E1204 09:55:33.294000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2076116Z E1204 09:55:33.294000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2076569Z E1204 09:55:33.294000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2076773Z PASSED [1.5425s] [ 2%] 2025-12-04T09:56:14.2077128Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:34.796000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2077743Z E1204 09:55:34.796000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2078203Z E1204 09:55:34.796000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2078510Z E1204 09:55:34.834000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2078999Z E1204 09:55:34.834000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2079451Z E1204 09:55:34.834000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2079653Z PASSED [2.8268s] [ 2%] 2025-12-04T09:56:14.2080007Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:37.620000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2080626Z E1204 09:55:37.620000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2081079Z E1204 09:55:37.620000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2081386Z E1204 09:55:37.658000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2081859Z E1204 09:55:37.658000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2082313Z E1204 09:55:37.658000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2082518Z PASSED [3.0254s] [ 2%] 2025-12-04T09:56:14.2082873Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:41.113000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2083549Z E1204 09:55:41.113000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2083999Z E1204 09:55:41.113000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2084306Z E1204 09:55:41.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2084794Z E1204 09:55:41.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2085276Z E1204 09:55:41.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2085480Z PASSED [3.1054s] [ 2%] 2025-12-04T09:56:14.2085834Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:43.760000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2086454Z E1204 09:55:43.760000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2086910Z E1204 09:55:43.760000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2087218Z E1204 09:55:43.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2087687Z E1204 09:55:43.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2088157Z E1204 09:55:43.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2088363Z PASSED [3.7256s] [ 2%] 2025-12-04T09:56:14.2088716Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:47.458000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2089335Z E1204 09:55:47.458000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2089786Z E1204 09:55:47.458000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2090092Z E1204 09:55:47.496000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2090565Z E1204 09:55:47.496000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2091019Z E1204 09:55:47.496000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2091223Z PASSED [2.7158s] [ 2%] 2025-12-04T09:56:14.2091583Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:50.181000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2092201Z E1204 09:55:50.181000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2092685Z E1204 09:55:50.181000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2093022Z E1204 09:55:50.218000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2093517Z E1204 09:55:50.218000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2093991Z E1204 09:55:50.218000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2094197Z PASSED [2.9171s] [ 2%] 2025-12-04T09:56:14.2094552Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:53.112000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2095173Z E1204 09:55:53.112000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2095628Z E1204 09:55:53.112000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2095936Z E1204 09:55:53.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2096414Z E1204 09:55:53.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2096871Z E1204 09:55:53.150000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2097077Z PASSED [2.9198s] [ 2%] 2025-12-04T09:56:14.2097451Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:56.042000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2098077Z E1204 09:55:56.042000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2098531Z E1204 09:55:56.042000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2098840Z E1204 09:55:56.081000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2099314Z E1204 09:55:56.081000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2099768Z E1204 09:55:56.081000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2099976Z PASSED [3.0122s] [ 2%] 2025-12-04T09:56:14.2100335Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:55:59.045000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2100959Z E1204 09:55:59.045000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2101436Z E1204 09:55:59.045000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2101746Z E1204 09:55:59.083000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2102219Z E1204 09:55:59.083000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2102672Z E1204 09:55:59.083000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2102899Z PASSED [1.7512s] [ 2%] 2025-12-04T09:56:14.2103307Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:56:00.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2103930Z E1204 09:56:00.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2104386Z E1204 09:56:00.801000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2104694Z E1204 09:56:00.840000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2105169Z E1204 09:56:00.840000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2105631Z E1204 09:56:00.840000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2105839Z PASSED [1.4960s] [ 2%] 2025-12-04T09:56:14.2106221Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:56:02.293000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2106843Z E1204 09:56:02.293000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2107297Z E1204 09:56:02.293000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2107605Z E1204 09:56:02.332000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2108079Z E1204 09:56:02.332000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2108539Z E1204 09:56:02.332000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2108744Z PASSED [3.7811s] [ 2%] 2025-12-04T09:56:14.2109104Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:56:06.057000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2109730Z E1204 09:56:06.057000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2110185Z E1204 09:56:06.057000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2110514Z E1204 09:56:06.093000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2110991Z E1204 09:56:06.093000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2111450Z E1204 09:56:06.093000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2111657Z PASSED [2.6212s] [ 2%] 2025-12-04T09:56:14.2112036Z inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code E1204 09:56:08.684000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2112667Z E1204 09:56:08.684000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2113159Z E1204 09:56:08.684000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2113470Z E1204 09:56:08.719000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Runtime error during autotuning: 2025-12-04T09:56:14.2113946Z E1204 09:56:08.719000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] No valid triton configs. OutOfMemoryError: out of resource: triton_mm Required: 65536 Hardware limit:65536 Reducing block sizes or `num_stages` may help.. 2025-12-04T09:56:14.2114404Z E1204 09:56:08.719000 189568 site-packages/torch/_inductor/select_algorithm.py:3696] [0/0] Ignoring this choice. 2025-12-04T09:56:14.2114610Z PASSED [2.7562s] [ 2%] 2025-12-04T09:56:14.2114677Z 2025-12-04T09:56:14.2114738Z =================================== FAILURES =================================== 2025-12-04T09:56:14.2114949Z ______ BenchmarkMultiTemplateFusionGpuTest.test_equivalent_template_code _______ 2025-12-04T09:56:14.2115147Z Traceback (most recent call last): 2025-12-04T09:56:14.2115412Z File "/var/lib/jenkins/pytorch/test/inductor/test_benchmark_fusion.py", line 303, in test_equivalent_template_code 2025-12-04T09:56:14.2115681Z ).check("" if config.cpp_wrapper else "return").run(out_code[0]) 2025-12-04T09:56:14.2115846Z ^^^^^^^^^^^^^^^^ 2025-12-04T09:56:14.2116037Z RuntimeError: Expected to find "triton_tem_fused_addmm_relu_t_0" but did not find it 2025-12-04T09:56:14.2116216Z Searched string: 2025-12-04T09:56:14.2116329Z with torch.cuda._DeviceGuard(0): 2025-12-04T09:56:14.2116463Z torch.cuda.set_device(0) 2025-12-04T09:56:14.2116620Z buf0 = empty_strided_cuda((256, 256), (256, 1), torch.float16) 2025-12-04T09:56:14.2116828Z # Topologically Sorted Source Nodes: [a], Original ATen: [aten.t, aten.addmm] 2025-12-04T09:56:14.2117013Z stream0 = get_raw_stream(0) 2025-12-04T09:56:14.2117186Z triton_tem_fused_addmm_t_0.run(arg2_1, arg0_1, buf0, 64, 1, 1, stream=stream0) 2025-12-04T09:56:14.2117354Z del arg0_1 2025-12-04T09:56:14.2117460Z del arg2_1 2025-12-04T09:56:14.2117571Z buf1 = buf0; del buf0 # reuse 2025-12-04T09:56:14.2117762Z # Topologically Sorted Source Nodes: [a, relu], Original ATen: [aten.addmm, aten.relu] 2025-12-04T09:56:14.2117950Z stream0 = get_raw_stream(0) 2025-12-04T09:56:14.2118113Z triton_poi_fused_addmm_relu_1.run(buf1, arg1_1, 65536, stream=stream0) 2025-12-04T09:56:14.2118274Z del arg1_1 2025-12-04T09:56:14.2118380Z return (buf1, ) 2025-12-04T09:56:14.2118448Z 2025-12-04T09:56:14.2118497Z runner = Runner(partitions=[]) 2025-12-04T09:56:14.2118614Z call = runner.call 2025-12-04T09:56:14.2118750Z recursively_apply_fns = runner.recursively_apply_fns 2025-12-04T09:56:14.2118885Z 2025-12-04T09:56:14.2118886Z 2025-12-04T09:56:14.2118949Z def benchmark_compiled_module(times=10, repeat=10): 2025-12-04T09:56:14.2119104Z from torch._dynamo.testing import rand_strided 2025-12-04T09:56:14.2119264Z from torch._inductor.utils import print_performance 2025-12-04T09:56:14.2119453Z arg0_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2119658Z arg1_1 = rand_strided((256, ), (1, ), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2119858Z arg2_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2120035Z fn = lambda: call([arg0_1, arg1_1, arg2_1]) 2025-12-04T09:56:14.2120220Z return print_performance(fn, times=times, repeat=repeat) 2025-12-04T09:56:14.2120350Z 2025-12-04T09:56:14.2120352Z 2025-12-04T09:56:14.2120397Z if __name__ == "__main__": 2025-12-04T09:56:14.2120550Z from torch._inductor.wrapper_benchmark import compiled_module_main 2025-12-04T09:56:14.2120741Z compiled_module_main('None', benchmark_compiled_module) 2025-12-04T09:56:14.2120899Z From CHECK: triton_tem_fused_addmm_relu_t_0 2025-12-04T09:56:14.2120989Z 2025-12-04T09:56:14.2120991Z 2025-12-04T09:56:14.2121067Z To execute this test, run the following from the base repo dir: 2025-12-04T09:56:14.2121370Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_benchmark_fusion.py BenchmarkMultiTemplateFusionGpuTest.test_equivalent_template_code 2025-12-04T09:56:14.2121597Z 2025-12-04T09:56:14.2121686Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:56:14.2121896Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:56:14.2122062Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:56:14.2122198Z stats [('calls_captured', 4), ('unique_graphs', 2)] 2025-12-04T09:56:14.2122399Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:56:14.2123234Z inductor [('triton_bundler_save_kernel', 488), ('benchmarking.InductorBenchmarker.benchmark_gpu', 57), ('async_compile_cache_miss', 44), ('generated_module_cache_miss', 36), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_hit', 36), ('benchmarking.InductorBenchmarker.benchmark', 21), ('coordesc_tuning_bench', 12), ('fxgraph_cache_miss', 2), ('pattern_matcher_count', 2), ('pattern_matcher_nodes', 2), ('triton_bundler_save_static_autotuner', 2), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1)] 2025-12-04T09:56:14.2123933Z graph_break [] 2025-12-04T09:56:14.2124043Z aten_mm_info [('aten.mm_256_256_256', 2)] 2025-12-04T09:56:14.2124201Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:56:14.2124806Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/_inductor/select_algorithm.py:3433: UserWarning: TypedStorage is deprecated. It will be removed in the future and UntypedStorage will be the only storage class. This should only matter to you if you are using storages directly. To access UntypedStorage directly, use tensor.untyped_storage() instead of tensor.storage() 2025-12-04T09:56:14.2125371Z current_size = base.storage().size() 2025-12-04T09:56:14.2125498Z Autotune Choices Stats: 2025-12-04T09:56:14.2125949Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_7", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:56:14.2126398Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:56:14.2126516Z strides: [256, 1], [1, 256] 2025-12-04T09:56:14.2126637Z dtypes: torch.float16, torch.float16 2025-12-04T09:56:14.2126962Z triton_mm_7 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2127496Z triton_mm_3 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2128006Z triton_mm_4 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2128534Z triton_mm_5 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:56:14.2129051Z triton_mm_8 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2129553Z triton_mm_9 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2130064Z triton_mm_1 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:56:14.2130578Z triton_mm_12 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2131091Z triton_mm_11 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2131610Z triton_mm_13 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2132018Z SingleProcess AUTOTUNE benchmarking takes 0.2067 seconds and 0.4095 seconds precompiling for 36 choices 2025-12-04T09:56:14.2132329Z Compiled module path: /tmp/tmp35suiot7/t6/ct6l3jqviv7tzvhrsjcetfruj2i6dxtetzrzxbzvvkhijcog7o5q.py 2025-12-04T09:56:14.2132650Z Compiled module path: /tmp/tmp35suiot7/fr/cfr3gwotp7qustu5rrp2pfsjdsoxtgr6ha56mv2xptavfzdih5ao.py 2025-12-04T09:56:14.2132903Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:56:14.2133114Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:56:14.2133246Z stats [('calls_captured', 4), ('unique_graphs', 2)] 2025-12-04T09:56:14.2133439Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:56:14.2134196Z inductor [('triton_bundler_save_kernel', 440), ('benchmarking.InductorBenchmarker.benchmark_gpu', 51), ('async_compile_cache_miss', 44), ('generated_module_cache_miss', 36), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_hit', 36), ('benchmarking.InductorBenchmarker.benchmark', 15), ('coordesc_tuning_bench', 6), ('fxgraph_cache_miss', 2), ('pattern_matcher_count', 2), ('pattern_matcher_nodes', 2), ('triton_bundler_save_static_autotuner', 2), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1)] 2025-12-04T09:56:14.2134880Z graph_break [] 2025-12-04T09:56:14.2134985Z aten_mm_info [('aten.mm_256_256_256', 2)] 2025-12-04T09:56:14.2135144Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:56:14.2135298Z Autotune Choices Stats: 2025-12-04T09:56:14.2135735Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_73", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2", "best_time": 0.005919999908655882, "best_triton_pos": 0} 2025-12-04T09:56:14.2136197Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:56:14.2136310Z strides: [256, 1], [1, 256] 2025-12-04T09:56:14.2136424Z dtypes: torch.float16, torch.float16 2025-12-04T09:56:14.2136742Z triton_mm_73 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:56:14.2137272Z triton_mm_75 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2137790Z triton_mm_77 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:56:14.2138295Z triton_mm_76 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2138796Z triton_mm_79 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2139299Z triton_mm_80 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2139803Z triton_mm_81 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2140318Z triton_mm_78 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2140816Z triton_mm_83 0.0061 ms 96.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2141317Z triton_mm_84 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2141719Z SingleProcess AUTOTUNE benchmarking takes 0.2084 seconds and 0.2480 seconds precompiling for 36 choices 2025-12-04T09:56:14.2142022Z Compiled module path: /tmp/tmpzcyumsvk/rg/crgipivzh7yvr6jii3gnj5ybtw2vlsvro6usxyvlcif6ilc5umk6.py 2025-12-04T09:56:14.2142332Z Compiled module path: /tmp/tmpzcyumsvk/em/cemqyvjlc3milbdwtjdiis6kh7n2kiixca6h76ryjf55aromdujw.py 2025-12-04T09:56:14.2142581Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:56:14.2142737Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:56:14.2142867Z stats [('calls_captured', 4), ('unique_graphs', 2)] 2025-12-04T09:56:14.2143093Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:56:14.2143850Z inductor [('triton_bundler_save_kernel', 440), ('benchmarking.InductorBenchmarker.benchmark_gpu', 51), ('async_compile_cache_miss', 44), ('generated_module_cache_miss', 36), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_hit', 36), ('benchmarking.InductorBenchmarker.benchmark', 15), ('coordesc_tuning_bench', 6), ('fxgraph_cache_miss', 2), ('pattern_matcher_count', 2), ('pattern_matcher_nodes', 2), ('triton_bundler_save_static_autotuner', 2), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1)] 2025-12-04T09:56:14.2144548Z graph_break [] 2025-12-04T09:56:14.2144650Z aten_mm_info [('aten.mm_256_256_256', 2)] 2025-12-04T09:56:14.2144807Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:56:14.2144960Z Autotune Choices Stats: 2025-12-04T09:56:14.2145411Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_147", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:56:14.2145871Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:56:14.2145987Z strides: [256, 1], [1, 256] 2025-12-04T09:56:14.2146100Z dtypes: torch.float16, torch.float16 2025-12-04T09:56:14.2146420Z triton_mm_147 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2146932Z triton_mm_151 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2147438Z triton_mm_152 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2147949Z triton_mm_153 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2148475Z triton_mm_156 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2148981Z triton_mm_149 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:56:14.2149486Z triton_mm_148 0.0061 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2149997Z triton_mm_155 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2150504Z triton_mm_145 0.0062 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:56:14.2151014Z triton_mm_157 0.0063 ms 94.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2151419Z SingleProcess AUTOTUNE benchmarking takes 0.2101 seconds and 0.2528 seconds precompiling for 36 choices 2025-12-04T09:56:14.2151726Z Compiled module path: /tmp/tmpw3ku5ga7/sw/csw6nuzphtjdngq62jzfdbceeoqf2p6i7nyri65n6m5pifiguzh4.py 2025-12-04T09:56:14.2157443Z Compiled module path: /tmp/tmpw3ku5ga7/ms/cmsacw5wvncgiswvprkzaggh2h6qgt4gejjk4oft3dehyv4gp3up.py 2025-12-04T09:56:14.2157760Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:56:14.2157920Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:56:14.2158054Z stats [('calls_captured', 4), ('unique_graphs', 2)] 2025-12-04T09:56:14.2158250Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:56:14.2159017Z inductor [('triton_bundler_save_kernel', 440), ('benchmarking.InductorBenchmarker.benchmark_gpu', 51), ('async_compile_cache_miss', 44), ('generated_module_cache_miss', 36), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_hit', 36), ('benchmarking.InductorBenchmarker.benchmark', 15), ('coordesc_tuning_bench', 6), ('fxgraph_cache_miss', 2), ('pattern_matcher_count', 2), ('pattern_matcher_nodes', 2), ('triton_bundler_save_static_autotuner', 2), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1)] 2025-12-04T09:56:14.2159713Z graph_break [] 2025-12-04T09:56:14.2159860Z aten_mm_info [('aten.mm_256_256_256', 2)] 2025-12-04T09:56:14.2160020Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:56:14.2160177Z Autotune Choices Stats: 2025-12-04T09:56:14.2160615Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_220", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005880000069737434, "best_triton_pos": 0} 2025-12-04T09:56:14.2161068Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:56:14.2161182Z strides: [256, 1], [1, 256] 2025-12-04T09:56:14.2161300Z dtypes: torch.float16, torch.float16 2025-12-04T09:56:14.2161624Z triton_mm_220 0.0059 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2162138Z triton_mm_223 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2162655Z triton_mm_217 0.0060 ms 98.7% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:56:14.2163234Z triton_mm_224 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2163745Z triton_mm_225 0.0060 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2164252Z triton_mm_221 0.0060 ms 97.4% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:56:14.2164760Z triton_mm_219 0.0061 ms 96.1% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2165265Z triton_mm_227 0.0062 ms 95.5% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2165834Z triton_mm_228 0.0062 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2166356Z triton_mm_222 0.0063 ms 93.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=32, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2166755Z SingleProcess AUTOTUNE benchmarking takes 0.2129 seconds and 0.2505 seconds precompiling for 36 choices 2025-12-04T09:56:14.2167060Z Compiled module path: /tmp/tmp9hmtndyd/vg/cvgpg4hlr22lwwsccm5druiqc4v73uo6yfkdgmvcwajqhniw7rka.py 2025-12-04T09:56:14.2167373Z Compiled module path: /tmp/tmp9hmtndyd/l4/cl4xdqow2kgaoqavd4tfw3gznhxq2w2eu4xxeeyqztbemry44cnz.py 2025-12-04T09:56:14.2167636Z ----------------------------- Captured stdout call ----------------------------- 2025-12-04T09:56:14.2167807Z frames [('total', 2), ('ok', 2)] 2025-12-04T09:56:14.2167939Z stats [('calls_captured', 4), ('unique_graphs', 2)] 2025-12-04T09:56:14.2168137Z aot_autograd [('total', 2), ('autograd_cache_miss', 2), ('autograd_cache_saved', 2), ('ok', 2)] 2025-12-04T09:56:14.2168931Z inductor [('triton_bundler_save_kernel', 544), ('benchmarking.InductorBenchmarker.benchmark_gpu', 82), ('async_compile_cache_miss', 52), ('benchmarking.InductorBenchmarker.benchmark', 46), ('generated_module_cache_miss', 36), ('select_algorithm_num_precompiles', 36), ('generated_module_cache_hit', 36), ('coordesc_tuning_bench', 32), ('fxgraph_cache_miss', 2), ('pattern_matcher_count', 2), ('pattern_matcher_nodes', 2), ('async_compile_cache_hit', 2), ('triton_bundler_save_static_autotuner', 2), ('select_algorithm_precompile', 1), ('select_algorithm_autotune', 1)] 2025-12-04T09:56:14.2169646Z graph_break [] 2025-12-04T09:56:14.2169753Z aten_mm_info [('aten.mm_256_256_256', 2)] 2025-12-04T09:56:14.2169911Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:56:14.2170065Z Autotune Choices Stats: 2025-12-04T09:56:14.2170509Z {"num_choices": 36, "num_triton_choices": 36, "best_kernel": "triton_mm_291", "best_kernel_desc": "ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4", "best_time": 0.005960000213235617, "best_triton_pos": 0} 2025-12-04T09:56:14.2170959Z AUTOTUNE mm(256x256, 256x256) 2025-12-04T09:56:14.2171069Z strides: [256, 1], [1, 256] 2025-12-04T09:56:14.2171184Z dtypes: torch.float16, torch.float16 2025-12-04T09:56:14.2171509Z triton_mm_291 0.0060 ms 100.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=32, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2172025Z triton_mm_295 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2172531Z triton_mm_296 0.0060 ms 99.3% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2173067Z triton_mm_289 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=256, BLOCK_M=32, BLOCK_N=16, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=2 2025-12-04T09:56:14.2173574Z triton_mm_292 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=32, BLOCK_N=64, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2174079Z triton_mm_293 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=16, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=2, num_stages=2, num_warps=4 2025-12-04T09:56:14.2175656Z triton_mm_297 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2176160Z triton_mm_300 0.0061 ms 98.0% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=128, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=16, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=8 2025-12-04T09:56:14.2176679Z triton_mm_299 0.0062 ms 96.8% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=64, BLOCK_N=64, EVEN_K=True, GROUP_M=4, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2177201Z triton_mm_307 0.0063 ms 94.9% ACC_TYPE='tl.float32', ALLOW_TF32=False, BLOCK_K=64, BLOCK_M=128, BLOCK_N=32, EVEN_K=True, GROUP_M=8, USE_FAST_ACCUM=False, kpack=2, matrix_instr_nonkdim=16, waves_per_eu=0, num_stages=2, num_warps=4 2025-12-04T09:56:14.2177613Z SingleProcess AUTOTUNE benchmarking takes 0.2162 seconds and 0.2851 seconds precompiling for 36 choices 2025-12-04T09:56:14.2177919Z Compiled module path: /tmp/tmp0wrdnsnr/5w/c5wza5ugjwawf2vysqpzqfrwdcyc2jmfglvyidq7mosllwev5lnx.py 2025-12-04T09:56:14.2178233Z Compiled module path: /tmp/tmp0wrdnsnr/ud/cudtypz7ziwj353j47w5yx6rf62tqqsv6qn2phsxh4hmmqkwgq5b.py 2025-12-04T09:56:14.2178639Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_benchmark_fusion/inductor.test_benchmark_fusion-a2b230cc22b80f43.xml - 2025-12-04T09:56:14.2178965Z =========================== short test summary info ============================ 2025-12-04T09:56:14.2179341Z FAILED [2.4244s] inductor/test_benchmark_fusion.py::BenchmarkMultiTemplateFusionGpuTest::test_equivalent_template_code - RuntimeError: Expected to find "triton_tem_fused_addmm_relu_t_0" but did not find it 2025-12-04T09:56:14.2179682Z Searched string: 2025-12-04T09:56:14.2179796Z with torch.cuda._DeviceGuard(0): 2025-12-04T09:56:14.2179927Z torch.cuda.set_device(0) 2025-12-04T09:56:14.2180078Z buf0 = empty_strided_cuda((256, 256), (256, 1), torch.float16) 2025-12-04T09:56:14.2180287Z # Topologically Sorted Source Nodes: [a], Original ATen: [aten.t, aten.addmm] 2025-12-04T09:56:14.2180465Z stream0 = get_raw_stream(0) 2025-12-04T09:56:14.2180635Z triton_tem_fused_addmm_t_0.run(arg2_1, arg0_1, buf0, 64, 1, 1, stream=stream0) 2025-12-04T09:56:14.2180799Z del arg0_1 2025-12-04T09:56:14.2180900Z del arg2_1 2025-12-04T09:56:14.2181012Z buf1 = buf0; del buf0 # reuse 2025-12-04T09:56:14.2181199Z # Topologically Sorted Source Nodes: [a, relu], Original ATen: [aten.addmm, aten.relu] 2025-12-04T09:56:14.2181387Z stream0 = get_raw_stream(0) 2025-12-04T09:56:14.2181549Z triton_poi_fused_addmm_relu_1.run(buf1, arg1_1, 65536, stream=stream0) 2025-12-04T09:56:14.2181711Z del arg1_1 2025-12-04T09:56:14.2181811Z return (buf1, ) 2025-12-04T09:56:14.2181876Z 2025-12-04T09:56:14.2181925Z runner = Runner(partitions=[]) 2025-12-04T09:56:14.2182037Z call = runner.call 2025-12-04T09:56:14.2182163Z recursively_apply_fns = runner.recursively_apply_fns 2025-12-04T09:56:14.2182267Z 2025-12-04T09:56:14.2182269Z 2025-12-04T09:56:14.2182332Z def benchmark_compiled_module(times=10, repeat=10): 2025-12-04T09:56:14.2182482Z from torch._dynamo.testing import rand_strided 2025-12-04T09:56:14.2182637Z from torch._inductor.utils import print_performance 2025-12-04T09:56:14.2182819Z arg0_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2183067Z arg1_1 = rand_strided((256, ), (1, ), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2183265Z arg2_1 = rand_strided((256, 256), (256, 1), device='cuda:0', dtype=torch.float16) 2025-12-04T09:56:14.2183441Z fn = lambda: call([arg0_1, arg1_1, arg2_1]) 2025-12-04T09:56:14.2183647Z return print_performance(fn, times=times, repeat=repeat) 2025-12-04T09:56:14.2183756Z 2025-12-04T09:56:14.2183757Z 2025-12-04T09:56:14.2183803Z if __name__ == "__main__": 2025-12-04T09:56:14.2183951Z from torch._inductor.wrapper_benchmark import compiled_module_main 2025-12-04T09:56:14.2184137Z compiled_module_main('None', benchmark_compiled_module) 2025-12-04T09:56:14.2184293Z From CHECK: triton_tem_fused_addmm_relu_t_0 2025-12-04T09:56:14.2184381Z 2025-12-04T09:56:14.2184383Z 2025-12-04T09:56:14.2184459Z To execute this test, run the following from the base repo dir: 2025-12-04T09:56:14.2184786Z PYTORCH_TEST_WITH_ROCM=1 python test/inductor/test_benchmark_fusion.py BenchmarkMultiTemplateFusionGpuTest.test_equivalent_template_code 2025-12-04T09:56:14.2185023Z 2025-12-04T09:56:14.2185115Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:56:14.2185309Z =================== 1 failed, 99 passed in 282.62s (0:04:42) =================== 2025-12-04T09:56:14.2185418Z 2025-12-04T09:56:14.2185602Z FINISHED PRINTING LOG FILE of inductor/test_benchmark_fusion 1/1 (test/test-reports/inductor.test_benchmark_fusion_1.1_8bc5215c8b38b324_.log) 2025-12-04T09:56:14.2185812Z 2025-12-04T09:56:14.2185936Z Finished inductor/test_benchmark_fusion 1/1 ... [2025-12-04 09:56:14.190083][2223345.749785816], took 4.88min 2025-12-04T09:56:14.2186327Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:56:14.2858285Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:56:14.2862624Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:56:14.2862893Z Uploading artifacts took 0.00 seconds 2025-12-04T09:56:14.2863169Z inductor/test_benchmark_fusion 1/1 failed! 2025-12-04T09:56:14.2866098Z Running inductor/test_compiled_optimizers 1/2 ... [2025-12-04 09:56:14.286492][2223345.846190934] 2025-12-04T09:56:14.2866370Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:56:14.2868472Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_compiled_optimizers.py', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:56:14.286725] 2025-12-04T09:56:21.8033633Z 2025-12-04T09:56:21.8034612Z inductor/test_compiled_optimizers 1/2 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_compiled_optimizers_1.2_1589a661eb3e7c5b_.log 2025-12-04T09:56:21.8035181Z Running 0 items in this shard: 2025-12-04T09:56:21.8035314Z 2025-12-04T09:56:21.8035518Z Finished inductor/test_compiled_optimizers 1/2 ... [2025-12-04 09:56:21.803091][2223353.362790458], took 0.13min 2025-12-04T09:56:21.8044107Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:56:21.9040501Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:56:21.9055242Z Running inductor/test_aot_inductor_utils 1/1 ... [2025-12-04 09:56:21.905341][2223353.465040884] 2025-12-04T09:56:21.9055561Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:56:21.9058878Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_aot_inductor_utils.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:56:21.905629] 2025-12-04T09:56:29.4224918Z 2025-12-04T09:56:29.4225696Z inductor/test_aot_inductor_utils 1/1 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_aot_inductor_utils_1.1_530511d7da9249b4_.log 2025-12-04T09:56:29.4226495Z Running 0 items in this shard: 2025-12-04T09:56:29.4226594Z 2025-12-04T09:56:29.4226726Z Finished inductor/test_aot_inductor_utils 1/1 ... [2025-12-04 09:56:29.422262][2223360.981965191], took 0.13min 2025-12-04T09:56:29.4230858Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:56:29.5179432Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:56:29.5187975Z Running inductor/test_control_flow 3/4 ... [2025-12-04 09:56:29.518605][2223361.078305552] 2025-12-04T09:56:29.5188176Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:56:29.5190432Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'inductor/test_control_flow.py', '--shard-id=3', '--num-shards=4', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:56:29.518914] 2025-12-04T09:56:36.1104447Z 2025-12-04T09:56:36.1105195Z inductor/test_control_flow 3/4 was successful, full logs can be found in artifacts with path test/test-reports/inductor.test_control_flow_3.4_2d1ed081ecea5b55_.log 2025-12-04T09:56:36.1105532Z Running 0 items in this shard: 2025-12-04T09:56:36.1105616Z 2025-12-04T09:56:36.1105739Z Finished inductor/test_control_flow 3/4 ... [2025-12-04 09:56:36.110110][2223367.669810717], took 0.11min 2025-12-04T09:56:36.1114015Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:56:36.2047728Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:56:36.2053161Z Running test_autograd 1/1 ... [2025-12-04 09:56:36.205170][2223367.764869953] 2025-12-04T09:56:36.2053363Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:56:36.2055944Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_autograd.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:56:36.205469] 2025-12-04T09:58:03.9627891Z 2025-12-04T09:58:03.9628785Z PRINTING LOG FILE of test_autograd 1/1 (test/test-reports/test_autograd_1.1_a4f56d936421b2fb_.log) 2025-12-04T09:58:03.9629132Z Test results will be stored in test-reports/python-pytest/test_autograd/test_autograd-fc2748e1f4477c23.xml 2025-12-04T09:58:03.9629375Z ============================= test session starts ============================== 2025-12-04T09:58:03.9629643Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:58:03.9629855Z cachedir: .pytest_cache 2025-12-04T09:58:03.9630092Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:58:03.9630372Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:58:03.9630504Z configfile: pytest.ini 2025-12-04T09:58:03.9630745Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:58:03.9630998Z collecting ... collected 659 items 2025-12-04T09:58:03.9631153Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:58:03.9655354Z Running 150 items in this shard: test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda, test/test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9676421Z 2025-12-04T09:58:03.9676770Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0006s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 0%] 2025-12-04T09:58:03.9677489Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 1%] 2025-12-04T09:58:03.9678028Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.7915s] [ 2%] 2025-12-04T09:58:03.9678554Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9679282Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9679994Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9680694Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9681404Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9682129Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9682825Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9683559Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9684255Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9684947Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9685644Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9686336Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9687031Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9687732Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9688428Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9689139Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9689849Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9690541Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9691252Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9691958Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9692653Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9693385Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9694077Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9694773Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9695469Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9696163Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9696854Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9697548Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9698248Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9698939Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9699669Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9700361Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9701068Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9701795Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9702489Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9703224Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9703915Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9704638Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9705322Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9706016Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9706711Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9707505Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9708294Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9709028Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9709802Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9710549Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9712985Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9713748Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9722613Z test_autograd.py::TestAutogradFunctional::test_hessian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9723400Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9724102Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9724793Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9725485Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9726174Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9726866Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9727560Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9728247Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9728935Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9729701Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9730425Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9731128Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9731828Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9732523Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9733257Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9733955Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.2186s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9734651Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0004s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9735348Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9736044Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9736740Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9737437Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9738129Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9738824Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9739560Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9740253Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9740973Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9741685Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9742380Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9743114Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9743809Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9744506Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9745200Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9745908Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9746614Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9747309Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9748008Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9748711Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9749432Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9750123Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9750834Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9751549Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9752243Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9753011Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9753707Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0003s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9754403Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9755097Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9755794Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9756494Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9757186Z test_autograd.py::TestAutogradFunctional::test_jacobian_vectorize_raises_no_warnings_logging_tensor <- test/autograd/test_functional.py SKIPPED [0.0002s] (Test is enabled but --rerun-disabled-tests verification mode is set, so only disabled tests are run) [ 2%] 2025-12-04T09:58:03.9757716Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6740s] [ 2%] 2025-12-04T09:58:03.9758072Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6757s] [ 2%] 2025-12-04T09:58:03.9758423Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6760s] [ 2%] 2025-12-04T09:58:03.9758772Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6743s] [ 2%] 2025-12-04T09:58:03.9759160Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6720s] [ 2%] 2025-12-04T09:58:03.9759507Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6740s] [ 2%] 2025-12-04T09:58:03.9759853Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6766s] [ 2%] 2025-12-04T09:58:03.9760198Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6743s] [ 2%] 2025-12-04T09:58:03.9760545Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6730s] [ 2%] 2025-12-04T09:58:03.9760921Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6763s] [ 2%] 2025-12-04T09:58:03.9761268Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6701s] [ 2%] 2025-12-04T09:58:03.9761619Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6676s] [ 2%] 2025-12-04T09:58:03.9761966Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6690s] [ 2%] 2025-12-04T09:58:03.9762311Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6706s] [ 2%] 2025-12-04T09:58:03.9762658Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6716s] [ 2%] 2025-12-04T09:58:03.9763041Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6682s] [ 2%] 2025-12-04T09:58:03.9763388Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6696s] [ 2%] 2025-12-04T09:58:03.9763732Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6703s] [ 2%] 2025-12-04T09:58:03.9764082Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6721s] [ 2%] 2025-12-04T09:58:03.9764427Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6679s] [ 2%] 2025-12-04T09:58:03.9764771Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6702s] [ 2%] 2025-12-04T09:58:03.9765117Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6715s] [ 2%] 2025-12-04T09:58:03.9765463Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6713s] [ 2%] 2025-12-04T09:58:03.9765810Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6683s] [ 2%] 2025-12-04T09:58:03.9766160Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6703s] [ 2%] 2025-12-04T09:58:03.9766506Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6703s] [ 2%] 2025-12-04T09:58:03.9766852Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6715s] [ 2%] 2025-12-04T09:58:03.9767198Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6688s] [ 2%] 2025-12-04T09:58:03.9767544Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6698s] [ 2%] 2025-12-04T09:58:03.9767889Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6714s] [ 2%] 2025-12-04T09:58:03.9768235Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6718s] [ 2%] 2025-12-04T09:58:03.9768630Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6696s] [ 2%] 2025-12-04T09:58:03.9768994Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6700s] [ 2%] 2025-12-04T09:58:03.9769340Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6703s] [ 2%] 2025-12-04T09:58:03.9769690Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6724s] [ 2%] 2025-12-04T09:58:03.9770035Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6683s] [ 2%] 2025-12-04T09:58:03.9770408Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6694s] [ 2%] 2025-12-04T09:58:03.9770768Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6705s] [ 2%] 2025-12-04T09:58:03.9771113Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6718s] [ 2%] 2025-12-04T09:58:03.9771459Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6689s] [ 2%] 2025-12-04T09:58:03.9771803Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6699s] [ 2%] 2025-12-04T09:58:03.9772146Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6718s] [ 2%] 2025-12-04T09:58:03.9772493Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6719s] [ 2%] 2025-12-04T09:58:03.9772838Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6690s] [ 2%] 2025-12-04T09:58:03.9773215Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6711s] [ 2%] 2025-12-04T09:58:03.9773560Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6705s] [ 2%] 2025-12-04T09:58:03.9773908Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6716s] [ 2%] 2025-12-04T09:58:03.9774254Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda FAILED [1.6678s] [ 2%] 2025-12-04T09:58:03.9774600Z test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda PASSED [1.6697s] [ 2%] 2025-12-04T09:58:03.9774796Z 2025-12-04T09:58:03.9774862Z =================================== FAILURES =================================== 2025-12-04T09:58:03.9775080Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9775286Z Traceback (most recent call last): 2025-12-04T09:58:03.9775512Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9775727Z check_ordering() 2025-12-04T09:58:03.9775902Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9776088Z self.assertTrue( 2025-12-04T09:58:03.9776268Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9776462Z raise self.failureException(msg) 2025-12-04T09:58:03.9776602Z AssertionError: False is not true 2025-12-04T09:58:03.9776684Z 2025-12-04T09:58:03.9776768Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9777064Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9777282Z 2025-12-04T09:58:03.9777380Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9777625Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9777826Z Traceback (most recent call last): 2025-12-04T09:58:03.9778091Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9778301Z check_ordering() 2025-12-04T09:58:03.9778468Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9778653Z self.assertTrue( 2025-12-04T09:58:03.9778820Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9779009Z raise self.failureException(msg) 2025-12-04T09:58:03.9779143Z AssertionError: False is not true 2025-12-04T09:58:03.9779222Z 2025-12-04T09:58:03.9779303Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9779631Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9779845Z 2025-12-04T09:58:03.9779939Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9780181Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9780379Z Traceback (most recent call last): 2025-12-04T09:58:03.9780588Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9780793Z check_ordering() 2025-12-04T09:58:03.9780961Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9781143Z self.assertTrue( 2025-12-04T09:58:03.9781307Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9781494Z raise self.failureException(msg) 2025-12-04T09:58:03.9781629Z AssertionError: False is not true 2025-12-04T09:58:03.9781708Z 2025-12-04T09:58:03.9781788Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9782078Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9782292Z 2025-12-04T09:58:03.9782385Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9782620Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9782816Z Traceback (most recent call last): 2025-12-04T09:58:03.9783070Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9783274Z check_ordering() 2025-12-04T09:58:03.9783443Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9783626Z self.assertTrue( 2025-12-04T09:58:03.9783795Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9783987Z raise self.failureException(msg) 2025-12-04T09:58:03.9784120Z AssertionError: False is not true 2025-12-04T09:58:03.9784198Z 2025-12-04T09:58:03.9784278Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9784566Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9784778Z 2025-12-04T09:58:03.9784870Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9785107Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9785306Z Traceback (most recent call last): 2025-12-04T09:58:03.9785514Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9785719Z check_ordering() 2025-12-04T09:58:03.9785893Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9786073Z self.assertTrue( 2025-12-04T09:58:03.9786234Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9786444Z raise self.failureException(msg) 2025-12-04T09:58:03.9786586Z AssertionError: False is not true 2025-12-04T09:58:03.9786667Z 2025-12-04T09:58:03.9786740Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9787023Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9787234Z 2025-12-04T09:58:03.9787325Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9787557Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9787750Z Traceback (most recent call last): 2025-12-04T09:58:03.9787975Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9788192Z check_ordering() 2025-12-04T09:58:03.9788355Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9788535Z self.assertTrue( 2025-12-04T09:58:03.9788694Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9788878Z raise self.failureException(msg) 2025-12-04T09:58:03.9789005Z AssertionError: False is not true 2025-12-04T09:58:03.9789087Z 2025-12-04T09:58:03.9789160Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9789443Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9789656Z 2025-12-04T09:58:03.9789745Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9789979Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9790177Z Traceback (most recent call last): 2025-12-04T09:58:03.9790381Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9790586Z check_ordering() 2025-12-04T09:58:03.9790751Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9790929Z self.assertTrue( 2025-12-04T09:58:03.9791092Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9791278Z raise self.failureException(msg) 2025-12-04T09:58:03.9791405Z AssertionError: False is not true 2025-12-04T09:58:03.9791486Z 2025-12-04T09:58:03.9791559Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9791842Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9792056Z 2025-12-04T09:58:03.9792150Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9792384Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9792578Z Traceback (most recent call last): 2025-12-04T09:58:03.9792784Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9793030Z check_ordering() 2025-12-04T09:58:03.9793191Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9793369Z self.assertTrue( 2025-12-04T09:58:03.9793528Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9793712Z raise self.failureException(msg) 2025-12-04T09:58:03.9793840Z AssertionError: False is not true 2025-12-04T09:58:03.9793918Z 2025-12-04T09:58:03.9793991Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9794274Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9794487Z 2025-12-04T09:58:03.9794574Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9794854Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9795049Z Traceback (most recent call last): 2025-12-04T09:58:03.9795255Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9795455Z check_ordering() 2025-12-04T09:58:03.9795617Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9795796Z self.assertTrue( 2025-12-04T09:58:03.9795958Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9796141Z raise self.failureException(msg) 2025-12-04T09:58:03.9796286Z AssertionError: False is not true 2025-12-04T09:58:03.9796388Z 2025-12-04T09:58:03.9796462Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9796752Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9796964Z 2025-12-04T09:58:03.9797051Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9797281Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9797474Z Traceback (most recent call last): 2025-12-04T09:58:03.9797678Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9797879Z check_ordering() 2025-12-04T09:58:03.9798040Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9798220Z self.assertTrue( 2025-12-04T09:58:03.9798385Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9798572Z raise self.failureException(msg) 2025-12-04T09:58:03.9798700Z AssertionError: False is not true 2025-12-04T09:58:03.9798781Z 2025-12-04T09:58:03.9798855Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9799139Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9799351Z 2025-12-04T09:58:03.9799438Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9799672Z _ TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda _ 2025-12-04T09:58:03.9799864Z Traceback (most recent call last): 2025-12-04T09:58:03.9800068Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13820, in test_side_stream_backward_overlap 2025-12-04T09:58:03.9800269Z check_ordering() 2025-12-04T09:58:03.9800435Z File "/var/lib/jenkins/pytorch/test/test_autograd.py", line 13804, in check_ordering 2025-12-04T09:58:03.9800618Z self.assertTrue( 2025-12-04T09:58:03.9800779Z File "/opt/conda/envs/py_3.12/lib/python3.12/unittest/case.py", line 727, in assertTrue 2025-12-04T09:58:03.9800965Z raise self.failureException(msg) 2025-12-04T09:58:03.9801095Z AssertionError: False is not true 2025-12-04T09:58:03.9801176Z 2025-12-04T09:58:03.9801250Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9801533Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9801746Z 2025-12-04T09:58:03.9801833Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9802136Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_autograd/test_autograd-fc2748e1f4477c23.xml - 2025-12-04T09:58:03.9802413Z =========================== short test summary info ============================ 2025-12-04T09:58:03.9802718Z FAILED [1.6743s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9802991Z 2025-12-04T09:58:03.9803110Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9803395Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9803602Z 2025-12-04T09:58:03.9803695Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9804015Z FAILED [1.6743s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9804247Z 2025-12-04T09:58:03.9804327Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9804634Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9804857Z 2025-12-04T09:58:03.9804949Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9805270Z FAILED [1.6676s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9805503Z 2025-12-04T09:58:03.9805584Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9805868Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9806082Z 2025-12-04T09:58:03.9806168Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9806487Z FAILED [1.6682s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9806720Z 2025-12-04T09:58:03.9806796Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9807080Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9807297Z 2025-12-04T09:58:03.9807384Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9807704Z FAILED [1.6679s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9807940Z 2025-12-04T09:58:03.9808014Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9808299Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9808515Z 2025-12-04T09:58:03.9808601Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9808921Z FAILED [1.6683s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9809155Z 2025-12-04T09:58:03.9809225Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9809508Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9809724Z 2025-12-04T09:58:03.9809812Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9810128Z FAILED [1.6688s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9810357Z 2025-12-04T09:58:03.9810433Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9810713Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9810923Z 2025-12-04T09:58:03.9811015Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9811335Z FAILED [1.6683s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9811601Z 2025-12-04T09:58:03.9811677Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9811957Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9812166Z 2025-12-04T09:58:03.9812256Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9812575Z FAILED [1.6689s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9812805Z 2025-12-04T09:58:03.9812897Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9813235Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9813448Z 2025-12-04T09:58:03.9813534Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9813860Z FAILED [1.6690s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9814100Z 2025-12-04T09:58:03.9814176Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9814459Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9814672Z 2025-12-04T09:58:03.9814757Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9815071Z FAILED [1.6678s] test_autograd.py::TestAutogradStreamSynchronizationCUDA::test_side_stream_backward_overlap_cuda - AssertionError: False is not true 2025-12-04T09:58:03.9815304Z 2025-12-04T09:58:03.9815375Z To execute this test, run the following from the base repo dir: 2025-12-04T09:58:03.9815655Z PYTORCH_TEST_WITH_ROCM=1 python test/test_autograd.py TestAutogradStreamSynchronizationCUDA.test_side_stream_backward_overlap_cuda 2025-12-04T09:58:03.9815866Z 2025-12-04T09:58:03.9815950Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:58:03.9816147Z ============ 11 failed, 39 passed, 100 skipped in 84.56s (0:01:24) ============= 2025-12-04T09:58:03.9816261Z 2025-12-04T09:58:03.9816393Z FINISHED PRINTING LOG FILE of test_autograd 1/1 (test/test-reports/test_autograd_1.1_a4f56d936421b2fb_.log) 2025-12-04T09:58:03.9816562Z 2025-12-04T09:58:03.9816660Z Finished test_autograd 1/1 ... [2025-12-04 09:58:03.962609][2223455.522310556], took 1.46min 2025-12-04T09:58:03.9817033Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:58:04.0579457Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:58:04.0587178Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:58:04.0587400Z Uploading artifacts took 0.00 seconds 2025-12-04T09:58:04.0587538Z test_autograd 1/1 failed! 2025-12-04T09:58:04.0590414Z Running test_dataloader 1/1 ... [2025-12-04 09:58:04.058926][2223455.61862622] 2025-12-04T09:58:04.0590621Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:58:04.0592855Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_dataloader.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:58:04.059208] 2025-12-04T09:58:07.0299439Z 2025-12-04T09:58:07.0300133Z test_dataloader 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_dataloader_1.1_258a6658ce7e2592_.log 2025-12-04T09:58:07.0300447Z Running 0 items in this shard: 2025-12-04T09:58:07.0300557Z 2025-12-04T09:58:07.0303323Z Finished test_dataloader 1/1 ... [2025-12-04 09:58:07.029719][2223458.589421977], took 0.05min 2025-12-04T09:58:07.0305753Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:58:07.1293975Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:58:07.1306380Z Running test_ops 5/5 ... [2025-12-04 09:58:07.130515][2223458.690214223] 2025-12-04T09:58:07.1306580Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:58:07.1313866Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops.py', '--shard-id=5', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:58:07.130805] 2025-12-04T09:59:02.8231633Z 2025-12-04T09:59:02.8232422Z test_ops 5/5 was successful, full logs can be found in artifacts with path test/test-reports/test_ops_5.5_9228d1c17170ffc9_.log 2025-12-04T09:59:02.8233235Z Running 0 items in this shard: 2025-12-04T09:59:02.8233574Z 2025-12-04T09:59:02.8233855Z Finished test_ops 5/5 ... [2025-12-04 09:59:02.822851][2223514.38255394], took 0.93min 2025-12-04T09:59:02.8240422Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:02.9173797Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:02.9185648Z Running test_decomp 6/11 ... [2025-12-04 09:59:02.918400][2223514.478100495] 2025-12-04T09:59:02.9186148Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:02.9188275Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_decomp.py', '--shard-id=6', '--num-shards=11', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:02.918682] 2025-12-04T09:59:16.5555569Z 2025-12-04T09:59:16.5556219Z test_decomp 6/11 was successful, full logs can be found in artifacts with path test/test-reports/test_decomp_6.11_20726cbbc77b5ff4_.log 2025-12-04T09:59:16.5556509Z Running 0 items in this shard: 2025-12-04T09:59:16.5556589Z 2025-12-04T09:59:16.5556691Z Finished test_decomp 6/11 ... [2025-12-04 09:59:16.555199][2223528.114901783], took 0.23min 2025-12-04T09:59:16.5561607Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:16.6499145Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:16.6511921Z Running test_nn 1/3 ... [2025-12-04 09:59:16.651058][2223528.210758544] 2025-12-04T09:59:16.6512121Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:16.6514233Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_nn.py', '--shard-id=1', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:16.651288] 2025-12-04T09:59:27.2282701Z 2025-12-04T09:59:27.2283608Z PRINTING LOG FILE of test_nn 1/3 (test/test-reports/test_nn_1.3_1350bff3fde7b76c_.log) 2025-12-04T09:59:27.2284384Z Test results will be stored in test-reports/python-pytest/test_nn/test_nn-d362433ea24e2ffe.xml 2025-12-04T09:59:27.2284995Z ============================= test session starts ============================== 2025-12-04T09:59:27.2285609Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T09:59:27.2286183Z cachedir: .pytest_cache 2025-12-04T09:59:27.2286880Z hypothesis profile 'no_deadline' -> database=None, deadline=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T09:59:27.2287609Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T09:59:27.2292898Z configfile: pytest.ini 2025-12-04T09:59:27.2293731Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T09:59:27.2294374Z collecting ... collected 2436 items 2025-12-04T09:59:27.2294539Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T09:59:27.2303669Z Running 100 items in this shard: test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_Linear_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32, test/test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2311928Z 2025-12-04T09:59:27.2312017Z test_nn.py::TestNN::test_Linear_cuda_tf32 FAILED [1.1745s] [ 1%] 2025-12-04T09:59:27.2312258Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 PASSED [0.4172s] [ 2%] 2025-12-04T09:59:27.2312499Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0397s] [ 2%] 2025-12-04T09:59:27.2312699Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0072s] [ 2%] 2025-12-04T09:59:27.2312899Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0069s] [ 2%] 2025-12-04T09:59:27.2313146Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0068s] [ 2%] 2025-12-04T09:59:27.2313342Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0069s] [ 2%] 2025-12-04T09:59:27.2313539Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0072s] [ 2%] 2025-12-04T09:59:27.2313736Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0068s] [ 2%] 2025-12-04T09:59:27.2313937Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2314136Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0089s] [ 2%] 2025-12-04T09:59:27.2314332Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2314569Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2314765Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0067s] [ 2%] 2025-12-04T09:59:27.2314961Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0070s] [ 2%] 2025-12-04T09:59:27.2315156Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2315353Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0065s] [ 2%] 2025-12-04T09:59:27.2315548Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0078s] [ 2%] 2025-12-04T09:59:27.2315766Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0067s] [ 2%] 2025-12-04T09:59:27.2315985Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0069s] [ 2%] 2025-12-04T09:59:27.2316180Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0069s] [ 2%] 2025-12-04T09:59:27.2316380Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0072s] [ 2%] 2025-12-04T09:59:27.2316576Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2316771Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0086s] [ 2%] 2025-12-04T09:59:27.2316967Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2317161Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2317356Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0067s] [ 2%] 2025-12-04T09:59:27.2317555Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2317751Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0068s] [ 2%] 2025-12-04T09:59:27.2317947Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0070s] [ 2%] 2025-12-04T09:59:27.2318148Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0067s] [ 2%] 2025-12-04T09:59:27.2318350Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0066s] [ 2%] 2025-12-04T09:59:27.2318547Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2318745Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0062s] [ 2%] 2025-12-04T09:59:27.2318942Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2319138Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0057s] [ 2%] 2025-12-04T09:59:27.2319333Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2319530Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2319728Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0057s] [ 2%] 2025-12-04T09:59:27.2319925Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0057s] [ 2%] 2025-12-04T09:59:27.2320129Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0057s] [ 2%] 2025-12-04T09:59:27.2320327Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2320525Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0059s] [ 2%] 2025-12-04T09:59:27.2320721Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0057s] [ 2%] 2025-12-04T09:59:27.2320917Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0059s] [ 2%] 2025-12-04T09:59:27.2321114Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0059s] [ 2%] 2025-12-04T09:59:27.2321313Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0065s] [ 2%] 2025-12-04T09:59:27.2321511Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0058s] [ 2%] 2025-12-04T09:59:27.2321708Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0059s] [ 2%] 2025-12-04T09:59:27.2323007Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0067s] [ 2%] 2025-12-04T09:59:27.2323205Z test_nn.py::TestNN::test_Linear_cuda_tf32 PASSED [0.0059s] [ 2%] 2025-12-04T09:59:27.2323443Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0661s] [ 2%] 2025-12-04T09:59:27.2323709Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0647s] [ 2%] 2025-12-04T09:59:27.2323973Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0654s] [ 2%] 2025-12-04T09:59:27.2324235Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0635s] [ 2%] 2025-12-04T09:59:27.2324532Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0618s] [ 2%] 2025-12-04T09:59:27.2324812Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0588s] [ 2%] 2025-12-04T09:59:27.2325074Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0588s] [ 2%] 2025-12-04T09:59:27.2325338Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0657s] [ 2%] 2025-12-04T09:59:27.2325600Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0658s] [ 2%] 2025-12-04T09:59:27.2325860Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0631s] [ 2%] 2025-12-04T09:59:27.2326129Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0601s] [ 2%] 2025-12-04T09:59:27.2326390Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0643s] [ 2%] 2025-12-04T09:59:27.2326653Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0623s] [ 2%] 2025-12-04T09:59:27.2326920Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0652s] [ 2%] 2025-12-04T09:59:27.2327185Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0674s] [ 2%] 2025-12-04T09:59:27.2327448Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0657s] [ 2%] 2025-12-04T09:59:27.2327709Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0598s] [ 2%] 2025-12-04T09:59:27.2327972Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0586s] [ 2%] 2025-12-04T09:59:27.2328232Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0571s] [ 2%] 2025-12-04T09:59:27.2328492Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0642s] [ 2%] 2025-12-04T09:59:27.2328753Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0645s] [ 2%] 2025-12-04T09:59:27.2329016Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0626s] [ 2%] 2025-12-04T09:59:27.2329279Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0634s] [ 2%] 2025-12-04T09:59:27.2329541Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0597s] [ 2%] 2025-12-04T09:59:27.2329804Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0624s] [ 2%] 2025-12-04T09:59:27.2330064Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0640s] [ 2%] 2025-12-04T09:59:27.2330326Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0605s] [ 2%] 2025-12-04T09:59:27.2330588Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0592s] [ 2%] 2025-12-04T09:59:27.2330849Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0588s] [ 2%] 2025-12-04T09:59:27.2331113Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0590s] [ 2%] 2025-12-04T09:59:27.2331392Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0631s] [ 2%] 2025-12-04T09:59:27.2331677Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0589s] [ 2%] 2025-12-04T09:59:27.2331940Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0573s] [ 2%] 2025-12-04T09:59:27.2332200Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0582s] [ 2%] 2025-12-04T09:59:27.2332462Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0604s] [ 2%] 2025-12-04T09:59:27.2332723Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0590s] [ 2%] 2025-12-04T09:59:27.2333033Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0610s] [ 2%] 2025-12-04T09:59:27.2333313Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0591s] [ 2%] 2025-12-04T09:59:27.2333575Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0631s] [ 2%] 2025-12-04T09:59:27.2333838Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0645s] [ 2%] 2025-12-04T09:59:27.2334098Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0612s] [ 2%] 2025-12-04T09:59:27.2334361Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0603s] [ 2%] 2025-12-04T09:59:27.2334623Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0620s] [ 2%] 2025-12-04T09:59:27.2334883Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0658s] [ 2%] 2025-12-04T09:59:27.2335144Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0637s] [ 2%] 2025-12-04T09:59:27.2335405Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0620s] [ 2%] 2025-12-04T09:59:27.2335666Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0620s] [ 2%] 2025-12-04T09:59:27.2335928Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0582s] [ 2%] 2025-12-04T09:59:27.2336188Z test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 FAILED [0.0611s] [ 2%] 2025-12-04T09:59:27.2336342Z 2025-12-04T09:59:27.2336400Z =================================== FAILURES =================================== 2025-12-04T09:59:27.2336571Z _________________________ TestNN.test_Linear_cuda_tf32 _________________________ 2025-12-04T09:59:27.2336731Z Traceback (most recent call last): 2025-12-04T09:59:27.2336909Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2337119Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2337373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3581, in test_cuda 2025-12-04T09:59:27.2337678Z test_case.assertEqual(cpu_d_i, gpu_d_i, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2337983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2338259Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2338433Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2338527Z 2025-12-04T09:59:27.2338575Z Mismatched elements: 1 / 80 (1.2%) 2025-12-04T09:59:27.2338761Z Greatest absolute difference: 0.006172716581073878 at index (0, 8) (up to 0.005 allowed) 2025-12-04T09:59:27.2339006Z Greatest relative difference: 0.0010043929000800671 at index (0, 8) (up to 0 allowed) 2025-12-04T09:59:27.2339147Z 2025-12-04T09:59:27.2339229Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2339436Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_Linear_cuda_tf32 2025-12-04T09:59:27.2339570Z 2025-12-04T09:59:27.2339681Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2339907Z ----------------------------- Captured stderr call ----------------------------- 2025-12-04T09:59:27.2340380Z /opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/backends/cudnn/__init__.py:159: UserWarning: cuDNN Benchmark limit is not supported in MIOpen and will have no effect. (Triggered internally at /var/lib/jenkins/workspace/torch/csrc/cuda/Module.cpp:1960.) 2025-12-04T09:59:27.2340844Z torch._C._cuda_set_cudnn_benchmark_limit(_benchmark_limit) 2025-12-04T09:59:27.2341051Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2341234Z Traceback (most recent call last): 2025-12-04T09:59:27.2341425Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2341617Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2341851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2342175Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2342500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2342773Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2342987Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2343082Z 2025-12-04T09:59:27.2343130Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2343319Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2343570Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2343713Z 2025-12-04T09:59:27.2343762Z The failure occurred for item [0] 2025-12-04T09:59:27.2343847Z 2025-12-04T09:59:27.2343923Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2344175Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2344350Z 2025-12-04T09:59:27.2344440Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2344662Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2344841Z Traceback (most recent call last): 2025-12-04T09:59:27.2345014Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2345190Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2345425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2345742Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2346062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2346334Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2346499Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2346593Z 2025-12-04T09:59:27.2346641Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2346830Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2347075Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2347308Z 2025-12-04T09:59:27.2347357Z The failure occurred for item [0] 2025-12-04T09:59:27.2347440Z 2025-12-04T09:59:27.2347516Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2347764Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2347939Z 2025-12-04T09:59:27.2348032Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2348297Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2348478Z Traceback (most recent call last): 2025-12-04T09:59:27.2348651Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2348826Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2349059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2349376Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2349719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2350010Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2350176Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2350266Z 2025-12-04T09:59:27.2350318Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2350510Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2350753Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2350891Z 2025-12-04T09:59:27.2350942Z The failure occurred for item [0] 2025-12-04T09:59:27.2351020Z 2025-12-04T09:59:27.2351101Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2351347Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2351517Z 2025-12-04T09:59:27.2351610Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2351835Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2352016Z Traceback (most recent call last): 2025-12-04T09:59:27.2352190Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2352370Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2352603Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2352923Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2353284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2353555Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2353722Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2353812Z 2025-12-04T09:59:27.2353864Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2354053Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2354299Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2354438Z 2025-12-04T09:59:27.2354492Z The failure occurred for item [0] 2025-12-04T09:59:27.2354570Z 2025-12-04T09:59:27.2354649Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2354894Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2355064Z 2025-12-04T09:59:27.2355157Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2355379Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2355558Z Traceback (most recent call last): 2025-12-04T09:59:27.2355731Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2355908Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2356142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2356485Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2356835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2357106Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2357272Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2357363Z 2025-12-04T09:59:27.2357413Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2357599Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2357842Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2358027Z 2025-12-04T09:59:27.2358081Z The failure occurred for item [0] 2025-12-04T09:59:27.2358160Z 2025-12-04T09:59:27.2358238Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2358482Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2358652Z 2025-12-04T09:59:27.2358745Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2358966Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2359146Z Traceback (most recent call last): 2025-12-04T09:59:27.2359319Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2359494Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2359727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2360043Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2360367Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2360643Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2360809Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2360901Z 2025-12-04T09:59:27.2360948Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2361134Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2361377Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2361518Z 2025-12-04T09:59:27.2361565Z The failure occurred for item [0] 2025-12-04T09:59:27.2361647Z 2025-12-04T09:59:27.2361722Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2361970Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2362144Z 2025-12-04T09:59:27.2362233Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2362460Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2362643Z Traceback (most recent call last): 2025-12-04T09:59:27.2362815Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2363040Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2363273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2363586Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2363909Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2364181Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2364347Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2364439Z 2025-12-04T09:59:27.2364485Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2364708Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2364952Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2365092Z 2025-12-04T09:59:27.2365137Z The failure occurred for item [0] 2025-12-04T09:59:27.2365217Z 2025-12-04T09:59:27.2365289Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2365527Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2365697Z 2025-12-04T09:59:27.2365783Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2366016Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2366206Z Traceback (most recent call last): 2025-12-04T09:59:27.2366375Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2366545Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2366775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2367085Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2367401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2367668Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2367828Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2367918Z 2025-12-04T09:59:27.2367964Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2368146Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2368387Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2368525Z 2025-12-04T09:59:27.2368571Z The failure occurred for item [0] 2025-12-04T09:59:27.2368654Z 2025-12-04T09:59:27.2368727Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2368965Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2369134Z 2025-12-04T09:59:27.2369221Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2369438Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2369611Z Traceback (most recent call last): 2025-12-04T09:59:27.2369778Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2369949Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2370177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2370485Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2370805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2371070Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2371229Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2371318Z 2025-12-04T09:59:27.2371362Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2371544Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2371783Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2371919Z 2025-12-04T09:59:27.2371965Z The failure occurred for item [0] 2025-12-04T09:59:27.2372045Z 2025-12-04T09:59:27.2372117Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2372359Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2372587Z 2025-12-04T09:59:27.2372678Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2372893Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2373112Z Traceback (most recent call last): 2025-12-04T09:59:27.2373279Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2373446Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2373675Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2374018Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2374352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2374616Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2374780Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2374867Z 2025-12-04T09:59:27.2374914Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2375100Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2375346Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2375483Z 2025-12-04T09:59:27.2375531Z The failure occurred for item [0] 2025-12-04T09:59:27.2375609Z 2025-12-04T09:59:27.2375685Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2375930Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2376103Z 2025-12-04T09:59:27.2376197Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2376419Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2376602Z Traceback (most recent call last): 2025-12-04T09:59:27.2376776Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2376952Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2377185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2377503Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2380106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2380426Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2380729Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2380841Z 2025-12-04T09:59:27.2388862Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2389096Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2389382Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2389525Z 2025-12-04T09:59:27.2389576Z The failure occurred for item [0] 2025-12-04T09:59:27.2389660Z 2025-12-04T09:59:27.2389737Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2389990Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2390165Z 2025-12-04T09:59:27.2390255Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2390475Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2390662Z Traceback (most recent call last): 2025-12-04T09:59:27.2390839Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2391015Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2391328Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2391647Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2391969Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2392241Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2392411Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2392506Z 2025-12-04T09:59:27.2392554Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2392753Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2393046Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2393184Z 2025-12-04T09:59:27.2393229Z The failure occurred for item [0] 2025-12-04T09:59:27.2393310Z 2025-12-04T09:59:27.2393386Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2393626Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2393794Z 2025-12-04T09:59:27.2393882Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2394099Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2394272Z Traceback (most recent call last): 2025-12-04T09:59:27.2394438Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2394605Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2394831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2395142Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2395462Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2395727Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2395888Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2395977Z 2025-12-04T09:59:27.2396022Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2396202Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2396440Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2396577Z 2025-12-04T09:59:27.2396621Z The failure occurred for item [0] 2025-12-04T09:59:27.2396702Z 2025-12-04T09:59:27.2396775Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2397014Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2397185Z 2025-12-04T09:59:27.2397273Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2397492Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2397667Z Traceback (most recent call last): 2025-12-04T09:59:27.2397834Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2398006Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2398231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2398543Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2398863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2399126Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2399286Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2399416Z 2025-12-04T09:59:27.2399461Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2399641Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2399878Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2400016Z 2025-12-04T09:59:27.2400060Z The failure occurred for item [0] 2025-12-04T09:59:27.2400139Z 2025-12-04T09:59:27.2400211Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2400453Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2400624Z 2025-12-04T09:59:27.2400746Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2400962Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2401134Z Traceback (most recent call last): 2025-12-04T09:59:27.2401302Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2401472Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2401698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2402010Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2402326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2402590Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2402751Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2402838Z 2025-12-04T09:59:27.2402884Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2403116Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2403357Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2403493Z 2025-12-04T09:59:27.2403541Z The failure occurred for item [0] 2025-12-04T09:59:27.2403616Z 2025-12-04T09:59:27.2403691Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2403930Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2404097Z 2025-12-04T09:59:27.2404187Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2404405Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2404580Z Traceback (most recent call last): 2025-12-04T09:59:27.2404749Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2404918Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2405145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2405455Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2405772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2406036Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2406197Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2406284Z 2025-12-04T09:59:27.2406330Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2406509Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2406747Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2406882Z 2025-12-04T09:59:27.2406930Z The failure occurred for item [0] 2025-12-04T09:59:27.2407005Z 2025-12-04T09:59:27.2407079Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2407353Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2407521Z 2025-12-04T09:59:27.2407609Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2407824Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2407998Z Traceback (most recent call last): 2025-12-04T09:59:27.2408165Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2408335Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2408575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2408900Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2409217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2409484Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2409643Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2409729Z 2025-12-04T09:59:27.2409775Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2409955Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2410193Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2410328Z 2025-12-04T09:59:27.2410376Z The failure occurred for item [0] 2025-12-04T09:59:27.2410453Z 2025-12-04T09:59:27.2410529Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2410768Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2410936Z 2025-12-04T09:59:27.2411030Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2411247Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2411423Z Traceback (most recent call last): 2025-12-04T09:59:27.2411590Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2411759Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2411986Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2412293Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2412609Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2412876Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2413068Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2413156Z 2025-12-04T09:59:27.2413205Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2413385Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2413622Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2413760Z 2025-12-04T09:59:27.2413805Z The failure occurred for item [0] 2025-12-04T09:59:27.2413882Z 2025-12-04T09:59:27.2413954Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2414193Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2414361Z 2025-12-04T09:59:27.2414448Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2414667Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2414841Z Traceback (most recent call last): 2025-12-04T09:59:27.2415029Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2415217Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2415444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2415750Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2416064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2416326Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2416486Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2416596Z 2025-12-04T09:59:27.2416657Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2416837Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2417074Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2417213Z 2025-12-04T09:59:27.2417257Z The failure occurred for item [0] 2025-12-04T09:59:27.2417336Z 2025-12-04T09:59:27.2417408Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2417650Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2417821Z 2025-12-04T09:59:27.2417907Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2418123Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2418299Z Traceback (most recent call last): 2025-12-04T09:59:27.2418468Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2418639Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2418866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2419178Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2419496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2419762Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2419921Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2420009Z 2025-12-04T09:59:27.2420053Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2420234Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2420474Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2420612Z 2025-12-04T09:59:27.2420658Z The failure occurred for item [0] 2025-12-04T09:59:27.2420736Z 2025-12-04T09:59:27.2420809Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2421050Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2421220Z 2025-12-04T09:59:27.2421306Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2421520Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2421693Z Traceback (most recent call last): 2025-12-04T09:59:27.2421860Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2422028Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2422257Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2422578Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2422898Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2423246Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2423409Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2423499Z 2025-12-04T09:59:27.2423544Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2423727Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2423967Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2424106Z 2025-12-04T09:59:27.2424153Z The failure occurred for item [0] 2025-12-04T09:59:27.2424234Z 2025-12-04T09:59:27.2424307Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2424578Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2424751Z 2025-12-04T09:59:27.2424838Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2425064Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2425241Z Traceback (most recent call last): 2025-12-04T09:59:27.2425411Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2425583Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2425813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2426123Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2426445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2426714Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2426875Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2426965Z 2025-12-04T09:59:27.2427013Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2427197Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2427438Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2427576Z 2025-12-04T09:59:27.2427624Z The failure occurred for item [0] 2025-12-04T09:59:27.2427700Z 2025-12-04T09:59:27.2427778Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2428018Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2428186Z 2025-12-04T09:59:27.2428276Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2428495Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2428672Z Traceback (most recent call last): 2025-12-04T09:59:27.2428840Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2429015Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2429244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2429556Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2429873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2430139Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2430299Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2430386Z 2025-12-04T09:59:27.2430436Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2430619Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2430859Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2431013Z 2025-12-04T09:59:27.2431072Z The failure occurred for item [0] 2025-12-04T09:59:27.2431151Z 2025-12-04T09:59:27.2431227Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2431469Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2431639Z 2025-12-04T09:59:27.2431732Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2431952Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2432131Z Traceback (most recent call last): 2025-12-04T09:59:27.2432315Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2432499Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2432726Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2433069Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2433387Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2433656Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2433816Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2433906Z 2025-12-04T09:59:27.2433953Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2434136Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2434377Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2434515Z 2025-12-04T09:59:27.2434565Z The failure occurred for item [0] 2025-12-04T09:59:27.2434643Z 2025-12-04T09:59:27.2434720Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2434962Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2435131Z 2025-12-04T09:59:27.2435223Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2435437Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2435612Z Traceback (most recent call last): 2025-12-04T09:59:27.2435780Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2435950Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2436176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2436489Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2436810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2437083Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2437245Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2437333Z 2025-12-04T09:59:27.2437384Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2437564Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2437805Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2437939Z 2025-12-04T09:59:27.2437988Z The failure occurred for item [0] 2025-12-04T09:59:27.2438065Z 2025-12-04T09:59:27.2438141Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2438380Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2438552Z 2025-12-04T09:59:27.2438639Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2438874Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2439065Z Traceback (most recent call last): 2025-12-04T09:59:27.2439231Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2439400Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2439628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2439939Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2440261Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2440541Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2440721Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2440811Z 2025-12-04T09:59:27.2440855Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2441038Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2441279Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2441418Z 2025-12-04T09:59:27.2441463Z The failure occurred for item [0] 2025-12-04T09:59:27.2441544Z 2025-12-04T09:59:27.2441617Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2441859Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2442029Z 2025-12-04T09:59:27.2442116Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2442332Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2442508Z Traceback (most recent call last): 2025-12-04T09:59:27.2442677Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2442846Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2443129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2443440Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2443758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2444025Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2444186Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2444276Z 2025-12-04T09:59:27.2444321Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2444503Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2444744Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2444883Z 2025-12-04T09:59:27.2444929Z The failure occurred for item [0] 2025-12-04T09:59:27.2445014Z 2025-12-04T09:59:27.2445086Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2445329Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2445498Z 2025-12-04T09:59:27.2445585Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2445799Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2445974Z Traceback (most recent call last): 2025-12-04T09:59:27.2446144Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2446317Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2446547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2446855Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2447206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2447474Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2447637Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2447728Z 2025-12-04T09:59:27.2447773Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2447954Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2448191Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2448329Z 2025-12-04T09:59:27.2448396Z The failure occurred for item [0] 2025-12-04T09:59:27.2448503Z 2025-12-04T09:59:27.2448578Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2448815Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2448987Z 2025-12-04T09:59:27.2449075Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2449290Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2449462Z Traceback (most recent call last): 2025-12-04T09:59:27.2449627Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2449794Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2450020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2450332Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2450649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2450913Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2451074Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2451162Z 2025-12-04T09:59:27.2451205Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2451382Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2451618Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2451754Z 2025-12-04T09:59:27.2451800Z The failure occurred for item [0] 2025-12-04T09:59:27.2451875Z 2025-12-04T09:59:27.2451947Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2452185Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2452354Z 2025-12-04T09:59:27.2452442Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2452656Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2452831Z Traceback (most recent call last): 2025-12-04T09:59:27.2453039Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2453207Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2453429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2453737Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2454052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2454316Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2454476Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2454562Z 2025-12-04T09:59:27.2454607Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2454787Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2455056Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2455191Z 2025-12-04T09:59:27.2455238Z The failure occurred for item [0] 2025-12-04T09:59:27.2455313Z 2025-12-04T09:59:27.2455386Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2455626Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2455793Z 2025-12-04T09:59:27.2455883Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2456095Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2456296Z Traceback (most recent call last): 2025-12-04T09:59:27.2456461Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2456627Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2456852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2457159Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2457470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2457729Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2457885Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2457971Z 2025-12-04T09:59:27.2458016Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2458193Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2458430Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2458564Z 2025-12-04T09:59:27.2458609Z The failure occurred for item [0] 2025-12-04T09:59:27.2458684Z 2025-12-04T09:59:27.2458762Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2459006Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2459173Z 2025-12-04T09:59:27.2459262Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2459476Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2459649Z Traceback (most recent call last): 2025-12-04T09:59:27.2459818Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2459989Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2460219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2460531Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2460858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2461121Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2461283Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2461371Z 2025-12-04T09:59:27.2461417Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2461598Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2461837Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2461972Z 2025-12-04T09:59:27.2462021Z The failure occurred for item [0] 2025-12-04T09:59:27.2462096Z 2025-12-04T09:59:27.2462172Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2462410Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2462578Z 2025-12-04T09:59:27.2462692Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2462907Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2463124Z Traceback (most recent call last): 2025-12-04T09:59:27.2463289Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2463459Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2463687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2463997Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2464334Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2464618Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2464780Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2464872Z 2025-12-04T09:59:27.2464917Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2465097Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2465336Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2465474Z 2025-12-04T09:59:27.2465518Z The failure occurred for item [0] 2025-12-04T09:59:27.2465595Z 2025-12-04T09:59:27.2465667Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2465906Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2466078Z 2025-12-04T09:59:27.2466167Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2466379Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2466552Z Traceback (most recent call last): 2025-12-04T09:59:27.2466726Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2466898Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2467126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2467436Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2467751Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2468017Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2468180Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2468269Z 2025-12-04T09:59:27.2468315Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2468501Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2468744Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2468885Z 2025-12-04T09:59:27.2468931Z The failure occurred for item [0] 2025-12-04T09:59:27.2469009Z 2025-12-04T09:59:27.2469081Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2469321Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2469491Z 2025-12-04T09:59:27.2469578Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2469799Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2469975Z Traceback (most recent call last): 2025-12-04T09:59:27.2470149Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2470322Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2470568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2470900Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2471223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2471493Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2471658Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2471751Z 2025-12-04T09:59:27.2471797Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2471978Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2472227Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2472376Z 2025-12-04T09:59:27.2472421Z The failure occurred for item [0] 2025-12-04T09:59:27.2472501Z 2025-12-04T09:59:27.2472573Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2472816Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2473020Z 2025-12-04T09:59:27.2473106Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2473323Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2473495Z Traceback (most recent call last): 2025-12-04T09:59:27.2473662Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2473829Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2474055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2474362Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2474681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2474945Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2475103Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2475192Z 2025-12-04T09:59:27.2475235Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2475415Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2475652Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2475789Z 2025-12-04T09:59:27.2475833Z The failure occurred for item [0] 2025-12-04T09:59:27.2475911Z 2025-12-04T09:59:27.2475986Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2476225Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2476394Z 2025-12-04T09:59:27.2476483Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2476699Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2476872Z Traceback (most recent call last): 2025-12-04T09:59:27.2477038Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2477206Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2477433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2477740Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2478058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2478323Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2478482Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2478589Z 2025-12-04T09:59:27.2478650Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2478829Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2479067Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2479203Z 2025-12-04T09:59:27.2479249Z The failure occurred for item [0] 2025-12-04T09:59:27.2479326Z 2025-12-04T09:59:27.2479400Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2479636Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2479802Z 2025-12-04T09:59:27.2479920Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2480150Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2480320Z Traceback (most recent call last): 2025-12-04T09:59:27.2480488Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2480659Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2480887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2481192Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2481504Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2481766Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2481930Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2482017Z 2025-12-04T09:59:27.2482065Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2482243Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2482478Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2482616Z 2025-12-04T09:59:27.2482665Z The failure occurred for item [0] 2025-12-04T09:59:27.2482741Z 2025-12-04T09:59:27.2482814Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2483107Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2483271Z 2025-12-04T09:59:27.2483361Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2483574Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2483746Z Traceback (most recent call last): 2025-12-04T09:59:27.2483911Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2484081Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2484308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2484619Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2484935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2485198Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2485356Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2485442Z 2025-12-04T09:59:27.2485487Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2485667Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2485904Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2486041Z 2025-12-04T09:59:27.2486088Z The failure occurred for item [0] 2025-12-04T09:59:27.2486163Z 2025-12-04T09:59:27.2486237Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2486510Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2486677Z 2025-12-04T09:59:27.2486766Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2486980Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2487153Z Traceback (most recent call last): 2025-12-04T09:59:27.2487318Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2487484Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2487711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2488050Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2488369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2488638Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2488796Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2488883Z 2025-12-04T09:59:27.2488927Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2489105Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2489342Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2489479Z 2025-12-04T09:59:27.2489524Z The failure occurred for item [0] 2025-12-04T09:59:27.2489601Z 2025-12-04T09:59:27.2489673Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2489912Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2490083Z 2025-12-04T09:59:27.2490171Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2490390Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2490563Z Traceback (most recent call last): 2025-12-04T09:59:27.2490728Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2490895Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2491119Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2491427Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2491741Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2492005Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2492166Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2492254Z 2025-12-04T09:59:27.2492297Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2492484Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2492720Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2492856Z 2025-12-04T09:59:27.2492901Z The failure occurred for item [0] 2025-12-04T09:59:27.2493016Z 2025-12-04T09:59:27.2493088Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2493327Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2493495Z 2025-12-04T09:59:27.2493581Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2493803Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2493976Z Traceback (most recent call last): 2025-12-04T09:59:27.2494141Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2494347Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2494575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2494883Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2495198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2495463Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2495627Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2495718Z 2025-12-04T09:59:27.2495779Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2495976Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2496212Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2496349Z 2025-12-04T09:59:27.2496395Z The failure occurred for item [0] 2025-12-04T09:59:27.2496472Z 2025-12-04T09:59:27.2496821Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2497058Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2497226Z 2025-12-04T09:59:27.2497312Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2497526Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2497697Z Traceback (most recent call last): 2025-12-04T09:59:27.2497862Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2498032Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2498258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2498566Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2498881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2499145Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2499304Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2499393Z 2025-12-04T09:59:27.2499437Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2499614Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2499850Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2499987Z 2025-12-04T09:59:27.2500033Z The failure occurred for item [0] 2025-12-04T09:59:27.2500111Z 2025-12-04T09:59:27.2500182Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2500422Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2500592Z 2025-12-04T09:59:27.2500680Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2500895Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2501067Z Traceback (most recent call last): 2025-12-04T09:59:27.2501233Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2501400Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2501624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2501930Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2502248Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2502536Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2502710Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2502797Z 2025-12-04T09:59:27.2502843Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2503064Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2503300Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2503435Z 2025-12-04T09:59:27.2503481Z The failure occurred for item [0] 2025-12-04T09:59:27.2503557Z 2025-12-04T09:59:27.2503630Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2503889Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2504073Z 2025-12-04T09:59:27.2504162Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2504376Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2504552Z Traceback (most recent call last): 2025-12-04T09:59:27.2504717Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2504886Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2505110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2505418Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2505730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2505993Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2506153Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2506240Z 2025-12-04T09:59:27.2506286Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2506469Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2506706Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2506842Z 2025-12-04T09:59:27.2506888Z The failure occurred for item [0] 2025-12-04T09:59:27.2506964Z 2025-12-04T09:59:27.2507038Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2507275Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2507443Z 2025-12-04T09:59:27.2507531Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2507747Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2507921Z Traceback (most recent call last): 2025-12-04T09:59:27.2508087Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2508255Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2508484Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2508793Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2509110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2509375Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2509534Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2509620Z 2025-12-04T09:59:27.2509666Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2509844Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2510081Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2510215Z 2025-12-04T09:59:27.2510261Z The failure occurred for item [0] 2025-12-04T09:59:27.2510359Z 2025-12-04T09:59:27.2510480Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2510719Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2510885Z 2025-12-04T09:59:27.2510974Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2511190Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2511361Z Traceback (most recent call last): 2025-12-04T09:59:27.2511527Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2511695Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2511945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2512254Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2512573Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2512836Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2513037Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2513127Z 2025-12-04T09:59:27.2513171Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2513351Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2513587Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2513728Z 2025-12-04T09:59:27.2513776Z The failure occurred for item [0] 2025-12-04T09:59:27.2513855Z 2025-12-04T09:59:27.2513927Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2514166Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2514336Z 2025-12-04T09:59:27.2514424Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2514643Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2514815Z Traceback (most recent call last): 2025-12-04T09:59:27.2514982Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2515150Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2515378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2515686Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2516004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2516268Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2516433Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2516524Z 2025-12-04T09:59:27.2516568Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2516747Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2516983Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2517119Z 2025-12-04T09:59:27.2517165Z The failure occurred for item [0] 2025-12-04T09:59:27.2517242Z 2025-12-04T09:59:27.2517314Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2517555Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2517727Z 2025-12-04T09:59:27.2517815Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2518033Z ________ TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 _________ 2025-12-04T09:59:27.2518231Z Traceback (most recent call last): 2025-12-04T09:59:27.2518416Z File "/var/lib/jenkins/pytorch/test/test_nn.py", line 7685, in with_tf32_on 2025-12-04T09:59:27.2518586Z test.test_cuda(self, **kwargs) 2025-12-04T09:59:27.2518813Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_nn.py", line 3553, in test_cuda 2025-12-04T09:59:27.2519125Z test_case.assertEqual(cpu_gradInput, gpu_gradInput, atol=self.precision, rtol=0, exact_dtype=False) 2025-12-04T09:59:27.2519445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 4284, in assertEqual 2025-12-04T09:59:27.2519709Z raise error_metas.pop()[0].to_error( # type: ignore[index] 2025-12-04T09:59:27.2519906Z AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2519996Z 2025-12-04T09:59:27.2520040Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2520219Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2520458Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2520596Z 2025-12-04T09:59:27.2520641Z The failure occurred for item [0] 2025-12-04T09:59:27.2520720Z 2025-12-04T09:59:27.2520793Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2521032Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2521200Z 2025-12-04T09:59:27.2521286Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2521573Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_nn/test_nn-d362433ea24e2ffe.xml - 2025-12-04T09:59:27.2521829Z =========================== short test summary info ============================ 2025-12-04T09:59:27.2522062Z FAILED [1.1745s] test_nn.py::TestNN::test_Linear_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2522223Z 2025-12-04T09:59:27.2522271Z Mismatched elements: 1 / 80 (1.2%) 2025-12-04T09:59:27.2522452Z Greatest absolute difference: 0.006172716581073878 at index (0, 8) (up to 0.005 allowed) 2025-12-04T09:59:27.2522690Z Greatest relative difference: 0.0010043929000800671 at index (0, 8) (up to 0 allowed) 2025-12-04T09:59:27.2522828Z 2025-12-04T09:59:27.2522902Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2523153Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_Linear_cuda_tf32 2025-12-04T09:59:27.2523282Z 2025-12-04T09:59:27.2523371Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2523656Z FAILED [0.0661s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2523858Z 2025-12-04T09:59:27.2523905Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2524084Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2524324Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2524458Z 2025-12-04T09:59:27.2524505Z The failure occurred for item [0] 2025-12-04T09:59:27.2524581Z 2025-12-04T09:59:27.2524655Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2524893Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2525059Z 2025-12-04T09:59:27.2525148Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2525433Z FAILED [0.0647s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2525635Z 2025-12-04T09:59:27.2525681Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2525859Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2526136Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2526270Z 2025-12-04T09:59:27.2526317Z The failure occurred for item [0] 2025-12-04T09:59:27.2526392Z 2025-12-04T09:59:27.2526466Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2526702Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2526867Z 2025-12-04T09:59:27.2526956Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2527255Z FAILED [0.0654s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2527471Z 2025-12-04T09:59:27.2527517Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2527696Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2527935Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2528072Z 2025-12-04T09:59:27.2528116Z The failure occurred for item [0] 2025-12-04T09:59:27.2528194Z 2025-12-04T09:59:27.2528265Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2528503Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2528674Z 2025-12-04T09:59:27.2528759Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2529046Z FAILED [0.0635s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2529253Z 2025-12-04T09:59:27.2529297Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2529475Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2529714Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2529850Z 2025-12-04T09:59:27.2529895Z The failure occurred for item [0] 2025-12-04T09:59:27.2529973Z 2025-12-04T09:59:27.2530045Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2530282Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2530449Z 2025-12-04T09:59:27.2530534Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2530817Z FAILED [0.0618s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2531019Z 2025-12-04T09:59:27.2531065Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2531242Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2531477Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2531615Z 2025-12-04T09:59:27.2531660Z The failure occurred for item [0] 2025-12-04T09:59:27.2531738Z 2025-12-04T09:59:27.2531809Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2532046Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2532213Z 2025-12-04T09:59:27.2532298Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2532591Z FAILED [0.0588s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2532796Z 2025-12-04T09:59:27.2532845Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2533063Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2533298Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2533455Z 2025-12-04T09:59:27.2533526Z The failure occurred for item [0] 2025-12-04T09:59:27.2533603Z 2025-12-04T09:59:27.2533680Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2533927Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2534092Z 2025-12-04T09:59:27.2534183Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2534470Z FAILED [0.0588s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2534671Z 2025-12-04T09:59:27.2534720Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2534962Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2535205Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2535339Z 2025-12-04T09:59:27.2535389Z The failure occurred for item [0] 2025-12-04T09:59:27.2535465Z 2025-12-04T09:59:27.2535539Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2540373Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2540544Z 2025-12-04T09:59:27.2540636Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2540930Z FAILED [0.0657s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2541131Z 2025-12-04T09:59:27.2541182Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2541369Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2541611Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2541747Z 2025-12-04T09:59:27.2541799Z The failure occurred for item [0] 2025-12-04T09:59:27.2541878Z 2025-12-04T09:59:27.2541955Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2542195Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2542369Z 2025-12-04T09:59:27.2542455Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2542742Z FAILED [0.0658s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2542989Z 2025-12-04T09:59:27.2543034Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2543216Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2543458Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2543596Z 2025-12-04T09:59:27.2543641Z The failure occurred for item [0] 2025-12-04T09:59:27.2543722Z 2025-12-04T09:59:27.2543794Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2544031Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2544199Z 2025-12-04T09:59:27.2544283Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2544566Z FAILED [0.0631s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2544768Z 2025-12-04T09:59:27.2544813Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2544994Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2545229Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2545364Z 2025-12-04T09:59:27.2545408Z The failure occurred for item [0] 2025-12-04T09:59:27.2545485Z 2025-12-04T09:59:27.2545629Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2545866Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2546032Z 2025-12-04T09:59:27.2546117Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2546402Z FAILED [0.0601s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2546603Z 2025-12-04T09:59:27.2546646Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2546824Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2547078Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2547234Z 2025-12-04T09:59:27.2547278Z The failure occurred for item [0] 2025-12-04T09:59:27.2547354Z 2025-12-04T09:59:27.2547428Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2547666Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2547831Z 2025-12-04T09:59:27.2547917Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2548201Z FAILED [0.0643s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2548400Z 2025-12-04T09:59:27.2548446Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2548621Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2548856Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2548992Z 2025-12-04T09:59:27.2549038Z The failure occurred for item [0] 2025-12-04T09:59:27.2549113Z 2025-12-04T09:59:27.2549187Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2549427Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2549592Z 2025-12-04T09:59:27.2549681Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2549962Z FAILED [0.0623s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2550160Z 2025-12-04T09:59:27.2550206Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2550383Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2550619Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2550755Z 2025-12-04T09:59:27.2550803Z The failure occurred for item [0] 2025-12-04T09:59:27.2550805Z 2025-12-04T09:59:27.2550877Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2551010Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2551012Z 2025-12-04T09:59:27.2551099Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2551264Z FAILED [0.0652s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2551266Z 2025-12-04T09:59:27.2551311Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2551412Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2551511Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2551515Z 2025-12-04T09:59:27.2551559Z The failure occurred for item [0] 2025-12-04T09:59:27.2551561Z 2025-12-04T09:59:27.2551635Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2551780Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2551796Z 2025-12-04T09:59:27.2551881Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2552044Z FAILED [0.0674s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2552046Z 2025-12-04T09:59:27.2552090Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2552190Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2552288Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2552290Z 2025-12-04T09:59:27.2552361Z The failure occurred for item [0] 2025-12-04T09:59:27.2552363Z 2025-12-04T09:59:27.2552435Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2552568Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2552572Z 2025-12-04T09:59:27.2552657Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2552823Z FAILED [0.0657s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2552825Z 2025-12-04T09:59:27.2552868Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2553016Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2553112Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2553114Z 2025-12-04T09:59:27.2553160Z The failure occurred for item [0] 2025-12-04T09:59:27.2553163Z 2025-12-04T09:59:27.2553234Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2553367Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2553370Z 2025-12-04T09:59:27.2553458Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2553621Z FAILED [0.0598s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2553623Z 2025-12-04T09:59:27.2553668Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2553769Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2553866Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2553869Z 2025-12-04T09:59:27.2553912Z The failure occurred for item [0] 2025-12-04T09:59:27.2553914Z 2025-12-04T09:59:27.2553990Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2554119Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2554122Z 2025-12-04T09:59:27.2554210Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2554372Z FAILED [0.0586s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2554374Z 2025-12-04T09:59:27.2554419Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2554519Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2554616Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2554618Z 2025-12-04T09:59:27.2554663Z The failure occurred for item [0] 2025-12-04T09:59:27.2554665Z 2025-12-04T09:59:27.2554736Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2554868Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2554870Z 2025-12-04T09:59:27.2554993Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2555160Z FAILED [0.0571s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2555162Z 2025-12-04T09:59:27.2555205Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2555309Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2555404Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2555406Z 2025-12-04T09:59:27.2555451Z The failure occurred for item [0] 2025-12-04T09:59:27.2555453Z 2025-12-04T09:59:27.2555540Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2555687Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2555689Z 2025-12-04T09:59:27.2555774Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2555938Z FAILED [0.0642s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2555940Z 2025-12-04T09:59:27.2555985Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2556084Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2556180Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2556182Z 2025-12-04T09:59:27.2556225Z The failure occurred for item [0] 2025-12-04T09:59:27.2556227Z 2025-12-04T09:59:27.2556300Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2556430Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2556432Z 2025-12-04T09:59:27.2556517Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2556682Z FAILED [0.0645s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2556686Z 2025-12-04T09:59:27.2556730Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2556831Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2556926Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2556929Z 2025-12-04T09:59:27.2556974Z The failure occurred for item [0] 2025-12-04T09:59:27.2556976Z 2025-12-04T09:59:27.2557048Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2557180Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2557183Z 2025-12-04T09:59:27.2557269Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2557436Z FAILED [0.0626s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2557438Z 2025-12-04T09:59:27.2557481Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2557584Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2557680Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2557682Z 2025-12-04T09:59:27.2557727Z The failure occurred for item [0] 2025-12-04T09:59:27.2557729Z 2025-12-04T09:59:27.2557799Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2557932Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2557935Z 2025-12-04T09:59:27.2558021Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2558200Z FAILED [0.0634s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2558213Z 2025-12-04T09:59:27.2558259Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2558358Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2558456Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2558458Z 2025-12-04T09:59:27.2558501Z The failure occurred for item [0] 2025-12-04T09:59:27.2558503Z 2025-12-04T09:59:27.2558576Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2558716Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2558739Z 2025-12-04T09:59:27.2558827Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2558989Z FAILED [0.0597s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2558994Z 2025-12-04T09:59:27.2559038Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2559141Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2559235Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2559237Z 2025-12-04T09:59:27.2559282Z The failure occurred for item [0] 2025-12-04T09:59:27.2559284Z 2025-12-04T09:59:27.2559354Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2559487Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2559490Z 2025-12-04T09:59:27.2559574Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2559744Z FAILED [0.0624s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2559748Z 2025-12-04T09:59:27.2559790Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2559891Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2559987Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2559989Z 2025-12-04T09:59:27.2560034Z The failure occurred for item [0] 2025-12-04T09:59:27.2560035Z 2025-12-04T09:59:27.2560108Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2560238Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2560241Z 2025-12-04T09:59:27.2560328Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2560490Z FAILED [0.0640s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2560493Z 2025-12-04T09:59:27.2560540Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2560639Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2560736Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2560738Z 2025-12-04T09:59:27.2560781Z The failure occurred for item [0] 2025-12-04T09:59:27.2560783Z 2025-12-04T09:59:27.2560857Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2560986Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2560988Z 2025-12-04T09:59:27.2561075Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2561238Z FAILED [0.0605s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2561255Z 2025-12-04T09:59:27.2561312Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2561414Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2561510Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2561512Z 2025-12-04T09:59:27.2561557Z The failure occurred for item [0] 2025-12-04T09:59:27.2561559Z 2025-12-04T09:59:27.2561629Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2561760Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2561763Z 2025-12-04T09:59:27.2561861Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2562037Z FAILED [0.0592s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2562039Z 2025-12-04T09:59:27.2562082Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2562186Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2562283Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2562284Z 2025-12-04T09:59:27.2562329Z The failure occurred for item [0] 2025-12-04T09:59:27.2562331Z 2025-12-04T09:59:27.2562404Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2562534Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2562536Z 2025-12-04T09:59:27.2562624Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2562789Z FAILED [0.0588s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2562791Z 2025-12-04T09:59:27.2562836Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2562987Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2563085Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2563088Z 2025-12-04T09:59:27.2563131Z The failure occurred for item [0] 2025-12-04T09:59:27.2563133Z 2025-12-04T09:59:27.2563205Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2563335Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2563337Z 2025-12-04T09:59:27.2563425Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2563589Z FAILED [0.0590s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2563595Z 2025-12-04T09:59:27.2563638Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2563741Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2563838Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2563840Z 2025-12-04T09:59:27.2563886Z The failure occurred for item [0] 2025-12-04T09:59:27.2563887Z 2025-12-04T09:59:27.2563958Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2564088Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2564090Z 2025-12-04T09:59:27.2564173Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2564338Z FAILED [0.0631s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2564341Z 2025-12-04T09:59:27.2564384Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2564502Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2564615Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2564617Z 2025-12-04T09:59:27.2564663Z The failure occurred for item [0] 2025-12-04T09:59:27.2564665Z 2025-12-04T09:59:27.2564738Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2564867Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2564868Z 2025-12-04T09:59:27.2564954Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2565130Z FAILED [0.0589s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2565149Z 2025-12-04T09:59:27.2565195Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2565295Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2565393Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2565395Z 2025-12-04T09:59:27.2565439Z The failure occurred for item [0] 2025-12-04T09:59:27.2565440Z 2025-12-04T09:59:27.2565513Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2565642Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2565644Z 2025-12-04T09:59:27.2565732Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2565896Z FAILED [0.0573s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2565900Z 2025-12-04T09:59:27.2565943Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2566045Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2566142Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2566144Z 2025-12-04T09:59:27.2566190Z The failure occurred for item [0] 2025-12-04T09:59:27.2566192Z 2025-12-04T09:59:27.2566262Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2566391Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2566393Z 2025-12-04T09:59:27.2566476Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2566640Z FAILED [0.0582s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2566644Z 2025-12-04T09:59:27.2566687Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2566789Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2566885Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2566889Z 2025-12-04T09:59:27.2566934Z The failure occurred for item [0] 2025-12-04T09:59:27.2566936Z 2025-12-04T09:59:27.2567009Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2567137Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2567139Z 2025-12-04T09:59:27.2567226Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2567392Z FAILED [0.0604s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2567394Z 2025-12-04T09:59:27.2567441Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2567543Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2567640Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2567665Z 2025-12-04T09:59:27.2567710Z The failure occurred for item [0] 2025-12-04T09:59:27.2567712Z 2025-12-04T09:59:27.2567784Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2567912Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2567914Z 2025-12-04T09:59:27.2568000Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2568165Z FAILED [0.0590s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2568167Z 2025-12-04T09:59:27.2568223Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2568335Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2568430Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2568433Z 2025-12-04T09:59:27.2568480Z The failure occurred for item [0] 2025-12-04T09:59:27.2568482Z 2025-12-04T09:59:27.2568555Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2568686Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2568688Z 2025-12-04T09:59:27.2568773Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2568938Z FAILED [0.0610s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2568939Z 2025-12-04T09:59:27.2568982Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2569087Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2569185Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2569188Z 2025-12-04T09:59:27.2569233Z The failure occurred for item [0] 2025-12-04T09:59:27.2569235Z 2025-12-04T09:59:27.2569308Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2569437Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2569439Z 2025-12-04T09:59:27.2569526Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2569689Z FAILED [0.0591s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2569691Z 2025-12-04T09:59:27.2569736Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2569838Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2569938Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2569940Z 2025-12-04T09:59:27.2569984Z The failure occurred for item [0] 2025-12-04T09:59:27.2569987Z 2025-12-04T09:59:27.2570062Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2570191Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2570195Z 2025-12-04T09:59:27.2570278Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2570443Z FAILED [0.0631s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2570445Z 2025-12-04T09:59:27.2570488Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2570591Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2570687Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2570689Z 2025-12-04T09:59:27.2570736Z The failure occurred for item [0] 2025-12-04T09:59:27.2570766Z 2025-12-04T09:59:27.2570853Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2570982Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2570984Z 2025-12-04T09:59:27.2571069Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2571230Z FAILED [0.0645s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2571232Z 2025-12-04T09:59:27.2571278Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2571395Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2571505Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2571507Z 2025-12-04T09:59:27.2571550Z The failure occurred for item [0] 2025-12-04T09:59:27.2571552Z 2025-12-04T09:59:27.2571627Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2571757Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2571761Z 2025-12-04T09:59:27.2571846Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2572010Z FAILED [0.0612s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2572012Z 2025-12-04T09:59:27.2572054Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2572156Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2572252Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2572255Z 2025-12-04T09:59:27.2572300Z The failure occurred for item [0] 2025-12-04T09:59:27.2572301Z 2025-12-04T09:59:27.2572371Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2572503Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2572504Z 2025-12-04T09:59:27.2572588Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2572752Z FAILED [0.0603s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2572754Z 2025-12-04T09:59:27.2572796Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2572898Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2573031Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2573034Z 2025-12-04T09:59:27.2573077Z The failure occurred for item [0] 2025-12-04T09:59:27.2573079Z 2025-12-04T09:59:27.2573151Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2573281Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2573283Z 2025-12-04T09:59:27.2573369Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2573532Z FAILED [0.0620s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2573534Z 2025-12-04T09:59:27.2573578Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2573678Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2573777Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2573780Z 2025-12-04T09:59:27.2573823Z The failure occurred for item [0] 2025-12-04T09:59:27.2573824Z 2025-12-04T09:59:27.2573897Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2574062Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2574066Z 2025-12-04T09:59:27.2574150Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2574315Z FAILED [0.0658s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2574317Z 2025-12-04T09:59:27.2574360Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2574461Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2574555Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2574585Z 2025-12-04T09:59:27.2574630Z The failure occurred for item [0] 2025-12-04T09:59:27.2574632Z 2025-12-04T09:59:27.2574703Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2574834Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2574837Z 2025-12-04T09:59:27.2574920Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2575084Z FAILED [0.0637s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2575086Z 2025-12-04T09:59:27.2575128Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2575228Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2575325Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2575327Z 2025-12-04T09:59:27.2575372Z The failure occurred for item [0] 2025-12-04T09:59:27.2575373Z 2025-12-04T09:59:27.2575446Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2575574Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2575577Z 2025-12-04T09:59:27.2575662Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2575826Z FAILED [0.0620s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2575828Z 2025-12-04T09:59:27.2575873Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2575972Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2576069Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2576071Z 2025-12-04T09:59:27.2576115Z The failure occurred for item [0] 2025-12-04T09:59:27.2576118Z 2025-12-04T09:59:27.2576190Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2576317Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2576321Z 2025-12-04T09:59:27.2576406Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2576572Z FAILED [0.0620s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2576574Z 2025-12-04T09:59:27.2576617Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2576718Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2576814Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2576816Z 2025-12-04T09:59:27.2576861Z The failure occurred for item [0] 2025-12-04T09:59:27.2576865Z 2025-12-04T09:59:27.2576935Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2577065Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2577081Z 2025-12-04T09:59:27.2577177Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2577341Z FAILED [0.0582s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2577342Z 2025-12-04T09:59:27.2577387Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2577486Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2577582Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2577584Z 2025-12-04T09:59:27.2577627Z The failure occurred for item [0] 2025-12-04T09:59:27.2577629Z 2025-12-04T09:59:27.2580305Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2582483Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2582485Z 2025-12-04T09:59:27.2582575Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2582738Z FAILED [0.0611s] test_nn.py::TestNN::test_TransformerEncoderLayer_gelu_activation_cuda_tf32 - AssertionError: Tensor-likes are not close! 2025-12-04T09:59:27.2582740Z 2025-12-04T09:59:27.2582785Z Mismatched elements: 3 / 24 (12.5%) 2025-12-04T09:59:27.2582884Z Greatest absolute difference: 0.22959615503416586 at index (1, 2, 2) (up to 0.08 allowed) 2025-12-04T09:59:27.2583021Z Greatest relative difference: 0.03982180413784518 at index (1, 2, 0) (up to 0 allowed) 2025-12-04T09:59:27.2583023Z 2025-12-04T09:59:27.2583066Z The failure occurred for item [0] 2025-12-04T09:59:27.2583068Z 2025-12-04T09:59:27.2583141Z To execute this test, run the following from the base repo dir: 2025-12-04T09:59:27.2583272Z PYTORCH_TEST_WITH_ROCM=1 python test/test_nn.py TestNN.test_TransformerEncoderLayer_gelu_activation_cuda_tf32 2025-12-04T09:59:27.2583274Z 2025-12-04T09:59:27.2583358Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T09:59:27.2583426Z ======================== 50 failed, 50 passed in 7.20s ========================= 2025-12-04T09:59:27.2583428Z 2025-12-04T09:59:27.2583539Z FINISHED PRINTING LOG FILE of test_nn 1/3 (test/test-reports/test_nn_1.3_1350bff3fde7b76c_.log) 2025-12-04T09:59:27.2583541Z 2025-12-04T09:59:27.2583625Z Finished test_nn 1/3 ... [2025-12-04 09:59:27.228815][2223538.788505289], took 0.18min 2025-12-04T09:59:27.2583866Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:27.3230016Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:27.3241509Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T09:59:27.3241578Z Uploading artifacts took 0.00 seconds 2025-12-04T09:59:27.3242081Z test_nn 1/3 failed! 2025-12-04T09:59:27.3246543Z Running test_transformers 1/1 ... [2025-12-04 09:59:27.324348][2223538.884048416] 2025-12-04T09:59:27.3246653Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:27.3248353Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_transformers.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:27.324668] 2025-12-04T09:59:45.5605066Z 2025-12-04T09:59:45.5605673Z test_transformers 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_transformers_1.1_aa2757b62f47cbf0_.log 2025-12-04T09:59:45.5605985Z Running 0 items in this shard: 2025-12-04T09:59:45.5606106Z 2025-12-04T09:59:45.5606216Z Finished test_transformers 1/1 ... [2025-12-04 09:59:45.560241][2223557.11994225], took 0.30min 2025-12-04T09:59:45.5614546Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:45.6548623Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:45.6556253Z Running test_cuda_expandable_segments 1/1 ... [2025-12-04 09:59:45.655462][2223557.215161095] 2025-12-04T09:59:45.6556510Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:45.6560542Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_cuda_expandable_segments.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:45.655743] 2025-12-04T09:59:49.3980584Z 2025-12-04T09:59:49.3981876Z test_cuda_expandable_segments 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_cuda_expandable_segments_1.1_2ede17439dddb060_.log 2025-12-04T09:59:49.3982626Z 2025-12-04T09:59:49.3982887Z Finished test_cuda_expandable_segments 1/1 ... [2025-12-04 09:59:49.397546][2223560.957245418], took 0.06min 2025-12-04T09:59:49.3988983Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:49.4909967Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:49.4925529Z Running test_fx 3/3 ... [2025-12-04 09:59:49.492167][2223561.051867044] 2025-12-04T09:59:49.4925854Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:49.4926654Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_fx.py', '--shard-id=3', '--num-shards=3', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:49.492456] 2025-12-04T09:59:54.6122328Z 2025-12-04T09:59:54.6123158Z test_fx 3/3 was successful, full logs can be found in artifacts with path test/test-reports/test_fx_3.3_d119ffc9225365d1_.log 2025-12-04T09:59:54.6135201Z Running 50 items in this shard: test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice, test/test_fx.py::TestFX::test_trace_buffer_slice 2025-12-04T09:59:54.6138345Z 2025-12-04T09:59:54.6138438Z Finished test_fx 3/3 ... [2025-12-04 09:59:54.611957][2223566.171656999], took 0.09min 2025-12-04T09:59:54.6138883Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T09:59:54.7097695Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T09:59:54.7107994Z Running functorch/test_ops 3/5 ... [2025-12-04 09:59:54.710653][2223566.270354014] 2025-12-04T09:59:54.7108198Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T09:59:54.7110584Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'functorch/test_ops.py', '--shard-id=3', '--num-shards=5', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 09:59:54.710958] 2025-12-04T10:00:10.8861242Z 2025-12-04T10:00:10.8862092Z functorch/test_ops 3/5 was successful, full logs can be found in artifacts with path test/test-reports/functorch.test_ops_3.5_88f86cf9670454a1_.log 2025-12-04T10:00:10.8862642Z Running 0 items in this shard: 2025-12-04T10:00:10.8862786Z 2025-12-04T10:00:10.8863129Z Finished functorch/test_ops 3/5 ... [2025-12-04 10:00:10.885894][2223582.445594831], took 0.27min 2025-12-04T10:00:10.8872536Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:00:10.9812920Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:00:10.9823334Z Running profiler/test_kineto 1/1 ... [2025-12-04 10:00:10.981965][2223582.541666553] 2025-12-04T10:00:10.9823724Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:00:10.9824677Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'profiler/test_kineto.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:00:10.982262] 2025-12-04T10:00:12.8408056Z 2025-12-04T10:00:12.8408928Z profiler/test_kineto 1/1 was successful, full logs can be found in artifacts with path test/test-reports/profiler.test_kineto_1.1_aa90988bb5951252_.log 2025-12-04T10:00:12.8409523Z Running 0 items in this shard: 2025-12-04T10:00:12.8409706Z 2025-12-04T10:00:12.8409937Z Finished profiler/test_kineto 1/1 ... [2025-12-04 10:00:12.840414][2223584.4001176], took 0.03min 2025-12-04T10:00:12.8414995Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:00:12.9349214Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:00:12.9363314Z Running test_ao_sparsity 1/1 ... [2025-12-04 10:00:12.936132][2223584.495832029] 2025-12-04T10:00:12.9363651Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:00:12.9366447Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ao_sparsity.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:00:12.936441] 2025-12-04T10:00:15.1343262Z 2025-12-04T10:00:15.1346475Z test_ao_sparsity 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_ao_sparsity_1.1_c3fcbb79c0f4a4f5_.log 2025-12-04T10:00:15.1347008Z Running 0 items in this shard: 2025-12-04T10:00:15.1347152Z 2025-12-04T10:00:15.1354940Z Finished test_ao_sparsity 1/1 ... [2025-12-04 10:00:15.134037][2223586.693738003], took 0.04min 2025-12-04T10:00:15.1355855Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:00:15.2289974Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:00:15.2305720Z Running test_autoload_enable 1/1 ... [2025-12-04 10:00:15.230001][2223586.789700988] 2025-12-04T10:00:15.3745619Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions 2025-12-04T10:00:18.2916044Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:00:18.2932731Z [?25hBuilding wheels for collected packages: torch_test_cpp_extension 2025-12-04T10:03:18.3539626Z Building wheel for torch_test_cpp_extension (pyproject.toml) ... [?25l- \ | / - \ | / - \ | / - \ | / - done 2025-12-04T10:03:18.3612606Z [?25h Created wheel for torch_test_cpp_extension: filename=torch_test_cpp_extension-0.0.0-cp312-cp312-linux_x86_64.whl size=13150368 sha256=19c256a0ef283dd513af282a4acd220fb2c4775091a23306750e7454c7f15515 2025-12-04T10:03:18.3613659Z Stored in directory: /tmp/pip-ephem-wheel-cache-w_ile8su/wheels/fc/3b/ed/ea7c0cea7dc731e18eb485707930be2a5fbc6e49db88cadb75 2025-12-04T10:03:18.3628333Z Successfully built torch_test_cpp_extension 2025-12-04T10:03:18.4463444Z Installing collected packages: torch_test_cpp_extension 2025-12-04T10:03:18.5511982Z Successfully installed torch_test_cpp_extension-0.0.0 2025-12-04T10:03:19.9700186Z 2025-12-04T10:03:19.9700756Z Running tests... 2025-12-04T10:03:19.9701244Z ---------------------------------------------------------------------- 2025-12-04T10:03:20.1909460Z . 2025-12-04T10:03:20.1909763Z ---------------------------------------------------------------------- 2025-12-04T10:03:20.1910081Z Ran 1 test in 0.221s 2025-12-04T10:03:20.1910219Z 2025-12-04T10:03:20.1912165Z OK 2025-12-04T10:03:20.1912626Z 2025-12-04T10:03:20.1913414Z Generating XML reports... 2025-12-04T10:03:20.7773193Z Finished test_autoload_enable 1/1 ... [2025-12-04 10:03:20.776871][2223772.336564078], took 3.09min 2025-12-04T10:03:20.7781901Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:03:20.8703056Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:03:20.8713716Z Running test_cpp_extensions_aot_ninja 1/1 ... [2025-12-04 10:03:20.871156][2223772.430856366] 2025-12-04T10:03:21.0347819Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions 2025-12-04T10:03:23.4589449Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:03:23.4605158Z [?25hBuilding wheels for collected packages: torch_test_cpp_extension 2025-12-04T10:06:00.3501784Z Building wheel for torch_test_cpp_extension (pyproject.toml) ... [?25l- \ | / - \ | / - \ | / - \ | / - done 2025-12-04T10:06:00.3575301Z [?25h Created wheel for torch_test_cpp_extension: filename=torch_test_cpp_extension-0.0.0-cp312-cp312-linux_x86_64.whl size=13150687 sha256=37ef76f064d3aa6b3007707eb7decba091ac4dd9cd9d74b2e7842b0f1bbada54 2025-12-04T10:06:00.3575805Z Stored in directory: /tmp/pip-ephem-wheel-cache-wfrty4zq/wheels/fc/3b/ed/ea7c0cea7dc731e18eb485707930be2a5fbc6e49db88cadb75 2025-12-04T10:06:00.3588191Z Successfully built torch_test_cpp_extension 2025-12-04T10:06:00.4405299Z Installing collected packages: torch_test_cpp_extension 2025-12-04T10:06:00.5473863Z Successfully installed torch_test_cpp_extension-0.0.0 2025-12-04T10:06:00.7186596Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/no_python_abi_suffix_test 2025-12-04T10:06:01.7838388Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:01.7854970Z [?25hBuilding wheels for collected packages: no_python_abi_suffix_test 2025-12-04T10:06:03.0522605Z Building wheel for no_python_abi_suffix_test (pyproject.toml) ... [?25l- \ done 2025-12-04T10:06:03.0527570Z [?25h Created wheel for no_python_abi_suffix_test: filename=no_python_abi_suffix_test-0.0.0-cp312-cp312-linux_x86_64.whl size=2942 sha256=0cd5bb5b1bed432cc4ab7362095acb69bc2bc603df9276d548633fc3a54cf2c6 2025-12-04T10:06:03.0528054Z Stored in directory: /tmp/pip-ephem-wheel-cache-i18nnnwu/wheels/0f/c6/d1/a47ade092c4854ee96ffa8750c0df779c8a501cdb658bb0982 2025-12-04T10:06:03.0541528Z Successfully built no_python_abi_suffix_test 2025-12-04T10:06:03.1358702Z Installing collected packages: no_python_abi_suffix_test 2025-12-04T10:06:03.1382533Z Successfully installed no_python_abi_suffix_test-0.0.0 2025-12-04T10:06:03.1940159Z * Getting build dependencies for wheel... 2025-12-04T10:06:04.1962466Z /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu -> /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu [skipped, no changes] 2025-12-04T10:06:04.1964305Z Successfully preprocessed all matching files. 2025-12-04T10:06:04.1964795Z Total number of unsupported CUDA function calls: 0 2025-12-04T10:06:04.1965072Z 2025-12-04T10:06:04.1965078Z 2025-12-04T10:06:04.1965200Z Total number of replaced kernel launches: 0 2025-12-04T10:06:04.2145969Z running egg_info 2025-12-04T10:06:04.2180419Z creating python_agnostic.egg-info 2025-12-04T10:06:04.2180681Z writing python_agnostic.egg-info/PKG-INFO 2025-12-04T10:06:04.2183827Z writing dependency_links to python_agnostic.egg-info/dependency_links.txt 2025-12-04T10:06:04.2184358Z writing top-level names to python_agnostic.egg-info/top_level.txt 2025-12-04T10:06:04.2184670Z writing manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:04.2431294Z reading manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:04.2436245Z writing manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:04.5796983Z * Building wheel... 2025-12-04T10:06:05.5742850Z /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu -> /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu [skipped, no changes] 2025-12-04T10:06:05.5743980Z Successfully preprocessed all matching files. 2025-12-04T10:06:05.5744252Z Total number of unsupported CUDA function calls: 0 2025-12-04T10:06:05.5744414Z 2025-12-04T10:06:05.5744418Z 2025-12-04T10:06:05.5744528Z Total number of replaced kernel launches: 0 2025-12-04T10:06:05.5874962Z running bdist_wheel 2025-12-04T10:06:05.6172205Z running build 2025-12-04T10:06:05.6172476Z running build_ext 2025-12-04T10:06:05.6190041Z building 'python_agnostic._C' extension 2025-12-04T10:06:05.6193901Z creating /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/build/temp.linux-x86_64-cpython-312/python_agnostic/csrc 2025-12-04T10:06:17.5000963Z [1/1] /opt/rocm/bin/hipcc -I/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/include -I/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/include/torch/csrc/api/include -I/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/include/THH -I/opt/rocm/include -I/opt/conda/envs/py_3.12/include/python3.12 -c -c /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu -o /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/build/temp.linux-x86_64-cpython-312/python_agnostic/csrc/ultra_norm.o -D__HIP_PLATFORM_AMD__=1 -DUSE_ROCM=1 -DHIPBLAS_V2 -fPIC -DCUDA_HAS_FP16=1 -D__HIP_NO_HALF_OPERATORS__=1 -D__HIP_NO_HALF_CONVERSIONS__=1 -DHIP_ENABLE_WARP_SYNC_BUILTINS=1 -DTORCH_API_INCLUDE_EXTENSION_H -DPy_LIMITED_API=0x030A0000 -DTORCH_EXTENSION_NAME=_C --offload-arch=gfx90a --offload-arch=gfx942 --offload-arch=gfx950 --offload-arch=gfx1100 -fno-gpu-rdc -std=c++17 2025-12-04T10:06:17.5034017Z creating build/lib.linux-x86_64-cpython-312/python_agnostic 2025-12-04T10:06:17.5036348Z g++ -pthread -B /opt/conda/envs/py_3.12/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/py_3.12/include -fPIC -O2 -isystem /opt/conda/envs/py_3.12/include -pthread -B /opt/conda/envs/py_3.12/compiler_compat -shared /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/build/temp.linux-x86_64-cpython-312/python_agnostic/csrc/ultra_norm.o -L/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/lib -L/opt/rocm/lib -L/opt/rocm/hip/lib -lc10 -ltorch -ltorch_cpu -lamdhip64 -lc10_hip -ltorch_hip -o build/lib.linux-x86_64-cpython-312/python_agnostic/_C.so 2025-12-04T10:06:17.6727045Z installing to build/bdist.linux-x86_64/wheel 2025-12-04T10:06:17.6727244Z running install 2025-12-04T10:06:17.6751803Z running install_lib 2025-12-04T10:06:17.6781827Z creating build/bdist.linux-x86_64/wheel 2025-12-04T10:06:17.6782995Z creating build/bdist.linux-x86_64/wheel/python_agnostic 2025-12-04T10:06:17.6783674Z copying build/lib.linux-x86_64-cpython-312/python_agnostic/_C.so -> build/bdist.linux-x86_64/wheel/./python_agnostic 2025-12-04T10:06:17.6784787Z running install_egg_info 2025-12-04T10:06:17.6816047Z running egg_info 2025-12-04T10:06:17.6843865Z writing python_agnostic.egg-info/PKG-INFO 2025-12-04T10:06:17.6846141Z writing dependency_links to python_agnostic.egg-info/dependency_links.txt 2025-12-04T10:06:17.6848494Z writing top-level names to python_agnostic.egg-info/top_level.txt 2025-12-04T10:06:17.6880015Z reading manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:17.6884239Z writing manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:17.6885229Z Copying python_agnostic.egg-info to build/bdist.linux-x86_64/wheel/./python_agnostic-0.0-py3.12.egg-info 2025-12-04T10:06:17.6887665Z running install_scripts 2025-12-04T10:06:17.6932861Z creating build/bdist.linux-x86_64/wheel/python_agnostic-0.0.dist-info/WHEEL 2025-12-04T10:06:17.6936244Z creating '/var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/dist/.tmp-okva3rj6/python_agnostic-0.0-cp39-abi3-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it 2025-12-04T10:06:17.6949487Z adding 'python_agnostic/_C.so' 2025-12-04T10:06:17.6951130Z adding 'python_agnostic-0.0.dist-info/METADATA' 2025-12-04T10:06:17.6951701Z adding 'python_agnostic-0.0.dist-info/WHEEL' 2025-12-04T10:06:17.6951886Z adding 'python_agnostic-0.0.dist-info/top_level.txt' 2025-12-04T10:06:17.6952695Z adding 'python_agnostic-0.0.dist-info/RECORD' 2025-12-04T10:06:17.6953059Z removing build/bdist.linux-x86_64/wheel 2025-12-04T10:06:18.0162277Z Successfully built python_agnostic-0.0-cp39-abi3-linux_x86_64.whl 2025-12-04T10:06:18.1636768Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/libtorch_agnostic_2_9_extension 2025-12-04T10:06:19.5771022Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:19.5788489Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from libtorch_agnostic_2_9==0.0) (2.10.0a0+gitffd9b0f) 2025-12-04T10:06:19.5794242Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (3.18.0) 2025-12-04T10:06:19.5796477Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (4.12.2) 2025-12-04T10:06:19.5799844Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (78.1.1) 2025-12-04T10:06:19.5801609Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (1.13.3) 2025-12-04T10:06:19.5803433Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (2.8.8) 2025-12-04T10:06:19.5804677Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (3.1.6) 2025-12-04T10:06:19.5806140Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (2025.10.0) 2025-12-04T10:06:19.5853228Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch->libtorch_agnostic_2_9==0.0) (1.3.0) 2025-12-04T10:06:19.5871925Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch->libtorch_agnostic_2_9==0.0) (3.0.3) 2025-12-04T10:06:19.5902857Z Building wheels for collected packages: libtorch_agnostic_2_9 2025-12-04T10:06:24.6411489Z Building wheel for libtorch_agnostic_2_9 (pyproject.toml) ... [?25l- \ | / done 2025-12-04T10:06:24.6418705Z [?25h Created wheel for libtorch_agnostic_2_9: filename=libtorch_agnostic_2_9-0.0-cp39-abi3-linux_x86_64.whl size=57932 sha256=93c515a982d791bc6296618cb18ae78febbc9e9e88f7a1a9e7b2402800da446d 2025-12-04T10:06:24.6419353Z Stored in directory: /tmp/pip-ephem-wheel-cache-c9c51lsj/wheels/0e/f1/02/1f09b3cb5394fb7859c394262345cbb3aff63ae0cb3b109531 2025-12-04T10:06:24.6436276Z Successfully built libtorch_agnostic_2_9 2025-12-04T10:06:24.7268881Z Installing collected packages: libtorch_agnostic_2_9 2025-12-04T10:06:24.7311076Z Successfully installed libtorch_agnostic_2_9-0.0 2025-12-04T10:06:24.9176273Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/libtorch_agnostic_2_10_extension 2025-12-04T10:06:26.5350906Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:26.5369899Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from libtorch_agnostic_2_10==0.0) (2.10.0a0+gitffd9b0f) 2025-12-04T10:06:26.5376099Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (3.18.0) 2025-12-04T10:06:26.5378034Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (4.12.2) 2025-12-04T10:06:26.5381438Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (78.1.1) 2025-12-04T10:06:26.5383222Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (1.13.3) 2025-12-04T10:06:26.5384944Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (2.8.8) 2025-12-04T10:06:26.5385813Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (3.1.6) 2025-12-04T10:06:26.5387669Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (2025.10.0) 2025-12-04T10:06:26.5434081Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch->libtorch_agnostic_2_10==0.0) (1.3.0) 2025-12-04T10:06:26.5453010Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch->libtorch_agnostic_2_10==0.0) (3.0.3) 2025-12-04T10:06:26.5483744Z Building wheels for collected packages: libtorch_agnostic_2_10 2025-12-04T10:06:32.4733602Z Building wheel for libtorch_agnostic_2_10 (pyproject.toml) ... [?25l- \ | / - \ | / - \ done 2025-12-04T10:06:32.4743097Z [?25h Created wheel for libtorch_agnostic_2_10: filename=libtorch_agnostic_2_10-0.0-cp39-abi3-linux_x86_64.whl size=85946 sha256=97df066623c7d76501d86f9a3e1b3d147a4eed9795081fee43adf79d4e6b15c1 2025-12-04T10:06:32.4744202Z Stored in directory: /tmp/pip-ephem-wheel-cache-qq6f1lg2/wheels/74/3e/b6/95673b850c2a780fa4a0d89508051aee851e2c75773485c325 2025-12-04T10:06:32.4758907Z Successfully built libtorch_agnostic_2_10 2025-12-04T10:06:32.5562703Z Installing collected packages: libtorch_agnostic_2_10 2025-12-04T10:06:32.5601506Z Successfully installed libtorch_agnostic_2_10-0.0 2025-12-04T10:06:32.5917103Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:06:32.5927673Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_cpp_extensions_aot_ninja.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:06:32.592188] 2025-12-04T10:06:34.7272594Z 2025-12-04T10:06:34.7273517Z test_cpp_extensions_aot_ninja 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_cpp_extensions_aot_ninja_1.1_74290e81a8f06137_.log 2025-12-04T10:06:34.7273859Z Running 0 items in this shard: 2025-12-04T10:06:34.7273945Z 2025-12-04T10:06:34.7274086Z Finished test_cpp_extensions_aot_ninja 1/1 ... [2025-12-04 10:06:34.727112][2223966.286813824], took 3.23min 2025-12-04T10:06:34.7281958Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:06:34.8226957Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:06:34.8234994Z Running test_cpp_extensions_aot_no_ninja 1/1 ... [2025-12-04 10:06:34.823383][2223966.383082819] 2025-12-04T10:06:34.9691946Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions 2025-12-04T10:06:37.3644124Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:37.3661507Z [?25hBuilding wheels for collected packages: torch_test_cpp_extension 2025-12-04T10:06:41.8788195Z Building wheel for torch_test_cpp_extension (pyproject.toml) ... [?25l- \ | / - \ | / - \ | done 2025-12-04T10:06:41.8858117Z [?25h Created wheel for torch_test_cpp_extension: filename=torch_test_cpp_extension-0.0.0-cp312-cp312-linux_x86_64.whl size=13150368 sha256=527a69875bc280a6f407a479acc4bcafa618d87ff6badcd8b8ce7a632a8e3c0d 2025-12-04T10:06:41.8859169Z Stored in directory: /tmp/pip-ephem-wheel-cache-w6c832c4/wheels/fc/3b/ed/ea7c0cea7dc731e18eb485707930be2a5fbc6e49db88cadb75 2025-12-04T10:06:41.8874671Z Successfully built torch_test_cpp_extension 2025-12-04T10:06:41.9718473Z Installing collected packages: torch_test_cpp_extension 2025-12-04T10:06:42.0768734Z Successfully installed torch_test_cpp_extension-0.0.0 2025-12-04T10:06:42.2532563Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/no_python_abi_suffix_test 2025-12-04T10:06:43.1974063Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:43.1994009Z [?25hBuilding wheels for collected packages: no_python_abi_suffix_test 2025-12-04T10:06:44.2322811Z Building wheel for no_python_abi_suffix_test (pyproject.toml) ... [?25l- \ done 2025-12-04T10:06:44.2331601Z [?25h Created wheel for no_python_abi_suffix_test: filename=no_python_abi_suffix_test-0.0.0-cp312-cp312-linux_x86_64.whl size=2942 sha256=115f98188a59200d1071cd98d5a02177935ef5612aa4b53ea7969d0dc13076b8 2025-12-04T10:06:44.2332473Z Stored in directory: /tmp/pip-ephem-wheel-cache-373k9tnj/wheels/0f/c6/d1/a47ade092c4854ee96ffa8750c0df779c8a501cdb658bb0982 2025-12-04T10:06:44.2349276Z Successfully built no_python_abi_suffix_test 2025-12-04T10:06:44.3162757Z Installing collected packages: no_python_abi_suffix_test 2025-12-04T10:06:44.3186419Z Successfully installed no_python_abi_suffix_test-0.0.0 2025-12-04T10:06:44.3722307Z * Getting build dependencies for wheel... 2025-12-04T10:06:45.2958283Z /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu -> /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu [skipped, no changes] 2025-12-04T10:06:45.2960188Z Successfully preprocessed all matching files. 2025-12-04T10:06:45.2960645Z Total number of unsupported CUDA function calls: 0 2025-12-04T10:06:45.2960914Z 2025-12-04T10:06:45.2960921Z 2025-12-04T10:06:45.2961073Z Total number of replaced kernel launches: 0 2025-12-04T10:06:45.3129567Z running egg_info 2025-12-04T10:06:45.3162688Z writing python_agnostic.egg-info/PKG-INFO 2025-12-04T10:06:45.3165171Z writing dependency_links to python_agnostic.egg-info/dependency_links.txt 2025-12-04T10:06:45.3166762Z writing top-level names to python_agnostic.egg-info/top_level.txt 2025-12-04T10:06:45.3400592Z reading manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:45.3407621Z writing manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:45.6408567Z * Building wheel... 2025-12-04T10:06:46.5672805Z /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu -> /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/python_agnostic/csrc/ultra_norm.cu [skipped, no changes] 2025-12-04T10:06:46.5674373Z Successfully preprocessed all matching files. 2025-12-04T10:06:46.5674759Z Total number of unsupported CUDA function calls: 0 2025-12-04T10:06:46.5674978Z 2025-12-04T10:06:46.5674983Z 2025-12-04T10:06:46.5675119Z Total number of replaced kernel launches: 0 2025-12-04T10:06:46.5799230Z running bdist_wheel 2025-12-04T10:06:46.6101410Z running build 2025-12-04T10:06:46.6101638Z running build_ext 2025-12-04T10:06:46.6119355Z building 'python_agnostic._C' extension 2025-12-04T10:06:46.6444134Z ninja: no work to do. 2025-12-04T10:06:46.6469284Z g++ -pthread -B /opt/conda/envs/py_3.12/compiler_compat -fno-strict-overflow -Wsign-compare -DNDEBUG -O2 -Wall -fPIC -O2 -isystem /opt/conda/envs/py_3.12/include -fPIC -O2 -isystem /opt/conda/envs/py_3.12/include -pthread -B /opt/conda/envs/py_3.12/compiler_compat -shared /var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/build/temp.linux-x86_64-cpython-312/python_agnostic/csrc/ultra_norm.o -L/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/lib -L/opt/rocm/lib -L/opt/rocm/hip/lib -lc10 -ltorch -ltorch_cpu -lamdhip64 -lc10_hip -ltorch_hip -o build/lib.linux-x86_64-cpython-312/python_agnostic/_C.so 2025-12-04T10:06:47.3586377Z installing to build/bdist.linux-x86_64/wheel 2025-12-04T10:06:47.3586586Z running install 2025-12-04T10:06:47.3609155Z running install_lib 2025-12-04T10:06:47.3641008Z creating build/bdist.linux-x86_64/wheel 2025-12-04T10:06:47.3641328Z creating build/bdist.linux-x86_64/wheel/python_agnostic 2025-12-04T10:06:47.3641629Z copying build/lib.linux-x86_64-cpython-312/python_agnostic/_C.so -> build/bdist.linux-x86_64/wheel/./python_agnostic 2025-12-04T10:06:47.3644366Z running install_egg_info 2025-12-04T10:06:47.3675244Z running egg_info 2025-12-04T10:06:47.3704299Z writing python_agnostic.egg-info/PKG-INFO 2025-12-04T10:06:47.3705966Z writing dependency_links to python_agnostic.egg-info/dependency_links.txt 2025-12-04T10:06:47.3708453Z writing top-level names to python_agnostic.egg-info/top_level.txt 2025-12-04T10:06:47.3739136Z reading manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:47.3743173Z writing manifest file 'python_agnostic.egg-info/SOURCES.txt' 2025-12-04T10:06:47.3744289Z Copying python_agnostic.egg-info to build/bdist.linux-x86_64/wheel/./python_agnostic-0.0-py3.12.egg-info 2025-12-04T10:06:47.3746497Z running install_scripts 2025-12-04T10:06:47.3791404Z creating build/bdist.linux-x86_64/wheel/python_agnostic-0.0.dist-info/WHEEL 2025-12-04T10:06:47.3795586Z creating '/var/lib/jenkins/pytorch/test/cpp_extensions/python_agnostic_extension/dist/.tmp-n9jqgrx6/python_agnostic-0.0-cp39-abi3-linux_x86_64.whl' and adding 'build/bdist.linux-x86_64/wheel' to it 2025-12-04T10:06:47.3807550Z adding 'python_agnostic/_C.so' 2025-12-04T10:06:47.3809110Z adding 'python_agnostic-0.0.dist-info/METADATA' 2025-12-04T10:06:47.3809302Z adding 'python_agnostic-0.0.dist-info/WHEEL' 2025-12-04T10:06:47.3809619Z adding 'python_agnostic-0.0.dist-info/top_level.txt' 2025-12-04T10:06:47.3810341Z adding 'python_agnostic-0.0.dist-info/RECORD' 2025-12-04T10:06:47.3810629Z removing build/bdist.linux-x86_64/wheel 2025-12-04T10:06:47.6616824Z Successfully built python_agnostic-0.0-cp39-abi3-linux_x86_64.whl 2025-12-04T10:06:47.8116372Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/libtorch_agnostic_2_9_extension 2025-12-04T10:06:49.0607008Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:49.0626493Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from libtorch_agnostic_2_9==0.0) (2.10.0a0+gitffd9b0f) 2025-12-04T10:06:49.0632220Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (3.18.0) 2025-12-04T10:06:49.0633562Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (4.12.2) 2025-12-04T10:06:49.0637813Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (78.1.1) 2025-12-04T10:06:49.0639209Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (1.13.3) 2025-12-04T10:06:49.0640824Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (2.8.8) 2025-12-04T10:06:49.0641920Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (3.1.6) 2025-12-04T10:06:49.0643673Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_9==0.0) (2025.10.0) 2025-12-04T10:06:49.0691058Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch->libtorch_agnostic_2_9==0.0) (1.3.0) 2025-12-04T10:06:49.0709850Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch->libtorch_agnostic_2_9==0.0) (3.0.3) 2025-12-04T10:06:49.0740683Z Building wheels for collected packages: libtorch_agnostic_2_9 2025-12-04T10:06:50.6466000Z Building wheel for libtorch_agnostic_2_9 (pyproject.toml) ... [?25l- \ done 2025-12-04T10:06:50.6474270Z [?25h Created wheel for libtorch_agnostic_2_9: filename=libtorch_agnostic_2_9-0.0-cp39-abi3-linux_x86_64.whl size=57932 sha256=ea1fd85c8d7744cf844ef15224f596384f560e05630c524c76503018161bbc70 2025-12-04T10:06:50.6475134Z Stored in directory: /tmp/pip-ephem-wheel-cache-aaygivf_/wheels/0e/f1/02/1f09b3cb5394fb7859c394262345cbb3aff63ae0cb3b109531 2025-12-04T10:06:50.6491042Z Successfully built libtorch_agnostic_2_9 2025-12-04T10:06:50.7272155Z Installing collected packages: libtorch_agnostic_2_9 2025-12-04T10:06:50.7309329Z Successfully installed libtorch_agnostic_2_9-0.0 2025-12-04T10:06:50.8977542Z Processing /var/lib/jenkins/pytorch/test/cpp_extensions/libtorch_agnostic_2_10_extension 2025-12-04T10:06:52.1515346Z Preparing metadata (pyproject.toml) ... [?25l- done 2025-12-04T10:06:52.1534613Z [?25hRequirement already satisfied: torch in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from libtorch_agnostic_2_10==0.0) (2.10.0a0+gitffd9b0f) 2025-12-04T10:06:52.1540187Z Requirement already satisfied: filelock in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (3.18.0) 2025-12-04T10:06:52.1542532Z Requirement already satisfied: typing-extensions>=4.10.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (4.12.2) 2025-12-04T10:06:52.1546347Z Requirement already satisfied: setuptools in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (78.1.1) 2025-12-04T10:06:52.1547836Z Requirement already satisfied: sympy>=1.13.3 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (1.13.3) 2025-12-04T10:06:52.1549571Z Requirement already satisfied: networkx>=2.5.1 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (2.8.8) 2025-12-04T10:06:52.1550852Z Requirement already satisfied: jinja2 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (3.1.6) 2025-12-04T10:06:52.1552250Z Requirement already satisfied: fsspec>=0.8.5 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from torch->libtorch_agnostic_2_10==0.0) (2025.10.0) 2025-12-04T10:06:52.1599514Z Requirement already satisfied: mpmath<1.4,>=1.1.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from sympy>=1.13.3->torch->libtorch_agnostic_2_10==0.0) (1.3.0) 2025-12-04T10:06:52.1618693Z Requirement already satisfied: MarkupSafe>=2.0 in /opt/conda/envs/py_3.12/lib/python3.12/site-packages (from jinja2->torch->libtorch_agnostic_2_10==0.0) (3.0.3) 2025-12-04T10:06:52.1649213Z Building wheels for collected packages: libtorch_agnostic_2_10 2025-12-04T10:06:53.6703064Z Building wheel for libtorch_agnostic_2_10 (pyproject.toml) ... [?25l- \ done 2025-12-04T10:06:53.6711590Z [?25h Created wheel for libtorch_agnostic_2_10: filename=libtorch_agnostic_2_10-0.0-cp39-abi3-linux_x86_64.whl size=85946 sha256=e9a264c9353ea28bed33bf3e82554dcea51e41948fc802b16ac250670b5d5023 2025-12-04T10:06:53.6712360Z Stored in directory: /tmp/pip-ephem-wheel-cache-x0ag9dds/wheels/74/3e/b6/95673b850c2a780fa4a0d89508051aee851e2c75773485c325 2025-12-04T10:06:53.6727227Z Successfully built libtorch_agnostic_2_10 2025-12-04T10:06:53.7484241Z Installing collected packages: libtorch_agnostic_2_10 2025-12-04T10:06:53.7520953Z Successfully installed libtorch_agnostic_2_10-0.0 2025-12-04T10:06:53.7780951Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:06:53.7784633Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_cpp_extensions_aot_no_ninja.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:06:53.778264] 2025-12-04T10:06:55.7975385Z 2025-12-04T10:06:55.7976156Z test_cpp_extensions_aot_no_ninja 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_cpp_extensions_aot_no_ninja_1.1_e61a17ddbd097ce1_.log 2025-12-04T10:06:55.7976510Z Running 0 items in this shard: 2025-12-04T10:06:55.7976589Z 2025-12-04T10:06:55.7976737Z Finished test_cpp_extensions_aot_no_ninja 1/1 ... [2025-12-04 10:06:55.797352][2223987.357052689], took 0.35min 2025-12-04T10:06:55.7987582Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:06:56.0099110Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:06:56.0113254Z Running test_cpp_extensions_jit 1/1 ... [2025-12-04 10:06:56.011146][2223987.570845054] 2025-12-04T10:06:56.0113469Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:06:56.0116199Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_cpp_extensions_jit.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:06:56.011456] 2025-12-04T10:06:58.5768024Z 2025-12-04T10:06:58.5768704Z test_cpp_extensions_jit 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_cpp_extensions_jit_1.1_95e999bc405038f2_.log 2025-12-04T10:06:58.5772399Z Running 0 items in this shard: 2025-12-04T10:06:58.5772481Z 2025-12-04T10:06:58.5772598Z Finished test_cpp_extensions_jit 1/1 ... [2025-12-04 10:06:58.576564][2223990.136261518], took 0.04min 2025-12-04T10:06:58.5779236Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:06:58.8699994Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:06:58.8710597Z Running test_meta 1/2 ... [2025-12-04 10:06:58.870900][2223990.430598408] 2025-12-04T10:06:58.8711704Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:06:58.8715738Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_meta.py', '--shard-id=1', '--num-shards=2', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:06:58.871242] 2025-12-04T10:07:39.0161474Z 2025-12-04T10:07:39.0162295Z test_meta 1/2 was successful, full logs can be found in artifacts with path test/test-reports/test_meta_1.2_bbf801bacde30a06_.log 2025-12-04T10:07:39.0162724Z Running 0 items in this shard: 2025-12-04T10:07:39.0162851Z 2025-12-04T10:07:39.0163050Z Finished test_meta 1/2 ... [2025-12-04 10:07:39.015837][2224030.57553724], took 0.67min 2025-12-04T10:07:39.0172728Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:07:39.2854063Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:07:39.2864974Z Running test_numa_binding 1/1 ... [2025-12-04 10:07:39.286322][2224030.846019245] 2025-12-04T10:07:39.2865325Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:07:39.2868804Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_numa_binding.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:07:39.286679] 2025-12-04T10:07:41.2510228Z 2025-12-04T10:07:41.2510585Z test_numa_binding 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_numa_binding_1.1_3b41eb2cbd13471a_.log 2025-12-04T10:07:41.2510856Z Running 0 items in this shard: 2025-12-04T10:07:41.2510937Z 2025-12-04T10:07:41.2511047Z Finished test_numa_binding 1/1 ... [2025-12-04 10:07:41.250604][2224032.810307618], took 0.03min 2025-12-04T10:07:41.2520596Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:07:41.4722594Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:07:41.4735910Z Running test_numba_integration 1/1 ... [2025-12-04 10:07:41.473367][2224033.033064433] 2025-12-04T10:07:41.4736394Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:07:41.4739224Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_numba_integration.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:07:41.473698] 2025-12-04T10:07:43.6115546Z 2025-12-04T10:07:43.6116537Z test_numba_integration 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_numba_integration_1.1_b2a3017721b450e8_.log 2025-12-04T10:07:43.6117354Z Running 0 items in this shard: 2025-12-04T10:07:43.6117577Z 2025-12-04T10:07:43.6117963Z Finished test_numba_integration 1/1 ... [2025-12-04 10:07:43.611237][2224035.170938046], took 0.04min 2025-12-04T10:07:43.6127992Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:07:43.8790385Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:07:43.8803687Z Running test_opaque_obj_v2 1/1 ... [2025-12-04 10:07:43.880117][2224035.43981612] 2025-12-04T10:07:43.8804024Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:07:43.8806225Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_opaque_obj_v2.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:07:43.880437] 2025-12-04T10:07:46.4544929Z 2025-12-04T10:07:46.4545890Z test_opaque_obj_v2 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_opaque_obj_v2_1.1_610bd3740a4ffe5b_.log 2025-12-04T10:07:46.4546290Z Running 0 items in this shard: 2025-12-04T10:07:46.4546373Z 2025-12-04T10:07:46.4546501Z Finished test_opaque_obj_v2 1/1 ... [2025-12-04 10:07:46.454257][2224038.013958655], took 0.04min 2025-12-04T10:07:46.4554903Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:07:46.7286240Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:07:46.7299039Z Running test_ops_gradients 1/1 ... [2025-12-04 10:07:46.729713][2224038.289410427] 2025-12-04T10:07:46.7299394Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:07:46.7302302Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_ops_gradients.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:07:46.730066] 2025-12-04T10:08:29.0499173Z 2025-12-04T10:08:29.0500005Z PRINTING LOG FILE of test_ops_gradients 1/1 (test/test-reports/test_ops_gradients_1.1_89dbe3076ea037ae_.log) 2025-12-04T10:08:29.0500593Z Test results will be stored in test-reports/python-pytest/test_ops_gradients/test_ops_gradients-335fccee26ff9f5c.xml 2025-12-04T10:08:29.0501183Z ============================= test session starts ============================== 2025-12-04T10:08:29.0501643Z platform linux -- Python 3.12.5, pytest-7.3.2, pluggy-1.6.0 -- /opt/conda/envs/py_3.12/bin/python 2025-12-04T10:08:29.0503609Z cachedir: .pytest_cache 2025-12-04T10:08:29.0503913Z hypothesis profile 'pytorch_ci' -> database=None, max_examples=50, derandomize=True, suppress_health_check=[HealthCheck.too_slow] 2025-12-04T10:08:29.0504187Z rootdir: /var/lib/jenkins/pytorch 2025-12-04T10:08:29.0504342Z configfile: pytest.ini 2025-12-04T10:08:29.0504599Z plugins: hypothesis-6.56.4, cpp-2.3.0, flakefinder-1.1.0, rerunfailures-14.0, subtests-0.13.1, xdist-3.3.1, xdoctest-1.3.0, typeguard-4.3.0 2025-12-04T10:08:29.0504856Z collecting ... collected 5396 items 2025-12-04T10:08:29.0505014Z stepcurrent: Cannot find last run test, not skipping 2025-12-04T10:08:29.0530170Z Running 200 items in this shard: test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128, test/test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0555397Z 2025-12-04T10:08:29.0555667Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.8222s] [ 0%] 2025-12-04T10:08:29.0556012Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.6882s] [ 1%] 2025-12-04T10:08:29.0556330Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0827s] [ 1%] 2025-12-04T10:08:29.0556679Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [1.3905s] [ 2%] 2025-12-04T10:08:29.0557004Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.1032s] [ 2%] 2025-12-04T10:08:29.0557315Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1038s] [ 2%] 2025-12-04T10:08:29.0557620Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0511s] [ 2%] 2025-12-04T10:08:29.0557936Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0506s] [ 2%] 2025-12-04T10:08:29.0558251Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0513s] [ 2%] 2025-12-04T10:08:29.0558558Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0520s] [ 2%] 2025-12-04T10:08:29.0558867Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0663s] [ 2%] 2025-12-04T10:08:29.0559188Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0547s] [ 2%] 2025-12-04T10:08:29.0559491Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0531s] [ 2%] 2025-12-04T10:08:29.0559802Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0526s] [ 2%] 2025-12-04T10:08:29.0560111Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0594s] [ 2%] 2025-12-04T10:08:29.0560442Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0556s] [ 2%] 2025-12-04T10:08:29.0560770Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0542s] [ 2%] 2025-12-04T10:08:29.0561468Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0549s] [ 2%] 2025-12-04T10:08:29.0561773Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0540s] [ 2%] 2025-12-04T10:08:29.0562075Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0784s] [ 2%] 2025-12-04T10:08:29.0562382Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0545s] [ 2%] 2025-12-04T10:08:29.0562691Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0546s] [ 2%] 2025-12-04T10:08:29.0563122Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0550s] [ 2%] 2025-12-04T10:08:29.0563485Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0548s] [ 2%] 2025-12-04T10:08:29.0563791Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0515s] [ 2%] 2025-12-04T10:08:29.0564103Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0987s] [ 2%] 2025-12-04T10:08:29.0564406Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1019s] [ 2%] 2025-12-04T10:08:29.0564706Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0961s] [ 2%] 2025-12-04T10:08:29.0565006Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1053s] [ 2%] 2025-12-04T10:08:29.0565309Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1007s] [ 2%] 2025-12-04T10:08:29.0565611Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0557s] [ 2%] 2025-12-04T10:08:29.0565915Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0560s] [ 2%] 2025-12-04T10:08:29.0566222Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0558s] [ 2%] 2025-12-04T10:08:29.0566525Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0659s] [ 2%] 2025-12-04T10:08:29.0566832Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0957s] [ 2%] 2025-12-04T10:08:29.0567141Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0966s] [ 2%] 2025-12-04T10:08:29.0567459Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1166s] [ 2%] 2025-12-04T10:08:29.0567784Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0962s] [ 2%] 2025-12-04T10:08:29.0568122Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0558s] [ 2%] 2025-12-04T10:08:29.0568441Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1104s] [ 2%] 2025-12-04T10:08:29.0568766Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0957s] [ 2%] 2025-12-04T10:08:29.0573589Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0589s] [ 2%] 2025-12-04T10:08:29.0573901Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0571s] [ 2%] 2025-12-04T10:08:29.0574210Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0563s] [ 2%] 2025-12-04T10:08:29.0574516Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0555s] [ 2%] 2025-12-04T10:08:29.0574821Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 PASSED [0.0964s] [ 2%] 2025-12-04T10:08:29.0575320Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0584s] [ 2%] 2025-12-04T10:08:29.0575626Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0664s] [ 2%] 2025-12-04T10:08:29.0575929Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.1407s] [ 2%] 2025-12-04T10:08:29.0576238Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0659s] [ 2%] 2025-12-04T10:08:29.0576543Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0563s] [ 2%] 2025-12-04T10:08:29.0576898Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0658s] [ 2%] 2025-12-04T10:08:29.0577202Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 FAILED [0.0700s] [ 2%] 2025-12-04T10:08:29.0577506Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0282s] [ 2%] 2025-12-04T10:08:29.0577802Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0267s] [ 2%] 2025-12-04T10:08:29.0578101Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0270s] [ 2%] 2025-12-04T10:08:29.0578396Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0578689Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0270s] [ 2%] 2025-12-04T10:08:29.0578984Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0293s] [ 2%] 2025-12-04T10:08:29.0579280Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0268s] [ 2%] 2025-12-04T10:08:29.0579581Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0579884Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0580177Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0580472Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0580765Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0581061Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0267s] [ 2%] 2025-12-04T10:08:29.0581357Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0264s] [ 2%] 2025-12-04T10:08:29.0581649Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0581945Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0261s] [ 2%] 2025-12-04T10:08:29.0582237Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0582528Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0582825Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0264s] [ 2%] 2025-12-04T10:08:29.0583174Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0264s] [ 2%] 2025-12-04T10:08:29.0583471Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0583769Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0584109Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0584406Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0584704Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0585002Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0264s] [ 2%] 2025-12-04T10:08:29.0585298Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0585614Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0585927Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0286s] [ 2%] 2025-12-04T10:08:29.0586223Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0269s] [ 2%] 2025-12-04T10:08:29.0586522Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0270s] [ 2%] 2025-12-04T10:08:29.0586818Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0268s] [ 2%] 2025-12-04T10:08:29.0587117Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0587415Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0587711Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0267s] [ 2%] 2025-12-04T10:08:29.0588009Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0588304Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0269s] [ 2%] 2025-12-04T10:08:29.0588602Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0588900Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0589195Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0261s] [ 2%] 2025-12-04T10:08:29.0589490Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0589786Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0590081Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0266s] [ 2%] 2025-12-04T10:08:29.0590377Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0590673Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0265s] [ 2%] 2025-12-04T10:08:29.0590971Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0262s] [ 2%] 2025-12-04T10:08:29.0591267Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0591562Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0264s] [ 2%] 2025-12-04T10:08:29.0591855Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 FAILED [0.0263s] [ 2%] 2025-12-04T10:08:29.0592157Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0680s] [ 2%] 2025-12-04T10:08:29.0592458Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0637s] [ 2%] 2025-12-04T10:08:29.0592776Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0326s] [ 2%] 2025-12-04T10:08:29.0593178Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0328s] [ 2%] 2025-12-04T10:08:29.0593476Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0331s] [ 2%] 2025-12-04T10:08:29.0593775Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0328s] [ 2%] 2025-12-04T10:08:29.0594070Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0323s] [ 2%] 2025-12-04T10:08:29.0594394Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0324s] [ 2%] 2025-12-04T10:08:29.0594704Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0335s] [ 2%] 2025-12-04T10:08:29.0595001Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0326s] [ 2%] 2025-12-04T10:08:29.0595306Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0320s] [ 2%] 2025-12-04T10:08:29.0595622Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0325s] [ 2%] 2025-12-04T10:08:29.0595914Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0325s] [ 2%] 2025-12-04T10:08:29.0596209Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0328s] [ 2%] 2025-12-04T10:08:29.0596501Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0325s] [ 2%] 2025-12-04T10:08:29.0596798Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0326s] [ 2%] 2025-12-04T10:08:29.0597091Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0325s] [ 2%] 2025-12-04T10:08:29.0597394Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0328s] [ 2%] 2025-12-04T10:08:29.0597688Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0323s] [ 2%] 2025-12-04T10:08:29.0597985Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0330s] [ 2%] 2025-12-04T10:08:29.0598280Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0326s] [ 2%] 2025-12-04T10:08:29.0598575Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0332s] [ 2%] 2025-12-04T10:08:29.0599078Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0323s] [ 2%] 2025-12-04T10:08:29.0599377Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0329s] [ 2%] 2025-12-04T10:08:29.0599670Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0328s] [ 2%] 2025-12-04T10:08:29.0599969Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0330s] [ 2%] 2025-12-04T10:08:29.0600265Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0325s] [ 2%] 2025-12-04T10:08:29.0600560Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0330s] [ 2%] 2025-12-04T10:08:29.0600857Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0332s] [ 2%] 2025-12-04T10:08:29.0601154Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0344s] [ 2%] 2025-12-04T10:08:29.0601453Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0329s] [ 2%] 2025-12-04T10:08:29.0601747Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0314s] [ 2%] 2025-12-04T10:08:29.0602102Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0315s] [ 2%] 2025-12-04T10:08:29.0602401Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0308s] [ 2%] 2025-12-04T10:08:29.0602699Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0308s] [ 2%] 2025-12-04T10:08:29.0603079Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0311s] [ 2%] 2025-12-04T10:08:29.0603377Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0314s] [ 2%] 2025-12-04T10:08:29.0603691Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0334s] [ 2%] 2025-12-04T10:08:29.0604000Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0327s] [ 2%] 2025-12-04T10:08:29.0604300Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0316s] [ 2%] 2025-12-04T10:08:29.0604597Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0315s] [ 2%] 2025-12-04T10:08:29.0604900Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0317s] [ 2%] 2025-12-04T10:08:29.0605197Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0311s] [ 2%] 2025-12-04T10:08:29.0605494Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0316s] [ 2%] 2025-12-04T10:08:29.0605790Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0311s] [ 2%] 2025-12-04T10:08:29.0606087Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0312s] [ 2%] 2025-12-04T10:08:29.0606379Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0307s] [ 2%] 2025-12-04T10:08:29.0606675Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0316s] [ 2%] 2025-12-04T10:08:29.0606975Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_grid_sampler_2d_cuda_float64 PASSED [0.0314s] [ 2%] 2025-12-04T10:08:29.0607281Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 FAILED [0.3516s] [ 2%] 2025-12-04T10:08:29.0607598Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4261s] [ 2%] 2025-12-04T10:08:29.0607913Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 FAILED [0.2872s] [ 2%] 2025-12-04T10:08:29.0608231Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4211s] [ 2%] 2025-12-04T10:08:29.0608547Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4276s] [ 2%] 2025-12-04T10:08:29.0608863Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5664s] [ 2%] 2025-12-04T10:08:29.0609176Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5516s] [ 2%] 2025-12-04T10:08:29.0609493Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5847s] [ 2%] 2025-12-04T10:08:29.0609809Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.6343s] [ 2%] 2025-12-04T10:08:29.0610124Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4398s] [ 2%] 2025-12-04T10:08:29.0610438Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5861s] [ 2%] 2025-12-04T10:08:29.0610769Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4757s] [ 2%] 2025-12-04T10:08:29.0611109Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4234s] [ 2%] 2025-12-04T10:08:29.0611423Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 FAILED [0.3317s] [ 2%] 2025-12-04T10:08:29.0611737Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4090s] [ 2%] 2025-12-04T10:08:29.0612052Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4094s] [ 2%] 2025-12-04T10:08:29.0612383Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4295s] [ 2%] 2025-12-04T10:08:29.0612709Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4097s] [ 2%] 2025-12-04T10:08:29.0613124Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4128s] [ 2%] 2025-12-04T10:08:29.0613449Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 FAILED [0.5100s] [ 2%] 2025-12-04T10:08:29.0613769Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4647s] [ 2%] 2025-12-04T10:08:29.0614083Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4651s] [ 2%] 2025-12-04T10:08:29.0614395Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.6201s] [ 2%] 2025-12-04T10:08:29.0614713Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5841s] [ 2%] 2025-12-04T10:08:29.0615030Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4262s] [ 2%] 2025-12-04T10:08:29.0615347Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4499s] [ 2%] 2025-12-04T10:08:29.0615660Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4642s] [ 2%] 2025-12-04T10:08:29.0615980Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.6029s] [ 2%] 2025-12-04T10:08:29.0616295Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.6278s] [ 2%] 2025-12-04T10:08:29.0616612Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4852s] [ 2%] 2025-12-04T10:08:29.0616926Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4268s] [ 2%] 2025-12-04T10:08:29.0617243Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4095s] [ 2%] 2025-12-04T10:08:29.0617559Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4112s] [ 2%] 2025-12-04T10:08:29.0617873Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4219s] [ 2%] 2025-12-04T10:08:29.0618186Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4276s] [ 2%] 2025-12-04T10:08:29.0618498Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4257s] [ 2%] 2025-12-04T10:08:29.0618813Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4264s] [ 2%] 2025-12-04T10:08:29.0619131Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4267s] [ 2%] 2025-12-04T10:08:29.0619446Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4318s] [ 2%] 2025-12-04T10:08:29.0619782Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4221s] [ 2%] 2025-12-04T10:08:29.0620114Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4279s] [ 2%] 2025-12-04T10:08:29.0620428Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4270s] [ 2%] 2025-12-04T10:08:29.0620741Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4270s] [ 2%] 2025-12-04T10:08:29.0621058Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.4178s] [ 2%] 2025-12-04T10:08:29.0621395Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5985s] [ 2%] 2025-12-04T10:08:29.0621728Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5866s] [ 2%] 2025-12-04T10:08:29.0622046Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5783s] [ 2%] 2025-12-04T10:08:29.0622366Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.5559s] [ 2%] 2025-12-04T10:08:29.0622685Z test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 PASSED [0.6424s] [ 2%] 2025-12-04T10:08:29.0622867Z 2025-12-04T10:08:29.0622972Z =================================== FAILURES =================================== 2025-12-04T10:08:29.0623178Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0623371Z Traceback (most recent call last): 2025-12-04T10:08:29.0623653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0623917Z return test(*args, **kwargs) 2025-12-04T10:08:29.0624040Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0624226Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0624451Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0624729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0625064Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0625281Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0625543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0625811Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0625956Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0626196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0626472Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0626630Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0626861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0627090Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0627218Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0627453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.0627689Z _gradcheck_real_imag( 2025-12-04T10:08:29.0627920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1489, in _gradcheck_real_imag 2025-12-04T10:08:29.0628157Z gradcheck_fn( 2025-12-04T10:08:29.0628368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.0628654Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.0628913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.0629172Z raise GradcheckError( 2025-12-04T10:08:29.0629458Z torch.autograd.gradcheck.GradcheckError: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.0629762Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.0629917Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.0630014Z 2025-12-04T10:08:29.0630137Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.0630421Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.0630667Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.0630814Z 2025-12-04T10:08:29.0630855Z Numerical: 2025-12-04T10:08:29.0631019Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.0631193Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0631326Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0631467Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0631623Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0631752Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0631888Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0632045Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0632178Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0632288Z ..., 2025-12-04T10:08:29.0632410Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0632566Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.0632702Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.0632839Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0633061Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.0633189Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.0633325Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0633479Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.0633646Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0633800Z Analytical: 2025-12-04T10:08:29.0633932Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.0634101Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0634234Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.0634370Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0634526Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0634654Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0634787Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0634940Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0635069Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0635179Z ..., 2025-12-04T10:08:29.0635301Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0635457Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.0635586Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.0635725Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0635878Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.0636004Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.0636140Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0636343Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.0636504Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0636613Z 2025-12-04T10:08:29.0636701Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.0636918Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.0637105Z test might've passed in slow_mode! 2025-12-04T10:08:29.0637187Z 2025-12-04T10:08:29.0637281Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0637542Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.0637696Z 2025-12-04T10:08:29.0637736Z If the test 2025-12-04T10:08:29.0637888Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0687950Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.0688181Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0688375Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.0688572Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.0688758Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.0688859Z 2025-12-04T10:08:29.0688949Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0689066Z 2025-12-04T10:08:29.0689119Z Traceback (most recent call last): 2025-12-04T10:08:29.0689390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0689634Z method(*args, **kwargs) 2025-12-04T10:08:29.0689882Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0690162Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0690286Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0690525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0690762Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0690880Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0691111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0691347Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0691458Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0691682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0691909Z fn(*args, **kwargs) 2025-12-04T10:08:29.0692141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0692393Z raise e_tracked from e 2025-12-04T10:08:29.0692621Z Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.0692877Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.0693105Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.0693197Z 2025-12-04T10:08:29.0693301Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.0693552Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.0693797Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.0693934Z 2025-12-04T10:08:29.0693974Z Numerical: 2025-12-04T10:08:29.0694106Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.0694273Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0694525Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0694661Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0694817Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0694941Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0695070Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0695217Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0695338Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0695440Z ..., 2025-12-04T10:08:29.0695555Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0695747Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.0695868Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.0696000Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0696150Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.0696271Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.0696401Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0696550Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.0696709Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0696855Z Analytical: 2025-12-04T10:08:29.0696983Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.0697144Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0697268Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.0697399Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0697550Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0697672Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0697798Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0697946Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.0698068Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.0698169Z ..., 2025-12-04T10:08:29.0698284Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0698432Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.0698553Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.0698682Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0698829Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.0698947Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.0699077Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.0699227Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.0699381Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0699494Z 2025-12-04T10:08:29.0699584Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.0699795Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.0699980Z test might've passed in slow_mode! 2025-12-04T10:08:29.0700060Z 2025-12-04T10:08:29.0700147Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0700377Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.0700521Z 2025-12-04T10:08:29.0700556Z If the test 2025-12-04T10:08:29.0700702Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0700890Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.0701077Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0701257Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.0701460Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.0701637Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.0701737Z 2025-12-04T10:08:29.0702044Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0702394Z 2025-12-04T10:08:29.0702468Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0702809Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0703125Z 2025-12-04T10:08:29.0703214Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0703434Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.0703617Z Traceback (most recent call last): 2025-12-04T10:08:29.0703874Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0704125Z return test(*args, **kwargs) 2025-12-04T10:08:29.0704239Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0704414Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0704620Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0704885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0705215Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0705427Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0705685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0705939Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0706073Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0706307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0706566Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0706711Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0706936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0707164Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0707284Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0707509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0707749Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0707989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0708226Z raise GradcheckError( 2025-12-04T10:08:29.0708384Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0708510Z 2025-12-04T10:08:29.0708604Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0708816Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0709013Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0709135Z 2025-12-04T10:08:29.0709222Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0709449Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0709672Z If the test 2025-12-04T10:08:29.0709835Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0710035Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0710229Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0710445Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0710568Z 2025-12-04T10:08:29.0710661Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0710878Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0711039Z the following. 2025-12-04T10:08:29.0711098Z 2025-12-04T10:08:29.0711226Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0711447Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0711631Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0711783Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0711944Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0712042Z 2025-12-04T10:08:29.0712077Z Got: 2025-12-04T10:08:29.0712183Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.0712326Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.0712460Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.0712591Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.0712720Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.0712806Z 2025-12-04T10:08:29.0712855Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.0713039Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.0713168Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.0713298Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.0713434Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.0713520Z 2025-12-04T10:08:29.0713522Z 2025-12-04T10:08:29.0713570Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.0713701Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.0713827Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.0713952Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.0714084Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.0714168Z 2025-12-04T10:08:29.0714216Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.0714348Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.0714478Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.0714606Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.0714754Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.0714899Z dtype=torch.float64) 2025-12-04T10:08:29.0714969Z 2025-12-04T10:08:29.0715005Z Expected: 2025-12-04T10:08:29.0715111Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.0715245Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.0715374Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.0715501Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.0715631Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.0715718Z 2025-12-04T10:08:29.0715763Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.0715897Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.0716022Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.0716152Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.0716322Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.0716408Z 2025-12-04T10:08:29.0716410Z 2025-12-04T10:08:29.0716457Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.0716584Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.0716711Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.0716837Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.0716966Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.0717050Z 2025-12-04T10:08:29.0717097Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.0717226Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.0717389Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.0717522Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.0717671Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.0717817Z dtype=torch.float64) 2025-12-04T10:08:29.0717889Z 2025-12-04T10:08:29.0717970Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0718096Z 2025-12-04T10:08:29.0718141Z Traceback (most recent call last): 2025-12-04T10:08:29.0718379Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0718618Z method(*args, **kwargs) 2025-12-04T10:08:29.0718866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0719129Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0719254Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0719490Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0719733Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0719852Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0720080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0720313Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0720431Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0720655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0720882Z fn(*args, **kwargs) 2025-12-04T10:08:29.0721115Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0721365Z raise e_tracked from e 2025-12-04T10:08:29.0721483Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0721563Z 2025-12-04T10:08:29.0721656Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0721875Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0722068Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0722184Z 2025-12-04T10:08:29.0722269Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0722495Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0722675Z If the test 2025-12-04T10:08:29.0722821Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0723092Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0723283Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0723503Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0723626Z 2025-12-04T10:08:29.0723719Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0723977Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0724141Z the following. 2025-12-04T10:08:29.0724200Z 2025-12-04T10:08:29.0724291Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0724511Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0724692Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0724844Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0725007Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0725107Z 2025-12-04T10:08:29.0725141Z Got: 2025-12-04T10:08:29.0725267Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.0725423Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.0725557Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.0725688Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.0725824Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.0725910Z 2025-12-04T10:08:29.0725956Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.0726081Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.0726209Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.0726334Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.0726466Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.0726553Z 2025-12-04T10:08:29.0726555Z 2025-12-04T10:08:29.0726601Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.0726731Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.0726859Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.0726981Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.0727107Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.0727195Z 2025-12-04T10:08:29.0727245Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.0727369Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.0727492Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.0727618Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.0727761Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.0727903Z dtype=torch.float64) 2025-12-04T10:08:29.0727971Z 2025-12-04T10:08:29.0728012Z Expected: 2025-12-04T10:08:29.0728113Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.0728249Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.0728380Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.0728504Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.0728631Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.0728716Z 2025-12-04T10:08:29.0728764Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.0728888Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.0729013Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.0729139Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.0729268Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.0729352Z 2025-12-04T10:08:29.0729354Z 2025-12-04T10:08:29.0729403Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.0729532Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.0729657Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.0729786Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.0729918Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.0730026Z 2025-12-04T10:08:29.0730091Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.0730225Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.0730354Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.0730486Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.0730635Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.0730775Z dtype=torch.float64) 2025-12-04T10:08:29.0730842Z 2025-12-04T10:08:29.0731147Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0731484Z 2025-12-04T10:08:29.0731564Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0731877Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.0732120Z 2025-12-04T10:08:29.0732210Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0732426Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0732608Z Traceback (most recent call last): 2025-12-04T10:08:29.0732855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0733144Z return test(*args, **kwargs) 2025-12-04T10:08:29.0733255Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0733430Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0733638Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0733903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0734228Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0734445Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0734699Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0734958Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0735098Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0735333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0735596Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0735745Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0735971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0736195Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0736315Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0736542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0736782Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0737022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0737257Z raise GradcheckError( 2025-12-04T10:08:29.0737414Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0737547Z 2025-12-04T10:08:29.0737641Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0737854Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0738075Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0738216Z 2025-12-04T10:08:29.0738304Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0738537Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0738717Z If the test 2025-12-04T10:08:29.0738862Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0739059Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0739254Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0739486Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0739625Z 2025-12-04T10:08:29.0739718Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0739931Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0740095Z the following. 2025-12-04T10:08:29.0740153Z 2025-12-04T10:08:29.0740245Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0740468Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0740647Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0740800Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0740961Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0741060Z 2025-12-04T10:08:29.0741094Z Got: 2025-12-04T10:08:29.0741217Z tensor([[[[-0.7501+7.9726e-02j, 0.4166+1.4770e+00j, 1.5250+5.0409e-01j, 2025-12-04T10:08:29.0741383Z 1.3125-5.3362e-01j, 0.4543-7.5771e-01j], 2025-12-04T10:08:29.0741537Z [-0.2393+5.2765e-02j, -0.0989-4.0902e-02j, -0.1885-5.7204e-02j, 2025-12-04T10:08:29.0741694Z -0.2942+1.7841e-01j, -0.0727+2.6102e-01j], 2025-12-04T10:08:29.0741845Z [-0.2867+5.4473e-02j, -0.2933+1.4645e-01j, 0.1696-1.0586e-01j, 2025-12-04T10:08:29.0742002Z 0.0314-4.4484e-01j, 0.1050+1.3559e-01j], 2025-12-04T10:08:29.0742148Z [-1.3958-8.1339e-01j, -0.5369-6.0813e-01j, -1.2260-1.7464e-01j, 2025-12-04T10:08:29.0742297Z 0.3117+5.7046e-01j, 0.3362-4.9936e-01j], 2025-12-04T10:08:29.0742442Z [ 4.7407+4.2793e+00j, 12.2699-9.5039e-01j, -8.6688+3.0407e+00j, 2025-12-04T10:08:29.0742597Z -1.7592+6.6302e+00j, -0.6919-8.5212e-01j]], 2025-12-04T10:08:29.0742682Z 2025-12-04T10:08:29.0742750Z [[-0.6800+7.0299e-01j, 1.4536+1.1274e+00j, -0.7016-2.3112e+00j, 2025-12-04T10:08:29.0742896Z 0.4316-2.2178e-01j, 0.7518-6.7808e-01j], 2025-12-04T10:08:29.0743080Z [ 0.8304+2.2318e+00j, -1.5760+1.3611e+00j, -0.2518+4.4128e-03j, 2025-12-04T10:08:29.0743230Z 0.6568-2.6649e-01j, -0.5120-6.2765e-01j], 2025-12-04T10:08:29.0743375Z [ 0.4447-6.1708e-01j, 0.4007-7.3907e-01j, 1.0581+4.5924e-02j, 2025-12-04T10:08:29.0743524Z -0.8412+5.8163e-02j, -0.3835-4.0253e-01j], 2025-12-04T10:08:29.0743670Z [ 0.1873+2.9768e-01j, -0.2781-5.8242e-01j, 0.5444-8.6504e-01j, 2025-12-04T10:08:29.0743819Z -0.1955+1.5327e-01j, 0.1963+3.9709e-01j], 2025-12-04T10:08:29.0743968Z [-2.8196-9.4837e-01j, -1.2308-1.3153e+00j, 5.3516-3.9024e-01j, 2025-12-04T10:08:29.0744119Z 0.6782-1.2914e+00j, -0.9552-2.9624e-01j]]], 2025-12-04T10:08:29.0744202Z 2025-12-04T10:08:29.0744204Z 2025-12-04T10:08:29.0744269Z [[[-0.1919-5.9893e-01j, -0.2037-4.1950e-01j, 0.6085+2.7197e-01j, 2025-12-04T10:08:29.0744418Z 1.4388-8.3350e-01j, -0.6628-1.1732e-01j], 2025-12-04T10:08:29.0744562Z [-0.6616-5.8389e-01j, -0.2443+9.6196e-01j, -0.2488+5.0987e-01j, 2025-12-04T10:08:29.0744713Z 0.1170-8.9906e-01j, 0.4268-3.0089e-01j], 2025-12-04T10:08:29.0744858Z [-0.1374+2.8444e-01j, -0.1955-1.4549e+00j, -0.5708-4.1567e-01j, 2025-12-04T10:08:29.0745008Z -0.0404+3.7118e-01j, 0.2557-1.8153e-01j], 2025-12-04T10:08:29.0745193Z [ 0.3232-1.1092e-01j, -0.4227-1.0964e+00j, 1.2298+9.0961e-01j, 2025-12-04T10:08:29.0745341Z -0.6143-2.3413e-01j, 0.1764-1.6442e+00j], 2025-12-04T10:08:29.0745485Z [ 1.0214+7.6772e-01j, 0.3184-3.5588e-01j, 0.3143+5.4397e-01j, 2025-12-04T10:08:29.0745637Z -0.8216-1.6840e-01j, -0.5994-8.6882e-01j]], 2025-12-04T10:08:29.0745722Z 2025-12-04T10:08:29.0745785Z [[ 1.0539-7.3211e-01j, 0.4599+5.2475e-01j, 1.1369-7.5329e-01j, 2025-12-04T10:08:29.0745931Z -0.7323+2.0070e+00j, -0.6316+1.7883e-01j], 2025-12-04T10:08:29.0746076Z [-1.0193-6.3350e-01j, -0.1444-9.0377e-01j, 0.8412+5.4601e-01j, 2025-12-04T10:08:29.0746238Z -0.4251+8.2113e-03j, -0.9993-3.5177e-01j], 2025-12-04T10:08:29.0746399Z [ 0.3320-4.2876e-01j, -0.8812-2.5672e-02j, 0.1053-7.5240e-01j, 2025-12-04T10:08:29.0746544Z 0.2988+3.5971e-01j, 0.6463+2.1691e-02j], 2025-12-04T10:08:29.0746689Z [-0.0153-3.8690e-01j, 0.8213-6.5318e-01j, 0.7421+1.2504e+00j, 2025-12-04T10:08:29.0746837Z 0.3329+7.9396e-01j, -1.0457-3.7436e-01j], 2025-12-04T10:08:29.0746980Z [-0.5649+1.4362e-01j, -0.1873-1.5054e+00j, -0.7475+3.7488e-01j, 2025-12-04T10:08:29.0747144Z 1.2359-2.0724e-01j, 1.0937+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0747303Z dtype=torch.complex128) 2025-12-04T10:08:29.0747379Z 2025-12-04T10:08:29.0747419Z Expected: 2025-12-04T10:08:29.0747550Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.0747705Z 0.3401-0.5676j], 2025-12-04T10:08:29.0747842Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.0747991Z 0.2064-0.7429j], 2025-12-04T10:08:29.0748127Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.0748272Z 0.4114+0.5306j], 2025-12-04T10:08:29.0748408Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.0748557Z -0.3622+0.5375j], 2025-12-04T10:08:29.0748693Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.0748839Z 0.0867+0.1067j]], 2025-12-04T10:08:29.0748907Z 2025-12-04T10:08:29.0748977Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.0749119Z 0.5321-0.4721j], 2025-12-04T10:08:29.0749252Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.0749396Z -0.6743-0.7686j], 2025-12-04T10:08:29.0749528Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.0749675Z -0.5254-0.5482j], 2025-12-04T10:08:29.0749809Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.0749951Z -0.3257-0.6610j], 2025-12-04T10:08:29.0750085Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.0750230Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.0750299Z 2025-12-04T10:08:29.0750301Z 2025-12-04T10:08:29.0750370Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.0750513Z -0.6628-0.1173j], 2025-12-04T10:08:29.0750646Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.0750788Z 0.4268-0.3009j], 2025-12-04T10:08:29.0750923Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.0751066Z 0.2557-0.1815j], 2025-12-04T10:08:29.0751201Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.0751342Z 0.1764-1.6442j], 2025-12-04T10:08:29.0751474Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.0751620Z -0.5994-0.8688j]], 2025-12-04T10:08:29.0751712Z 2025-12-04T10:08:29.0751818Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.0751961Z -0.6316+0.1788j], 2025-12-04T10:08:29.0752094Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.0752237Z -0.9993-0.3518j], 2025-12-04T10:08:29.0752370Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.0752511Z 0.6463+0.0217j], 2025-12-04T10:08:29.0752643Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.0752784Z -1.0457-0.3744j], 2025-12-04T10:08:29.0753009Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.0753205Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0753312Z 2025-12-04T10:08:29.0753394Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0753520Z 2025-12-04T10:08:29.0753569Z Traceback (most recent call last): 2025-12-04T10:08:29.0753810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0754051Z method(*args, **kwargs) 2025-12-04T10:08:29.0754301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0754567Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0754692Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0754936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0755185Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0755303Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0755540Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0755789Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0755905Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0756131Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0756362Z fn(*args, **kwargs) 2025-12-04T10:08:29.0756598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0756846Z raise e_tracked from e 2025-12-04T10:08:29.0756965Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0757049Z 2025-12-04T10:08:29.0757148Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0757367Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0757568Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0757690Z 2025-12-04T10:08:29.0757779Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0758010Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0758192Z If the test 2025-12-04T10:08:29.0758341Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0758542Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0758738Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0758959Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0759084Z 2025-12-04T10:08:29.0759180Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0759400Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0759563Z the following. 2025-12-04T10:08:29.0759625Z 2025-12-04T10:08:29.0759756Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0759978Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0760161Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0760316Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0760480Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0760582Z 2025-12-04T10:08:29.0760617Z Got: 2025-12-04T10:08:29.0760747Z tensor([[[[-0.7501+7.9726e-02j, 0.4166+1.4770e+00j, 1.5250+5.0409e-01j, 2025-12-04T10:08:29.0760912Z 1.3125-5.3362e-01j, 0.4543-7.5771e-01j], 2025-12-04T10:08:29.0761087Z [-0.2393+5.2765e-02j, -0.0989-4.0902e-02j, -0.1885-5.7204e-02j, 2025-12-04T10:08:29.0761252Z -0.2942+1.7841e-01j, -0.0727+2.6102e-01j], 2025-12-04T10:08:29.0761402Z [-0.2867+5.4473e-02j, -0.2933+1.4645e-01j, 0.1696-1.0586e-01j, 2025-12-04T10:08:29.0761553Z 0.0314-4.4484e-01j, 0.1050+1.3559e-01j], 2025-12-04T10:08:29.0761703Z [-1.3958-8.1339e-01j, -0.5369-6.0813e-01j, -1.2260-1.7464e-01j, 2025-12-04T10:08:29.0761848Z 0.3117+5.7046e-01j, 0.3362-4.9936e-01j], 2025-12-04T10:08:29.0761994Z [ 4.7407+4.2793e+00j, 12.2699-9.5039e-01j, -8.6688+3.0407e+00j, 2025-12-04T10:08:29.0762141Z -1.7592+6.6302e+00j, -0.6919-8.5212e-01j]], 2025-12-04T10:08:29.0762225Z 2025-12-04T10:08:29.0762286Z [[-0.6800+7.0299e-01j, 1.4536+1.1274e+00j, -0.7016-2.3112e+00j, 2025-12-04T10:08:29.0762427Z 0.4316-2.2178e-01j, 0.7518-6.7808e-01j], 2025-12-04T10:08:29.0762567Z [ 0.8304+2.2318e+00j, -1.5760+1.3611e+00j, -0.2518+4.4128e-03j, 2025-12-04T10:08:29.0762712Z 0.6568-2.6649e-01j, -0.5120-6.2765e-01j], 2025-12-04T10:08:29.0762852Z [ 0.4447-6.1708e-01j, 0.4007-7.3907e-01j, 1.0581+4.5924e-02j, 2025-12-04T10:08:29.0763111Z -0.8412+5.8163e-02j, -0.3835-4.0253e-01j], 2025-12-04T10:08:29.0763257Z [ 0.1873+2.9768e-01j, -0.2781-5.8242e-01j, 0.5444-8.6504e-01j, 2025-12-04T10:08:29.0763400Z -0.1955+1.5327e-01j, 0.1963+3.9709e-01j], 2025-12-04T10:08:29.0763541Z [-2.8196-9.4837e-01j, -1.2308-1.3153e+00j, 5.3516-3.9024e-01j, 2025-12-04T10:08:29.0763687Z 0.6782-1.2914e+00j, -0.9552-2.9624e-01j]]], 2025-12-04T10:08:29.0763771Z 2025-12-04T10:08:29.0763773Z 2025-12-04T10:08:29.0763833Z [[[-0.1919-5.9893e-01j, -0.2037-4.1950e-01j, 0.6085+2.7197e-01j, 2025-12-04T10:08:29.0763974Z 1.4388-8.3350e-01j, -0.6628-1.1732e-01j], 2025-12-04T10:08:29.0764113Z [-0.6616-5.8389e-01j, -0.2443+9.6196e-01j, -0.2488+5.0987e-01j, 2025-12-04T10:08:29.0764256Z 0.1170-8.9906e-01j, 0.4268-3.0089e-01j], 2025-12-04T10:08:29.0764398Z [-0.1374+2.8444e-01j, -0.1955-1.4549e+00j, -0.5708-4.1567e-01j, 2025-12-04T10:08:29.0764541Z -0.0404+3.7118e-01j, 0.2557-1.8153e-01j], 2025-12-04T10:08:29.0764683Z [ 0.3232-1.1092e-01j, -0.4227-1.0964e+00j, 1.2298+9.0961e-01j, 2025-12-04T10:08:29.0764827Z -0.6143-2.3413e-01j, 0.1764-1.6442e+00j], 2025-12-04T10:08:29.0764968Z [ 1.0214+7.6772e-01j, 0.3184-3.5588e-01j, 0.3143+5.4397e-01j, 2025-12-04T10:08:29.0765113Z -0.8216-1.6840e-01j, -0.5994-8.6882e-01j]], 2025-12-04T10:08:29.0765198Z 2025-12-04T10:08:29.0765258Z [[ 1.0539-7.3211e-01j, 0.4599+5.2475e-01j, 1.1369-7.5329e-01j, 2025-12-04T10:08:29.0765401Z -0.7323+2.0070e+00j, -0.6316+1.7883e-01j], 2025-12-04T10:08:29.0765542Z [-1.0193-6.3350e-01j, -0.1444-9.0377e-01j, 0.8412+5.4601e-01j, 2025-12-04T10:08:29.0765686Z -0.4251+8.2113e-03j, -0.9993-3.5177e-01j], 2025-12-04T10:08:29.0765831Z [ 0.3320-4.2876e-01j, -0.8812-2.5672e-02j, 0.1053-7.5240e-01j, 2025-12-04T10:08:29.0765975Z 0.2988+3.5971e-01j, 0.6463+2.1691e-02j], 2025-12-04T10:08:29.0766115Z [-0.0153-3.8690e-01j, 0.8213-6.5318e-01j, 0.7421+1.2504e+00j, 2025-12-04T10:08:29.0766298Z 0.3329+7.9396e-01j, -1.0457-3.7436e-01j], 2025-12-04T10:08:29.0766440Z [-0.5649+1.4362e-01j, -0.1873-1.5054e+00j, -0.7475+3.7488e-01j, 2025-12-04T10:08:29.0766598Z 1.2359-2.0724e-01j, 1.0937+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0766738Z dtype=torch.complex128) 2025-12-04T10:08:29.0766812Z 2025-12-04T10:08:29.0766846Z Expected: 2025-12-04T10:08:29.0766970Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.0767118Z 0.3401-0.5676j], 2025-12-04T10:08:29.0767245Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.0767381Z 0.2064-0.7429j], 2025-12-04T10:08:29.0767530Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.0767685Z 0.4114+0.5306j], 2025-12-04T10:08:29.0767814Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.0767957Z -0.3622+0.5375j], 2025-12-04T10:08:29.0768087Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.0768229Z 0.0867+0.1067j]], 2025-12-04T10:08:29.0768296Z 2025-12-04T10:08:29.0768360Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.0768496Z 0.5321-0.4721j], 2025-12-04T10:08:29.0768625Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.0768762Z -0.6743-0.7686j], 2025-12-04T10:08:29.0768888Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.0769023Z -0.5254-0.5482j], 2025-12-04T10:08:29.0769152Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.0769291Z -0.3257-0.6610j], 2025-12-04T10:08:29.0769421Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.0769565Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.0769636Z 2025-12-04T10:08:29.0769638Z 2025-12-04T10:08:29.0769703Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.0769840Z -0.6628-0.1173j], 2025-12-04T10:08:29.0769969Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.0770105Z 0.4268-0.3009j], 2025-12-04T10:08:29.0770232Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.0770369Z 0.2557-0.1815j], 2025-12-04T10:08:29.0770500Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.0770641Z 0.1764-1.6442j], 2025-12-04T10:08:29.0770772Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.0770911Z -0.5994-0.8688j]], 2025-12-04T10:08:29.0770978Z 2025-12-04T10:08:29.0771042Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.0771181Z -0.6316+0.1788j], 2025-12-04T10:08:29.0771308Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.0771450Z -0.9993-0.3518j], 2025-12-04T10:08:29.0771577Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.0771719Z 0.6463+0.0217j], 2025-12-04T10:08:29.0771846Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.0771984Z -1.0457-0.3744j], 2025-12-04T10:08:29.0772115Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.0772282Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0772389Z 2025-12-04T10:08:29.0772709Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0773095Z 2025-12-04T10:08:29.0773175Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0773495Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0773738Z 2025-12-04T10:08:29.0773831Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0774054Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0774239Z Traceback (most recent call last): 2025-12-04T10:08:29.0774520Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0774784Z return test(*args, **kwargs) 2025-12-04T10:08:29.0774901Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0775083Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0775291Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0775562Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0775894Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0776108Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0776364Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0776620Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0776756Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0776994Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0777255Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0777403Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0777625Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0777848Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0777976Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0778208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0778454Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0778819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0779103Z raise GradcheckError( 2025-12-04T10:08:29.0779300Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0779433Z 2025-12-04T10:08:29.0779579Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0779833Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0780063Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0780207Z 2025-12-04T10:08:29.0780328Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0780592Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0780823Z If the test 2025-12-04T10:08:29.0781015Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0781253Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0781495Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0781768Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0781921Z 2025-12-04T10:08:29.0782035Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0782311Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0782515Z the following. 2025-12-04T10:08:29.0782582Z 2025-12-04T10:08:29.0782707Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0783049Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0783270Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0783478Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0783721Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0783829Z 2025-12-04T10:08:29.0783882Z Got: 2025-12-04T10:08:29.0784039Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0784207Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0784376Z nan+nanj], 2025-12-04T10:08:29.0784540Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0784702Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0784874Z nan+nanj], 2025-12-04T10:08:29.0785026Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0785182Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0785363Z nan+nanj], 2025-12-04T10:08:29.0785525Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.0785721Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.0785899Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.0786067Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.0786262Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.0786433Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.0786522Z 2025-12-04T10:08:29.0786607Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0786800Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0786968Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0787144Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0787371Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0787535Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0787699Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0787870Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0788026Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0788205Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0788380Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0788547Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0788707Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0788881Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0789151Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0789237Z 2025-12-04T10:08:29.0789239Z 2025-12-04T10:08:29.0789318Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0789483Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0789660Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0789822Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0790002Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0790179Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0790334Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0790525Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0790687Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0790874Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0791078Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0791237Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0791399Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0791579Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0791739Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0791819Z 2025-12-04T10:08:29.0791921Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0792090Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0792264Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0792467Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0792637Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0793069Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0793232Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0793405Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0793579Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0793733Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0793909Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0794099Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0794266Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0794442Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0794620Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0794791Z dtype=torch.complex128) 2025-12-04T10:08:29.0794868Z 2025-12-04T10:08:29.0794943Z Expected: 2025-12-04T10:08:29.0795104Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0795283Z 0.3401-0.5673j], 2025-12-04T10:08:29.0795467Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0795645Z 0.2078-0.7444j], 2025-12-04T10:08:29.0795814Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0796000Z 0.4109+0.5305j], 2025-12-04T10:08:29.0796162Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0796345Z -0.3607+0.5386j], 2025-12-04T10:08:29.0796512Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0796681Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0796771Z 2025-12-04T10:08:29.0796871Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0797046Z 0.5323-0.4729j], 2025-12-04T10:08:29.0797216Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0797396Z -0.6732-0.7677j], 2025-12-04T10:08:29.0797562Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0797753Z -0.5241-0.5479j], 2025-12-04T10:08:29.0797913Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0798078Z -0.3257-0.6597j], 2025-12-04T10:08:29.0798261Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0798434Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0798516Z 2025-12-04T10:08:29.0798518Z 2025-12-04T10:08:29.0798619Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0798797Z -0.6637-0.1175j], 2025-12-04T10:08:29.0798960Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0799145Z 0.4261-0.3012j], 2025-12-04T10:08:29.0799305Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0799509Z 0.2567-0.1808j], 2025-12-04T10:08:29.0799700Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0799876Z 0.1761-1.6446j], 2025-12-04T10:08:29.0800041Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0800633Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0800717Z 2025-12-04T10:08:29.0800804Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0800984Z -0.6307+0.1756j], 2025-12-04T10:08:29.0801159Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0801323Z -0.9972-0.3518j], 2025-12-04T10:08:29.0801531Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0801700Z 0.6467+0.0201j], 2025-12-04T10:08:29.0801868Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0802052Z -1.0443-0.3699j], 2025-12-04T10:08:29.0802216Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0802437Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0802552Z 2025-12-04T10:08:29.0802659Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0802785Z 2025-12-04T10:08:29.0802849Z Traceback (most recent call last): 2025-12-04T10:08:29.0803199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0803469Z method(*args, **kwargs) 2025-12-04T10:08:29.0803758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0804061Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0804215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0804506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0804778Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0804921Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0805205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0805476Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0805629Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0805887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0806153Z fn(*args, **kwargs) 2025-12-04T10:08:29.0806429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0806705Z raise e_tracked from e 2025-12-04T10:08:29.0806854Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0806958Z 2025-12-04T10:08:29.0807082Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0807331Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0807565Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0807696Z 2025-12-04T10:08:29.0807808Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0808071Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0808292Z If the test 2025-12-04T10:08:29.0808474Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0808701Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0808944Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0809202Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0809370Z 2025-12-04T10:08:29.0809496Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0809753Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0809943Z the following. 2025-12-04T10:08:29.0872654Z 2025-12-04T10:08:29.0872813Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0873122Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0873319Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0873478Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0873756Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0873892Z 2025-12-04T10:08:29.0873925Z Got: 2025-12-04T10:08:29.0874026Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874154Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874289Z nan+nanj], 2025-12-04T10:08:29.0874405Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874525Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874642Z nan+nanj], 2025-12-04T10:08:29.0874757Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874876Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0874988Z nan+nanj], 2025-12-04T10:08:29.0875113Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.0875263Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.0875393Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.0875522Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.0875670Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.0875801Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.0875877Z 2025-12-04T10:08:29.0875930Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0876072Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0876198Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0876327Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0876471Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0876595Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0876723Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0876863Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0876986Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0877108Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0877244Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0877367Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0877488Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0877624Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0877750Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0877824Z 2025-12-04T10:08:29.0877826Z 2025-12-04T10:08:29.0877880Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0878015Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0878138Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0878260Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0878394Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0878517Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0878641Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0878776Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0878899Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0879064Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0879200Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0879321Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0879440Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0879577Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0879703Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0879777Z 2025-12-04T10:08:29.0879829Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0879963Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0880085Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0880165Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0880217Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0880257Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0880310Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0880361Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0880400Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0880451Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0880500Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0880539Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0880590Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0880640Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0880692Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0880741Z dtype=torch.complex128) 2025-12-04T10:08:29.0880744Z 2025-12-04T10:08:29.0880782Z Expected: 2025-12-04T10:08:29.0880862Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0880904Z 0.3401-0.5673j], 2025-12-04T10:08:29.0880972Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0881012Z 0.2078-0.7444j], 2025-12-04T10:08:29.0881078Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0881116Z 0.4109+0.5305j], 2025-12-04T10:08:29.0881180Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0881220Z -0.3607+0.5386j], 2025-12-04T10:08:29.0881283Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0881323Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0881325Z 2025-12-04T10:08:29.0881390Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0881430Z 0.5323-0.4729j], 2025-12-04T10:08:29.0881492Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0881530Z -0.6732-0.7677j], 2025-12-04T10:08:29.0881595Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0881633Z -0.5241-0.5479j], 2025-12-04T10:08:29.0881695Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0881734Z -0.3257-0.6597j], 2025-12-04T10:08:29.0881797Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0881837Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0881839Z 2025-12-04T10:08:29.0881841Z 2025-12-04T10:08:29.0881905Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0881941Z -0.6637-0.1175j], 2025-12-04T10:08:29.0882006Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0882043Z 0.4261-0.3012j], 2025-12-04T10:08:29.0882108Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0882162Z 0.2567-0.1808j], 2025-12-04T10:08:29.0882238Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0882276Z 0.1761-1.6446j], 2025-12-04T10:08:29.0882339Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0882378Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0882380Z 2025-12-04T10:08:29.0882443Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0882480Z -0.6307+0.1756j], 2025-12-04T10:08:29.0882542Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0882579Z -0.9972-0.3518j], 2025-12-04T10:08:29.0882654Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0882700Z 0.6467+0.0201j], 2025-12-04T10:08:29.0882762Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0882799Z -1.0443-0.3699j], 2025-12-04T10:08:29.0882863Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0882975Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0882977Z 2025-12-04T10:08:29.0883288Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0883291Z 2025-12-04T10:08:29.0883367Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0883582Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0883585Z 2025-12-04T10:08:29.0883674Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0883771Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0883819Z Traceback (most recent call last): 2025-12-04T10:08:29.0884002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0884047Z return test(*args, **kwargs) 2025-12-04T10:08:29.0884084Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0884195Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0884265Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0884437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0884560Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0884617Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0884779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0884839Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0884882Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0885039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0885107Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0885154Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0885294Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0885341Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0885380Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0885555Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0885624Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0885779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0885823Z raise GradcheckError( 2025-12-04T10:08:29.0885915Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0885917Z 2025-12-04T10:08:29.0886012Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0886094Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0886191Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0886206Z 2025-12-04T10:08:29.0886290Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0886397Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0886434Z If the test 2025-12-04T10:08:29.0886530Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0886593Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0886692Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0886774Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0886776Z 2025-12-04T10:08:29.0886871Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0886959Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0886998Z the following. 2025-12-04T10:08:29.0887000Z 2025-12-04T10:08:29.0887089Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0887180Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0887235Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0887299Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0887361Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0887363Z 2025-12-04T10:08:29.0887396Z Got: 2025-12-04T10:08:29.0887448Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887494Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887534Z nan+nanj], 2025-12-04T10:08:29.0887578Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887623Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887662Z nan+nanj], 2025-12-04T10:08:29.0887708Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887751Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0887789Z nan+nanj], 2025-12-04T10:08:29.0887846Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.0887904Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.0887944Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.0887998Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.0888050Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.0888094Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.0888097Z 2025-12-04T10:08:29.0888147Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0888199Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0888237Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0888290Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0888340Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0888380Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0888429Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0888506Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0888546Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0888597Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0888645Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0888685Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0888734Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0888784Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0888827Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0888829Z 2025-12-04T10:08:29.0888831Z 2025-12-04T10:08:29.0888894Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0888954Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0888994Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0889044Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0889097Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0889136Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0889187Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0889238Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0889279Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0889329Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0889380Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0889419Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0889469Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0889520Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0889561Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0889564Z 2025-12-04T10:08:29.0889614Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0889665Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0889705Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0889755Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0889806Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0889845Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0889895Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0889945Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0889984Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0890035Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0890086Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0890125Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0890175Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0890228Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0890281Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0890325Z dtype=torch.complex128) 2025-12-04T10:08:29.0890328Z 2025-12-04T10:08:29.0890364Z Expected: 2025-12-04T10:08:29.0890442Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0890482Z 0.3401-0.5673j], 2025-12-04T10:08:29.0890547Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0890586Z 0.2078-0.7444j], 2025-12-04T10:08:29.0890650Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0890690Z 0.4109+0.5305j], 2025-12-04T10:08:29.0890752Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0890791Z -0.3607+0.5386j], 2025-12-04T10:08:29.0890854Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0890922Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0890924Z 2025-12-04T10:08:29.0890987Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0891024Z 0.5323-0.4729j], 2025-12-04T10:08:29.0891087Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0891125Z -0.6732-0.7677j], 2025-12-04T10:08:29.0891186Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0891226Z -0.5241-0.5479j], 2025-12-04T10:08:29.0891288Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0891353Z -0.3257-0.6597j], 2025-12-04T10:08:29.0891416Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0891454Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0891456Z 2025-12-04T10:08:29.0891459Z 2025-12-04T10:08:29.0891522Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0891560Z -0.6637-0.1175j], 2025-12-04T10:08:29.0891622Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0891658Z 0.4261-0.3012j], 2025-12-04T10:08:29.0891721Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0891758Z 0.2567-0.1808j], 2025-12-04T10:08:29.0891822Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0891857Z 0.1761-1.6446j], 2025-12-04T10:08:29.0891922Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0891962Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0891964Z 2025-12-04T10:08:29.0892026Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0892063Z -0.6307+0.1756j], 2025-12-04T10:08:29.0892128Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0892164Z -0.9972-0.3518j], 2025-12-04T10:08:29.0892228Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0892264Z 0.6467+0.0201j], 2025-12-04T10:08:29.0892325Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0892362Z -1.0443-0.3699j], 2025-12-04T10:08:29.0892426Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0892491Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0892493Z 2025-12-04T10:08:29.0892580Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0892582Z 2025-12-04T10:08:29.0892628Z Traceback (most recent call last): 2025-12-04T10:08:29.0892787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0892829Z method(*args, **kwargs) 2025-12-04T10:08:29.0893063Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0893109Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0893150Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0893309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0893354Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0893392Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0893550Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0893593Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0893630Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0893826Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0893866Z fn(*args, **kwargs) 2025-12-04T10:08:29.0894033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0894074Z raise e_tracked from e 2025-12-04T10:08:29.0894121Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0894123Z 2025-12-04T10:08:29.0894216Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0894300Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0894402Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0894423Z 2025-12-04T10:08:29.0894510Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0894612Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0894650Z If the test 2025-12-04T10:08:29.0894744Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0894810Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0894908Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0894992Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0894994Z 2025-12-04T10:08:29.0895086Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0895175Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0895215Z the following. 2025-12-04T10:08:29.0895217Z 2025-12-04T10:08:29.0895308Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0895398Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0895457Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0895523Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0895587Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0895589Z 2025-12-04T10:08:29.0895626Z Got: 2025-12-04T10:08:29.0895678Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0895727Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0895767Z nan+nanj], 2025-12-04T10:08:29.0895813Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0895858Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0895900Z nan+nanj], 2025-12-04T10:08:29.0895942Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0895986Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0896026Z nan+nanj], 2025-12-04T10:08:29.0896086Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.0896143Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.0896183Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.0896234Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.0896290Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.0896334Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.0896336Z 2025-12-04T10:08:29.0896388Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0896439Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0896480Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0896530Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0896585Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0896624Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0896678Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0896759Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0896812Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0896862Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0896915Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0896959Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0897019Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0897069Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0897123Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0897125Z 2025-12-04T10:08:29.0897127Z 2025-12-04T10:08:29.0897186Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0897249Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0897290Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0897344Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0897396Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0897439Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0897488Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0897544Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0897583Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0897634Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0897683Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0897730Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0897780Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0897835Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0897878Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0897880Z 2025-12-04T10:08:29.0897930Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0897984Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0898027Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0898078Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0898136Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0898179Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0898238Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0898295Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0898334Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0898386Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0898436Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0898478Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0898528Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0898583Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0898635Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0898684Z dtype=torch.complex128) 2025-12-04T10:08:29.0898686Z 2025-12-04T10:08:29.0898721Z Expected: 2025-12-04T10:08:29.0898808Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0898845Z 0.3401-0.5673j], 2025-12-04T10:08:29.0898913Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0898949Z 0.2078-0.7444j], 2025-12-04T10:08:29.0899018Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0899054Z 0.4109+0.5305j], 2025-12-04T10:08:29.0899122Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0899160Z -0.3607+0.5386j], 2025-12-04T10:08:29.0899223Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0899287Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0899289Z 2025-12-04T10:08:29.0899353Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0899389Z 0.5323-0.4729j], 2025-12-04T10:08:29.0899453Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0899490Z -0.6732-0.7677j], 2025-12-04T10:08:29.0899552Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0899587Z -0.5241-0.5479j], 2025-12-04T10:08:29.0899653Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0899703Z -0.3257-0.6597j], 2025-12-04T10:08:29.0899780Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0899819Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0899821Z 2025-12-04T10:08:29.0899823Z 2025-12-04T10:08:29.0899890Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0899928Z -0.6637-0.1175j], 2025-12-04T10:08:29.0899991Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0900027Z 0.4261-0.3012j], 2025-12-04T10:08:29.0900093Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0900130Z 0.2567-0.1808j], 2025-12-04T10:08:29.0900193Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0900230Z 0.1761-1.6446j], 2025-12-04T10:08:29.0900293Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0900333Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0900336Z 2025-12-04T10:08:29.0900397Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0900438Z -0.6307+0.1756j], 2025-12-04T10:08:29.0900503Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0900544Z -0.9972-0.3518j], 2025-12-04T10:08:29.0900606Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0900645Z 0.6467+0.0201j], 2025-12-04T10:08:29.0900708Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0900746Z -1.0443-0.3699j], 2025-12-04T10:08:29.0900810Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0900879Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0900881Z 2025-12-04T10:08:29.0901184Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0901189Z 2025-12-04T10:08:29.0901264Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0901471Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0901473Z 2025-12-04T10:08:29.0901565Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0901661Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0901709Z Traceback (most recent call last): 2025-12-04T10:08:29.0901885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0901927Z return test(*args, **kwargs) 2025-12-04T10:08:29.0901970Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0902076Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0902198Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0902365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0902488Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0902541Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0902704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0902773Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0902828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0903020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0903094Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0903141Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0903284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0903331Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0903373Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0903522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0903576Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0903729Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0903773Z raise GradcheckError( 2025-12-04T10:08:29.0903863Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0903866Z 2025-12-04T10:08:29.0903962Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0904046Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0904126Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0904128Z 2025-12-04T10:08:29.0904214Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0904316Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0904352Z If the test 2025-12-04T10:08:29.0904446Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0904511Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0904607Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0904691Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0904694Z 2025-12-04T10:08:29.0904786Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0904873Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0904911Z the following. 2025-12-04T10:08:29.0904913Z 2025-12-04T10:08:29.0905005Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0905093Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0905147Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0905209Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0905274Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0905276Z 2025-12-04T10:08:29.0905310Z Got: 2025-12-04T10:08:29.0905388Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.0905427Z -0.0303+0.0508j], 2025-12-04T10:08:29.0905494Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.0905565Z -0.0087+0.0311j], 2025-12-04T10:08:29.0905631Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.0905668Z 0.0279+0.0361j], 2025-12-04T10:08:29.0905733Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.0905770Z -0.4873+0.7136j], 2025-12-04T10:08:29.0905833Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.0905872Z -0.0153-0.0191j]], 2025-12-04T10:08:29.0905876Z 2025-12-04T10:08:29.0905939Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.0905998Z 0.2857-0.2518j], 2025-12-04T10:08:29.0906075Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.0906113Z 0.0473+0.0540j], 2025-12-04T10:08:29.0906174Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.0906214Z -0.0383-0.0398j], 2025-12-04T10:08:29.0906275Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.0906312Z -0.0382-0.0777j], 2025-12-04T10:08:29.0906374Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.0906413Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.0906415Z 2025-12-04T10:08:29.0906417Z 2025-12-04T10:08:29.0906479Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0906515Z -0.6637-0.1175j], 2025-12-04T10:08:29.0906579Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0906618Z 0.4261-0.3012j], 2025-12-04T10:08:29.0906681Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0906718Z 0.2567-0.1808j], 2025-12-04T10:08:29.0906781Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0906818Z 0.1761-1.6446j], 2025-12-04T10:08:29.0906880Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0906921Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0906923Z 2025-12-04T10:08:29.0906984Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0907021Z -0.6307+0.1756j], 2025-12-04T10:08:29.0907082Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0907120Z -0.9972-0.3518j], 2025-12-04T10:08:29.0907182Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0907219Z 0.6467+0.0201j], 2025-12-04T10:08:29.0907280Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0907317Z -1.0443-0.3699j], 2025-12-04T10:08:29.0907381Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0907448Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0907450Z 2025-12-04T10:08:29.0907485Z Expected: 2025-12-04T10:08:29.0907558Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0907593Z 0.3401-0.5673j], 2025-12-04T10:08:29.0907656Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0907691Z 0.2078-0.7444j], 2025-12-04T10:08:29.0907756Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0907793Z 0.4109+0.5305j], 2025-12-04T10:08:29.0907857Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0907894Z -0.3607+0.5386j], 2025-12-04T10:08:29.0907956Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0908021Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0908023Z 2025-12-04T10:08:29.0908086Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0908122Z 0.5323-0.4729j], 2025-12-04T10:08:29.0908185Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0908222Z -0.6732-0.7677j], 2025-12-04T10:08:29.0908282Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0908318Z -0.5241-0.5479j], 2025-12-04T10:08:29.0908380Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0908419Z -0.3257-0.6597j], 2025-12-04T10:08:29.0908504Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0908543Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0908545Z 2025-12-04T10:08:29.0908547Z 2025-12-04T10:08:29.0908610Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0908648Z -0.6637-0.1175j], 2025-12-04T10:08:29.0908710Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0908748Z 0.4261-0.3012j], 2025-12-04T10:08:29.0908810Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0908847Z 0.2567-0.1808j], 2025-12-04T10:08:29.0908909Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0908945Z 0.1761-1.6446j], 2025-12-04T10:08:29.0909006Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0909048Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0909051Z 2025-12-04T10:08:29.0909112Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0909149Z -0.6307+0.1756j], 2025-12-04T10:08:29.0909213Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0909250Z -0.9972-0.3518j], 2025-12-04T10:08:29.0909312Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0909349Z 0.6467+0.0201j], 2025-12-04T10:08:29.0909409Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0909446Z -1.0443-0.3699j], 2025-12-04T10:08:29.0909510Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0909576Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0909578Z 2025-12-04T10:08:29.0909663Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0909666Z 2025-12-04T10:08:29.0909711Z Traceback (most recent call last): 2025-12-04T10:08:29.0909870Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0909913Z method(*args, **kwargs) 2025-12-04T10:08:29.0910091Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0910137Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0910178Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0910337Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0910381Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0910419Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0910578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0910619Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0910656Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0910816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0910871Z fn(*args, **kwargs) 2025-12-04T10:08:29.0911035Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0911078Z raise e_tracked from e 2025-12-04T10:08:29.0911126Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0911129Z 2025-12-04T10:08:29.0911224Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0911305Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0911388Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0911436Z 2025-12-04T10:08:29.0911526Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0911631Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0911669Z If the test 2025-12-04T10:08:29.0911762Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0911826Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0911921Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0912005Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0912008Z 2025-12-04T10:08:29.0912099Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0912185Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0912222Z the following. 2025-12-04T10:08:29.0912225Z 2025-12-04T10:08:29.0912316Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0912404Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0912456Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0912523Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0912585Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0912587Z 2025-12-04T10:08:29.0912619Z Got: 2025-12-04T10:08:29.0912693Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.0912731Z -0.0303+0.0508j], 2025-12-04T10:08:29.0912799Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.0912838Z -0.0087+0.0311j], 2025-12-04T10:08:29.0912905Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.0912994Z 0.0279+0.0361j], 2025-12-04T10:08:29.0913059Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.0913097Z -0.4873+0.7136j], 2025-12-04T10:08:29.0913162Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.0913203Z -0.0153-0.0191j]], 2025-12-04T10:08:29.0913205Z 2025-12-04T10:08:29.0913270Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.0913307Z 0.2857-0.2518j], 2025-12-04T10:08:29.0913372Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.0913407Z 0.0473+0.0540j], 2025-12-04T10:08:29.0913468Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.0913504Z -0.0383-0.0398j], 2025-12-04T10:08:29.0913569Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.0913606Z -0.0382-0.0777j], 2025-12-04T10:08:29.0913672Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.0913710Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.0913715Z 2025-12-04T10:08:29.0913717Z 2025-12-04T10:08:29.0913804Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0913858Z -0.6637-0.1175j], 2025-12-04T10:08:29.0913920Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0913956Z 0.4261-0.3012j], 2025-12-04T10:08:29.0914019Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0914057Z 0.2567-0.1808j], 2025-12-04T10:08:29.0914121Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0914158Z 0.1761-1.6446j], 2025-12-04T10:08:29.0914220Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0914294Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0914296Z 2025-12-04T10:08:29.0914361Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0914399Z -0.6307+0.1756j], 2025-12-04T10:08:29.0914465Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0914506Z -0.9972-0.3518j], 2025-12-04T10:08:29.0914569Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0914606Z 0.6467+0.0201j], 2025-12-04T10:08:29.0914666Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0914706Z -1.0443-0.3699j], 2025-12-04T10:08:29.0914769Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0914836Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0914838Z 2025-12-04T10:08:29.0914872Z Expected: 2025-12-04T10:08:29.0914950Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0914990Z 0.3401-0.5673j], 2025-12-04T10:08:29.0915054Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0915094Z 0.2078-0.7444j], 2025-12-04T10:08:29.0915160Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0915194Z 0.4109+0.5305j], 2025-12-04T10:08:29.0915259Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0915295Z -0.3607+0.5386j], 2025-12-04T10:08:29.0915359Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0915395Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0915397Z 2025-12-04T10:08:29.0915460Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0915496Z 0.5323-0.4729j], 2025-12-04T10:08:29.0915565Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0915604Z -0.6732-0.7677j], 2025-12-04T10:08:29.0915666Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0915705Z -0.5241-0.5479j], 2025-12-04T10:08:29.0915768Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0915807Z -0.3257-0.6597j], 2025-12-04T10:08:29.0915870Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0915912Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0915913Z 2025-12-04T10:08:29.0915915Z 2025-12-04T10:08:29.0915979Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0916018Z -0.6637-0.1175j], 2025-12-04T10:08:29.0916082Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0916121Z 0.4261-0.3012j], 2025-12-04T10:08:29.0916185Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0916223Z 0.2567-0.1808j], 2025-12-04T10:08:29.0916285Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0916355Z 0.1761-1.6446j], 2025-12-04T10:08:29.0916417Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0916459Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0916460Z 2025-12-04T10:08:29.0916523Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0916563Z -0.6307+0.1756j], 2025-12-04T10:08:29.0916626Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0916665Z -0.9972-0.3518j], 2025-12-04T10:08:29.0916728Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0916779Z 0.6467+0.0201j], 2025-12-04T10:08:29.0916852Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0916893Z -1.0443-0.3699j], 2025-12-04T10:08:29.0916955Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0917025Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0917027Z 2025-12-04T10:08:29.0917327Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0917332Z 2025-12-04T10:08:29.0917406Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0917614Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0917617Z 2025-12-04T10:08:29.0917705Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0917800Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0917849Z Traceback (most recent call last): 2025-12-04T10:08:29.0918019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0918062Z return test(*args, **kwargs) 2025-12-04T10:08:29.0918104Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0918207Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0918273Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0918441Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0918569Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0918623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0918786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0918843Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0918888Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0919043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0919110Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0919157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0919296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0919345Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0919383Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0919538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0919614Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0919768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0919811Z raise GradcheckError( 2025-12-04T10:08:29.0919901Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0919903Z 2025-12-04T10:08:29.0919997Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0920079Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0920158Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0920160Z 2025-12-04T10:08:29.0920267Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0920371Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0920408Z If the test 2025-12-04T10:08:29.0920504Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0920571Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0920665Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0920749Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0920751Z 2025-12-04T10:08:29.0920843Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0920929Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0920966Z the following. 2025-12-04T10:08:29.0920969Z 2025-12-04T10:08:29.0921058Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0921152Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0921203Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0921270Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0921331Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0921333Z 2025-12-04T10:08:29.0921369Z Got: 2025-12-04T10:08:29.0921444Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.0921483Z -0.0303+0.0508j], 2025-12-04T10:08:29.0921547Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.0921588Z -0.0087+0.0311j], 2025-12-04T10:08:29.0921653Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.0921694Z 0.0279+0.0361j], 2025-12-04T10:08:29.0921759Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.0921800Z -0.4873+0.7136j], 2025-12-04T10:08:29.0921862Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.0921904Z -0.0153-0.0191j]], 2025-12-04T10:08:29.0921907Z 2025-12-04T10:08:29.0921971Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.0922009Z 0.2857-0.2518j], 2025-12-04T10:08:29.0922072Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.0922111Z 0.0473+0.0540j], 2025-12-04T10:08:29.0922172Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.0922209Z -0.0383-0.0398j], 2025-12-04T10:08:29.0922271Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.0922310Z -0.0382-0.0777j], 2025-12-04T10:08:29.0922372Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.0922415Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.0922417Z 2025-12-04T10:08:29.0922419Z 2025-12-04T10:08:29.0922483Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0922548Z -0.6637-0.1175j], 2025-12-04T10:08:29.0922613Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0922655Z 0.4261-0.3012j], 2025-12-04T10:08:29.0922717Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0922758Z 0.2567-0.1808j], 2025-12-04T10:08:29.0922821Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0922862Z 0.1761-1.6446j], 2025-12-04T10:08:29.0922978Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0923038Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0923053Z 2025-12-04T10:08:29.0923115Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0923152Z -0.6307+0.1756j], 2025-12-04T10:08:29.0923215Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0923253Z -0.9972-0.3518j], 2025-12-04T10:08:29.0923320Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0923357Z 0.6467+0.0201j], 2025-12-04T10:08:29.0923420Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0923459Z -1.0443-0.3699j], 2025-12-04T10:08:29.0923529Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0923596Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0923598Z 2025-12-04T10:08:29.0923632Z Expected: 2025-12-04T10:08:29.0923708Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0923748Z 0.3401-0.5673j], 2025-12-04T10:08:29.0923811Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0923848Z 0.2078-0.7444j], 2025-12-04T10:08:29.0923914Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0923955Z 0.4109+0.5305j], 2025-12-04T10:08:29.0924018Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0924058Z -0.3607+0.5386j], 2025-12-04T10:08:29.0924121Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0924162Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0924164Z 2025-12-04T10:08:29.0924228Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0924267Z 0.5323-0.4729j], 2025-12-04T10:08:29.0924330Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0924371Z -0.6732-0.7677j], 2025-12-04T10:08:29.0924433Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0924470Z -0.5241-0.5479j], 2025-12-04T10:08:29.0924534Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0924573Z -0.3257-0.6597j], 2025-12-04T10:08:29.0924635Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0924675Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0924677Z 2025-12-04T10:08:29.0924678Z 2025-12-04T10:08:29.0924741Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0924781Z -0.6637-0.1175j], 2025-12-04T10:08:29.0924843Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0924879Z 0.4261-0.3012j], 2025-12-04T10:08:29.0924945Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0924980Z 0.2567-0.1808j], 2025-12-04T10:08:29.0925043Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0925107Z 0.1761-1.6446j], 2025-12-04T10:08:29.0925173Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0925212Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0925214Z 2025-12-04T10:08:29.0925277Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0925313Z -0.6307+0.1756j], 2025-12-04T10:08:29.0925380Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0925417Z -0.9972-0.3518j], 2025-12-04T10:08:29.0925483Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0925520Z 0.6467+0.0201j], 2025-12-04T10:08:29.0925609Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0925646Z -1.0443-0.3699j], 2025-12-04T10:08:29.0925714Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0925780Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0925782Z 2025-12-04T10:08:29.0925865Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0925867Z 2025-12-04T10:08:29.0925913Z Traceback (most recent call last): 2025-12-04T10:08:29.0926076Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0926118Z method(*args, **kwargs) 2025-12-04T10:08:29.0926298Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0926344Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0926385Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0926544Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0926590Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0926630Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0926787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0926828Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0926868Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0927025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0927068Z fn(*args, **kwargs) 2025-12-04T10:08:29.0927236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0927280Z raise e_tracked from e 2025-12-04T10:08:29.0927328Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0927331Z 2025-12-04T10:08:29.0927425Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0927509Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0927588Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0927590Z 2025-12-04T10:08:29.0927679Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0927780Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0927820Z If the test 2025-12-04T10:08:29.0927914Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0927978Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0928076Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0928160Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0928162Z 2025-12-04T10:08:29.0928252Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0928371Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0928409Z the following. 2025-12-04T10:08:29.0928411Z 2025-12-04T10:08:29.0928500Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0928591Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0928645Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0928709Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0928771Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0928773Z 2025-12-04T10:08:29.0928808Z Got: 2025-12-04T10:08:29.0928892Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.0928948Z -0.0303+0.0508j], 2025-12-04T10:08:29.0929013Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.0929053Z -0.0087+0.0311j], 2025-12-04T10:08:29.0929117Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.0929155Z 0.0279+0.0361j], 2025-12-04T10:08:29.0929218Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.0929257Z -0.4873+0.7136j], 2025-12-04T10:08:29.0929320Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.0929363Z -0.0153-0.0191j]], 2025-12-04T10:08:29.0929365Z 2025-12-04T10:08:29.0929428Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.0929468Z 0.2857-0.2518j], 2025-12-04T10:08:29.0929531Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.0929570Z 0.0473+0.0540j], 2025-12-04T10:08:29.0929633Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.0929672Z -0.0383-0.0398j], 2025-12-04T10:08:29.0929735Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.0929779Z -0.0382-0.0777j], 2025-12-04T10:08:29.0929841Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.0929881Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.0929883Z 2025-12-04T10:08:29.0929885Z 2025-12-04T10:08:29.0929948Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0929985Z -0.6637-0.1175j], 2025-12-04T10:08:29.0930048Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0930087Z 0.4261-0.3012j], 2025-12-04T10:08:29.0930152Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0930190Z 0.2567-0.1808j], 2025-12-04T10:08:29.0930255Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0930297Z 0.1761-1.6446j], 2025-12-04T10:08:29.0930359Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0930402Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0930404Z 2025-12-04T10:08:29.0930466Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0930508Z -0.6307+0.1756j], 2025-12-04T10:08:29.0930571Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0930609Z -0.9972-0.3518j], 2025-12-04T10:08:29.0930671Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0930711Z 0.6467+0.0201j], 2025-12-04T10:08:29.0930774Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0930810Z -1.0443-0.3699j], 2025-12-04T10:08:29.0930874Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0930963Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0930965Z 2025-12-04T10:08:29.0931003Z Expected: 2025-12-04T10:08:29.0931074Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0931112Z 0.3401-0.5673j], 2025-12-04T10:08:29.0931174Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0931211Z 0.2078-0.7444j], 2025-12-04T10:08:29.0931274Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0931312Z 0.4109+0.5305j], 2025-12-04T10:08:29.0931386Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0931436Z -0.3607+0.5386j], 2025-12-04T10:08:29.0931500Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0931538Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0931541Z 2025-12-04T10:08:29.0931603Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0931643Z 0.5323-0.4729j], 2025-12-04T10:08:29.0931706Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0931745Z -0.6732-0.7677j], 2025-12-04T10:08:29.0931806Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0931845Z -0.5241-0.5479j], 2025-12-04T10:08:29.0931908Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0931946Z -0.3257-0.6597j], 2025-12-04T10:08:29.0932010Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0932050Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0932052Z 2025-12-04T10:08:29.0932054Z 2025-12-04T10:08:29.0932116Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0932157Z -0.6637-0.1175j], 2025-12-04T10:08:29.0932220Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0932257Z 0.4261-0.3012j], 2025-12-04T10:08:29.0932321Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0932362Z 0.2567-0.1808j], 2025-12-04T10:08:29.0932426Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0932463Z 0.1761-1.6446j], 2025-12-04T10:08:29.0932526Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0932569Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0932571Z 2025-12-04T10:08:29.0932637Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0932677Z -0.6307+0.1756j], 2025-12-04T10:08:29.0932742Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0932781Z -0.9972-0.3518j], 2025-12-04T10:08:29.0932845Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0932882Z 0.6467+0.0201j], 2025-12-04T10:08:29.0932998Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0933035Z -1.0443-0.3699j], 2025-12-04T10:08:29.0933100Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0933165Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0933167Z 2025-12-04T10:08:29.0933470Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0933474Z 2025-12-04T10:08:29.0933549Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0933806Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0933809Z 2025-12-04T10:08:29.0933896Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0933992Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0934038Z Traceback (most recent call last): 2025-12-04T10:08:29.0934210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0934254Z return test(*args, **kwargs) 2025-12-04T10:08:29.0934320Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0934429Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0934495Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0934669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0934789Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0934847Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0935007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0935066Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0935109Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0935267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0935335Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0935383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0935525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0935572Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0935611Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0935763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0935814Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0935971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0936013Z raise GradcheckError( 2025-12-04T10:08:29.0936107Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0936110Z 2025-12-04T10:08:29.0936203Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0936289Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0936373Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0936375Z 2025-12-04T10:08:29.0936460Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0936568Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0936605Z If the test 2025-12-04T10:08:29.0936699Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0936764Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0936864Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0936947Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0936949Z 2025-12-04T10:08:29.0937043Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0937153Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0937192Z the following. 2025-12-04T10:08:29.0937194Z 2025-12-04T10:08:29.0937283Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0937375Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0937426Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0937490Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0937550Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0937552Z 2025-12-04T10:08:29.0937588Z Got: 2025-12-04T10:08:29.0937662Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.0937738Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.0937779Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.0937833Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.0937887Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.0937930Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.0937982Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.0938034Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.0938072Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.0938126Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.0938175Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.0938214Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.0938265Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.0938323Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.0938366Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.0938372Z 2025-12-04T10:08:29.0938423Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.0938480Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.0938520Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.0938573Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.0938624Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.0938665Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.0938718Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.0938770Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.0938809Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.0938863Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.0938912Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.0938954Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.0939004Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.0939054Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.0939097Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.0939099Z 2025-12-04T10:08:29.0939101Z 2025-12-04T10:08:29.0939155Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.0939206Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.0939246Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.0939296Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.0939346Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.0939385Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.0939438Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.0939495Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.0939535Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.0939584Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.0939658Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.0939700Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.0939750Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.0939798Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.0939843Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.0939845Z 2025-12-04T10:08:29.0939896Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.0939947Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.0939985Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.0940036Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.0940112Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.0940153Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.0940204Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.0940258Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.0940296Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.0940348Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.0940401Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.0940442Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.0940492Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.0940543Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.0940596Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0940640Z dtype=torch.complex128) 2025-12-04T10:08:29.0940642Z 2025-12-04T10:08:29.0940679Z Expected: 2025-12-04T10:08:29.0940754Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.0940792Z 0.3406-0.5682j], 2025-12-04T10:08:29.0940859Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.0940900Z 0.2069-0.7450j], 2025-12-04T10:08:29.0940966Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.0941003Z 0.4118+0.5311j], 2025-12-04T10:08:29.0941065Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.0941103Z -0.3628+0.5383j], 2025-12-04T10:08:29.0941167Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.0941211Z 0.0876+0.1073j]], 2025-12-04T10:08:29.0941212Z 2025-12-04T10:08:29.0941276Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.0941314Z 0.5325-0.4733j], 2025-12-04T10:08:29.0941377Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.0941414Z -0.6729-0.7686j], 2025-12-04T10:08:29.0941476Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.0941517Z -0.5258-0.5473j], 2025-12-04T10:08:29.0941579Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.0941617Z -0.3244-0.6603j], 2025-12-04T10:08:29.0941678Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.0941717Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.0941719Z 2025-12-04T10:08:29.0941721Z 2025-12-04T10:08:29.0941783Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.0941825Z -0.6623-0.1171j], 2025-12-04T10:08:29.0941889Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.0941928Z 0.4266-0.2997j], 2025-12-04T10:08:29.0941991Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.0942030Z 0.2556-0.1819j], 2025-12-04T10:08:29.0942103Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.0942154Z 0.1768-1.6449j], 2025-12-04T10:08:29.0942215Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.0942255Z -0.6011-0.8699j]], 2025-12-04T10:08:29.0942257Z 2025-12-04T10:08:29.0942318Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.0942356Z -0.6312+0.1775j], 2025-12-04T10:08:29.0942419Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.0942458Z -0.9967-0.3519j], 2025-12-04T10:08:29.0942519Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.0942579Z 0.6457+0.0238j], 2025-12-04T10:08:29.0942643Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.0942679Z -1.0432-0.3734j], 2025-12-04T10:08:29.0942744Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.0942812Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0942813Z 2025-12-04T10:08:29.0942898Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0942900Z 2025-12-04T10:08:29.0942998Z Traceback (most recent call last): 2025-12-04T10:08:29.0943155Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0943197Z method(*args, **kwargs) 2025-12-04T10:08:29.0943376Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0943426Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0943468Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0943627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0943675Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0943902Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0944062Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0944104Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0944141Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0944291Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0944330Z fn(*args, **kwargs) 2025-12-04T10:08:29.0944498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0944540Z raise e_tracked from e 2025-12-04T10:08:29.0944587Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0944589Z 2025-12-04T10:08:29.0944683Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0944766Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0944848Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0944850Z 2025-12-04T10:08:29.0944938Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0945041Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0945079Z If the test 2025-12-04T10:08:29.0945172Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0945236Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0945334Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0945418Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0945420Z 2025-12-04T10:08:29.0945531Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0945633Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0945670Z the following. 2025-12-04T10:08:29.0945672Z 2025-12-04T10:08:29.0945761Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0945850Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0945905Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0945967Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0946034Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0946035Z 2025-12-04T10:08:29.0946099Z Got: 2025-12-04T10:08:29.0946165Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.0946219Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.0946261Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.0946318Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.0946377Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.0946416Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.0946468Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.0946518Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.0946559Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.0946608Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.0946659Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.0946697Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.0946754Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.0946805Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.0946854Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.0946856Z 2025-12-04T10:08:29.0946908Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.0946958Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.0946999Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.0947049Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.0947100Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.0947137Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.0947189Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.0947238Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.0947277Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.0947328Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.0947378Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.0947416Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.0947467Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.0947520Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.0947564Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.0947567Z 2025-12-04T10:08:29.0947569Z 2025-12-04T10:08:29.0947620Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.0947670Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.0947709Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.0947763Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.0947812Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.0947850Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.0947900Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.0947953Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.0947991Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.0948096Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.0948147Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.0948189Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.0948237Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.0948290Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.0948333Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.0948335Z 2025-12-04T10:08:29.0948390Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.0948440Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.0948479Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.0948563Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.0948617Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.0948658Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.0948713Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.0948765Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.0948809Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.0948860Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.0948913Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.0948952Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.0949004Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.0949053Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.0949107Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0949152Z dtype=torch.complex128) 2025-12-04T10:08:29.0949158Z 2025-12-04T10:08:29.0949192Z Expected: 2025-12-04T10:08:29.0949268Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.0949307Z 0.3406-0.5682j], 2025-12-04T10:08:29.0949374Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.0949412Z 0.2069-0.7450j], 2025-12-04T10:08:29.0949479Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.0949515Z 0.4118+0.5311j], 2025-12-04T10:08:29.0949581Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.0949618Z -0.3628+0.5383j], 2025-12-04T10:08:29.0949681Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.0949719Z 0.0876+0.1073j]], 2025-12-04T10:08:29.0949721Z 2025-12-04T10:08:29.0949788Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.0949826Z 0.5325-0.4733j], 2025-12-04T10:08:29.0949892Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.0949929Z -0.6729-0.7686j], 2025-12-04T10:08:29.0949996Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.0950034Z -0.5258-0.5473j], 2025-12-04T10:08:29.0950101Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.0950137Z -0.3244-0.6603j], 2025-12-04T10:08:29.0950204Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.0950242Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.0950244Z 2025-12-04T10:08:29.0950245Z 2025-12-04T10:08:29.0950311Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.0950348Z -0.6623-0.1171j], 2025-12-04T10:08:29.0950414Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.0950451Z 0.4266-0.2997j], 2025-12-04T10:08:29.0950516Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.0950567Z 0.2556-0.1819j], 2025-12-04T10:08:29.0950642Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.0950679Z 0.1768-1.6449j], 2025-12-04T10:08:29.0950743Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.0950783Z -0.6011-0.8699j]], 2025-12-04T10:08:29.0950784Z 2025-12-04T10:08:29.0950849Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.0950887Z -0.6312+0.1775j], 2025-12-04T10:08:29.0950951Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.0950988Z -0.9967-0.3519j], 2025-12-04T10:08:29.0951066Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.0951114Z 0.6457+0.0238j], 2025-12-04T10:08:29.0951176Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.0951215Z -1.0432-0.3734j], 2025-12-04T10:08:29.0951278Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.0951346Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0951348Z 2025-12-04T10:08:29.0951646Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0951649Z 2025-12-04T10:08:29.0951723Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0951933Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0951936Z 2025-12-04T10:08:29.0952027Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0952125Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0952172Z Traceback (most recent call last): 2025-12-04T10:08:29.0952343Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0952392Z return test(*args, **kwargs) 2025-12-04T10:08:29.0952432Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0952541Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0952606Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0952776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0952898Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0952990Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0953154Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0953212Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0953256Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0953411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0953483Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0953527Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0953670Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0953716Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0953759Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0953954Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0954007Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0954160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0954205Z raise GradcheckError( 2025-12-04T10:08:29.0954297Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0954299Z 2025-12-04T10:08:29.0954393Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0954475Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0954569Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0954584Z 2025-12-04T10:08:29.0954667Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0954775Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0954813Z If the test 2025-12-04T10:08:29.0954906Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0954972Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0955068Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0955153Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0955156Z 2025-12-04T10:08:29.0955246Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0955335Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0955374Z the following. 2025-12-04T10:08:29.0955376Z 2025-12-04T10:08:29.0955465Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0955555Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0955610Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0955675Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0955737Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0955739Z 2025-12-04T10:08:29.0955772Z Got: 2025-12-04T10:08:29.0955846Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0955883Z 0.3401-0.5673j], 2025-12-04T10:08:29.0955950Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0955988Z 0.2078-0.7444j], 2025-12-04T10:08:29.0956055Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0956093Z 0.4109+0.5305j], 2025-12-04T10:08:29.0956159Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0956196Z -0.3607+0.5386j], 2025-12-04T10:08:29.0956262Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0956300Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0956302Z 2025-12-04T10:08:29.0956367Z [[-0.0544+0.0551j, 0.1142+0.0904j, -0.0538-0.1835j, 0.0343-0.0172j, 2025-12-04T10:08:29.0956403Z 0.0600-0.0531j], 2025-12-04T10:08:29.0956472Z [ 0.0741+0.0886j, -0.0645+0.0327j, 0.0494+0.0031j, -0.0136-0.0117j, 2025-12-04T10:08:29.0956508Z -0.0521-0.0595j], 2025-12-04T10:08:29.0956571Z [ 0.0363-0.0508j, 0.0327-0.0608j, 0.0869+0.0035j, -0.0690+0.0050j, 2025-12-04T10:08:29.0956609Z -0.0316-0.0329j], 2025-12-04T10:08:29.0956676Z [-0.0712-0.1140j, 0.1059+0.2229j, -0.2099+0.3292j, 0.0750-0.0582j, 2025-12-04T10:08:29.0956714Z -0.0746-0.1521j], 2025-12-04T10:08:29.0956779Z [-0.0238-0.0080j, -0.0105-0.0112j, 0.0452-0.0034j, 0.0057-0.0109j, 2025-12-04T10:08:29.0956821Z -0.0081-0.0025j]]], 2025-12-04T10:08:29.0956836Z 2025-12-04T10:08:29.0956838Z 2025-12-04T10:08:29.0956912Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0956953Z -0.6637-0.1175j], 2025-12-04T10:08:29.0957017Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0957055Z 0.4261-0.3012j], 2025-12-04T10:08:29.0957119Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0957157Z 0.2567-0.1808j], 2025-12-04T10:08:29.0957220Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0957262Z 0.1761-1.6446j], 2025-12-04T10:08:29.0957336Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0957385Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0957387Z 2025-12-04T10:08:29.0957449Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0957491Z -0.6307+0.1756j], 2025-12-04T10:08:29.0957556Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0957597Z -0.9972-0.3518j], 2025-12-04T10:08:29.0957660Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0957697Z 0.6467+0.0201j], 2025-12-04T10:08:29.0957760Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0957797Z -1.0443-0.3699j], 2025-12-04T10:08:29.0957861Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0957929Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0957934Z 2025-12-04T10:08:29.0957970Z Expected: 2025-12-04T10:08:29.0958043Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0958079Z 0.3401-0.5673j], 2025-12-04T10:08:29.0958143Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0958179Z 0.2078-0.7444j], 2025-12-04T10:08:29.0958241Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0958276Z 0.4109+0.5305j], 2025-12-04T10:08:29.0958340Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0958376Z -0.3607+0.5386j], 2025-12-04T10:08:29.0958440Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0958476Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0958478Z 2025-12-04T10:08:29.0958545Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0958585Z 0.5323-0.4729j], 2025-12-04T10:08:29.0958647Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0958685Z -0.6732-0.7677j], 2025-12-04T10:08:29.0958748Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0958786Z -0.5241-0.5479j], 2025-12-04T10:08:29.0958849Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0958888Z -0.3257-0.6597j], 2025-12-04T10:08:29.0958952Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0958991Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0958993Z 2025-12-04T10:08:29.0958994Z 2025-12-04T10:08:29.0959056Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0959097Z -0.6637-0.1175j], 2025-12-04T10:08:29.0968259Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0968321Z 0.4261-0.3012j], 2025-12-04T10:08:29.0968394Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0968431Z 0.2567-0.1808j], 2025-12-04T10:08:29.0968565Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0968603Z 0.1761-1.6446j], 2025-12-04T10:08:29.0968666Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0968707Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0968710Z 2025-12-04T10:08:29.0968772Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0968810Z -0.6307+0.1756j], 2025-12-04T10:08:29.0968873Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0968911Z -0.9972-0.3518j], 2025-12-04T10:08:29.0968990Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0969043Z 0.6467+0.0201j], 2025-12-04T10:08:29.0969104Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0969140Z -1.0443-0.3699j], 2025-12-04T10:08:29.0969208Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0969277Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0969280Z 2025-12-04T10:08:29.0969363Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0969365Z 2025-12-04T10:08:29.0969412Z Traceback (most recent call last): 2025-12-04T10:08:29.0969575Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0969619Z method(*args, **kwargs) 2025-12-04T10:08:29.0969804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0969854Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0969893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0970055Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0970103Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0970141Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0970299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0970342Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0970381Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0970534Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0970573Z fn(*args, **kwargs) 2025-12-04T10:08:29.0970740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0970787Z raise e_tracked from e 2025-12-04T10:08:29.0970832Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0970837Z 2025-12-04T10:08:29.0970935Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0971016Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0971098Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0971100Z 2025-12-04T10:08:29.0971185Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0971289Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0971324Z If the test 2025-12-04T10:08:29.0971418Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0971483Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0971582Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0971663Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0971679Z 2025-12-04T10:08:29.0971783Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0971872Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0971908Z the following. 2025-12-04T10:08:29.0971910Z 2025-12-04T10:08:29.0971999Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0972091Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0972144Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0972210Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0972284Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0972296Z 2025-12-04T10:08:29.0972328Z Got: 2025-12-04T10:08:29.0972405Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0972443Z 0.3401-0.5673j], 2025-12-04T10:08:29.0972512Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0972548Z 0.2078-0.7444j], 2025-12-04T10:08:29.0972614Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0972650Z 0.4109+0.5305j], 2025-12-04T10:08:29.0972713Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0972750Z -0.3607+0.5386j], 2025-12-04T10:08:29.0972813Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0972851Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0972853Z 2025-12-04T10:08:29.0972920Z [[-0.0544+0.0551j, 0.1142+0.0904j, -0.0538-0.1835j, 0.0343-0.0172j, 2025-12-04T10:08:29.0973030Z 0.0600-0.0531j], 2025-12-04T10:08:29.0973094Z [ 0.0741+0.0886j, -0.0645+0.0327j, 0.0494+0.0031j, -0.0136-0.0117j, 2025-12-04T10:08:29.0973131Z -0.0521-0.0595j], 2025-12-04T10:08:29.0973199Z [ 0.0363-0.0508j, 0.0327-0.0608j, 0.0869+0.0035j, -0.0690+0.0050j, 2025-12-04T10:08:29.0973235Z -0.0316-0.0329j], 2025-12-04T10:08:29.0973297Z [-0.0712-0.1140j, 0.1059+0.2229j, -0.2099+0.3292j, 0.0750-0.0582j, 2025-12-04T10:08:29.0973333Z -0.0746-0.1521j], 2025-12-04T10:08:29.0973398Z [-0.0238-0.0080j, -0.0105-0.0112j, 0.0452-0.0034j, 0.0057-0.0109j, 2025-12-04T10:08:29.0973437Z -0.0081-0.0025j]]], 2025-12-04T10:08:29.0973439Z 2025-12-04T10:08:29.0973440Z 2025-12-04T10:08:29.0973504Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0973539Z -0.6637-0.1175j], 2025-12-04T10:08:29.0973604Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0973642Z 0.4261-0.3012j], 2025-12-04T10:08:29.0973706Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0973744Z 0.2567-0.1808j], 2025-12-04T10:08:29.0973808Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0973845Z 0.1761-1.6446j], 2025-12-04T10:08:29.0973907Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0973945Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0973947Z 2025-12-04T10:08:29.0974009Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0974048Z -0.6307+0.1756j], 2025-12-04T10:08:29.0974111Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0974149Z -0.9972-0.3518j], 2025-12-04T10:08:29.0974213Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0974249Z 0.6467+0.0201j], 2025-12-04T10:08:29.0974310Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0974348Z -1.0443-0.3699j], 2025-12-04T10:08:29.0974447Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0974516Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0974518Z 2025-12-04T10:08:29.0974553Z Expected: 2025-12-04T10:08:29.0974626Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0974661Z 0.3401-0.5673j], 2025-12-04T10:08:29.0974724Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0974761Z 0.2078-0.7444j], 2025-12-04T10:08:29.0974824Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0974877Z 0.4109+0.5305j], 2025-12-04T10:08:29.0974954Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0974990Z -0.3607+0.5386j], 2025-12-04T10:08:29.0975052Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0975091Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0975093Z 2025-12-04T10:08:29.0975156Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0975191Z 0.5323-0.4729j], 2025-12-04T10:08:29.0975257Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0975294Z -0.6732-0.7677j], 2025-12-04T10:08:29.0975357Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0975393Z -0.5241-0.5479j], 2025-12-04T10:08:29.0975457Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0975495Z -0.3257-0.6597j], 2025-12-04T10:08:29.0975561Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0975598Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0975600Z 2025-12-04T10:08:29.0975605Z 2025-12-04T10:08:29.0975669Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0975706Z -0.6637-0.1175j], 2025-12-04T10:08:29.0975770Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0975806Z 0.4261-0.3012j], 2025-12-04T10:08:29.0975871Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0975907Z 0.2567-0.1808j], 2025-12-04T10:08:29.0975970Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0976007Z 0.1761-1.6446j], 2025-12-04T10:08:29.0976069Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0976108Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0976110Z 2025-12-04T10:08:29.0976171Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0976208Z -0.6307+0.1756j], 2025-12-04T10:08:29.0976271Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0976308Z -0.9972-0.3518j], 2025-12-04T10:08:29.0976370Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0976406Z 0.6467+0.0201j], 2025-12-04T10:08:29.0976468Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0976504Z -1.0443-0.3699j], 2025-12-04T10:08:29.0976567Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0976632Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0976634Z 2025-12-04T10:08:29.0976941Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0976956Z 2025-12-04T10:08:29.0977045Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0977255Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0977260Z 2025-12-04T10:08:29.0977346Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0977441Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0977488Z Traceback (most recent call last): 2025-12-04T10:08:29.0977672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0977731Z return test(*args, **kwargs) 2025-12-04T10:08:29.0977769Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0977875Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0977942Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0978113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0978236Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0978290Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0978451Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0978510Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0978556Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0978711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0978783Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0978828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0978968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0979014Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0979056Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0979206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0979257Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0979413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0979455Z raise GradcheckError( 2025-12-04T10:08:29.0979547Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0979549Z 2025-12-04T10:08:29.0979644Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0979725Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0979805Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0979807Z 2025-12-04T10:08:29.0979895Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0979999Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0980036Z If the test 2025-12-04T10:08:29.0980131Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0980194Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0980290Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0980374Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0980376Z 2025-12-04T10:08:29.0980493Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0980578Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0980616Z the following. 2025-12-04T10:08:29.0980618Z 2025-12-04T10:08:29.0980708Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0980797Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0980850Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0980913Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0980975Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0980993Z 2025-12-04T10:08:29.0981078Z Got: 2025-12-04T10:08:29.0981143Z tensor([[[[-5.6119e-01+5.7406e-02j, 3.1233e-01+1.1033e+00j, 2025-12-04T10:08:29.0981201Z 1.1405e+00+3.7729e-01j, 9.8358e-01-3.9860e-01j, 2025-12-04T10:08:29.0981242Z 3.4014e-01-5.6728e-01j], 2025-12-04T10:08:29.0981298Z [ 6.8236e-01-1.5236e-01j, 2.8253e-01+1.1557e-01j, 2025-12-04T10:08:29.0981349Z 5.3698e-01+1.6411e-01j, 8.3948e-01-5.0656e-01j, 2025-12-04T10:08:29.0981390Z 2.0776e-01-7.4444e-01j], 2025-12-04T10:08:29.0981440Z [-1.1234e+00+2.1468e-01j, -1.1468e+00+5.7362e-01j, 2025-12-04T10:08:29.0981493Z 6.6358e-01-4.1426e-01j, 1.2341e-01-1.7417e+00j, 2025-12-04T10:08:29.0981531Z 4.1088e-01+5.3045e-01j], 2025-12-04T10:08:29.0981581Z [ 1.5025e+00+8.7788e-01j, 5.7751e-01+6.5749e-01j, 2025-12-04T10:08:29.0981630Z 1.3189e+00+1.8928e-01j, -3.3668e-01-6.1260e-01j, 2025-12-04T10:08:29.0981670Z -3.6075e-01+5.3857e-01j], 2025-12-04T10:08:29.0981724Z [-5.9510e-01-5.3655e-01j, -1.5396e+00+1.1822e-01j, 2025-12-04T10:08:29.0981775Z 1.0860e+00-3.8168e-01j, 2.1929e-01-8.3159e-01j, 2025-12-04T10:08:29.0981817Z 8.5424e-02+1.0631e-01j]], 2025-12-04T10:08:29.0981820Z 2025-12-04T10:08:29.0981873Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0981923Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0981963Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0982012Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0982065Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0982104Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0982155Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0982204Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0982244Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0982296Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0982348Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0982386Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0982438Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0982487Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0982530Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0982532Z 2025-12-04T10:08:29.0982534Z 2025-12-04T10:08:29.0982584Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0982635Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0982673Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0982727Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0982777Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0982816Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0982867Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0982921Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0983020Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0983106Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0983156Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0983196Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0983246Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0983297Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0983339Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0983342Z 2025-12-04T10:08:29.0983394Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0983445Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0983498Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0983562Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0983613Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0983656Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0983709Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0983759Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0983797Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0983847Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0983896Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0983935Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0983985Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0984037Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0984090Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0984139Z dtype=torch.complex128) 2025-12-04T10:08:29.0984141Z 2025-12-04T10:08:29.0984176Z Expected: 2025-12-04T10:08:29.0984253Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0984291Z 0.3401-0.5673j], 2025-12-04T10:08:29.0984360Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0984398Z 0.2078-0.7444j], 2025-12-04T10:08:29.0984465Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0984500Z 0.4109+0.5305j], 2025-12-04T10:08:29.0984564Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0984602Z -0.3607+0.5386j], 2025-12-04T10:08:29.0984667Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0984705Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0984707Z 2025-12-04T10:08:29.0984772Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0984809Z 0.5323-0.4729j], 2025-12-04T10:08:29.0984872Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0984908Z -0.6732-0.7677j], 2025-12-04T10:08:29.0984974Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0985010Z -0.5241-0.5479j], 2025-12-04T10:08:29.0985074Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0985110Z -0.3257-0.6597j], 2025-12-04T10:08:29.0985175Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0985213Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0985215Z 2025-12-04T10:08:29.0985217Z 2025-12-04T10:08:29.0985279Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0985317Z -0.6637-0.1175j], 2025-12-04T10:08:29.0985383Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0985418Z 0.4261-0.3012j], 2025-12-04T10:08:29.0985482Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0985545Z 0.2567-0.1808j], 2025-12-04T10:08:29.0985608Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0985647Z 0.1761-1.6446j], 2025-12-04T10:08:29.0985708Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0985748Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0985750Z 2025-12-04T10:08:29.0985810Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0985848Z -0.6307+0.1756j], 2025-12-04T10:08:29.0985911Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0985950Z -0.9972-0.3518j], 2025-12-04T10:08:29.0986035Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0986075Z 0.6467+0.0201j], 2025-12-04T10:08:29.0986136Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0986176Z -1.0443-0.3699j], 2025-12-04T10:08:29.0986239Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0986306Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0986308Z 2025-12-04T10:08:29.0986392Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.0986394Z 2025-12-04T10:08:29.0986441Z Traceback (most recent call last): 2025-12-04T10:08:29.0986602Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.0986645Z method(*args, **kwargs) 2025-12-04T10:08:29.0986822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.0986871Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.0986908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0987072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0987115Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0987155Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0987313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.0987356Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.0987392Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0987543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.0987582Z fn(*args, **kwargs) 2025-12-04T10:08:29.0987750Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.0987792Z raise e_tracked from e 2025-12-04T10:08:29.0987837Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.0987841Z 2025-12-04T10:08:29.0987936Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0988018Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0988099Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0988101Z 2025-12-04T10:08:29.0988186Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0988290Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0988324Z If the test 2025-12-04T10:08:29.0988419Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0988488Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0988587Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0988669Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0988696Z 2025-12-04T10:08:29.0988788Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0988873Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0988911Z the following. 2025-12-04T10:08:29.0988913Z 2025-12-04T10:08:29.0989001Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0989091Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0989142Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0989206Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0989285Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0989297Z 2025-12-04T10:08:29.0989331Z Got: 2025-12-04T10:08:29.0989392Z tensor([[[[-5.6119e-01+5.7406e-02j, 3.1233e-01+1.1033e+00j, 2025-12-04T10:08:29.0989446Z 1.1405e+00+3.7729e-01j, 9.8358e-01-3.9860e-01j, 2025-12-04T10:08:29.0989492Z 3.4014e-01-5.6728e-01j], 2025-12-04T10:08:29.0989545Z [ 6.8236e-01-1.5236e-01j, 2.8253e-01+1.1557e-01j, 2025-12-04T10:08:29.0989597Z 5.3698e-01+1.6411e-01j, 8.3948e-01-5.0656e-01j, 2025-12-04T10:08:29.0989635Z 2.0776e-01-7.4444e-01j], 2025-12-04T10:08:29.0989688Z [-1.1234e+00+2.1468e-01j, -1.1468e+00+5.7362e-01j, 2025-12-04T10:08:29.0989739Z 6.6358e-01-4.1426e-01j, 1.2341e-01-1.7417e+00j, 2025-12-04T10:08:29.0989778Z 4.1088e-01+5.3045e-01j], 2025-12-04T10:08:29.0989827Z [ 1.5025e+00+8.7788e-01j, 5.7751e-01+6.5749e-01j, 2025-12-04T10:08:29.0989879Z 1.3189e+00+1.8928e-01j, -3.3668e-01-6.1260e-01j, 2025-12-04T10:08:29.0989919Z -3.6075e-01+5.3857e-01j], 2025-12-04T10:08:29.0989970Z [-5.9510e-01-5.3655e-01j, -1.5396e+00+1.1822e-01j, 2025-12-04T10:08:29.0990020Z 1.0860e+00-3.8168e-01j, 2.1929e-01-8.3159e-01j, 2025-12-04T10:08:29.0990069Z 8.5424e-02+1.0631e-01j]], 2025-12-04T10:08:29.0990071Z 2025-12-04T10:08:29.0990120Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0990173Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0990211Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0990262Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0990312Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.0990355Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.0990404Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.0990458Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.0990499Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.0990551Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.0990601Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.0990644Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.0990692Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.0990744Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.0990783Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.0990785Z 2025-12-04T10:08:29.0990787Z 2025-12-04T10:08:29.0990840Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.0990888Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.0990930Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.0990981Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.0991035Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.0991074Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.0991126Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.0991178Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.0991250Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.0991301Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.0991355Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.0991394Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.0991447Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.0991497Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.0991541Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.0991543Z 2025-12-04T10:08:29.0991594Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.0991658Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.0991710Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.0991761Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.0991812Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.0991854Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.0991906Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.0991956Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.0991995Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.0992046Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.0992100Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.0992140Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.0992193Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.0992244Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.0992301Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.0992344Z dtype=torch.complex128) 2025-12-04T10:08:29.0992346Z 2025-12-04T10:08:29.0992382Z Expected: 2025-12-04T10:08:29.0992460Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.0992500Z 0.3401-0.5673j], 2025-12-04T10:08:29.0992564Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.0992603Z 0.2078-0.7444j], 2025-12-04T10:08:29.0992668Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.0992708Z 0.4109+0.5305j], 2025-12-04T10:08:29.0992770Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.0992808Z -0.3607+0.5386j], 2025-12-04T10:08:29.0992870Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.0992914Z 0.0854+0.1063j]], 2025-12-04T10:08:29.0992917Z 2025-12-04T10:08:29.0993028Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.0993067Z 0.5323-0.4729j], 2025-12-04T10:08:29.0993129Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.0993172Z -0.6732-0.7677j], 2025-12-04T10:08:29.0993235Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.0993271Z -0.5241-0.5479j], 2025-12-04T10:08:29.0993334Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.0993375Z -0.3257-0.6597j], 2025-12-04T10:08:29.0993438Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.0993480Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.0993482Z 2025-12-04T10:08:29.0993483Z 2025-12-04T10:08:29.0993547Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.0993586Z -0.6637-0.1175j], 2025-12-04T10:08:29.0993650Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.0993688Z 0.4261-0.3012j], 2025-12-04T10:08:29.0993787Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.0993825Z 0.2567-0.1808j], 2025-12-04T10:08:29.0993890Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.0993928Z 0.1761-1.6446j], 2025-12-04T10:08:29.0993992Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.0994031Z -0.5996-0.8700j]], 2025-12-04T10:08:29.0994033Z 2025-12-04T10:08:29.0994096Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.0994133Z -0.6307+0.1756j], 2025-12-04T10:08:29.0994213Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.0994269Z -0.9972-0.3518j], 2025-12-04T10:08:29.0994332Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.0994368Z 0.6467+0.0201j], 2025-12-04T10:08:29.0994436Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.0994472Z -1.0443-0.3699j], 2025-12-04T10:08:29.0994538Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.0994603Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.0994605Z 2025-12-04T10:08:29.0994911Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.0994913Z 2025-12-04T10:08:29.0994990Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.0995201Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.0995203Z 2025-12-04T10:08:29.0995293Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.0995388Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.0995439Z Traceback (most recent call last): 2025-12-04T10:08:29.0995611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.0995656Z return test(*args, **kwargs) 2025-12-04T10:08:29.0995693Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0995803Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.0995870Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.0996043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.0996164Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.0996222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0996383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.0996445Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.0996489Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0996646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.0996713Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.0996761Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0996903Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.0996949Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.0997012Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.0997168Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.0997218Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.0997377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.0997420Z raise GradcheckError( 2025-12-04T10:08:29.0997514Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.0997516Z 2025-12-04T10:08:29.0997609Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.0997719Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.0997801Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.0997803Z 2025-12-04T10:08:29.0997888Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.0997994Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.0998030Z If the test 2025-12-04T10:08:29.0998127Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.0998189Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.0998288Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.0998370Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.0998372Z 2025-12-04T10:08:29.0998466Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.0998554Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.0998593Z the following. 2025-12-04T10:08:29.0998595Z 2025-12-04T10:08:29.0998683Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.0998777Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.0998828Z operation' in the backward pass. Please see 2025-12-04T10:08:29.0998893Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.0998955Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.0998958Z 2025-12-04T10:08:29.0998992Z Got: 2025-12-04T10:08:29.0999044Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999092Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999132Z nan+nanj], 2025-12-04T10:08:29.0999182Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999226Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999270Z nan+nanj], 2025-12-04T10:08:29.0999312Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999354Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.0999392Z nan+nanj], 2025-12-04T10:08:29.0999449Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.0999504Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.0999546Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.0999600Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.0999653Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.0999698Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.0999700Z 2025-12-04T10:08:29.0999750Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.0999805Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.0999846Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.0999899Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.0999949Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1000006Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1000075Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1000127Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1000167Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1000220Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1000270Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1000312Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1000361Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1000414Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1000466Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1000480Z 2025-12-04T10:08:29.1000481Z 2025-12-04T10:08:29.1000532Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1000581Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1000624Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1000675Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1000728Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1000768Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1000823Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1000873Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1000915Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1000964Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1001018Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1001058Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1001108Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1001160Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1001202Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1001206Z 2025-12-04T10:08:29.1001256Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1001307Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1001346Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1001399Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1001448Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1001488Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1001538Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1001590Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1001632Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1001685Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1001733Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1001774Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1001827Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1001877Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1001932Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1001975Z dtype=torch.complex128) 2025-12-04T10:08:29.1001977Z 2025-12-04T10:08:29.1002014Z Expected: 2025-12-04T10:08:29.1002090Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1002130Z 0.3401-0.5673j], 2025-12-04T10:08:29.1002194Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1002234Z 0.2078-0.7444j], 2025-12-04T10:08:29.1002300Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1002340Z 0.4109+0.5305j], 2025-12-04T10:08:29.1002404Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1002458Z -0.3607+0.5386j], 2025-12-04T10:08:29.1002531Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1002573Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1002575Z 2025-12-04T10:08:29.1002639Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1002678Z 0.5323-0.4729j], 2025-12-04T10:08:29.1002741Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1002779Z -0.6732-0.7677j], 2025-12-04T10:08:29.1002841Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1002878Z -0.5241-0.5479j], 2025-12-04T10:08:29.1003021Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1003061Z -0.3257-0.6597j], 2025-12-04T10:08:29.1003124Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1003165Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1003168Z 2025-12-04T10:08:29.1003169Z 2025-12-04T10:08:29.1003233Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1003272Z -0.6637-0.1175j], 2025-12-04T10:08:29.1003335Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1003374Z 0.4261-0.3012j], 2025-12-04T10:08:29.1003438Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1003476Z 0.2567-0.1808j], 2025-12-04T10:08:29.1003540Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1003582Z 0.1761-1.6446j], 2025-12-04T10:08:29.1003646Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1003688Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1003689Z 2025-12-04T10:08:29.1003753Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1003794Z -0.6307+0.1756j], 2025-12-04T10:08:29.1003857Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1003895Z -0.9972-0.3518j], 2025-12-04T10:08:29.1003959Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1003996Z 0.6467+0.0201j], 2025-12-04T10:08:29.1004059Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1004095Z -1.0443-0.3699j], 2025-12-04T10:08:29.1004159Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1004227Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1004230Z 2025-12-04T10:08:29.1004312Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1004314Z 2025-12-04T10:08:29.1004361Z Traceback (most recent call last): 2025-12-04T10:08:29.1004519Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1004561Z method(*args, **kwargs) 2025-12-04T10:08:29.1004739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1004784Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1004826Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1004985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1005031Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1005071Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1005232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1005274Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1005343Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1005496Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1005537Z fn(*args, **kwargs) 2025-12-04T10:08:29.1005705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1005748Z raise e_tracked from e 2025-12-04T10:08:29.1005793Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1005795Z 2025-12-04T10:08:29.1005891Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1005987Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1006081Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1006083Z 2025-12-04T10:08:29.1006168Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1006273Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1006313Z If the test 2025-12-04T10:08:29.1006407Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1006470Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1006565Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1006650Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1006652Z 2025-12-04T10:08:29.1006743Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1006832Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1006870Z the following. 2025-12-04T10:08:29.1006872Z 2025-12-04T10:08:29.1006964Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1007056Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1007111Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1007176Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1007240Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1007242Z 2025-12-04T10:08:29.1007274Z Got: 2025-12-04T10:08:29.1007327Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007371Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007414Z nan+nanj], 2025-12-04T10:08:29.1007460Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007508Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007548Z nan+nanj], 2025-12-04T10:08:29.1007591Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007635Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1007675Z nan+nanj], 2025-12-04T10:08:29.1007731Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1007787Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1007829Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1007883Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1007935Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1007982Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1007984Z 2025-12-04T10:08:29.1008033Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1008086Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1008127Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1008178Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1008229Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1008269Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1008349Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1008399Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1008439Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1008489Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1008541Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1008579Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1008630Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1008680Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1008733Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1008745Z 2025-12-04T10:08:29.1008746Z 2025-12-04T10:08:29.1008796Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1008850Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1008892Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1008946Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1008997Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1009036Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1009089Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1009143Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1009181Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1009232Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1009281Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1009324Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1009373Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1009425Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1009466Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1009469Z 2025-12-04T10:08:29.1009521Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1009570Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1009611Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1009661Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1009711Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1009750Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1009801Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1009851Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1009890Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1009941Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1009992Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1010030Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1010083Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1010134Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1010187Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1010230Z dtype=torch.complex128) 2025-12-04T10:08:29.1010234Z 2025-12-04T10:08:29.1010269Z Expected: 2025-12-04T10:08:29.1010345Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1010386Z 0.3401-0.5673j], 2025-12-04T10:08:29.1010451Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1010488Z 0.2078-0.7444j], 2025-12-04T10:08:29.1010554Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1010591Z 0.4109+0.5305j], 2025-12-04T10:08:29.1010655Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1010713Z -0.3607+0.5386j], 2025-12-04T10:08:29.1010787Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1010825Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1010827Z 2025-12-04T10:08:29.1010892Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1010928Z 0.5323-0.4729j], 2025-12-04T10:08:29.1010992Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1011028Z -0.6732-0.7677j], 2025-12-04T10:08:29.1011093Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1011129Z -0.5241-0.5479j], 2025-12-04T10:08:29.1011203Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1011250Z -0.3257-0.6597j], 2025-12-04T10:08:29.1011313Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1011352Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1011355Z 2025-12-04T10:08:29.1011357Z 2025-12-04T10:08:29.1011420Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1011456Z -0.6637-0.1175j], 2025-12-04T10:08:29.1011520Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1011555Z 0.4261-0.3012j], 2025-12-04T10:08:29.1011620Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1011656Z 0.2567-0.1808j], 2025-12-04T10:08:29.1011720Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1011756Z 0.1761-1.6446j], 2025-12-04T10:08:29.1011822Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1011861Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1011862Z 2025-12-04T10:08:29.1011926Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1011965Z -0.6307+0.1756j], 2025-12-04T10:08:29.1012029Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1012065Z -0.9972-0.3518j], 2025-12-04T10:08:29.1012128Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1012163Z 0.6467+0.0201j], 2025-12-04T10:08:29.1012225Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1012261Z -1.0443-0.3699j], 2025-12-04T10:08:29.1012325Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1012392Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1012395Z 2025-12-04T10:08:29.1012699Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1012702Z 2025-12-04T10:08:29.1012777Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1013030Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1013032Z 2025-12-04T10:08:29.1013122Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1013215Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1013262Z Traceback (most recent call last): 2025-12-04T10:08:29.1013433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1013478Z return test(*args, **kwargs) 2025-12-04T10:08:29.1013515Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1013661Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1013730Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1013901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1014026Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1014079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1014258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1014331Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1014375Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1014530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1014599Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1014644Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1014784Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1014829Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1014867Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1015018Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1015071Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1015227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1015270Z raise GradcheckError( 2025-12-04T10:08:29.1015359Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1015364Z 2025-12-04T10:08:29.1015460Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1015541Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1015621Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1015623Z 2025-12-04T10:08:29.1015706Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1015810Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1015846Z If the test 2025-12-04T10:08:29.1015944Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1016012Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1016108Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1016191Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1016193Z 2025-12-04T10:08:29.1016285Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1016370Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1016407Z the following. 2025-12-04T10:08:29.1016409Z 2025-12-04T10:08:29.1016499Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1016588Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1016640Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1016703Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1016766Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1016769Z 2025-12-04T10:08:29.1016802Z Got: 2025-12-04T10:08:29.1016853Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1016897Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1016960Z nan+nanj], 2025-12-04T10:08:29.1017004Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1017048Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1017086Z nan+nanj], 2025-12-04T10:08:29.1017130Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1017171Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1017209Z nan+nanj], 2025-12-04T10:08:29.1017263Z [-6.8713e-02+4.1696e-01j, 4.9646e-02+4.3508e-01j, 2025-12-04T10:08:29.1017318Z -3.1639e-02-7.7189e-03j, -1.2184e-01-1.0718e-01j, 2025-12-04T10:08:29.1017358Z -8.5515e-02-2.2762e-02j], 2025-12-04T10:08:29.1017436Z [ 1.0284e-01-5.4252e-02j, 6.0851e-02-2.1565e-01j, 2025-12-04T10:08:29.1017488Z -2.2839e-03+1.6702e-01j, 1.0233e-01+7.1440e-02j, 2025-12-04T10:08:29.1017531Z -1.8752e-02+6.3237e-03j]], 2025-12-04T10:08:29.1017534Z 2025-12-04T10:08:29.1017585Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1017639Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1017678Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1017728Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1017777Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1017818Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1017868Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1017918Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1017957Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1018010Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1018058Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1018099Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1018147Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1018203Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1018245Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1018247Z 2025-12-04T10:08:29.1018249Z 2025-12-04T10:08:29.1018300Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1018351Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1018389Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1018440Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1018490Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1018532Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1018583Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1018635Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1018672Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1018725Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1018774Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1018814Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1018862Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1018912Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1018952Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1018954Z 2025-12-04T10:08:29.1019004Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1019053Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1019093Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1019145Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1019195Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1019234Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1019312Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1019362Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1019402Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1019453Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1019503Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1019542Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1019592Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1019642Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1019693Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1019749Z dtype=torch.complex128) 2025-12-04T10:08:29.1019769Z 2025-12-04T10:08:29.1019805Z Expected: 2025-12-04T10:08:29.1019880Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1019918Z 0.3401-0.5673j], 2025-12-04T10:08:29.1019985Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1020024Z 0.2078-0.7444j], 2025-12-04T10:08:29.1020088Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1020125Z 0.4109+0.5305j], 2025-12-04T10:08:29.1020187Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1020225Z -0.3607+0.5386j], 2025-12-04T10:08:29.1020287Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1020325Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1020327Z 2025-12-04T10:08:29.1020391Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1020429Z 0.5323-0.4729j], 2025-12-04T10:08:29.1020492Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1020529Z -0.6732-0.7677j], 2025-12-04T10:08:29.1020595Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1020631Z -0.5241-0.5479j], 2025-12-04T10:08:29.1020695Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1020730Z -0.3257-0.6597j], 2025-12-04T10:08:29.1020793Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1020831Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1020833Z 2025-12-04T10:08:29.1020835Z 2025-12-04T10:08:29.1020898Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1020934Z -0.6637-0.1175j], 2025-12-04T10:08:29.1020997Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1021034Z 0.4261-0.3012j], 2025-12-04T10:08:29.1021098Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1021135Z 0.2567-0.1808j], 2025-12-04T10:08:29.1021200Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1021237Z 0.1761-1.6446j], 2025-12-04T10:08:29.1021301Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1021339Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1021341Z 2025-12-04T10:08:29.1021404Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1021441Z -0.6307+0.1756j], 2025-12-04T10:08:29.1021504Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1021541Z -0.9972-0.3518j], 2025-12-04T10:08:29.1021604Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1021640Z 0.6467+0.0201j], 2025-12-04T10:08:29.1021702Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1021753Z -1.0443-0.3699j], 2025-12-04T10:08:29.1021831Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1021897Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1021899Z 2025-12-04T10:08:29.1021981Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1021984Z 2025-12-04T10:08:29.1022030Z Traceback (most recent call last): 2025-12-04T10:08:29.1022187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1022228Z method(*args, **kwargs) 2025-12-04T10:08:29.1022420Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1022477Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1022516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1022681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1022724Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1022763Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1022922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1023002Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1023038Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1023191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1023228Z fn(*args, **kwargs) 2025-12-04T10:08:29.1023398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1023439Z raise e_tracked from e 2025-12-04T10:08:29.1023485Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1023488Z 2025-12-04T10:08:29.1023582Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1023666Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1023745Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1023747Z 2025-12-04T10:08:29.1023833Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1023934Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1023970Z If the test 2025-12-04T10:08:29.1024065Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1024130Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1024226Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1024308Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1024312Z 2025-12-04T10:08:29.1024403Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1024487Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1024524Z the following. 2025-12-04T10:08:29.1024526Z 2025-12-04T10:08:29.1024615Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1024707Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1024758Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1024823Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1024885Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1024888Z 2025-12-04T10:08:29.1024922Z Got: 2025-12-04T10:08:29.1024973Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025018Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025100Z nan+nanj], 2025-12-04T10:08:29.1025148Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025193Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025233Z nan+nanj], 2025-12-04T10:08:29.1025278Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025325Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1025363Z nan+nanj], 2025-12-04T10:08:29.1025417Z [-6.8713e-02+4.1696e-01j, 4.9646e-02+4.3508e-01j, 2025-12-04T10:08:29.1025471Z -3.1639e-02-7.7189e-03j, -1.2184e-01-1.0718e-01j, 2025-12-04T10:08:29.1025513Z -8.5515e-02-2.2762e-02j], 2025-12-04T10:08:29.1025585Z [ 1.0284e-01-5.4252e-02j, 6.0851e-02-2.1565e-01j, 2025-12-04T10:08:29.1025650Z -2.2839e-03+1.6702e-01j, 1.0233e-01+7.1440e-02j, 2025-12-04T10:08:29.1025693Z -1.8752e-02+6.3237e-03j]], 2025-12-04T10:08:29.1025695Z 2025-12-04T10:08:29.1025748Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1025798Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1025838Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1025887Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1025938Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1025976Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1026028Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1026078Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1026121Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1026173Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1026226Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1026265Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1026317Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1026369Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1026414Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1026417Z 2025-12-04T10:08:29.1026418Z 2025-12-04T10:08:29.1026471Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1026521Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1026562Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1026616Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1026667Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1026706Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1026763Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1026815Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1026855Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1026908Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1026961Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1026999Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1027050Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1027101Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1027145Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1027148Z 2025-12-04T10:08:29.1027196Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1027248Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1027287Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1027343Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1027395Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1027441Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1027492Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1027572Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1027612Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1027664Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1027714Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1027754Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1027804Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1027855Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1027907Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1027972Z dtype=torch.complex128) 2025-12-04T10:08:29.1027984Z 2025-12-04T10:08:29.1028020Z Expected: 2025-12-04T10:08:29.1028098Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1028138Z 0.3401-0.5673j], 2025-12-04T10:08:29.1028208Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1028247Z 0.2078-0.7444j], 2025-12-04T10:08:29.1028316Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1028353Z 0.4109+0.5305j], 2025-12-04T10:08:29.1028420Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1028456Z -0.3607+0.5386j], 2025-12-04T10:08:29.1028522Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1028561Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1028563Z 2025-12-04T10:08:29.1028632Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1028671Z 0.5323-0.4729j], 2025-12-04T10:08:29.1028734Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1028771Z -0.6732-0.7677j], 2025-12-04T10:08:29.1028837Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1028875Z -0.5241-0.5479j], 2025-12-04T10:08:29.1028936Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1028977Z -0.3257-0.6597j], 2025-12-04T10:08:29.1029041Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1029079Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1029081Z 2025-12-04T10:08:29.1029083Z 2025-12-04T10:08:29.1029146Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1029184Z -0.6637-0.1175j], 2025-12-04T10:08:29.1029248Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1029288Z 0.4261-0.3012j], 2025-12-04T10:08:29.1029352Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1029389Z 0.2567-0.1808j], 2025-12-04T10:08:29.1029455Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1029494Z 0.1761-1.6446j], 2025-12-04T10:08:29.1029557Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1029600Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1029601Z 2025-12-04T10:08:29.1029664Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1029703Z -0.6307+0.1756j], 2025-12-04T10:08:29.1029766Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1029806Z -0.9972-0.3518j], 2025-12-04T10:08:29.1029871Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1029910Z 0.6467+0.0201j], 2025-12-04T10:08:29.1029971Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1030025Z -1.0443-0.3699j], 2025-12-04T10:08:29.1030098Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1030166Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1030169Z 2025-12-04T10:08:29.1030493Z Caused by sample input at index 10: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={'upper': 'False'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1030498Z 2025-12-04T10:08:29.1030573Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1030807Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=10 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1030822Z 2025-12-04T10:08:29.1030910Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1031010Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1031058Z Traceback (most recent call last): 2025-12-04T10:08:29.1031232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1031274Z return test(*args, **kwargs) 2025-12-04T10:08:29.1031313Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1031416Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1031484Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1031653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1031778Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1031832Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1032004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1032061Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1032104Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1032263Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1032331Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1032379Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1032522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1032570Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1032608Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1032764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1032814Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1033005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1033048Z raise GradcheckError( 2025-12-04T10:08:29.1033142Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1033147Z 2025-12-04T10:08:29.1033238Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1033321Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1033402Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1033404Z 2025-12-04T10:08:29.1033490Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1033611Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1033665Z If the test 2025-12-04T10:08:29.1033760Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1033830Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1033926Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1034011Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1034013Z 2025-12-04T10:08:29.1034103Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1034203Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1034256Z the following. 2025-12-04T10:08:29.1034260Z 2025-12-04T10:08:29.1034348Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1034440Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1034494Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1034565Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1034626Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1034628Z 2025-12-04T10:08:29.1034662Z Got: 2025-12-04T10:08:29.1034712Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1034757Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1034797Z nan+nanj], 2025-12-04T10:08:29.1034842Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1034888Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1034929Z nan+nanj], 2025-12-04T10:08:29.1034973Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1035016Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1035053Z nan+nanj], 2025-12-04T10:08:29.1035113Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1035171Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1035213Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1035263Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1035316Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1035357Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1035359Z 2025-12-04T10:08:29.1035412Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1035464Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1035506Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1035558Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1035610Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1035649Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1035703Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1035756Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1035798Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1035846Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1035899Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1035939Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1035988Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1036037Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1036079Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1036081Z 2025-12-04T10:08:29.1036083Z 2025-12-04T10:08:29.1036135Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1036185Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1036224Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1036287Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1036351Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1036390Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1036440Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1036492Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1036531Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1036580Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1036631Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1036669Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1036734Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1036793Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1036836Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1036839Z 2025-12-04T10:08:29.1036890Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1036945Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1036984Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1037035Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1037084Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1037124Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1037173Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1037223Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1037261Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1037314Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1037364Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1037403Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1037453Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1037507Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1037559Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1037604Z dtype=torch.complex128) 2025-12-04T10:08:29.1037606Z 2025-12-04T10:08:29.1037640Z Expected: 2025-12-04T10:08:29.1037716Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1037754Z 0.3401-0.5673j], 2025-12-04T10:08:29.1037819Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1037856Z 0.2078-0.7444j], 2025-12-04T10:08:29.1037921Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1037962Z 0.4109+0.5305j], 2025-12-04T10:08:29.1038026Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1038063Z -0.3607+0.5386j], 2025-12-04T10:08:29.1038129Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1038170Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1038172Z 2025-12-04T10:08:29.1038235Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1038272Z 0.5323-0.4729j], 2025-12-04T10:08:29.1038336Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1038373Z -0.6732-0.7677j], 2025-12-04T10:08:29.1038436Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1038472Z -0.5241-0.5479j], 2025-12-04T10:08:29.1038536Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1038574Z -0.3257-0.6597j], 2025-12-04T10:08:29.1038637Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1038676Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1038679Z 2025-12-04T10:08:29.1038694Z 2025-12-04T10:08:29.1038767Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1038805Z -0.6637-0.1175j], 2025-12-04T10:08:29.1038867Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1038904Z 0.4261-0.3012j], 2025-12-04T10:08:29.1038967Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1039003Z 0.2567-0.1808j], 2025-12-04T10:08:29.1039065Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1039102Z 0.1761-1.6446j], 2025-12-04T10:08:29.1039175Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1039227Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1039229Z 2025-12-04T10:08:29.1039291Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1039328Z -0.6307+0.1756j], 2025-12-04T10:08:29.1039392Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1039430Z -0.9972-0.3518j], 2025-12-04T10:08:29.1039492Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1039529Z 0.6467+0.0201j], 2025-12-04T10:08:29.1039590Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1039626Z -1.0443-0.3699j], 2025-12-04T10:08:29.1039689Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1039755Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1039757Z 2025-12-04T10:08:29.1039843Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1039845Z 2025-12-04T10:08:29.1039892Z Traceback (most recent call last): 2025-12-04T10:08:29.1040049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1040091Z method(*args, **kwargs) 2025-12-04T10:08:29.1040268Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1040316Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1040354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1040516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1040560Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1040598Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1040759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1040803Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1040840Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1040994Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1041033Z fn(*args, **kwargs) 2025-12-04T10:08:29.1041202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1041244Z raise e_tracked from e 2025-12-04T10:08:29.1041288Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1041290Z 2025-12-04T10:08:29.1041383Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1041465Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1041547Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1041549Z 2025-12-04T10:08:29.1041634Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1041753Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1041806Z If the test 2025-12-04T10:08:29.1041900Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1041962Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1042058Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1042140Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1042142Z 2025-12-04T10:08:29.1042234Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1042318Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1042380Z the following. 2025-12-04T10:08:29.1042382Z 2025-12-04T10:08:29.1042470Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1042562Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1042617Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1042680Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1042744Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1042746Z 2025-12-04T10:08:29.1042778Z Got: 2025-12-04T10:08:29.1042830Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1042874Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1042913Z nan+nanj], 2025-12-04T10:08:29.1043006Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1043051Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1043089Z nan+nanj], 2025-12-04T10:08:29.1043136Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1043179Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1043217Z nan+nanj], 2025-12-04T10:08:29.1043272Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1043330Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1043369Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1043422Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1043474Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1043516Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1043518Z 2025-12-04T10:08:29.1043568Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1043620Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1043657Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1043709Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1043760Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1043800Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1043850Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1043902Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1043941Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1043990Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1044039Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1044079Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1044126Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1044178Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1044218Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1044220Z 2025-12-04T10:08:29.1044223Z 2025-12-04T10:08:29.1044274Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1044324Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1044364Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1044414Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1044512Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1044552Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1044603Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1044654Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1044692Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1044742Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1044792Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1044830Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1044895Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1044964Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1045007Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1045009Z 2025-12-04T10:08:29.1045059Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1045111Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1045151Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1045201Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1045250Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1045289Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1045342Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1045391Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1045432Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1045484Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1045535Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1045573Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1045624Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1045676Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1045728Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1045772Z dtype=torch.complex128) 2025-12-04T10:08:29.1045773Z 2025-12-04T10:08:29.1045809Z Expected: 2025-12-04T10:08:29.1045885Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1045924Z 0.3401-0.5673j], 2025-12-04T10:08:29.1045989Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1046028Z 0.2078-0.7444j], 2025-12-04T10:08:29.1046091Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1046129Z 0.4109+0.5305j], 2025-12-04T10:08:29.1046192Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1046230Z -0.3607+0.5386j], 2025-12-04T10:08:29.1046293Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1046333Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1046335Z 2025-12-04T10:08:29.1046398Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1046436Z 0.5323-0.4729j], 2025-12-04T10:08:29.1046499Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1046536Z -0.6732-0.7677j], 2025-12-04T10:08:29.1046598Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1046636Z -0.5241-0.5479j], 2025-12-04T10:08:29.1046698Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1046737Z -0.3257-0.6597j], 2025-12-04T10:08:29.1046800Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1046838Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1046840Z 2025-12-04T10:08:29.1046857Z 2025-12-04T10:08:29.1046929Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1046967Z -0.6637-0.1175j], 2025-12-04T10:08:29.1047030Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1047065Z 0.4261-0.3012j], 2025-12-04T10:08:29.1047129Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1047165Z 0.2567-0.1808j], 2025-12-04T10:08:29.1047229Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1047264Z 0.1761-1.6446j], 2025-12-04T10:08:29.1047338Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1047388Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1047390Z 2025-12-04T10:08:29.1047454Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1047490Z -0.6307+0.1756j], 2025-12-04T10:08:29.1047556Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1047593Z -0.9972-0.3518j], 2025-12-04T10:08:29.1047656Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1047691Z 0.6467+0.0201j], 2025-12-04T10:08:29.1047754Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1047789Z -1.0443-0.3699j], 2025-12-04T10:08:29.1047854Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1047920Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1047922Z 2025-12-04T10:08:29.1048227Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1048231Z 2025-12-04T10:08:29.1048306Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1048512Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1048515Z 2025-12-04T10:08:29.1048602Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1048694Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1048741Z Traceback (most recent call last): 2025-12-04T10:08:29.1048913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1048956Z return test(*args, **kwargs) 2025-12-04T10:08:29.1048995Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1049100Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1049168Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1049339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1049461Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1049516Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1049677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1049734Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1049777Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1049934Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1050026Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1050072Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1050213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1050259Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1050296Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1050449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1050499Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1050664Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1050717Z raise GradcheckError( 2025-12-04T10:08:29.1050805Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1050808Z 2025-12-04T10:08:29.1050903Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1050985Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1051065Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1051067Z 2025-12-04T10:08:29.1051150Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1051254Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1051289Z If the test 2025-12-04T10:08:29.1051385Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1051448Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1051545Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1051626Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1051628Z 2025-12-04T10:08:29.1051723Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1051808Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1051846Z the following. 2025-12-04T10:08:29.1051848Z 2025-12-04T10:08:29.1051936Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1052027Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1052078Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1052144Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1052204Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1052207Z 2025-12-04T10:08:29.1052241Z Got: 2025-12-04T10:08:29.1052292Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052338Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052378Z nan+nanj], 2025-12-04T10:08:29.1052425Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052468Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052507Z nan+nanj], 2025-12-04T10:08:29.1052549Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052592Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1052630Z nan+nanj], 2025-12-04T10:08:29.1052684Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1052739Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1056109Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1056185Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1056243Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1056288Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1056290Z 2025-12-04T10:08:29.1056342Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1056449Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1056489Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1056539Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1056589Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1056629Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1056678Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1056729Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1056768Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1056818Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1056882Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1056940Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1056988Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1057039Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1057083Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1057085Z 2025-12-04T10:08:29.1057087Z 2025-12-04T10:08:29.1057138Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1057187Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1057228Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1057278Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1057329Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1057366Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1057416Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1057470Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1057510Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1057560Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1057616Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1057656Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1057709Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1057758Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1057800Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1057802Z 2025-12-04T10:08:29.1057852Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1057902Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1057941Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1057991Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1058043Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1058082Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1058132Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1058189Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1058226Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1058277Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1058326Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1058366Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1058416Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1058466Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1058518Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1058562Z dtype=torch.complex128) 2025-12-04T10:08:29.1058564Z 2025-12-04T10:08:29.1058600Z Expected: 2025-12-04T10:08:29.1058679Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1058718Z 0.3401-0.5673j], 2025-12-04T10:08:29.1058782Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1058850Z 0.2078-0.7444j], 2025-12-04T10:08:29.1058915Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1058952Z 0.4109+0.5305j], 2025-12-04T10:08:29.1059014Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1059052Z -0.3607+0.5386j], 2025-12-04T10:08:29.1059114Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1059153Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1059155Z 2025-12-04T10:08:29.1059217Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1059266Z 0.5323-0.4729j], 2025-12-04T10:08:29.1059340Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1059377Z -0.6732-0.7677j], 2025-12-04T10:08:29.1059438Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1059477Z -0.5241-0.5479j], 2025-12-04T10:08:29.1059538Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1059576Z -0.3257-0.6597j], 2025-12-04T10:08:29.1059638Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1059676Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1059678Z 2025-12-04T10:08:29.1059680Z 2025-12-04T10:08:29.1059742Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1059779Z -0.6637-0.1175j], 2025-12-04T10:08:29.1059840Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1059880Z 0.4261-0.3012j], 2025-12-04T10:08:29.1059943Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1059979Z 0.2567-0.1808j], 2025-12-04T10:08:29.1060042Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1060082Z 0.1761-1.6446j], 2025-12-04T10:08:29.1060144Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1060184Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1060186Z 2025-12-04T10:08:29.1060247Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1060285Z -0.6307+0.1756j], 2025-12-04T10:08:29.1060348Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1060385Z -0.9972-0.3518j], 2025-12-04T10:08:29.1060447Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1060487Z 0.6467+0.0201j], 2025-12-04T10:08:29.1060550Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1060586Z -1.0443-0.3699j], 2025-12-04T10:08:29.1060650Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1060717Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1060719Z 2025-12-04T10:08:29.1060801Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1060803Z 2025-12-04T10:08:29.1060848Z Traceback (most recent call last): 2025-12-04T10:08:29.1061008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1061049Z method(*args, **kwargs) 2025-12-04T10:08:29.1061228Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1061277Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1061316Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1061477Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1061548Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1061587Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1061745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1061786Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1061823Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1061974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1062012Z fn(*args, **kwargs) 2025-12-04T10:08:29.1062191Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1062243Z raise e_tracked from e 2025-12-04T10:08:29.1062288Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1062290Z 2025-12-04T10:08:29.1062385Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1062468Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1062548Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1062550Z 2025-12-04T10:08:29.1062635Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1062737Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1062772Z If the test 2025-12-04T10:08:29.1062865Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1062976Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1063074Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1063156Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1063158Z 2025-12-04T10:08:29.1063251Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1063336Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1063372Z the following. 2025-12-04T10:08:29.1063374Z 2025-12-04T10:08:29.1063462Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1063551Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1063603Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1063666Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1063728Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1063730Z 2025-12-04T10:08:29.1063764Z Got: 2025-12-04T10:08:29.1063815Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1063859Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1063899Z nan+nanj], 2025-12-04T10:08:29.1063943Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1063989Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1064027Z nan+nanj], 2025-12-04T10:08:29.1064070Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1064111Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1064149Z nan+nanj], 2025-12-04T10:08:29.1064204Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1064260Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1064298Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1064351Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1064403Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1064447Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1064449Z 2025-12-04T10:08:29.1064500Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1064584Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1064625Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1064675Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1064726Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1064765Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1064815Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1064865Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1064904Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1064952Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1065018Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1065076Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1065125Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1065175Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1065218Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1065220Z 2025-12-04T10:08:29.1065222Z 2025-12-04T10:08:29.1065272Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1065321Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1065359Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1065410Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1065460Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1065498Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1065547Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1065602Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1065640Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1065690Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1065739Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1065779Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1065827Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1065876Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1065917Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1065919Z 2025-12-04T10:08:29.1065969Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1066018Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1066057Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1066106Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1066157Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1066196Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1066247Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1066295Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1066336Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1066386Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1066435Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1066473Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1066524Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1066573Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1066624Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1066667Z dtype=torch.complex128) 2025-12-04T10:08:29.1066670Z 2025-12-04T10:08:29.1066705Z Expected: 2025-12-04T10:08:29.1066784Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1066822Z 0.3401-0.5673j], 2025-12-04T10:08:29.1066886Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1066951Z 0.2078-0.7444j], 2025-12-04T10:08:29.1067017Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1067053Z 0.4109+0.5305j], 2025-12-04T10:08:29.1067118Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1067155Z -0.3607+0.5386j], 2025-12-04T10:08:29.1067218Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1067256Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1067258Z 2025-12-04T10:08:29.1067321Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1067356Z 0.5323-0.4729j], 2025-12-04T10:08:29.1067447Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1067487Z -0.6732-0.7677j], 2025-12-04T10:08:29.1067549Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1067588Z -0.5241-0.5479j], 2025-12-04T10:08:29.1067650Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1067686Z -0.3257-0.6597j], 2025-12-04T10:08:29.1067750Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1067787Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1067789Z 2025-12-04T10:08:29.1067791Z 2025-12-04T10:08:29.1067853Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1067889Z -0.6637-0.1175j], 2025-12-04T10:08:29.1067952Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1067988Z 0.4261-0.3012j], 2025-12-04T10:08:29.1068052Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1068088Z 0.2567-0.1808j], 2025-12-04T10:08:29.1068150Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1068187Z 0.1761-1.6446j], 2025-12-04T10:08:29.1068250Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1068288Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1068290Z 2025-12-04T10:08:29.1068352Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1068388Z -0.6307+0.1756j], 2025-12-04T10:08:29.1068450Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1068486Z -0.9972-0.3518j], 2025-12-04T10:08:29.1068548Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1068584Z 0.6467+0.0201j], 2025-12-04T10:08:29.1068646Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1068682Z -1.0443-0.3699j], 2025-12-04T10:08:29.1068746Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1068814Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1068816Z 2025-12-04T10:08:29.1069121Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1069123Z 2025-12-04T10:08:29.1069198Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1069406Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1069412Z 2025-12-04T10:08:29.1069499Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1069594Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1069663Z Traceback (most recent call last): 2025-12-04T10:08:29.1069835Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1069878Z return test(*args, **kwargs) 2025-12-04T10:08:29.1069915Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1070021Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1070087Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1070255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1070392Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1070455Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1070618Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1070675Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1070720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1070873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1070942Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1070987Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1071126Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1071172Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1071211Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1071363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1071416Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1071569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1071611Z raise GradcheckError( 2025-12-04T10:08:29.1071700Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1071703Z 2025-12-04T10:08:29.1071796Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1071877Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1071957Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1071960Z 2025-12-04T10:08:29.1072044Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1072147Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1072183Z If the test 2025-12-04T10:08:29.1072277Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1072340Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1072434Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1072516Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1072518Z 2025-12-04T10:08:29.1072607Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1072691Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1072727Z the following. 2025-12-04T10:08:29.1072729Z 2025-12-04T10:08:29.1072818Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1072908Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1072996Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1073100Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1073162Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1073165Z 2025-12-04T10:08:29.1073197Z Got: 2025-12-04T10:08:29.1073275Z tensor([[[[-10.9555+1.1443e+01j, -10.7610+9.3674e+00j, 4.0176+4.5979e+00j, 2025-12-04T10:08:29.1073326Z 6.2494-9.6514e+00j, -7.6518-2.9573e+00j], 2025-12-04T10:08:29.1073392Z [ 1.6973-1.0608e+01j, 3.8142-1.0573e+01j, -6.6223-2.5443e+00j, 2025-12-04T10:08:29.1073442Z -1.1524+8.9229e+00j, 4.8668-1.4703e+00j], 2025-12-04T10:08:29.1073507Z [ -1.4156-5.1293e+00j, -0.1388-5.3173e+00j, -3.7781-2.4617e-01j, 2025-12-04T10:08:29.1073572Z 0.4484+4.2408e+00j, 1.5391-1.9971e+00j], 2025-12-04T10:08:29.1073652Z [ -1.3952-2.9971e+00j, -1.4045-2.8774e+00j, -0.7956+1.0268e-02j, 2025-12-04T10:08:29.1073699Z 1.1773+8.6251e-01j, 0.7337-4.2551e-01j], 2025-12-04T10:08:29.1073764Z [ -0.0984+7.5107e-01j, 0.9180+1.1351e+00j, -0.8797-6.4058e-01j, 2025-12-04T10:08:29.1073814Z -0.7650+2.7541e-01j, 0.0369-1.2352e-01j]], 2025-12-04T10:08:29.1073817Z 2025-12-04T10:08:29.1073879Z [[ -4.9773+1.6248e+00j, 2.9623+9.3284e-01j, 4.8539-3.5427e-03j, 2025-12-04T10:08:29.1073924Z 0.6497-4.7870e+00j, -0.9892+1.2625e-01j], 2025-12-04T10:08:29.1073986Z [ -1.7052-2.8590e+00j, -0.0110+1.1556e+00j, 1.9902+2.9968e+00j, 2025-12-04T10:08:29.1074032Z 2.8546-8.5227e-01j, -0.8828+2.1961e-01j], 2025-12-04T10:08:29.1074093Z [ 3.1874-2.3475e+00j, -1.6718-2.0495e-01j, -6.3047-8.6525e-01j, 2025-12-04T10:08:29.1074141Z 0.5177+3.8594e+00j, 1.7619-8.4486e-02j], 2025-12-04T10:08:29.1074203Z [ 0.9590-1.5771e+00j, -0.2202+5.4104e-01j, -2.1598+1.7769e+00j, 2025-12-04T10:08:29.1074249Z 0.8666+5.8784e-01j, 0.7389-9.9069e-01j], 2025-12-04T10:08:29.1074309Z [ 0.5992+5.4884e-01j, 0.1630+4.6679e-01j, -1.3796-4.8927e-01j, 2025-12-04T10:08:29.1074361Z -0.3115+2.4686e-01j, 0.2055+1.7864e-01j]]], 2025-12-04T10:08:29.1074363Z 2025-12-04T10:08:29.1074365Z 2025-12-04T10:08:29.1074426Z [[[ -0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1074471Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1074532Z [ -0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1074577Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1074638Z [ -0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1074685Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1074746Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1074793Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1074853Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1074905Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1074907Z 2025-12-04T10:08:29.1074966Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1075013Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1075073Z [ -1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1075120Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1075180Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1075226Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1075287Z [ -0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1075334Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1075396Z [ -0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1075483Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1075529Z dtype=torch.complex128) 2025-12-04T10:08:29.1075532Z 2025-12-04T10:08:29.1075566Z Expected: 2025-12-04T10:08:29.1075640Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1075678Z 0.3401-0.5673j], 2025-12-04T10:08:29.1075742Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1075778Z 0.2078-0.7444j], 2025-12-04T10:08:29.1075844Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1075879Z 0.4109+0.5305j], 2025-12-04T10:08:29.1075963Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1076011Z -0.3607+0.5386j], 2025-12-04T10:08:29.1076074Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1076114Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1076117Z 2025-12-04T10:08:29.1076180Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1076215Z 0.5323-0.4729j], 2025-12-04T10:08:29.1076279Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1076316Z -0.6732-0.7677j], 2025-12-04T10:08:29.1076378Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1076413Z -0.5241-0.5479j], 2025-12-04T10:08:29.1076476Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1076511Z -0.3257-0.6597j], 2025-12-04T10:08:29.1076576Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1076614Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1076616Z 2025-12-04T10:08:29.1076618Z 2025-12-04T10:08:29.1076680Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1076718Z -0.6637-0.1175j], 2025-12-04T10:08:29.1076781Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1076816Z 0.4261-0.3012j], 2025-12-04T10:08:29.1076880Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1076916Z 0.2567-0.1808j], 2025-12-04T10:08:29.1076979Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1077015Z 0.1761-1.6446j], 2025-12-04T10:08:29.1077077Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1077117Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1077120Z 2025-12-04T10:08:29.1077183Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1077221Z -0.6307+0.1756j], 2025-12-04T10:08:29.1077283Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1077321Z -0.9972-0.3518j], 2025-12-04T10:08:29.1077384Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1077420Z 0.6467+0.0201j], 2025-12-04T10:08:29.1077482Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1077519Z -1.0443-0.3699j], 2025-12-04T10:08:29.1077582Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1077648Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1077650Z 2025-12-04T10:08:29.1077733Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1077736Z 2025-12-04T10:08:29.1077782Z Traceback (most recent call last): 2025-12-04T10:08:29.1077937Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1078006Z method(*args, **kwargs) 2025-12-04T10:08:29.1078183Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1078230Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1078268Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1078430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1078474Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1078513Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1078682Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1078735Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1078772Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1078924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1078964Z fn(*args, **kwargs) 2025-12-04T10:08:29.1079130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1079170Z raise e_tracked from e 2025-12-04T10:08:29.1079217Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1079219Z 2025-12-04T10:08:29.1079312Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1079395Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1079475Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1079478Z 2025-12-04T10:08:29.1079563Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1079665Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1079700Z If the test 2025-12-04T10:08:29.1079795Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1079857Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1079953Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1080034Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1080036Z 2025-12-04T10:08:29.1080127Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1080212Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1080248Z the following. 2025-12-04T10:08:29.1080250Z 2025-12-04T10:08:29.1080340Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1080431Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1080482Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1080548Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1080608Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1080610Z 2025-12-04T10:08:29.1080643Z Got: 2025-12-04T10:08:29.1080718Z tensor([[[[-10.9555+1.1443e+01j, -10.7610+9.3674e+00j, 4.0176+4.5979e+00j, 2025-12-04T10:08:29.1080767Z 6.2494-9.6514e+00j, -7.6518-2.9573e+00j], 2025-12-04T10:08:29.1080830Z [ 1.6973-1.0608e+01j, 3.8142-1.0573e+01j, -6.6223-2.5443e+00j, 2025-12-04T10:08:29.1080879Z -1.1524+8.9229e+00j, 4.8668-1.4703e+00j], 2025-12-04T10:08:29.1080942Z [ -1.4156-5.1293e+00j, -0.1388-5.3173e+00j, -3.7781-2.4617e-01j, 2025-12-04T10:08:29.1080990Z 0.4484+4.2408e+00j, 1.5391-1.9971e+00j], 2025-12-04T10:08:29.1081053Z [ -1.3952-2.9971e+00j, -1.4045-2.8774e+00j, -0.7956+1.0268e-02j, 2025-12-04T10:08:29.1081100Z 1.1773+8.6251e-01j, 0.7337-4.2551e-01j], 2025-12-04T10:08:29.1081185Z [ -0.0984+7.5107e-01j, 0.9180+1.1351e+00j, -0.8797-6.4058e-01j, 2025-12-04T10:08:29.1081235Z -0.7650+2.7541e-01j, 0.0369-1.2352e-01j]], 2025-12-04T10:08:29.1081237Z 2025-12-04T10:08:29.1081298Z [[ -4.9773+1.6248e+00j, 2.9623+9.3284e-01j, 4.8539-3.5427e-03j, 2025-12-04T10:08:29.1081343Z 0.6497-4.7870e+00j, -0.9892+1.2625e-01j], 2025-12-04T10:08:29.1081404Z [ -1.7052-2.8590e+00j, -0.0110+1.1556e+00j, 1.9902+2.9968e+00j, 2025-12-04T10:08:29.1081449Z 2.8546-8.5227e-01j, -0.8828+2.1961e-01j], 2025-12-04T10:08:29.1081511Z [ 3.1874-2.3475e+00j, -1.6718-2.0495e-01j, -6.3047-8.6525e-01j, 2025-12-04T10:08:29.1081568Z 0.5177+3.8594e+00j, 1.7619-8.4486e-02j], 2025-12-04T10:08:29.1081639Z [ 0.9590-1.5771e+00j, -0.2202+5.4104e-01j, -2.1598+1.7769e+00j, 2025-12-04T10:08:29.1081685Z 0.8666+5.8784e-01j, 0.7389-9.9069e-01j], 2025-12-04T10:08:29.1081745Z [ 0.5992+5.4884e-01j, 0.1630+4.6679e-01j, -1.3796-4.8927e-01j, 2025-12-04T10:08:29.1081796Z -0.3115+2.4686e-01j, 0.2055+1.7864e-01j]]], 2025-12-04T10:08:29.1081799Z 2025-12-04T10:08:29.1081800Z 2025-12-04T10:08:29.1081862Z [[[ -0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1081906Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1081968Z [ -0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1082013Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1082075Z [ -0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1082123Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1082185Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1082231Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1082292Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1082342Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1082346Z 2025-12-04T10:08:29.1082404Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1082451Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1082512Z [ -1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1082558Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1082617Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1082663Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1082723Z [ -0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1082770Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1082831Z [ -0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1082897Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1082988Z dtype=torch.complex128) 2025-12-04T10:08:29.1082990Z 2025-12-04T10:08:29.1083025Z Expected: 2025-12-04T10:08:29.1083099Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1083136Z 0.3401-0.5673j], 2025-12-04T10:08:29.1083199Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1083237Z 0.2078-0.7444j], 2025-12-04T10:08:29.1083301Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1083338Z 0.4109+0.5305j], 2025-12-04T10:08:29.1083401Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1083439Z -0.3607+0.5386j], 2025-12-04T10:08:29.1083501Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1083559Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1083574Z 2025-12-04T10:08:29.1083638Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1083674Z 0.5323-0.4729j], 2025-12-04T10:08:29.1083736Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1083775Z -0.6732-0.7677j], 2025-12-04T10:08:29.1083837Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1083875Z -0.5241-0.5479j], 2025-12-04T10:08:29.1083937Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1083975Z -0.3257-0.6597j], 2025-12-04T10:08:29.1084068Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1084107Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1084109Z 2025-12-04T10:08:29.1084110Z 2025-12-04T10:08:29.1084173Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1084211Z -0.6637-0.1175j], 2025-12-04T10:08:29.1084273Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1084309Z 0.4261-0.3012j], 2025-12-04T10:08:29.1084373Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1084408Z 0.2567-0.1808j], 2025-12-04T10:08:29.1084472Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1084507Z 0.1761-1.6446j], 2025-12-04T10:08:29.1084569Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1084608Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1084611Z 2025-12-04T10:08:29.1084673Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1084709Z -0.6307+0.1756j], 2025-12-04T10:08:29.1084773Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1084810Z -0.9972-0.3518j], 2025-12-04T10:08:29.1084872Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1084908Z 0.6467+0.0201j], 2025-12-04T10:08:29.1084969Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1085005Z -1.0443-0.3699j], 2025-12-04T10:08:29.1085068Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1085133Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1085135Z 2025-12-04T10:08:29.1085440Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1085443Z 2025-12-04T10:08:29.1085519Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1085727Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1085729Z 2025-12-04T10:08:29.1085816Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1085910Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1085957Z Traceback (most recent call last): 2025-12-04T10:08:29.1086128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1086172Z return test(*args, **kwargs) 2025-12-04T10:08:29.1086209Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1086314Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1086379Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1086584Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1086706Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1086760Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1086921Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1086978Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1087032Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1087198Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1087264Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1087311Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1087450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1087497Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1087535Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1087687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1087738Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1087892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1087937Z raise GradcheckError( 2025-12-04T10:08:29.1088026Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1088028Z 2025-12-04T10:08:29.1088121Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1088204Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1088285Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1088287Z 2025-12-04T10:08:29.1088372Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1088474Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1088509Z If the test 2025-12-04T10:08:29.1088603Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1088665Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1088762Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1088844Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1088846Z 2025-12-04T10:08:29.1088938Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1089024Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1089060Z the following. 2025-12-04T10:08:29.1089062Z 2025-12-04T10:08:29.1089149Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1089239Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1089289Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1089352Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1089413Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1089415Z 2025-12-04T10:08:29.1089448Z Got: 2025-12-04T10:08:29.1089523Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1047j, 1.1406+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.1089562Z 0.3399-0.5667j], 2025-12-04T10:08:29.1089625Z [ 0.6809-0.1507j, 0.2812+0.1175j, 0.5375+0.1638j, 0.8389-0.5080j, 2025-12-04T10:08:29.1089690Z 0.2074-0.7436j], 2025-12-04T10:08:29.1089756Z [-1.1227+0.2137j, -1.1472+0.5734j, 0.6646-0.4148j, 0.1232-1.7416j, 2025-12-04T10:08:29.1089792Z 0.4108+0.5305j], 2025-12-04T10:08:29.1089855Z [ 1.5016+0.8767j, 0.5762+0.6562j, 1.3188+0.1896j, -0.3358-0.6125j, 2025-12-04T10:08:29.1089891Z -0.3605+0.5383j], 2025-12-04T10:08:29.1089954Z [-0.5945-0.5360j, -1.5380+0.1181j, 1.0848-0.3813j, 0.2191-0.8307j, 2025-12-04T10:08:29.1089991Z 0.0853+0.1062j]], 2025-12-04T10:08:29.1089993Z 2025-12-04T10:08:29.1090056Z [[-0.4814+0.4918j, 1.0181+0.7994j, -0.4840-1.6292j, 0.3046-0.1542j, 2025-12-04T10:08:29.1090091Z 0.5318-0.4740j], 2025-12-04T10:08:29.1090177Z [ 0.9584+1.1453j, -0.8334+0.4231j, 0.6382+0.0402j, -0.1755-0.1514j, 2025-12-04T10:08:29.1090214Z -0.6735-0.7687j], 2025-12-04T10:08:29.1090276Z [ 0.6042-0.8441j, 0.5444-1.0102j, 1.4445+0.0590j, -1.1478+0.0824j, 2025-12-04T10:08:29.1090314Z -0.5243-0.5478j], 2025-12-04T10:08:29.1090377Z [-0.3103-0.4949j, 0.4622+0.9676j, -0.9095+1.4325j, 0.3254-0.2537j, 2025-12-04T10:08:29.1090413Z -0.3255-0.6602j], 2025-12-04T10:08:29.1090475Z [ 0.9170+0.3097j, 0.4022+0.4302j, -1.7385+0.1306j, -0.2206+0.4188j, 2025-12-04T10:08:29.1090512Z 0.3098+0.0958j]]], 2025-12-04T10:08:29.1090514Z 2025-12-04T10:08:29.1090516Z 2025-12-04T10:08:29.1090578Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1090614Z -0.6637-0.1175j], 2025-12-04T10:08:29.1090676Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1090713Z 0.4261-0.3012j], 2025-12-04T10:08:29.1090778Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1090813Z 0.2567-0.1808j], 2025-12-04T10:08:29.1090875Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1090913Z 0.1761-1.6446j], 2025-12-04T10:08:29.1090975Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1091013Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1091015Z 2025-12-04T10:08:29.1091077Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1091113Z -0.6307+0.1756j], 2025-12-04T10:08:29.1091176Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1091211Z -0.9972-0.3518j], 2025-12-04T10:08:29.1091273Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1091309Z 0.6467+0.0201j], 2025-12-04T10:08:29.1091374Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1091410Z -1.0443-0.3699j], 2025-12-04T10:08:29.1091474Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1091540Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1091543Z 2025-12-04T10:08:29.1091577Z Expected: 2025-12-04T10:08:29.1091650Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1091684Z 0.3401-0.5673j], 2025-12-04T10:08:29.1091747Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1091782Z 0.2078-0.7444j], 2025-12-04T10:08:29.1091845Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1091881Z 0.4109+0.5305j], 2025-12-04T10:08:29.1091944Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1091981Z -0.3607+0.5386j], 2025-12-04T10:08:29.1092043Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1092080Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1092096Z 2025-12-04T10:08:29.1092173Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1092209Z 0.5323-0.4729j], 2025-12-04T10:08:29.1092272Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1092308Z -0.6732-0.7677j], 2025-12-04T10:08:29.1092369Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1092405Z -0.5241-0.5479j], 2025-12-04T10:08:29.1092468Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1092503Z -0.3257-0.6597j], 2025-12-04T10:08:29.1092579Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1092631Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1092633Z 2025-12-04T10:08:29.1092635Z 2025-12-04T10:08:29.1092699Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1092738Z -0.6637-0.1175j], 2025-12-04T10:08:29.1092805Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1092840Z 0.4261-0.3012j], 2025-12-04T10:08:29.1092905Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1092984Z 0.2567-0.1808j], 2025-12-04T10:08:29.1093047Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1093083Z 0.1761-1.6446j], 2025-12-04T10:08:29.1093144Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1093183Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1093189Z 2025-12-04T10:08:29.1093252Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1093289Z -0.6307+0.1756j], 2025-12-04T10:08:29.1093353Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1093393Z -0.9972-0.3518j], 2025-12-04T10:08:29.1093459Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1093495Z 0.6467+0.0201j], 2025-12-04T10:08:29.1093558Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1093596Z -1.0443-0.3699j], 2025-12-04T10:08:29.1093659Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1093725Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1093727Z 2025-12-04T10:08:29.1093809Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1093813Z 2025-12-04T10:08:29.1093858Z Traceback (most recent call last): 2025-12-04T10:08:29.1094012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1094056Z method(*args, **kwargs) 2025-12-04T10:08:29.1094234Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1094281Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1094319Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1094478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1094522Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1094560Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1094719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1094763Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1094799Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1094950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1095025Z fn(*args, **kwargs) 2025-12-04T10:08:29.1095193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1095233Z raise e_tracked from e 2025-12-04T10:08:29.1095279Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1095281Z 2025-12-04T10:08:29.1095374Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1095455Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1095536Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1095539Z 2025-12-04T10:08:29.1095657Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1095761Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1095798Z If the test 2025-12-04T10:08:29.1095896Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1095960Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1096058Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1096139Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1096141Z 2025-12-04T10:08:29.1096234Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1096318Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1096356Z the following. 2025-12-04T10:08:29.1096358Z 2025-12-04T10:08:29.1096447Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1096540Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1096590Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1096660Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1096722Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1096724Z 2025-12-04T10:08:29.1096757Z Got: 2025-12-04T10:08:29.1096832Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1047j, 1.1406+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.1096872Z 0.3399-0.5667j], 2025-12-04T10:08:29.1096938Z [ 0.6809-0.1507j, 0.2812+0.1175j, 0.5375+0.1638j, 0.8389-0.5080j, 2025-12-04T10:08:29.1096977Z 0.2074-0.7436j], 2025-12-04T10:08:29.1097040Z [-1.1227+0.2137j, -1.1472+0.5734j, 0.6646-0.4148j, 0.1232-1.7416j, 2025-12-04T10:08:29.1097078Z 0.4108+0.5305j], 2025-12-04T10:08:29.1097142Z [ 1.5016+0.8767j, 0.5762+0.6562j, 1.3188+0.1896j, -0.3358-0.6125j, 2025-12-04T10:08:29.1097182Z -0.3605+0.5383j], 2025-12-04T10:08:29.1097244Z [-0.5945-0.5360j, -1.5380+0.1181j, 1.0848-0.3813j, 0.2191-0.8307j, 2025-12-04T10:08:29.1097283Z 0.0853+0.1062j]], 2025-12-04T10:08:29.1097287Z 2025-12-04T10:08:29.1097350Z [[-0.4814+0.4918j, 1.0181+0.7994j, -0.4840-1.6292j, 0.3046-0.1542j, 2025-12-04T10:08:29.1097388Z 0.5318-0.4740j], 2025-12-04T10:08:29.1097452Z [ 0.9584+1.1453j, -0.8334+0.4231j, 0.6382+0.0402j, -0.1755-0.1514j, 2025-12-04T10:08:29.1097488Z -0.6735-0.7687j], 2025-12-04T10:08:29.1097552Z [ 0.6042-0.8441j, 0.5444-1.0102j, 1.4445+0.0590j, -1.1478+0.0824j, 2025-12-04T10:08:29.1097588Z -0.5243-0.5478j], 2025-12-04T10:08:29.1097653Z [-0.3103-0.4949j, 0.4622+0.9676j, -0.9095+1.4325j, 0.3254-0.2537j, 2025-12-04T10:08:29.1097689Z -0.3255-0.6602j], 2025-12-04T10:08:29.1097753Z [ 0.9170+0.3097j, 0.4022+0.4302j, -1.7385+0.1306j, -0.2206+0.4188j, 2025-12-04T10:08:29.1097792Z 0.3098+0.0958j]]], 2025-12-04T10:08:29.1097794Z 2025-12-04T10:08:29.1097795Z 2025-12-04T10:08:29.1097858Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1097925Z -0.6637-0.1175j], 2025-12-04T10:08:29.1097989Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1098024Z 0.4261-0.3012j], 2025-12-04T10:08:29.1098088Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1098124Z 0.2567-0.1808j], 2025-12-04T10:08:29.1098187Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1098222Z 0.1761-1.6446j], 2025-12-04T10:08:29.1098284Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1098322Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1098351Z 2025-12-04T10:08:29.1098416Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1098452Z -0.6307+0.1756j], 2025-12-04T10:08:29.1098515Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1098553Z -0.9972-0.3518j], 2025-12-04T10:08:29.1098618Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1098654Z 0.6467+0.0201j], 2025-12-04T10:08:29.1098716Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1098752Z -1.0443-0.3699j], 2025-12-04T10:08:29.1098818Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1098884Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1098886Z 2025-12-04T10:08:29.1098922Z Expected: 2025-12-04T10:08:29.1098996Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1099033Z 0.3401-0.5673j], 2025-12-04T10:08:29.1099095Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1099131Z 0.2078-0.7444j], 2025-12-04T10:08:29.1099196Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1099234Z 0.4109+0.5305j], 2025-12-04T10:08:29.1099296Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1099335Z -0.3607+0.5386j], 2025-12-04T10:08:29.1099397Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1099436Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1099438Z 2025-12-04T10:08:29.1099502Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1099539Z 0.5323-0.4729j], 2025-12-04T10:08:29.1099603Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1099641Z -0.6732-0.7677j], 2025-12-04T10:08:29.1099704Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1099741Z -0.5241-0.5479j], 2025-12-04T10:08:29.1099806Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1099843Z -0.3257-0.6597j], 2025-12-04T10:08:29.1099905Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1099944Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1099946Z 2025-12-04T10:08:29.1099947Z 2025-12-04T10:08:29.1100011Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1100048Z -0.6637-0.1175j], 2025-12-04T10:08:29.1100113Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1100148Z 0.4261-0.3012j], 2025-12-04T10:08:29.1100215Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1100250Z 0.2567-0.1808j], 2025-12-04T10:08:29.1100314Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1100362Z 0.1761-1.6446j], 2025-12-04T10:08:29.1100437Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1100478Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1100480Z 2025-12-04T10:08:29.1100543Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1100579Z -0.6307+0.1756j], 2025-12-04T10:08:29.1100646Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1100682Z -0.9972-0.3518j], 2025-12-04T10:08:29.1100745Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1100779Z 0.6467+0.0201j], 2025-12-04T10:08:29.1100868Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1100904Z -1.0443-0.3699j], 2025-12-04T10:08:29.1100968Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1101035Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1101037Z 2025-12-04T10:08:29.1101335Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1101338Z 2025-12-04T10:08:29.1101413Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1101618Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1101621Z 2025-12-04T10:08:29.1101709Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1101803Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1101850Z Traceback (most recent call last): 2025-12-04T10:08:29.1102024Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1102066Z return test(*args, **kwargs) 2025-12-04T10:08:29.1102103Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1102211Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1102276Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1102445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1102567Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1102623Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1102788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1102846Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1102891Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1103077Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1103144Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1103190Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1103331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1103377Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1103420Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1103571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.1103631Z _gradcheck_real_imag( 2025-12-04T10:08:29.1103800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1489, in _gradcheck_real_imag 2025-12-04T10:08:29.1103837Z gradcheck_fn( 2025-12-04T10:08:29.1103985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.1104034Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.1104208Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.1104251Z raise GradcheckError( 2025-12-04T10:08:29.1104492Z torch.autograd.gradcheck.GradcheckError: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1104561Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.1104620Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.1104625Z 2025-12-04T10:08:29.1104729Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1104842Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1104943Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1104945Z 2025-12-04T10:08:29.1104983Z Numerical: 2025-12-04T10:08:29.1105058Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.1105113Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105151Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1105220Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105269Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105307Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1105369Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105419Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105457Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1105495Z ..., 2025-12-04T10:08:29.1105556Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105605Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.1105643Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.1105707Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105754Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.1105793Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.1105854Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1105902Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.1105974Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1106011Z Analytical: 2025-12-04T10:08:29.1106084Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.1106135Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1106172Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1106234Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1106280Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1106319Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1106378Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1106426Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1106464Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1106500Z ..., 2025-12-04T10:08:29.1106562Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1106610Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.1106673Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.1106736Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1106781Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.1106820Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.1106882Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1106930Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.1107001Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1107003Z 2025-12-04T10:08:29.1107087Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.1107213Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.1107260Z test might've passed in slow_mode! 2025-12-04T10:08:29.1107262Z 2025-12-04T10:08:29.1107348Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1107454Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.1107456Z 2025-12-04T10:08:29.1107490Z If the test 2025-12-04T10:08:29.1107583Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1107639Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.1107736Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1107784Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1107862Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.1107931Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1107934Z 2025-12-04T10:08:29.1108015Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1108017Z 2025-12-04T10:08:29.1108062Z Traceback (most recent call last): 2025-12-04T10:08:29.1108221Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1108262Z method(*args, **kwargs) 2025-12-04T10:08:29.1108438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1108486Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1108524Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1108685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1108729Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1108770Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1108928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1108973Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1109010Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1109163Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1109201Z fn(*args, **kwargs) 2025-12-04T10:08:29.1109368Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1109411Z raise e_tracked from e 2025-12-04T10:08:29.1109577Z Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1109631Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.1109690Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.1109694Z 2025-12-04T10:08:29.1109794Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1109899Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1110024Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1110026Z 2025-12-04T10:08:29.1110061Z Numerical: 2025-12-04T10:08:29.1110138Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.1110187Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110227Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1110289Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110339Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110376Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1110452Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110508Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110547Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1110580Z ..., 2025-12-04T10:08:29.1110646Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110692Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.1110729Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.1110790Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110837Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.1110873Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.1110936Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1110982Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.1111057Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1111093Z Analytical: 2025-12-04T10:08:29.1111165Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.1111213Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1111252Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1111313Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1111362Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1111399Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1111459Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1111506Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1111542Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1111575Z ..., 2025-12-04T10:08:29.1111639Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1111688Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.1111727Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.1111789Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1111834Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.1111873Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.1111935Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1111984Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.1112054Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1112056Z 2025-12-04T10:08:29.1112137Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.1112234Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.1112282Z test might've passed in slow_mode! 2025-12-04T10:08:29.1112284Z 2025-12-04T10:08:29.1112371Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1112476Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.1112479Z 2025-12-04T10:08:29.1112512Z If the test 2025-12-04T10:08:29.1112632Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1112688Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.1112784Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1112830Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1112908Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.1113019Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1113021Z 2025-12-04T10:08:29.1113344Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1113360Z 2025-12-04T10:08:29.1113437Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1113645Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1113648Z 2025-12-04T10:08:29.1113735Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1113830Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1113878Z Traceback (most recent call last): 2025-12-04T10:08:29.1114048Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1114095Z return test(*args, **kwargs) 2025-12-04T10:08:29.1114132Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1114241Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1114304Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1114472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1114594Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1114651Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1114811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1114869Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1114912Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1115069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1115136Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1115181Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1115325Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1115370Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1115410Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1115561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1115613Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1115767Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1115809Z raise GradcheckError( 2025-12-04T10:08:29.1115899Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1115902Z 2025-12-04T10:08:29.1115994Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1116074Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1116189Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1116192Z 2025-12-04T10:08:29.1116276Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1116380Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1116414Z If the test 2025-12-04T10:08:29.1116511Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1116574Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1116670Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1116762Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1116774Z 2025-12-04T10:08:29.1116866Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1116952Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1116990Z the following. 2025-12-04T10:08:29.1116992Z 2025-12-04T10:08:29.1117084Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1117173Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1117226Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1117289Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1117352Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1117353Z 2025-12-04T10:08:29.1117385Z Got: 2025-12-04T10:08:29.1117456Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1117497Z nan+nanj], 2025-12-04T10:08:29.1117559Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1117597Z nan+nanj], 2025-12-04T10:08:29.1117656Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1117694Z nan+nanj], 2025-12-04T10:08:29.1117762Z [-0.4501-0.4557j, -0.4128-0.1096j, -0.0924-0.3252j, 0.0246-0.0093j, 2025-12-04T10:08:29.1117802Z 0.1692-0.0800j], 2025-12-04T10:08:29.1117869Z [ 0.0270+0.0775j, 0.1441+0.0653j, -0.1164-0.0193j, -0.0607+0.0639j, 2025-12-04T10:08:29.1117909Z -0.0024-0.0138j]], 2025-12-04T10:08:29.1117911Z 2025-12-04T10:08:29.1117977Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1118015Z 0.5323-0.4729j], 2025-12-04T10:08:29.1118078Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1118119Z -0.6732-0.7677j], 2025-12-04T10:08:29.1118184Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1118222Z -0.5241-0.5479j], 2025-12-04T10:08:29.1118286Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1118324Z -0.3257-0.6597j], 2025-12-04T10:08:29.1118387Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1118425Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1118427Z 2025-12-04T10:08:29.1118429Z 2025-12-04T10:08:29.1118492Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1118529Z -0.6637-0.1175j], 2025-12-04T10:08:29.1118596Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1118632Z 0.4261-0.3012j], 2025-12-04T10:08:29.1118698Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1118735Z 0.2567-0.1808j], 2025-12-04T10:08:29.1118799Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1118836Z 0.1761-1.6446j], 2025-12-04T10:08:29.1118899Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1118964Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1118967Z 2025-12-04T10:08:29.1119029Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1119068Z -0.6307+0.1756j], 2025-12-04T10:08:29.1119131Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1119168Z -0.9972-0.3518j], 2025-12-04T10:08:29.1119231Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1119267Z 0.6467+0.0201j], 2025-12-04T10:08:29.1119329Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1119383Z -1.0443-0.3699j], 2025-12-04T10:08:29.1119457Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1119527Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1119531Z 2025-12-04T10:08:29.1119566Z Expected: 2025-12-04T10:08:29.1119642Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1119679Z 0.3401-0.5673j], 2025-12-04T10:08:29.1119743Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1119779Z 0.2078-0.7444j], 2025-12-04T10:08:29.1119844Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1119879Z 0.4109+0.5305j], 2025-12-04T10:08:29.1119942Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1119979Z -0.3607+0.5386j], 2025-12-04T10:08:29.1120044Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1120081Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1120083Z 2025-12-04T10:08:29.1120147Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1120187Z 0.5323-0.4729j], 2025-12-04T10:08:29.1120253Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1120290Z -0.6732-0.7677j], 2025-12-04T10:08:29.1120354Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1120390Z -0.5241-0.5479j], 2025-12-04T10:08:29.1120453Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1120488Z -0.3257-0.6597j], 2025-12-04T10:08:29.1120551Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1120588Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1120590Z 2025-12-04T10:08:29.1120594Z 2025-12-04T10:08:29.1120658Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1120693Z -0.6637-0.1175j], 2025-12-04T10:08:29.1120757Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1120795Z 0.4261-0.3012j], 2025-12-04T10:08:29.1120860Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1120896Z 0.2567-0.1808j], 2025-12-04T10:08:29.1120959Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1120995Z 0.1761-1.6446j], 2025-12-04T10:08:29.1121057Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1121096Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1121098Z 2025-12-04T10:08:29.1121159Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1121197Z -0.6307+0.1756j], 2025-12-04T10:08:29.1121261Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1121299Z -0.9972-0.3518j], 2025-12-04T10:08:29.1121361Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1121423Z 0.6467+0.0201j], 2025-12-04T10:08:29.1121487Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1121526Z -1.0443-0.3699j], 2025-12-04T10:08:29.1121589Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1121658Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1121660Z 2025-12-04T10:08:29.1121742Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1121745Z 2025-12-04T10:08:29.1121792Z Traceback (most recent call last): 2025-12-04T10:08:29.1121961Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1122012Z method(*args, **kwargs) 2025-12-04T10:08:29.1122189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1122238Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1122278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1122438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1122482Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1122523Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1122681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1122723Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1122759Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1122915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1122992Z fn(*args, **kwargs) 2025-12-04T10:08:29.1123165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1123208Z raise e_tracked from e 2025-12-04T10:08:29.1123253Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1123255Z 2025-12-04T10:08:29.1123348Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1123428Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1123510Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1123511Z 2025-12-04T10:08:29.1123594Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1123699Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1123736Z If the test 2025-12-04T10:08:29.1123830Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1123892Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1123990Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1124071Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1124073Z 2025-12-04T10:08:29.1124164Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1124249Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1124286Z the following. 2025-12-04T10:08:29.1124287Z 2025-12-04T10:08:29.1124376Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1124469Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1124522Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1124589Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1124650Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1124670Z 2025-12-04T10:08:29.1124716Z Got: 2025-12-04T10:08:29.1124786Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1124826Z nan+nanj], 2025-12-04T10:08:29.1124883Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1124924Z nan+nanj], 2025-12-04T10:08:29.1124984Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1125022Z nan+nanj], 2025-12-04T10:08:29.1125089Z [-0.4501-0.4557j, -0.4128-0.1096j, -0.0924-0.3252j, 0.0246-0.0093j, 2025-12-04T10:08:29.1125125Z 0.1692-0.0800j], 2025-12-04T10:08:29.1125203Z [ 0.0270+0.0775j, 0.1441+0.0653j, -0.1164-0.0193j, -0.0607+0.0639j, 2025-12-04T10:08:29.1125256Z -0.0024-0.0138j]], 2025-12-04T10:08:29.1125258Z 2025-12-04T10:08:29.1125322Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1125359Z 0.5323-0.4729j], 2025-12-04T10:08:29.1125425Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1125461Z -0.6732-0.7677j], 2025-12-04T10:08:29.1125525Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1125561Z -0.5241-0.5479j], 2025-12-04T10:08:29.1125623Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1125659Z -0.3257-0.6597j], 2025-12-04T10:08:29.1125722Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1125759Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1125761Z 2025-12-04T10:08:29.1125763Z 2025-12-04T10:08:29.1125827Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1125863Z -0.6637-0.1175j], 2025-12-04T10:08:29.1125926Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1125962Z 0.4261-0.3012j], 2025-12-04T10:08:29.1126028Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1126064Z 0.2567-0.1808j], 2025-12-04T10:08:29.1126127Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1126162Z 0.1761-1.6446j], 2025-12-04T10:08:29.1126225Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1126264Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1126266Z 2025-12-04T10:08:29.1126329Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1126365Z -0.6307+0.1756j], 2025-12-04T10:08:29.1126430Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1126465Z -0.9972-0.3518j], 2025-12-04T10:08:29.1126529Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1126566Z 0.6467+0.0201j], 2025-12-04T10:08:29.1126628Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1126664Z -1.0443-0.3699j], 2025-12-04T10:08:29.1126728Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1126793Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1126796Z 2025-12-04T10:08:29.1126831Z Expected: 2025-12-04T10:08:29.1126906Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1126942Z 0.3401-0.5673j], 2025-12-04T10:08:29.1127007Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1127043Z 0.2078-0.7444j], 2025-12-04T10:08:29.1127107Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1127143Z 0.4109+0.5305j], 2025-12-04T10:08:29.1127249Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1127287Z -0.3607+0.5386j], 2025-12-04T10:08:29.1127351Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1127388Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1127390Z 2025-12-04T10:08:29.1127455Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1127490Z 0.5323-0.4729j], 2025-12-04T10:08:29.1127554Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1127590Z -0.6732-0.7677j], 2025-12-04T10:08:29.1127665Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1127712Z -0.5241-0.5479j], 2025-12-04T10:08:29.1127775Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1127811Z -0.3257-0.6597j], 2025-12-04T10:08:29.1127875Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1127912Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1127914Z 2025-12-04T10:08:29.1127916Z 2025-12-04T10:08:29.1127979Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1128014Z -0.6637-0.1175j], 2025-12-04T10:08:29.1128079Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1128113Z 0.4261-0.3012j], 2025-12-04T10:08:29.1128178Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1128213Z 0.2567-0.1808j], 2025-12-04T10:08:29.1128280Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1128315Z 0.1761-1.6446j], 2025-12-04T10:08:29.1128377Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1128417Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1128419Z 2025-12-04T10:08:29.1128485Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1128522Z -0.6307+0.1756j], 2025-12-04T10:08:29.1128584Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1128621Z -0.9972-0.3518j], 2025-12-04T10:08:29.1128683Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1128718Z 0.6467+0.0201j], 2025-12-04T10:08:29.1128780Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1128818Z -1.0443-0.3699j], 2025-12-04T10:08:29.1128881Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1128948Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1128950Z 2025-12-04T10:08:29.1129250Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1129253Z 2025-12-04T10:08:29.1129329Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1129532Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1129535Z 2025-12-04T10:08:29.1129621Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1129715Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1129762Z Traceback (most recent call last): 2025-12-04T10:08:29.1129933Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1129990Z return test(*args, **kwargs) 2025-12-04T10:08:29.1130044Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1130152Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1130217Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1130386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1130512Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1130567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1130755Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1130811Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1130856Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1131011Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1131078Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1131124Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1131264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1131309Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1131349Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1131501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1131553Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1131705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1131751Z raise GradcheckError( 2025-12-04T10:08:29.1131840Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1131842Z 2025-12-04T10:08:29.1131937Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1132019Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1132102Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1132104Z 2025-12-04T10:08:29.1132189Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1132290Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1132327Z If the test 2025-12-04T10:08:29.1132420Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1132486Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1132581Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1132666Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1132668Z 2025-12-04T10:08:29.1132759Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1132844Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1132881Z the following. 2025-12-04T10:08:29.1132883Z 2025-12-04T10:08:29.1133022Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1133113Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1133168Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1133232Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1133294Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1133296Z 2025-12-04T10:08:29.1133328Z Got: 2025-12-04T10:08:29.1133415Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133462Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133504Z nan+nanj], 2025-12-04T10:08:29.1133548Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133596Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133638Z nan+nanj], 2025-12-04T10:08:29.1133681Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133724Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1133762Z nan+nanj], 2025-12-04T10:08:29.1133819Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1133891Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1133946Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1134001Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1134054Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1134100Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1134102Z 2025-12-04T10:08:29.1134154Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1134206Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1134245Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1134298Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1134348Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1134388Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1134438Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1134493Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1134533Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1134583Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1134633Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1134673Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1134724Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1134774Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1134816Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1134818Z 2025-12-04T10:08:29.1134820Z 2025-12-04T10:08:29.1134871Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1134923Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1134962Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1135013Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1135064Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1135105Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1135155Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1135207Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1135248Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1135298Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1135347Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1135388Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1135436Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1135486Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1135528Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1135530Z 2025-12-04T10:08:29.1135580Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1135631Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1135673Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1135723Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1135772Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1135835Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1135888Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1135937Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1135979Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1136029Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1136078Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1136116Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1136167Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1136217Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1136296Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1136342Z dtype=torch.complex128) 2025-12-04T10:08:29.1136344Z 2025-12-04T10:08:29.1136382Z Expected: 2025-12-04T10:08:29.1136461Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1136500Z 0.3401-0.5673j], 2025-12-04T10:08:29.1136564Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1136603Z 0.2078-0.7444j], 2025-12-04T10:08:29.1136667Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1136704Z 0.4109+0.5305j], 2025-12-04T10:08:29.1136766Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1136804Z -0.3607+0.5386j], 2025-12-04T10:08:29.1136868Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1136909Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1136912Z 2025-12-04T10:08:29.1136976Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1137012Z 0.5323-0.4729j], 2025-12-04T10:08:29.1137077Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1137115Z -0.6732-0.7677j], 2025-12-04T10:08:29.1137180Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1137216Z -0.5241-0.5479j], 2025-12-04T10:08:29.1137278Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1137313Z -0.3257-0.6597j], 2025-12-04T10:08:29.1137376Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1137415Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1137416Z 2025-12-04T10:08:29.1137418Z 2025-12-04T10:08:29.1137482Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1137520Z -0.6637-0.1175j], 2025-12-04T10:08:29.1137585Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1137624Z 0.4261-0.3012j], 2025-12-04T10:08:29.1137690Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1137727Z 0.2567-0.1808j], 2025-12-04T10:08:29.1137792Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1137829Z 0.1761-1.6446j], 2025-12-04T10:08:29.1137893Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1137932Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1137934Z 2025-12-04T10:08:29.1137997Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1138033Z -0.6307+0.1756j], 2025-12-04T10:08:29.1138099Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1138135Z -0.9972-0.3518j], 2025-12-04T10:08:29.1138197Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1138232Z 0.6467+0.0201j], 2025-12-04T10:08:29.1138321Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1138357Z -1.0443-0.3699j], 2025-12-04T10:08:29.1138421Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1138485Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1138487Z 2025-12-04T10:08:29.1138569Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1138571Z 2025-12-04T10:08:29.1138618Z Traceback (most recent call last): 2025-12-04T10:08:29.1138777Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1138844Z method(*args, **kwargs) 2025-12-04T10:08:29.1139021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1139069Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1139111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1139273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1139316Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1139354Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1139514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1139558Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1139594Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1139748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1139788Z fn(*args, **kwargs) 2025-12-04T10:08:29.1139956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1139999Z raise e_tracked from e 2025-12-04T10:08:29.1140046Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1140048Z 2025-12-04T10:08:29.1140141Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1140224Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1140305Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1140307Z 2025-12-04T10:08:29.1140392Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1140494Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1140532Z If the test 2025-12-04T10:08:29.1140630Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1140695Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1140794Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1140878Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1140880Z 2025-12-04T10:08:29.1140971Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1141055Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1141093Z the following. 2025-12-04T10:08:29.1141095Z 2025-12-04T10:08:29.1141187Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1141279Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1141330Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1141397Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1141458Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1141460Z 2025-12-04T10:08:29.1141493Z Got: 2025-12-04T10:08:29.1141542Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141629Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141669Z nan+nanj], 2025-12-04T10:08:29.1141715Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141759Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141799Z nan+nanj], 2025-12-04T10:08:29.1141841Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141885Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1141922Z nan+nanj], 2025-12-04T10:08:29.1141978Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1142043Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1142097Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1142147Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1142201Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1142246Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1142248Z 2025-12-04T10:08:29.1142299Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1142349Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1142389Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1142439Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1142490Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1142529Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1142580Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1142633Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1142674Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1142724Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1144975Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1145025Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1145076Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1145126Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1145168Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1145170Z 2025-12-04T10:08:29.1145172Z 2025-12-04T10:08:29.1145223Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1145272Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1145311Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1145362Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1145417Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1145458Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1145508Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1145559Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1145599Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1145648Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1145697Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1145735Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1145785Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1145834Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1145875Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1145877Z 2025-12-04T10:08:29.1145926Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1145977Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1146016Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1146067Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1146116Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1146199Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1146249Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1146299Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1146336Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1146389Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1146437Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1146476Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1146525Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1146575Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1146656Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1146701Z dtype=torch.complex128) 2025-12-04T10:08:29.1146703Z 2025-12-04T10:08:29.1146737Z Expected: 2025-12-04T10:08:29.1146814Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1146856Z 0.3401-0.5673j], 2025-12-04T10:08:29.1146921Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1146958Z 0.2078-0.7444j], 2025-12-04T10:08:29.1147024Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1147060Z 0.4109+0.5305j], 2025-12-04T10:08:29.1147124Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1147160Z -0.3607+0.5386j], 2025-12-04T10:08:29.1147225Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1147266Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1147269Z 2025-12-04T10:08:29.1147333Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1147368Z 0.5323-0.4729j], 2025-12-04T10:08:29.1147431Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1147471Z -0.6732-0.7677j], 2025-12-04T10:08:29.1147534Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1147571Z -0.5241-0.5479j], 2025-12-04T10:08:29.1147633Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1147670Z -0.3257-0.6597j], 2025-12-04T10:08:29.1147732Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1147796Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1147798Z 2025-12-04T10:08:29.1147800Z 2025-12-04T10:08:29.1147862Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1147901Z -0.6637-0.1175j], 2025-12-04T10:08:29.1147963Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1148000Z 0.4261-0.3012j], 2025-12-04T10:08:29.1148065Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1148101Z 0.2567-0.1808j], 2025-12-04T10:08:29.1148164Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1148200Z 0.1761-1.6446j], 2025-12-04T10:08:29.1148261Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1148301Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1148303Z 2025-12-04T10:08:29.1148364Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1148400Z -0.6307+0.1756j], 2025-12-04T10:08:29.1148463Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1148501Z -0.9972-0.3518j], 2025-12-04T10:08:29.1148564Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1148600Z 0.6467+0.0201j], 2025-12-04T10:08:29.1148687Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1148724Z -1.0443-0.3699j], 2025-12-04T10:08:29.1148788Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1148855Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1148857Z 2025-12-04T10:08:29.1149160Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1149163Z 2025-12-04T10:08:29.1149249Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1149468Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1149470Z 2025-12-04T10:08:29.1149560Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1149655Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1149700Z Traceback (most recent call last): 2025-12-04T10:08:29.1149874Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1149915Z return test(*args, **kwargs) 2025-12-04T10:08:29.1149953Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1150058Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1150127Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1150296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1150419Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1150477Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1150640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1150696Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1150740Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1150895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1150964Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1151011Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1151152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1151197Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1151237Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1151390Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1151439Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1151595Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1151636Z raise GradcheckError( 2025-12-04T10:08:29.1151728Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1151730Z 2025-12-04T10:08:29.1151823Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1151908Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1151988Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1151990Z 2025-12-04T10:08:29.1152076Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1152201Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1152238Z If the test 2025-12-04T10:08:29.1152330Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1152393Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1152487Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1152570Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1152572Z 2025-12-04T10:08:29.1152661Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1152776Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1152812Z the following. 2025-12-04T10:08:29.1152815Z 2025-12-04T10:08:29.1152904Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1153045Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1153096Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1153161Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1153221Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1153223Z 2025-12-04T10:08:29.1153256Z Got: 2025-12-04T10:08:29.1153317Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1153372Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1153411Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1153469Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1153520Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1153560Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1153610Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1153665Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1153703Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1153752Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1153801Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1153841Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1153890Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1153941Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1153981Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1153983Z 2025-12-04T10:08:29.1154032Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1154083Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1154121Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1154171Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1154222Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1154260Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1154309Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1154359Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1154397Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1154446Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1154496Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1154534Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1154583Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1154633Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1154675Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1154677Z 2025-12-04T10:08:29.1154679Z 2025-12-04T10:08:29.1154728Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1154809Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1154850Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1154901Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1154952Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1154990Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1155039Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1155090Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1155131Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1155181Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1155260Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1155299Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1155348Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1155399Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1155442Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1155444Z 2025-12-04T10:08:29.1155493Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1155543Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1155582Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1155632Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1155681Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1155720Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1155770Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1155820Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1155859Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1155909Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1155957Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1155999Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1156048Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1156099Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1156151Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1156195Z dtype=torch.complex128) 2025-12-04T10:08:29.1156197Z 2025-12-04T10:08:29.1156230Z Expected: 2025-12-04T10:08:29.1156307Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1156344Z 0.3401-0.5673j], 2025-12-04T10:08:29.1156410Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1156447Z 0.2078-0.7444j], 2025-12-04T10:08:29.1156512Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1156549Z 0.4109+0.5305j], 2025-12-04T10:08:29.1156614Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1156650Z -0.3607+0.5386j], 2025-12-04T10:08:29.1156713Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1156751Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1156753Z 2025-12-04T10:08:29.1156817Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1156852Z 0.5323-0.4729j], 2025-12-04T10:08:29.1156916Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1156951Z -0.6732-0.7677j], 2025-12-04T10:08:29.1157014Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1157051Z -0.5241-0.5479j], 2025-12-04T10:08:29.1157113Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1157149Z -0.3257-0.6597j], 2025-12-04T10:08:29.1157237Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1157275Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1157278Z 2025-12-04T10:08:29.1157279Z 2025-12-04T10:08:29.1157341Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1157378Z -0.6637-0.1175j], 2025-12-04T10:08:29.1157440Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1157476Z 0.4261-0.3012j], 2025-12-04T10:08:29.1157539Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1157575Z 0.2567-0.1808j], 2025-12-04T10:08:29.1157647Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1157695Z 0.1761-1.6446j], 2025-12-04T10:08:29.1157756Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1157796Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1157799Z 2025-12-04T10:08:29.1157861Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1157898Z -0.6307+0.1756j], 2025-12-04T10:08:29.1157960Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1157996Z -0.9972-0.3518j], 2025-12-04T10:08:29.1158057Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1158093Z 0.6467+0.0201j], 2025-12-04T10:08:29.1158154Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1158191Z -1.0443-0.3699j], 2025-12-04T10:08:29.1158256Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1158322Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1158324Z 2025-12-04T10:08:29.1158406Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1158409Z 2025-12-04T10:08:29.1158455Z Traceback (most recent call last): 2025-12-04T10:08:29.1158613Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1158654Z method(*args, **kwargs) 2025-12-04T10:08:29.1158830Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1158876Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1158914Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1159075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1159121Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1159158Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1159318Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1159359Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1159396Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1159546Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1159585Z fn(*args, **kwargs) 2025-12-04T10:08:29.1159752Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1159794Z raise e_tracked from e 2025-12-04T10:08:29.1159839Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1159841Z 2025-12-04T10:08:29.1159935Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1160016Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1160097Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1160114Z 2025-12-04T10:08:29.1160208Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1160311Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1160346Z If the test 2025-12-04T10:08:29.1160440Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1160501Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1160596Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1160679Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1160681Z 2025-12-04T10:08:29.1160787Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1160881Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1160918Z the following. 2025-12-04T10:08:29.1160921Z 2025-12-04T10:08:29.1161011Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1161100Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1161152Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1161215Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1161278Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1161280Z 2025-12-04T10:08:29.1161311Z Got: 2025-12-04T10:08:29.1161374Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1161426Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1161467Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1161520Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1161571Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1161610Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1161662Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1161712Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1161751Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1161800Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1161850Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1161889Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1161938Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1161989Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1162029Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1162032Z 2025-12-04T10:08:29.1162081Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1162132Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1162170Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1162221Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1162270Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1162308Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1162356Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1162407Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1162444Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1162494Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1162542Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1162581Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1162630Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1162681Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1162722Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1162724Z 2025-12-04T10:08:29.1162744Z 2025-12-04T10:08:29.1162806Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1162856Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1162896Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1162978Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1163030Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1163068Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1163119Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1163170Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1163210Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1163303Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1163353Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1163392Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1163441Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1163492Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1163532Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1163534Z 2025-12-04T10:08:29.1163584Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1163633Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1163672Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1163722Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1163773Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1163811Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1163864Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1163914Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1163954Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1164004Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1164057Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1164096Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1164146Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1164195Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1164247Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1164290Z dtype=torch.complex128) 2025-12-04T10:08:29.1164292Z 2025-12-04T10:08:29.1164328Z Expected: 2025-12-04T10:08:29.1164403Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1164441Z 0.3401-0.5673j], 2025-12-04T10:08:29.1164506Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1164544Z 0.2078-0.7444j], 2025-12-04T10:08:29.1164607Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1164646Z 0.4109+0.5305j], 2025-12-04T10:08:29.1164708Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1164745Z -0.3607+0.5386j], 2025-12-04T10:08:29.1164807Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1164846Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1164848Z 2025-12-04T10:08:29.1164910Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1164947Z 0.5323-0.4729j], 2025-12-04T10:08:29.1165011Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1165051Z -0.6732-0.7677j], 2025-12-04T10:08:29.1165114Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1165151Z -0.5241-0.5479j], 2025-12-04T10:08:29.1165213Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1165285Z -0.3257-0.6597j], 2025-12-04T10:08:29.1165348Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1165386Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1165388Z 2025-12-04T10:08:29.1165390Z 2025-12-04T10:08:29.1165454Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1165491Z -0.6637-0.1175j], 2025-12-04T10:08:29.1165554Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1165589Z 0.4261-0.3012j], 2025-12-04T10:08:29.1165652Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1165717Z 0.2567-0.1808j], 2025-12-04T10:08:29.1165780Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1165815Z 0.1761-1.6446j], 2025-12-04T10:08:29.1165879Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1165919Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1165921Z 2025-12-04T10:08:29.1165984Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1166020Z -0.6307+0.1756j], 2025-12-04T10:08:29.1166084Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1166119Z -0.9972-0.3518j], 2025-12-04T10:08:29.1166183Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1166218Z 0.6467+0.0201j], 2025-12-04T10:08:29.1166280Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1166318Z -1.0443-0.3699j], 2025-12-04T10:08:29.1166384Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1166450Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1166453Z 2025-12-04T10:08:29.1166763Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1166765Z 2025-12-04T10:08:29.1166838Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1167044Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1167046Z 2025-12-04T10:08:29.1167134Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1167228Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1167275Z Traceback (most recent call last): 2025-12-04T10:08:29.1167449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1167492Z return test(*args, **kwargs) 2025-12-04T10:08:29.1167529Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1167634Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1167698Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1167868Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1167991Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1168047Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1168211Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1168293Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1168337Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1168493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1168561Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1168608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1168749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1168794Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1168832Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1168997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1169059Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1169213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1169256Z raise GradcheckError( 2025-12-04T10:08:29.1169344Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1169347Z 2025-12-04T10:08:29.1169439Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1169520Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1169600Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1169602Z 2025-12-04T10:08:29.1169686Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1169791Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1169827Z If the test 2025-12-04T10:08:29.1169920Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1169982Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1170079Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1170161Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1170163Z 2025-12-04T10:08:29.1170256Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1170340Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1170376Z the following. 2025-12-04T10:08:29.1170378Z 2025-12-04T10:08:29.1170466Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1170559Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1170612Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1170677Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1170741Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1170744Z 2025-12-04T10:08:29.1170776Z Got: 2025-12-04T10:08:29.1170840Z tensor([[[[-2.3518e+01-5.6232e+01j, -1.2445e+02-7.6613e+01j, 2025-12-04T10:08:29.1170892Z 9.3101e+01+5.3124e+01j, 7.8771e+01-5.1318e+01j, 2025-12-04T10:08:29.1170932Z -4.7595e+00+9.2052e+00j], 2025-12-04T10:08:29.1170986Z [-5.8362e+01-2.6163e+01j, -1.5184e+02+2.2944e+01j, 2025-12-04T10:08:29.1171038Z 1.1262e+02-1.7163e+01j, 3.2374e+01-9.3903e+01j, 2025-12-04T10:08:29.1171076Z 1.7040e+00+1.0627e+01j], 2025-12-04T10:08:29.1171128Z [-9.1504e+00+1.0782e+01j, -5.3149e+00+2.6978e+01j, 2025-12-04T10:08:29.1171178Z 2.4708e+00-1.7297e+01j, -1.2730e+01-1.0703e+01j, 2025-12-04T10:08:29.1171219Z 1.4913e+00+4.0749e-01j], 2025-12-04T10:08:29.1171268Z [ 4.7359e+00+3.0196e+00j, 1.4319e+01-3.8324e-01j, 2025-12-04T10:08:29.1171319Z -1.0828e+01+3.2204e-01j, -3.4928e+00+8.0073e+00j, 2025-12-04T10:08:29.1171370Z 2.8789e-01-9.7090e-01j], 2025-12-04T10:08:29.1171430Z [ 3.3319e-01-5.8596e+00j, -7.7389e+00-8.2484e+00j, 2025-12-04T10:08:29.1171480Z 7.1618e+00+4.4494e+00j, 5.7542e+00-2.5633e+00j, 2025-12-04T10:08:29.1171521Z -2.1506e-01+9.7549e-01j]], 2025-12-04T10:08:29.1171523Z 2025-12-04T10:08:29.1171572Z [[ 6.1179e+00+8.1178e-01j, -1.1040e+00+9.5730e+00j, 2025-12-04T10:08:29.1171622Z -2.1417e+01+4.3606e+00j, -2.4228e+00+4.2418e+00j, 2025-12-04T10:08:29.1171659Z 1.2144e+00-5.4223e+00j], 2025-12-04T10:08:29.1171708Z [ 1.0554e+00+2.0025e+00j, 6.0366e-01+1.3909e+00j, 2025-12-04T10:08:29.1171758Z -5.3986e+00-3.7971e+00j, -1.9855e+00+1.4202e-01j, 2025-12-04T10:08:29.1171822Z 1.8767e+00+4.8361e-01j], 2025-12-04T10:08:29.1171871Z [ 7.9709e-01+3.7062e+00j, -7.5262e-01+5.7069e+00j, 2025-12-04T10:08:29.1171924Z -8.1417e+00-6.4404e+00j, -2.5707e+00-4.4328e-01j, 2025-12-04T10:08:29.1171964Z -2.3716e-01-5.0440e-01j], 2025-12-04T10:08:29.1172017Z [ 3.7944e-01+2.4863e+00j, 2.3908e+00+3.2409e+00j, 2025-12-04T10:08:29.1172068Z -4.5207e+00+3.7503e-01j, -1.3235e+00-3.7416e-01j, 2025-12-04T10:08:29.1172107Z -1.0091e+00+2.0470e-01j], 2025-12-04T10:08:29.1172156Z [ 2.4189e+00+1.7475e+00j, 7.9292e-01+1.6335e+00j, 2025-12-04T10:08:29.1172208Z -5.2401e+00-1.1988e+00j, -1.0313e+00+1.0328e+00j, 2025-12-04T10:08:29.1172250Z 8.2539e-01+5.6439e-01j]]], 2025-12-04T10:08:29.1172252Z 2025-12-04T10:08:29.1172253Z 2025-12-04T10:08:29.1172306Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1172360Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1172400Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1172450Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1172501Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1172543Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1172594Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1172645Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1172686Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1172735Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1172785Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1172823Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1172874Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1172923Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1173007Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1173010Z 2025-12-04T10:08:29.1173061Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1173111Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1173151Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1173202Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1173254Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1173292Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1173342Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1173391Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1173430Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1173480Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1173529Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1173568Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1173619Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1173669Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1173722Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1173803Z dtype=torch.complex128) 2025-12-04T10:08:29.1173805Z 2025-12-04T10:08:29.1173841Z Expected: 2025-12-04T10:08:29.1173916Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1173954Z 0.3401-0.5673j], 2025-12-04T10:08:29.1174018Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1174056Z 0.2078-0.7444j], 2025-12-04T10:08:29.1174120Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1174157Z 0.4109+0.5305j], 2025-12-04T10:08:29.1174219Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1174290Z -0.3607+0.5386j], 2025-12-04T10:08:29.1174353Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1174392Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1174394Z 2025-12-04T10:08:29.1174461Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1174498Z 0.5323-0.4729j], 2025-12-04T10:08:29.1174561Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1174598Z -0.6732-0.7677j], 2025-12-04T10:08:29.1174659Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1174697Z -0.5241-0.5479j], 2025-12-04T10:08:29.1174758Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1174795Z -0.3257-0.6597j], 2025-12-04T10:08:29.1174857Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1174896Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1174898Z 2025-12-04T10:08:29.1174900Z 2025-12-04T10:08:29.1174964Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1174999Z -0.6637-0.1175j], 2025-12-04T10:08:29.1175065Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1175100Z 0.4261-0.3012j], 2025-12-04T10:08:29.1175164Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1175200Z 0.2567-0.1808j], 2025-12-04T10:08:29.1175263Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1175298Z 0.1761-1.6446j], 2025-12-04T10:08:29.1175361Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1175399Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1175401Z 2025-12-04T10:08:29.1175464Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1175503Z -0.6307+0.1756j], 2025-12-04T10:08:29.1175566Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1175603Z -0.9972-0.3518j], 2025-12-04T10:08:29.1175669Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1175705Z 0.6467+0.0201j], 2025-12-04T10:08:29.1175766Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1175803Z -1.0443-0.3699j], 2025-12-04T10:08:29.1175867Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1175931Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1175933Z 2025-12-04T10:08:29.1176016Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1176018Z 2025-12-04T10:08:29.1176063Z Traceback (most recent call last): 2025-12-04T10:08:29.1176223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1176263Z method(*args, **kwargs) 2025-12-04T10:08:29.1176465Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1176511Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1176550Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1176710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1176754Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1176791Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1176950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1177001Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1177052Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1177205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1177244Z fn(*args, **kwargs) 2025-12-04T10:08:29.1177412Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1177452Z raise e_tracked from e 2025-12-04T10:08:29.1177498Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1177500Z 2025-12-04T10:08:29.1177592Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1177675Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1177756Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1177758Z 2025-12-04T10:08:29.1177844Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1177947Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1177985Z If the test 2025-12-04T10:08:29.1178077Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1178142Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1178237Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1178320Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1178322Z 2025-12-04T10:08:29.1178412Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1178499Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1178534Z the following. 2025-12-04T10:08:29.1178536Z 2025-12-04T10:08:29.1178626Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1178717Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1178769Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1178832Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1178895Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1178897Z 2025-12-04T10:08:29.1178929Z Got: 2025-12-04T10:08:29.1178991Z tensor([[[[-2.3518e+01-5.6232e+01j, -1.2445e+02-7.6613e+01j, 2025-12-04T10:08:29.1179043Z 9.3101e+01+5.3124e+01j, 7.8771e+01-5.1318e+01j, 2025-12-04T10:08:29.1179082Z -4.7595e+00+9.2052e+00j], 2025-12-04T10:08:29.1179135Z [-5.8362e+01-2.6163e+01j, -1.5184e+02+2.2944e+01j, 2025-12-04T10:08:29.1179185Z 1.1262e+02-1.7163e+01j, 3.2374e+01-9.3903e+01j, 2025-12-04T10:08:29.1179225Z 1.7040e+00+1.0627e+01j], 2025-12-04T10:08:29.1179275Z [-9.1504e+00+1.0782e+01j, -5.3149e+00+2.6978e+01j, 2025-12-04T10:08:29.1179327Z 2.4708e+00-1.7297e+01j, -1.2730e+01-1.0703e+01j, 2025-12-04T10:08:29.1179367Z 1.4913e+00+4.0749e-01j], 2025-12-04T10:08:29.1179417Z [ 4.7359e+00+3.0196e+00j, 1.4319e+01-3.8324e-01j, 2025-12-04T10:08:29.1179494Z -1.0828e+01+3.2204e-01j, -3.4928e+00+8.0073e+00j, 2025-12-04T10:08:29.1179533Z 2.8789e-01-9.7090e-01j], 2025-12-04T10:08:29.1179582Z [ 3.3319e-01-5.8596e+00j, -7.7389e+00-8.2484e+00j, 2025-12-04T10:08:29.1179631Z 7.1618e+00+4.4494e+00j, 5.7542e+00-2.5633e+00j, 2025-12-04T10:08:29.1179673Z -2.1506e-01+9.7549e-01j]], 2025-12-04T10:08:29.1179675Z 2025-12-04T10:08:29.1179725Z [[ 6.1179e+00+8.1178e-01j, -1.1040e+00+9.5730e+00j, 2025-12-04T10:08:29.1179774Z -2.1417e+01+4.3606e+00j, -2.4228e+00+4.2418e+00j, 2025-12-04T10:08:29.1179813Z 1.2144e+00-5.4223e+00j], 2025-12-04T10:08:29.1179861Z [ 1.0554e+00+2.0025e+00j, 6.0366e-01+1.3909e+00j, 2025-12-04T10:08:29.1179938Z -5.3986e+00-3.7971e+00j, -1.9855e+00+1.4202e-01j, 2025-12-04T10:08:29.1179977Z 1.8767e+00+4.8361e-01j], 2025-12-04T10:08:29.1180028Z [ 7.9709e-01+3.7062e+00j, -7.5262e-01+5.7069e+00j, 2025-12-04T10:08:29.1180080Z -8.1417e+00-6.4404e+00j, -2.5707e+00-4.4328e-01j, 2025-12-04T10:08:29.1180120Z -2.3716e-01-5.0440e-01j], 2025-12-04T10:08:29.1180168Z [ 3.7944e-01+2.4863e+00j, 2.3908e+00+3.2409e+00j, 2025-12-04T10:08:29.1180218Z -4.5207e+00+3.7503e-01j, -1.3235e+00-3.7416e-01j, 2025-12-04T10:08:29.1180257Z -1.0091e+00+2.0470e-01j], 2025-12-04T10:08:29.1180305Z [ 2.4189e+00+1.7475e+00j, 7.9292e-01+1.6335e+00j, 2025-12-04T10:08:29.1180355Z -5.2401e+00-1.1988e+00j, -1.0313e+00+1.0328e+00j, 2025-12-04T10:08:29.1180396Z 8.2539e-01+5.6439e-01j]]], 2025-12-04T10:08:29.1180399Z 2025-12-04T10:08:29.1180400Z 2025-12-04T10:08:29.1180451Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1180502Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1180541Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1180592Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1180644Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1180683Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1180731Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1180783Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1180820Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1180870Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1180919Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1180957Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1181006Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1181060Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1181102Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1181105Z 2025-12-04T10:08:29.1181155Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1181207Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1181246Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1181296Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1181345Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1181385Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1181434Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1181485Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1181523Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1181573Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1181622Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1181663Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1181712Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1181762Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1181836Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1181881Z dtype=torch.complex128) 2025-12-04T10:08:29.1181883Z 2025-12-04T10:08:29.1181917Z Expected: 2025-12-04T10:08:29.1181993Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1182030Z 0.3401-0.5673j], 2025-12-04T10:08:29.1182094Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1182130Z 0.2078-0.7444j], 2025-12-04T10:08:29.1182195Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1182230Z 0.4109+0.5305j], 2025-12-04T10:08:29.1182306Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1182354Z -0.3607+0.5386j], 2025-12-04T10:08:29.1182417Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1182456Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1182459Z 2025-12-04T10:08:29.1182522Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1182559Z 0.5323-0.4729j], 2025-12-04T10:08:29.1182623Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1182660Z -0.6732-0.7677j], 2025-12-04T10:08:29.1182722Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1182757Z -0.5241-0.5479j], 2025-12-04T10:08:29.1182820Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1182856Z -0.3257-0.6597j], 2025-12-04T10:08:29.1182920Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1182999Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1183001Z 2025-12-04T10:08:29.1183003Z 2025-12-04T10:08:29.1183067Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1183104Z -0.6637-0.1175j], 2025-12-04T10:08:29.1183167Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1183205Z 0.4261-0.3012j], 2025-12-04T10:08:29.1183268Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1183305Z 0.2567-0.1808j], 2025-12-04T10:08:29.1183367Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1183403Z 0.1761-1.6446j], 2025-12-04T10:08:29.1183465Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1183507Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1183510Z 2025-12-04T10:08:29.1183571Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1183608Z -0.6307+0.1756j], 2025-12-04T10:08:29.1183672Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1183711Z -0.9972-0.3518j], 2025-12-04T10:08:29.1183773Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1183811Z 0.6467+0.0201j], 2025-12-04T10:08:29.1183871Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1183908Z -1.0443-0.3699j], 2025-12-04T10:08:29.1183971Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1184037Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1184039Z 2025-12-04T10:08:29.1184339Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1184342Z 2025-12-04T10:08:29.1184456Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1184663Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1184667Z 2025-12-04T10:08:29.1184755Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1184850Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1184895Z Traceback (most recent call last): 2025-12-04T10:08:29.1185070Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1185144Z return test(*args, **kwargs) 2025-12-04T10:08:29.1185184Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1185289Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1185356Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1185526Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1185650Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1185702Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1185864Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1185921Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1185966Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1186121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1186189Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1186236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1186378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1186423Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1186460Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1186612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1186663Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1186816Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1186860Z raise GradcheckError( 2025-12-04T10:08:29.1186949Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1186951Z 2025-12-04T10:08:29.1187044Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1187130Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1187211Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1187213Z 2025-12-04T10:08:29.1187299Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1187402Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1187437Z If the test 2025-12-04T10:08:29.1187531Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1187594Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1187689Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1187773Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1187775Z 2025-12-04T10:08:29.1187864Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1187975Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1188011Z the following. 2025-12-04T10:08:29.1188013Z 2025-12-04T10:08:29.1188102Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1188192Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1188242Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1188306Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1188367Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1188369Z 2025-12-04T10:08:29.1188401Z Got: 2025-12-04T10:08:29.1188501Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.1188541Z -0.0303+0.0508j], 2025-12-04T10:08:29.1188609Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.1188649Z -0.0087+0.0311j], 2025-12-04T10:08:29.1188713Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.1188749Z 0.0279+0.0361j], 2025-12-04T10:08:29.1188812Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.1188848Z -0.4873+0.7136j], 2025-12-04T10:08:29.1188910Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.1188950Z -0.0153-0.0191j]], 2025-12-04T10:08:29.1188952Z 2025-12-04T10:08:29.1189014Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.1189050Z 0.2857-0.2518j], 2025-12-04T10:08:29.1189114Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.1189150Z 0.0473+0.0540j], 2025-12-04T10:08:29.1189211Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.1189250Z -0.0383-0.0398j], 2025-12-04T10:08:29.1189312Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.1189349Z -0.0382-0.0777j], 2025-12-04T10:08:29.1189411Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.1189450Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.1189452Z 2025-12-04T10:08:29.1189454Z 2025-12-04T10:08:29.1189515Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1189552Z -0.6637-0.1175j], 2025-12-04T10:08:29.1189614Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1189651Z 0.4261-0.3012j], 2025-12-04T10:08:29.1189715Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1189751Z 0.2567-0.1808j], 2025-12-04T10:08:29.1189812Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1189851Z 0.1761-1.6446j], 2025-12-04T10:08:29.1189913Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1189953Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1189957Z 2025-12-04T10:08:29.1190019Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1190056Z -0.6307+0.1756j], 2025-12-04T10:08:29.1190120Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1190156Z -0.9972-0.3518j], 2025-12-04T10:08:29.1190218Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1190255Z 0.6467+0.0201j], 2025-12-04T10:08:29.1190317Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1190355Z -1.0443-0.3699j], 2025-12-04T10:08:29.1190418Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1190513Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1190515Z 2025-12-04T10:08:29.1190551Z Expected: 2025-12-04T10:08:29.1190623Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1190659Z 0.3401-0.5673j], 2025-12-04T10:08:29.1190720Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1190756Z 0.2078-0.7444j], 2025-12-04T10:08:29.1190820Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1190857Z 0.4109+0.5305j], 2025-12-04T10:08:29.1190931Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1190978Z -0.3607+0.5386j], 2025-12-04T10:08:29.1191040Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1191078Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1191081Z 2025-12-04T10:08:29.1191143Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1191180Z 0.5323-0.4729j], 2025-12-04T10:08:29.1191242Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1191279Z -0.6732-0.7677j], 2025-12-04T10:08:29.1191340Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1191377Z -0.5241-0.5479j], 2025-12-04T10:08:29.1191438Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1191475Z -0.3257-0.6597j], 2025-12-04T10:08:29.1191537Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1191576Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1191578Z 2025-12-04T10:08:29.1191580Z 2025-12-04T10:08:29.1191641Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1191680Z -0.6637-0.1175j], 2025-12-04T10:08:29.1191743Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1191780Z 0.4261-0.3012j], 2025-12-04T10:08:29.1191843Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1191880Z 0.2567-0.1808j], 2025-12-04T10:08:29.1191941Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1191978Z 0.1761-1.6446j], 2025-12-04T10:08:29.1192039Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1192079Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1192083Z 2025-12-04T10:08:29.1192144Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1192181Z -0.6307+0.1756j], 2025-12-04T10:08:29.1192242Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1192281Z -0.9972-0.3518j], 2025-12-04T10:08:29.1192342Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1192379Z 0.6467+0.0201j], 2025-12-04T10:08:29.1192440Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1192476Z -1.0443-0.3699j], 2025-12-04T10:08:29.1192540Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1192604Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1192606Z 2025-12-04T10:08:29.1192688Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1192692Z 2025-12-04T10:08:29.1192736Z Traceback (most recent call last): 2025-12-04T10:08:29.1192892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1192992Z method(*args, **kwargs) 2025-12-04T10:08:29.1193187Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1193232Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1193272Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1193432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1193476Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1193514Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1193695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1193756Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1193793Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1193944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1193984Z fn(*args, **kwargs) 2025-12-04T10:08:29.1194151Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1194192Z raise e_tracked from e 2025-12-04T10:08:29.1194237Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1194239Z 2025-12-04T10:08:29.1194332Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1194413Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1194494Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1194496Z 2025-12-04T10:08:29.1194582Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1194683Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1194718Z If the test 2025-12-04T10:08:29.1194813Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1194877Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1194971Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1195052Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1195054Z 2025-12-04T10:08:29.1195144Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1195228Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1195264Z the following. 2025-12-04T10:08:29.1195266Z 2025-12-04T10:08:29.1195355Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1195445Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1195497Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1195562Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1195624Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1195626Z 2025-12-04T10:08:29.1195658Z Got: 2025-12-04T10:08:29.1195733Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.1195770Z -0.0303+0.0508j], 2025-12-04T10:08:29.1195836Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.1195873Z -0.0087+0.0311j], 2025-12-04T10:08:29.1195937Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.1195972Z 0.0279+0.0361j], 2025-12-04T10:08:29.1196036Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.1196073Z -0.4873+0.7136j], 2025-12-04T10:08:29.1196136Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.1196175Z -0.0153-0.0191j]], 2025-12-04T10:08:29.1196203Z 2025-12-04T10:08:29.1196267Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.1196303Z 0.2857-0.2518j], 2025-12-04T10:08:29.1196366Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.1196401Z 0.0473+0.0540j], 2025-12-04T10:08:29.1196463Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.1196499Z -0.0383-0.0398j], 2025-12-04T10:08:29.1196561Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.1196598Z -0.0382-0.0777j], 2025-12-04T10:08:29.1196670Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.1196720Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.1196722Z 2025-12-04T10:08:29.1196724Z 2025-12-04T10:08:29.1196786Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1196825Z -0.6637-0.1175j], 2025-12-04T10:08:29.1196887Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1196923Z 0.4261-0.3012j], 2025-12-04T10:08:29.1196985Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1197022Z 0.2567-0.1808j], 2025-12-04T10:08:29.1197084Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1197120Z 0.1761-1.6446j], 2025-12-04T10:08:29.1197181Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1197220Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1197223Z 2025-12-04T10:08:29.1197285Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1197323Z -0.6307+0.1756j], 2025-12-04T10:08:29.1197384Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1197424Z -0.9972-0.3518j], 2025-12-04T10:08:29.1197486Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1197522Z 0.6467+0.0201j], 2025-12-04T10:08:29.1197583Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1197619Z -1.0443-0.3699j], 2025-12-04T10:08:29.1197682Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1197748Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1197750Z 2025-12-04T10:08:29.1197784Z Expected: 2025-12-04T10:08:29.1197857Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1197894Z 0.3401-0.5673j], 2025-12-04T10:08:29.1197956Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1197991Z 0.2078-0.7444j], 2025-12-04T10:08:29.1198057Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1198094Z 0.4109+0.5305j], 2025-12-04T10:08:29.1198156Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1198192Z -0.3607+0.5386j], 2025-12-04T10:08:29.1198255Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1198293Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1198294Z 2025-12-04T10:08:29.1198357Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1198393Z 0.5323-0.4729j], 2025-12-04T10:08:29.1198455Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1198493Z -0.6732-0.7677j], 2025-12-04T10:08:29.1198554Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1198591Z -0.5241-0.5479j], 2025-12-04T10:08:29.1198677Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1198714Z -0.3257-0.6597j], 2025-12-04T10:08:29.1198776Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1198814Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1198816Z 2025-12-04T10:08:29.1198818Z 2025-12-04T10:08:29.1198879Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1198915Z -0.6637-0.1175j], 2025-12-04T10:08:29.1198978Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1199015Z 0.4261-0.3012j], 2025-12-04T10:08:29.1199099Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1199136Z 0.2567-0.1808j], 2025-12-04T10:08:29.1199198Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1199236Z 0.1761-1.6446j], 2025-12-04T10:08:29.1199298Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1199337Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1199339Z 2025-12-04T10:08:29.1199400Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1199437Z -0.6307+0.1756j], 2025-12-04T10:08:29.1199499Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1199535Z -0.9972-0.3518j], 2025-12-04T10:08:29.1199597Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1199633Z 0.6467+0.0201j], 2025-12-04T10:08:29.1199698Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1199735Z -1.0443-0.3699j], 2025-12-04T10:08:29.1199798Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1199865Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1199867Z 2025-12-04T10:08:29.1200168Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1200170Z 2025-12-04T10:08:29.1200244Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1200451Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1200454Z 2025-12-04T10:08:29.1200541Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1200636Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1200682Z Traceback (most recent call last): 2025-12-04T10:08:29.1200858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1200900Z return test(*args, **kwargs) 2025-12-04T10:08:29.1200938Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1201043Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1201109Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1201276Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1201399Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1201452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1201626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1201694Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1201737Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1201891Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1201957Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1202004Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1202142Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1202203Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1202252Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1202406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1202458Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1202615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1202658Z raise GradcheckError( 2025-12-04T10:08:29.1202748Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1202750Z 2025-12-04T10:08:29.1202843Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1202959Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1203039Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1203041Z 2025-12-04T10:08:29.1203129Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1203231Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1203267Z If the test 2025-12-04T10:08:29.1203362Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1203429Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1203522Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1203606Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1203608Z 2025-12-04T10:08:29.1203701Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1203785Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1203822Z the following. 2025-12-04T10:08:29.1203823Z 2025-12-04T10:08:29.1203912Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1204006Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1204056Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1204119Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1204181Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1204183Z 2025-12-04T10:08:29.1204215Z Got: 2025-12-04T10:08:29.1204283Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1204322Z nan+nanj], 2025-12-04T10:08:29.1204382Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1204420Z nan+nanj], 2025-12-04T10:08:29.1204477Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1204514Z nan+nanj], 2025-12-04T10:08:29.1204580Z [-0.1128+0.0345j, 0.1313-0.0704j, -0.3074+0.0842j, 0.0296+0.1745j, 2025-12-04T10:08:29.1204620Z 0.0075-0.0879j], 2025-12-04T10:08:29.1204684Z [-0.2084+0.0790j, -0.1661+0.3962j, 0.0437-0.3177j, -0.1778-0.1603j, 2025-12-04T10:08:29.1204723Z 0.0375-0.0079j]], 2025-12-04T10:08:29.1204725Z 2025-12-04T10:08:29.1204824Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1204862Z 0.5321-0.4721j], 2025-12-04T10:08:29.1204924Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1204962Z -0.6743-0.7686j], 2025-12-04T10:08:29.1205024Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1205061Z -0.5254-0.5482j], 2025-12-04T10:08:29.1205124Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1205162Z -0.3257-0.6610j], 2025-12-04T10:08:29.1205224Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1205303Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1205305Z 2025-12-04T10:08:29.1205306Z 2025-12-04T10:08:29.1205370Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1205408Z -0.6628-0.1173j], 2025-12-04T10:08:29.1205476Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1205514Z 0.4268-0.3009j], 2025-12-04T10:08:29.1205577Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1205612Z 0.2557-0.1815j], 2025-12-04T10:08:29.1205676Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1205711Z 0.1764-1.6442j], 2025-12-04T10:08:29.1205774Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1205812Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1205814Z 2025-12-04T10:08:29.1205880Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1205918Z -0.6316+0.1788j], 2025-12-04T10:08:29.1205980Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1206016Z -0.9993-0.3518j], 2025-12-04T10:08:29.1206081Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1206118Z 0.6463+0.0217j], 2025-12-04T10:08:29.1206181Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1206218Z -1.0457-0.3744j], 2025-12-04T10:08:29.1206281Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1206347Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1206349Z 2025-12-04T10:08:29.1206385Z Expected: 2025-12-04T10:08:29.1206456Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1206493Z 0.3401-0.5676j], 2025-12-04T10:08:29.1206557Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1206594Z 0.2064-0.7429j], 2025-12-04T10:08:29.1206658Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1206697Z 0.4114+0.5306j], 2025-12-04T10:08:29.1206760Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1206798Z -0.3622+0.5375j], 2025-12-04T10:08:29.1206859Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1206897Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1206899Z 2025-12-04T10:08:29.1206961Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1206997Z 0.5321-0.4721j], 2025-12-04T10:08:29.1207060Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1207097Z -0.6743-0.7686j], 2025-12-04T10:08:29.1207159Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1207196Z -0.5254-0.5482j], 2025-12-04T10:08:29.1207257Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1207318Z -0.3257-0.6610j], 2025-12-04T10:08:29.1207382Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1207421Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1207423Z 2025-12-04T10:08:29.1207425Z 2025-12-04T10:08:29.1207486Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1207522Z -0.6628-0.1173j], 2025-12-04T10:08:29.1207586Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1207621Z 0.4268-0.3009j], 2025-12-04T10:08:29.1207694Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1207740Z 0.2557-0.1815j], 2025-12-04T10:08:29.1207804Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1207839Z 0.1764-1.6442j], 2025-12-04T10:08:29.1207904Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1207942Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1207944Z 2025-12-04T10:08:29.1208006Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1208042Z -0.6316+0.1788j], 2025-12-04T10:08:29.1208105Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1208141Z -0.9993-0.3518j], 2025-12-04T10:08:29.1208203Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1208238Z 0.6463+0.0217j], 2025-12-04T10:08:29.1208302Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1208339Z -1.0457-0.3744j], 2025-12-04T10:08:29.1208402Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1208467Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1208470Z 2025-12-04T10:08:29.1208554Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1208557Z 2025-12-04T10:08:29.1208601Z Traceback (most recent call last): 2025-12-04T10:08:29.1208759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1208799Z method(*args, **kwargs) 2025-12-04T10:08:29.1208976Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1209021Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1209062Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1209223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1209268Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1209307Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1209471Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1209513Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1209549Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1209701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1209739Z fn(*args, **kwargs) 2025-12-04T10:08:29.1209907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1209948Z raise e_tracked from e 2025-12-04T10:08:29.1209995Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1209998Z 2025-12-04T10:08:29.1210090Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1210173Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1210278Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1210281Z 2025-12-04T10:08:29.1210366Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1210469Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1210505Z If the test 2025-12-04T10:08:29.1210597Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1210661Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1210755Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1210852Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1210865Z 2025-12-04T10:08:29.1210955Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1211040Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1211078Z the following. 2025-12-04T10:08:29.1211081Z 2025-12-04T10:08:29.1211170Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1211260Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1211311Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1211375Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1211436Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1211438Z 2025-12-04T10:08:29.1211471Z Got: 2025-12-04T10:08:29.1211537Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1211578Z nan+nanj], 2025-12-04T10:08:29.1211637Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1211675Z nan+nanj], 2025-12-04T10:08:29.1211731Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.1211772Z nan+nanj], 2025-12-04T10:08:29.1211838Z [-0.1128+0.0345j, 0.1313-0.0704j, -0.3074+0.0842j, 0.0296+0.1745j, 2025-12-04T10:08:29.1211875Z 0.0075-0.0879j], 2025-12-04T10:08:29.1211940Z [-0.2084+0.0790j, -0.1661+0.3962j, 0.0437-0.3177j, -0.1778-0.1603j, 2025-12-04T10:08:29.1211979Z 0.0375-0.0079j]], 2025-12-04T10:08:29.1211981Z 2025-12-04T10:08:29.1212043Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1212080Z 0.5321-0.4721j], 2025-12-04T10:08:29.1212143Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1212181Z -0.6743-0.7686j], 2025-12-04T10:08:29.1212244Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1212281Z -0.5254-0.5482j], 2025-12-04T10:08:29.1212343Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1212381Z -0.3257-0.6610j], 2025-12-04T10:08:29.1212443Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1212482Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1212484Z 2025-12-04T10:08:29.1212485Z 2025-12-04T10:08:29.1212547Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1212584Z -0.6628-0.1173j], 2025-12-04T10:08:29.1212645Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1212681Z 0.4268-0.3009j], 2025-12-04T10:08:29.1212744Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1212783Z 0.2557-0.1815j], 2025-12-04T10:08:29.1212845Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1212881Z 0.1764-1.6442j], 2025-12-04T10:08:29.1212997Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1213086Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1213088Z 2025-12-04T10:08:29.1213150Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1213187Z -0.6316+0.1788j], 2025-12-04T10:08:29.1213250Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1213286Z -0.9993-0.3518j], 2025-12-04T10:08:29.1213348Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1213384Z 0.6463+0.0217j], 2025-12-04T10:08:29.1213445Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1213517Z -1.0457-0.3744j], 2025-12-04T10:08:29.1213581Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1213647Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1213651Z 2025-12-04T10:08:29.1213688Z Expected: 2025-12-04T10:08:29.1213760Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1213796Z 0.3401-0.5676j], 2025-12-04T10:08:29.1213857Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1213894Z 0.2064-0.7429j], 2025-12-04T10:08:29.1213958Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1213994Z 0.4114+0.5306j], 2025-12-04T10:08:29.1214056Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1214093Z -0.3622+0.5375j], 2025-12-04T10:08:29.1214156Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1214195Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1214197Z 2025-12-04T10:08:29.1214258Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1214299Z 0.5321-0.4721j], 2025-12-04T10:08:29.1214362Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1214399Z -0.6743-0.7686j], 2025-12-04T10:08:29.1214460Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1214497Z -0.5254-0.5482j], 2025-12-04T10:08:29.1214558Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1214595Z -0.3257-0.6610j], 2025-12-04T10:08:29.1214657Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1214695Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1214697Z 2025-12-04T10:08:29.1214700Z 2025-12-04T10:08:29.1214762Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1214800Z -0.6628-0.1173j], 2025-12-04T10:08:29.1214861Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1214900Z 0.4268-0.3009j], 2025-12-04T10:08:29.1214963Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1214999Z 0.2557-0.1815j], 2025-12-04T10:08:29.1215061Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1215098Z 0.1764-1.6442j], 2025-12-04T10:08:29.1215160Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1215198Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1215200Z 2025-12-04T10:08:29.1215262Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1215299Z -0.6316+0.1788j], 2025-12-04T10:08:29.1215363Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1215398Z -0.9993-0.3518j], 2025-12-04T10:08:29.1215461Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1215530Z 0.6463+0.0217j], 2025-12-04T10:08:29.1215593Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1215629Z -1.0457-0.3744j], 2025-12-04T10:08:29.1215692Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1215756Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1215759Z 2025-12-04T10:08:29.1216076Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1216089Z 2025-12-04T10:08:29.1216163Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1216370Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1216373Z 2025-12-04T10:08:29.1216459Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1216554Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1216600Z Traceback (most recent call last): 2025-12-04T10:08:29.1216773Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1216816Z return test(*args, **kwargs) 2025-12-04T10:08:29.1216852Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1216959Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1217025Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1217193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1217317Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1217372Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1217535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1217593Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1217635Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1217791Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1217859Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1217905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1218046Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1218094Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1218132Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1218284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.1218324Z _gradcheck_real_imag( 2025-12-04T10:08:29.1218482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1505, in _gradcheck_real_imag 2025-12-04T10:08:29.1218518Z gradcheck_fn( 2025-12-04T10:08:29.1218666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.1218713Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.1218887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.1218929Z raise GradcheckError( 2025-12-04T10:08:29.1219165Z torch.autograd.gradcheck.GradcheckError: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1219220Z numerical:(-5.755417309607989+580.8226412522022j) 2025-12-04T10:08:29.1219271Z analytical:(-5.75541730976393+4.180765823773575j) 2025-12-04T10:08:29.1219273Z 2025-12-04T10:08:29.1219375Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1219479Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1219579Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1219594Z 2025-12-04T10:08:29.1219641Z Numerical: 2025-12-04T10:08:29.1219719Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.1219769Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1219811Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1219877Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.1219925Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1219966Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1220030Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.1220077Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220114Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1220147Z ..., 2025-12-04T10:08:29.1220210Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220256Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220294Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1220355Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220401Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220439Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1220500Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1220548Z ..., -10.5935+0.0000e+00j, -16.7554+8.8818e-10j, 2025-12-04T10:08:29.1220621Z -13.8938+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1220655Z Analytical: 2025-12-04T10:08:29.1220727Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.1220774Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1220812Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1220874Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.1220923Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1220960Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1221023Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.1221071Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1221109Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1221142Z ..., 2025-12-04T10:08:29.1221204Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1221250Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1221286Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1221347Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1221392Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1221427Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1221490Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1221540Z ..., -10.5935-6.5151e-17j, -16.7554-1.0305e-16j, 2025-12-04T10:08:29.1221610Z -13.8938-8.5447e-17j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1221612Z 2025-12-04T10:08:29.1221721Z The max per-element difference (slow mode) is: 2.644327920579172e-09. 2025-12-04T10:08:29.1221819Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.1221866Z test might've passed in slow_mode! 2025-12-04T10:08:29.1221868Z 2025-12-04T10:08:29.1221951Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1222055Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.1222057Z 2025-12-04T10:08:29.1222090Z If the test 2025-12-04T10:08:29.1222184Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1222249Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.1222354Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1222401Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1222479Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.1222544Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1222546Z 2025-12-04T10:08:29.1222628Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1222630Z 2025-12-04T10:08:29.1222674Z Traceback (most recent call last): 2025-12-04T10:08:29.1222833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1222873Z method(*args, **kwargs) 2025-12-04T10:08:29.1223097Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1223146Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1223185Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1223346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1223390Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1223428Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1223585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1223627Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1223663Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1223814Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1223851Z fn(*args, **kwargs) 2025-12-04T10:08:29.1224020Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1224061Z raise e_tracked from e 2025-12-04T10:08:29.1224216Z Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1224268Z numerical:(-5.755417309607989+580.8226412522022j) 2025-12-04T10:08:29.1224321Z analytical:(-5.75541730976393+4.180765823773575j) 2025-12-04T10:08:29.1224323Z 2025-12-04T10:08:29.1224423Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1224527Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1224626Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1224629Z 2025-12-04T10:08:29.1224664Z Numerical: 2025-12-04T10:08:29.1224738Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.1224789Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1224826Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1224891Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.1224937Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225013Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1225076Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.1225123Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225160Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1225193Z ..., 2025-12-04T10:08:29.1225255Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225300Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225337Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1225397Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225458Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225506Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1225567Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1225616Z ..., -10.5935+0.0000e+00j, -16.7554+8.8818e-10j, 2025-12-04T10:08:29.1225689Z -13.8938+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1225724Z Analytical: 2025-12-04T10:08:29.1225795Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.1225842Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1225881Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1225942Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.1225989Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1226025Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1226088Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.1226135Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1226173Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1226206Z ..., 2025-12-04T10:08:29.1226267Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1226314Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1226351Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1226411Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1226457Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1226492Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1226554Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1226601Z ..., -10.5935-6.5151e-17j, -16.7554-1.0305e-16j, 2025-12-04T10:08:29.1226671Z -13.8938-8.5447e-17j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1226675Z 2025-12-04T10:08:29.1226754Z The max per-element difference (slow mode) is: 2.644327920579172e-09. 2025-12-04T10:08:29.1226853Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.1226899Z test might've passed in slow_mode! 2025-12-04T10:08:29.1226902Z 2025-12-04T10:08:29.1226988Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1227091Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.1227093Z 2025-12-04T10:08:29.1227128Z If the test 2025-12-04T10:08:29.1227222Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1227277Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.1227373Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1227419Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1227498Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.1227561Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.1227563Z 2025-12-04T10:08:29.1227880Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1227894Z 2025-12-04T10:08:29.1227968Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1228175Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1228178Z 2025-12-04T10:08:29.1228262Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1228367Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1228423Z Traceback (most recent call last): 2025-12-04T10:08:29.1228594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1228636Z return test(*args, **kwargs) 2025-12-04T10:08:29.1228676Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1228780Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1228845Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1229013Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1229137Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1229190Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1229355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1229412Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1229453Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1229611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1229679Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1229724Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1229863Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1229909Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1229946Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1230099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1230149Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1230303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1230345Z raise GradcheckError( 2025-12-04T10:08:29.1230435Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1230437Z 2025-12-04T10:08:29.1230528Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1230610Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1230689Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1230691Z 2025-12-04T10:08:29.1230775Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1230878Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1230912Z If the test 2025-12-04T10:08:29.1231007Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1231069Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1233134Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1233275Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1233277Z 2025-12-04T10:08:29.1233370Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1233455Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1233493Z the following. 2025-12-04T10:08:29.1233495Z 2025-12-04T10:08:29.1233584Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1233675Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1233725Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1233830Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1233892Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1233894Z 2025-12-04T10:08:29.1233927Z Got: 2025-12-04T10:08:29.1234002Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1046j, 1.1405+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.1234044Z 0.3398-0.5666j], 2025-12-04T10:08:29.1234108Z [ 0.6809-0.1503j, 0.2815+0.1163j, 0.5365+0.1627j, 0.8373-0.5079j, 2025-12-04T10:08:29.1234147Z 0.2066-0.7429j], 2025-12-04T10:08:29.1234212Z [-1.1219+0.2129j, -1.1479+0.5728j, 0.6637-0.4141j, 0.1232-1.7406j, 2025-12-04T10:08:29.1234249Z 0.4109+0.5306j], 2025-12-04T10:08:29.1234312Z [ 1.5018+0.8758j, 0.5776+0.6546j, 1.3193+0.1883j, -0.3353-0.6140j, 2025-12-04T10:08:29.1234350Z -0.3620+0.5373j], 2025-12-04T10:08:29.1234416Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1234460Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1234462Z 2025-12-04T10:08:29.1234524Z [[-0.4817+0.4921j, 1.0186+0.7998j, -0.4843-1.6301j, 0.3048-0.1543j, 2025-12-04T10:08:29.1234561Z 0.5321-0.4742j], 2025-12-04T10:08:29.1234627Z [ 0.9586+1.1457j, -0.8337+0.4236j, 0.6387+0.0398j, -0.1755-0.1514j, 2025-12-04T10:08:29.1234665Z -0.6735-0.7690j], 2025-12-04T10:08:29.1234726Z [ 0.6050-0.8440j, 0.5445-1.0105j, 1.4448+0.0590j, -1.1483+0.0823j, 2025-12-04T10:08:29.1234764Z -0.5249-0.5482j], 2025-12-04T10:08:29.1234826Z [-0.3104-0.4952j, 0.4605+0.9686j, -0.9071+1.4359j, 0.3253-0.2541j, 2025-12-04T10:08:29.1234862Z -0.3251-0.6604j], 2025-12-04T10:08:29.1234924Z [ 0.9182+0.3088j, 0.4008+0.4283j, -1.7427+0.1271j, -0.2208+0.4205j, 2025-12-04T10:08:29.1234964Z 0.3111+0.0965j]]], 2025-12-04T10:08:29.1234966Z 2025-12-04T10:08:29.1234967Z 2025-12-04T10:08:29.1235033Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1235073Z -0.6628-0.1173j], 2025-12-04T10:08:29.1235136Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1235171Z 0.4268-0.3009j], 2025-12-04T10:08:29.1235240Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1235275Z 0.2557-0.1815j], 2025-12-04T10:08:29.1235338Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1235374Z 0.1764-1.6442j], 2025-12-04T10:08:29.1235436Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1235475Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1235478Z 2025-12-04T10:08:29.1235540Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1235576Z -0.6316+0.1788j], 2025-12-04T10:08:29.1235643Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1235680Z -0.9993-0.3518j], 2025-12-04T10:08:29.1235743Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1235778Z 0.6463+0.0217j], 2025-12-04T10:08:29.1235865Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1235902Z -1.0457-0.3744j], 2025-12-04T10:08:29.1235965Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1236033Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1236035Z 2025-12-04T10:08:29.1236070Z Expected: 2025-12-04T10:08:29.1236142Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1236179Z 0.3401-0.5676j], 2025-12-04T10:08:29.1236240Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1236289Z 0.2064-0.7429j], 2025-12-04T10:08:29.1236362Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1236398Z 0.4114+0.5306j], 2025-12-04T10:08:29.1236460Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1236500Z -0.3622+0.5375j], 2025-12-04T10:08:29.1236562Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1236599Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1236601Z 2025-12-04T10:08:29.1236671Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1236707Z 0.5321-0.4721j], 2025-12-04T10:08:29.1236770Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1236806Z -0.6743-0.7686j], 2025-12-04T10:08:29.1236869Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1236907Z -0.5254-0.5482j], 2025-12-04T10:08:29.1236970Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1237006Z -0.3257-0.6610j], 2025-12-04T10:08:29.1237070Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1237113Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1237115Z 2025-12-04T10:08:29.1237117Z 2025-12-04T10:08:29.1237180Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1237215Z -0.6628-0.1173j], 2025-12-04T10:08:29.1237279Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1237314Z 0.4268-0.3009j], 2025-12-04T10:08:29.1237378Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1237413Z 0.2557-0.1815j], 2025-12-04T10:08:29.1237477Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1237513Z 0.1764-1.6442j], 2025-12-04T10:08:29.1237576Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1237613Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1237615Z 2025-12-04T10:08:29.1237679Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1237716Z -0.6316+0.1788j], 2025-12-04T10:08:29.1237780Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1237816Z -0.9993-0.3518j], 2025-12-04T10:08:29.1237878Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1237913Z 0.6463+0.0217j], 2025-12-04T10:08:29.1237975Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1238010Z -1.0457-0.3744j], 2025-12-04T10:08:29.1238075Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1238144Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1238146Z 2025-12-04T10:08:29.1238230Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1238246Z 2025-12-04T10:08:29.1238302Z Traceback (most recent call last): 2025-12-04T10:08:29.1238464Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1238504Z method(*args, **kwargs) 2025-12-04T10:08:29.1238683Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1238729Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1238767Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1238928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1239000Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1239038Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1239196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1239240Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1239276Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1239430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1239467Z fn(*args, **kwargs) 2025-12-04T10:08:29.1239635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1239676Z raise e_tracked from e 2025-12-04T10:08:29.1239722Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1239724Z 2025-12-04T10:08:29.1239820Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1239903Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1239984Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1239986Z 2025-12-04T10:08:29.1240073Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1240175Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1240210Z If the test 2025-12-04T10:08:29.1240304Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1240368Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1240467Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1240549Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1240551Z 2025-12-04T10:08:29.1240644Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1240729Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1240766Z the following. 2025-12-04T10:08:29.1240768Z 2025-12-04T10:08:29.1240857Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1240947Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1240998Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1241062Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1241123Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1241125Z 2025-12-04T10:08:29.1241158Z Got: 2025-12-04T10:08:29.1241231Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1046j, 1.1405+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.1241269Z 0.3398-0.5666j], 2025-12-04T10:08:29.1241331Z [ 0.6809-0.1503j, 0.2815+0.1163j, 0.5365+0.1627j, 0.8373-0.5079j, 2025-12-04T10:08:29.1241370Z 0.2066-0.7429j], 2025-12-04T10:08:29.1241434Z [-1.1219+0.2129j, -1.1479+0.5728j, 0.6637-0.4141j, 0.1232-1.7406j, 2025-12-04T10:08:29.1241470Z 0.4109+0.5306j], 2025-12-04T10:08:29.1241544Z [ 1.5018+0.8758j, 0.5776+0.6546j, 1.3193+0.1883j, -0.3353-0.6140j, 2025-12-04T10:08:29.1241595Z -0.3620+0.5373j], 2025-12-04T10:08:29.1241657Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1241696Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1241698Z 2025-12-04T10:08:29.1241760Z [[-0.4817+0.4921j, 1.0186+0.7998j, -0.4843-1.6301j, 0.3048-0.1543j, 2025-12-04T10:08:29.1241796Z 0.5321-0.4742j], 2025-12-04T10:08:29.1241859Z [ 0.9586+1.1457j, -0.8337+0.4236j, 0.6387+0.0398j, -0.1755-0.1514j, 2025-12-04T10:08:29.1241896Z -0.6735-0.7690j], 2025-12-04T10:08:29.1241956Z [ 0.6050-0.8440j, 0.5445-1.0105j, 1.4448+0.0590j, -1.1483+0.0823j, 2025-12-04T10:08:29.1242014Z -0.5249-0.5482j], 2025-12-04T10:08:29.1242077Z [-0.3104-0.4952j, 0.4605+0.9686j, -0.9071+1.4359j, 0.3253-0.2541j, 2025-12-04T10:08:29.1242114Z -0.3251-0.6604j], 2025-12-04T10:08:29.1242177Z [ 0.9182+0.3088j, 0.4008+0.4283j, -1.7427+0.1271j, -0.2208+0.4205j, 2025-12-04T10:08:29.1242216Z 0.3111+0.0965j]]], 2025-12-04T10:08:29.1242218Z 2025-12-04T10:08:29.1242220Z 2025-12-04T10:08:29.1242282Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1242319Z -0.6628-0.1173j], 2025-12-04T10:08:29.1242381Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1242417Z 0.4268-0.3009j], 2025-12-04T10:08:29.1242481Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1242516Z 0.2557-0.1815j], 2025-12-04T10:08:29.1242579Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1242615Z 0.1764-1.6442j], 2025-12-04T10:08:29.1242677Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1242716Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1242719Z 2025-12-04T10:08:29.1242781Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1242818Z -0.6316+0.1788j], 2025-12-04T10:08:29.1242880Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1242915Z -0.9993-0.3518j], 2025-12-04T10:08:29.1243033Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1243068Z 0.6463+0.0217j], 2025-12-04T10:08:29.1243130Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1243166Z -1.0457-0.3744j], 2025-12-04T10:08:29.1243231Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1243297Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1243299Z 2025-12-04T10:08:29.1243334Z Expected: 2025-12-04T10:08:29.1243406Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1243444Z 0.3401-0.5676j], 2025-12-04T10:08:29.1243504Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1243540Z 0.2064-0.7429j], 2025-12-04T10:08:29.1243603Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1243639Z 0.4114+0.5306j], 2025-12-04T10:08:29.1243701Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1243737Z -0.3622+0.5375j], 2025-12-04T10:08:29.1243799Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1243837Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1243840Z 2025-12-04T10:08:29.1243903Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1243939Z 0.5321-0.4721j], 2025-12-04T10:08:29.1244001Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1244071Z -0.6743-0.7686j], 2025-12-04T10:08:29.1244134Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1244170Z -0.5254-0.5482j], 2025-12-04T10:08:29.1244232Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1244268Z -0.3257-0.6610j], 2025-12-04T10:08:29.1244331Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1244370Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1244372Z 2025-12-04T10:08:29.1244374Z 2025-12-04T10:08:29.1244450Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1244501Z -0.6628-0.1173j], 2025-12-04T10:08:29.1244564Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1244599Z 0.4268-0.3009j], 2025-12-04T10:08:29.1244663Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1244699Z 0.2557-0.1815j], 2025-12-04T10:08:29.1244763Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1244799Z 0.1764-1.6442j], 2025-12-04T10:08:29.1244862Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1244900Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1244902Z 2025-12-04T10:08:29.1244964Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1245000Z -0.6316+0.1788j], 2025-12-04T10:08:29.1245063Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1245100Z -0.9993-0.3518j], 2025-12-04T10:08:29.1245162Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1245197Z 0.6463+0.0217j], 2025-12-04T10:08:29.1245262Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1245297Z -1.0457-0.3744j], 2025-12-04T10:08:29.1245361Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1245426Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1245428Z 2025-12-04T10:08:29.1245757Z Caused by sample input at index 22: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={'upper': 'False'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1245760Z 2025-12-04T10:08:29.1245835Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1246044Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=22 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1246048Z 2025-12-04T10:08:29.1246135Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1246229Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1246276Z Traceback (most recent call last): 2025-12-04T10:08:29.1246446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1246489Z return test(*args, **kwargs) 2025-12-04T10:08:29.1246526Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1246631Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1246696Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1246865Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1247000Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1247069Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1247231Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1247289Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1247331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1247488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1247555Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1247621Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1247761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1247807Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1247846Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1247998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1248049Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1248203Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1248245Z raise GradcheckError( 2025-12-04T10:08:29.1248334Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1248336Z 2025-12-04T10:08:29.1248429Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1248512Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1248592Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1248594Z 2025-12-04T10:08:29.1248679Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1248783Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1248817Z If the test 2025-12-04T10:08:29.1248911Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1248973Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1249069Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1249150Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1249152Z 2025-12-04T10:08:29.1249243Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1249329Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1249365Z the following. 2025-12-04T10:08:29.1249367Z 2025-12-04T10:08:29.1249455Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1249548Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1249598Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1249663Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1249723Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1249726Z 2025-12-04T10:08:29.1249758Z Got: 2025-12-04T10:08:29.1249823Z tensor([[[[-1.0977e+01+1.1337e+01j, -1.0756e+01+9.2380e+00j, 2025-12-04T10:08:29.1249876Z 3.9925e+00+4.6300e+00j, 6.3377e+00-9.6003e+00j, 2025-12-04T10:08:29.1249918Z -7.6218e+00-3.0058e+00j], 2025-12-04T10:08:29.1249971Z [ 1.7222e+00-1.0554e+01j, 3.8398e+00-1.0499e+01j, 2025-12-04T10:08:29.1250026Z -6.6268e+00-2.5683e+00j, -1.2097e+00+8.9256e+00j, 2025-12-04T10:08:29.1250065Z 4.8629e+00-1.4466e+00j], 2025-12-04T10:08:29.1250117Z [-1.3885e+00-5.1036e+00j, -1.0999e-01-5.2818e+00j, 2025-12-04T10:08:29.1250192Z -3.7775e+00-2.5616e-01j, 4.2126e-01+4.2466e+00j, 2025-12-04T10:08:29.1250234Z 1.5395e+00-1.9816e+00j], 2025-12-04T10:08:29.1250284Z [-1.3818e+00-2.9840e+00j, -1.3907e+00-2.8604e+00j, 2025-12-04T10:08:29.1250335Z -7.9615e-01+6.6249e-03j, 1.1648e+00+8.6583e-01j, 2025-12-04T10:08:29.1250373Z 7.3385e-01-4.1776e-01j], 2025-12-04T10:08:29.1250424Z [-9.8467e-02+7.5125e-01j, 9.1949e-01+1.1341e+00j, 2025-12-04T10:08:29.1250475Z -8.8098e-01-6.4165e-01j, -7.6596e-01+2.7492e-01j, 2025-12-04T10:08:29.1250517Z 3.6590e-02-1.2498e-01j]], 2025-12-04T10:08:29.1250519Z 2025-12-04T10:08:29.1250587Z [[-5.0049e+00+1.6417e+00j, 2.9798e+00+9.4143e-01j, 2025-12-04T10:08:29.1250648Z 4.9091e+00-3.7872e-03j, 6.3788e-01-4.8041e+00j, 2025-12-04T10:08:29.1250687Z -1.0136e+00+1.2785e-01j], 2025-12-04T10:08:29.1250737Z [-1.7261e+00-2.8658e+00j, -8.7846e-03+1.1695e+00j, 2025-12-04T10:08:29.1250787Z 2.0116e+00+3.0260e+00j, 2.8595e+00-8.6768e-01j, 2025-12-04T10:08:29.1250827Z -8.9377e-01+2.0670e-01j], 2025-12-04T10:08:29.1250876Z [ 3.2179e+00-2.3623e+00j, -1.6873e+00-2.1378e-01j, 2025-12-04T10:08:29.1250927Z -6.3615e+00-8.6185e-01j, 5.2496e-01+3.8774e+00j, 2025-12-04T10:08:29.1250965Z 1.7859e+00-8.7532e-02j], 2025-12-04T10:08:29.1251016Z [ 9.6471e-01-1.5865e+00j, -2.2860e-01+5.4319e-01j, 2025-12-04T10:08:29.1251065Z -2.1799e+00+1.7894e+00j, 8.7317e-01+5.9223e-01j, 2025-12-04T10:08:29.1251104Z 7.4597e-01-9.9616e-01j], 2025-12-04T10:08:29.1251153Z [ 5.9963e-01+5.4587e-01j, 1.6291e-01+4.6320e-01j, 2025-12-04T10:08:29.1251205Z -1.3783e+00-4.8949e-01j, -3.1085e-01+2.4789e-01j, 2025-12-04T10:08:29.1251247Z 2.0589e-01+1.7868e-01j]]], 2025-12-04T10:08:29.1251249Z 2025-12-04T10:08:29.1251251Z 2025-12-04T10:08:29.1251302Z [[[-1.9189e-01-5.9893e-01j, -2.0372e-01-4.1950e-01j, 2025-12-04T10:08:29.1251353Z 6.0848e-01+2.7197e-01j, 1.4388e+00-8.3350e-01j, 2025-12-04T10:08:29.1251393Z -6.6285e-01-1.1732e-01j], 2025-12-04T10:08:29.1251442Z [-6.6164e-01-5.8389e-01j, -2.4430e-01+9.6196e-01j, 2025-12-04T10:08:29.1251493Z -2.4885e-01+5.0987e-01j, 1.1702e-01-8.9906e-01j, 2025-12-04T10:08:29.1251531Z 4.2679e-01-3.0089e-01j], 2025-12-04T10:08:29.1251582Z [-1.3736e-01+2.8444e-01j, -1.9547e-01-1.4549e+00j, 2025-12-04T10:08:29.1251632Z -5.7081e-01-4.1567e-01j, -4.0360e-02+3.7118e-01j, 2025-12-04T10:08:29.1251672Z 2.5569e-01-1.8153e-01j], 2025-12-04T10:08:29.1251722Z [ 3.2317e-01-1.1092e-01j, -4.2273e-01-1.0964e+00j, 2025-12-04T10:08:29.1251774Z 1.2298e+00+9.0961e-01j, -6.1429e-01-2.3413e-01j, 2025-12-04T10:08:29.1251813Z 1.7642e-01-1.6442e+00j], 2025-12-04T10:08:29.1251862Z [ 1.0214e+00+7.6772e-01j, 3.1844e-01-3.5588e-01j, 2025-12-04T10:08:29.1251913Z 3.1428e-01+5.4397e-01j, -8.2156e-01-1.6840e-01j, 2025-12-04T10:08:29.1251955Z -5.9945e-01-8.6882e-01j]], 2025-12-04T10:08:29.1251957Z 2025-12-04T10:08:29.1252007Z [[ 1.0539e+00-7.3211e-01j, 4.5990e-01+5.2475e-01j, 2025-12-04T10:08:29.1252057Z 1.1369e+00-7.5329e-01j, -7.3226e-01+2.0070e+00j, 2025-12-04T10:08:29.1252096Z -6.3165e-01+1.7883e-01j], 2025-12-04T10:08:29.1252146Z [-1.0193e+00-6.3350e-01j, -1.4438e-01-9.0377e-01j, 2025-12-04T10:08:29.1252196Z 8.4124e-01+5.4601e-01j, -4.2510e-01+8.2113e-03j, 2025-12-04T10:08:29.1252234Z -9.9926e-01-3.5177e-01j], 2025-12-04T10:08:29.1252284Z [ 3.3203e-01-4.2876e-01j, -8.8123e-01-2.5672e-02j, 2025-12-04T10:08:29.1252336Z 1.0533e-01-7.5240e-01j, 2.9878e-01+3.5971e-01j, 2025-12-04T10:08:29.1252375Z 6.4627e-01+2.1691e-02j], 2025-12-04T10:08:29.1252425Z [-1.5263e-02-3.8690e-01j, 8.2130e-01-6.5318e-01j, 2025-12-04T10:08:29.1252498Z 7.4210e-01+1.2504e+00j, 3.3293e-01+7.9396e-01j, 2025-12-04T10:08:29.1252537Z -1.0457e+00-3.7436e-01j], 2025-12-04T10:08:29.1252588Z [-5.6491e-01+1.4362e-01j, -1.8726e-01-1.5054e+00j, 2025-12-04T10:08:29.1252637Z -7.4748e-01+3.7488e-01j, 1.2359e+00-2.0724e-01j, 2025-12-04T10:08:29.1252689Z 1.0937e+00+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1252733Z dtype=torch.complex128) 2025-12-04T10:08:29.1252735Z 2025-12-04T10:08:29.1252770Z Expected: 2025-12-04T10:08:29.1252844Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1252883Z 0.3401-0.5676j], 2025-12-04T10:08:29.1253004Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1253058Z 0.2064-0.7429j], 2025-12-04T10:08:29.1253122Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1253158Z 0.4114+0.5306j], 2025-12-04T10:08:29.1253222Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1253259Z -0.3622+0.5375j], 2025-12-04T10:08:29.1253322Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1253361Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1253362Z 2025-12-04T10:08:29.1253424Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1253461Z 0.5321-0.4721j], 2025-12-04T10:08:29.1253523Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1253560Z -0.6743-0.7686j], 2025-12-04T10:08:29.1253623Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1253661Z -0.5254-0.5482j], 2025-12-04T10:08:29.1253723Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1253759Z -0.3257-0.6610j], 2025-12-04T10:08:29.1253824Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1253863Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1253865Z 2025-12-04T10:08:29.1253866Z 2025-12-04T10:08:29.1253928Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1253965Z -0.6628-0.1173j], 2025-12-04T10:08:29.1254028Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1254063Z 0.4268-0.3009j], 2025-12-04T10:08:29.1254126Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1254162Z 0.2557-0.1815j], 2025-12-04T10:08:29.1254226Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1254263Z 0.1764-1.6442j], 2025-12-04T10:08:29.1254325Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1254365Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1254368Z 2025-12-04T10:08:29.1254430Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1254466Z -0.6316+0.1788j], 2025-12-04T10:08:29.1254529Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1254564Z -0.9993-0.3518j], 2025-12-04T10:08:29.1254626Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1254662Z 0.6463+0.0217j], 2025-12-04T10:08:29.1254724Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1254759Z -1.0457-0.3744j], 2025-12-04T10:08:29.1254824Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1254890Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1254892Z 2025-12-04T10:08:29.1254975Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1255011Z 2025-12-04T10:08:29.1255057Z Traceback (most recent call last): 2025-12-04T10:08:29.1255214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1255255Z method(*args, **kwargs) 2025-12-04T10:08:29.1255433Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1255478Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1255517Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1255690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1255746Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1255783Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1255943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1255987Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1256024Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1256177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1256215Z fn(*args, **kwargs) 2025-12-04T10:08:29.1256382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1256423Z raise e_tracked from e 2025-12-04T10:08:29.1256468Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1256470Z 2025-12-04T10:08:29.1256564Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1256646Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1256727Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1256730Z 2025-12-04T10:08:29.1256815Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1256915Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1256950Z If the test 2025-12-04T10:08:29.1257043Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1257106Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1257201Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1257283Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1257286Z 2025-12-04T10:08:29.1257378Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1257464Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1257500Z the following. 2025-12-04T10:08:29.1257503Z 2025-12-04T10:08:29.1257592Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1257682Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1257733Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1257796Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1257858Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1257860Z 2025-12-04T10:08:29.1257893Z Got: 2025-12-04T10:08:29.1257954Z tensor([[[[-1.0977e+01+1.1337e+01j, -1.0756e+01+9.2380e+00j, 2025-12-04T10:08:29.1258007Z 3.9925e+00+4.6300e+00j, 6.3377e+00-9.6003e+00j, 2025-12-04T10:08:29.1258048Z -7.6218e+00-3.0058e+00j], 2025-12-04T10:08:29.1258101Z [ 1.7222e+00-1.0554e+01j, 3.8398e+00-1.0499e+01j, 2025-12-04T10:08:29.1258153Z -6.6268e+00-2.5683e+00j, -1.2097e+00+8.9256e+00j, 2025-12-04T10:08:29.1258192Z 4.8629e+00-1.4466e+00j], 2025-12-04T10:08:29.1258267Z [-1.3885e+00-5.1036e+00j, -1.0999e-01-5.2818e+00j, 2025-12-04T10:08:29.1258319Z -3.7775e+00-2.5616e-01j, 4.2126e-01+4.2466e+00j, 2025-12-04T10:08:29.1258357Z 1.5395e+00-1.9816e+00j], 2025-12-04T10:08:29.1258407Z [-1.3818e+00-2.9840e+00j, -1.3907e+00-2.8604e+00j, 2025-12-04T10:08:29.1258457Z -7.9615e-01+6.6249e-03j, 1.1648e+00+8.6583e-01j, 2025-12-04T10:08:29.1258496Z 7.3385e-01-4.1776e-01j], 2025-12-04T10:08:29.1258545Z [-9.8467e-02+7.5125e-01j, 9.1949e-01+1.1341e+00j, 2025-12-04T10:08:29.1258597Z -8.8098e-01-6.4165e-01j, -7.6596e-01+2.7492e-01j, 2025-12-04T10:08:29.1258637Z 3.6590e-02-1.2498e-01j]], 2025-12-04T10:08:29.1258662Z 2025-12-04T10:08:29.1258712Z [[-5.0049e+00+1.6417e+00j, 2.9798e+00+9.4143e-01j, 2025-12-04T10:08:29.1258762Z 4.9091e+00-3.7872e-03j, 6.3788e-01-4.8041e+00j, 2025-12-04T10:08:29.1258802Z -1.0136e+00+1.2785e-01j], 2025-12-04T10:08:29.1258853Z [-1.7261e+00-2.8658e+00j, -8.7846e-03+1.1695e+00j, 2025-12-04T10:08:29.1258903Z 2.0116e+00+3.0260e+00j, 2.8595e+00-8.6768e-01j, 2025-12-04T10:08:29.1258941Z -8.9377e-01+2.0670e-01j], 2025-12-04T10:08:29.1258991Z [ 3.2179e+00-2.3623e+00j, -1.6873e+00-2.1378e-01j, 2025-12-04T10:08:29.1259041Z -6.3615e+00-8.6185e-01j, 5.2496e-01+3.8774e+00j, 2025-12-04T10:08:29.1259079Z 1.7859e+00-8.7532e-02j], 2025-12-04T10:08:29.1259129Z [ 9.6471e-01-1.5865e+00j, -2.2860e-01+5.4319e-01j, 2025-12-04T10:08:29.1259178Z -2.1799e+00+1.7894e+00j, 8.7317e-01+5.9223e-01j, 2025-12-04T10:08:29.1259216Z 7.4597e-01-9.9616e-01j], 2025-12-04T10:08:29.1259266Z [ 5.9963e-01+5.4587e-01j, 1.6291e-01+4.6320e-01j, 2025-12-04T10:08:29.1259317Z -1.3783e+00-4.8949e-01j, -3.1085e-01+2.4789e-01j, 2025-12-04T10:08:29.1259358Z 2.0589e-01+1.7868e-01j]]], 2025-12-04T10:08:29.1259361Z 2025-12-04T10:08:29.1259363Z 2025-12-04T10:08:29.1259414Z [[[-1.9189e-01-5.9893e-01j, -2.0372e-01-4.1950e-01j, 2025-12-04T10:08:29.1259464Z 6.0848e-01+2.7197e-01j, 1.4388e+00-8.3350e-01j, 2025-12-04T10:08:29.1259502Z -6.6285e-01-1.1732e-01j], 2025-12-04T10:08:29.1259554Z [-6.6164e-01-5.8389e-01j, -2.4430e-01+9.6196e-01j, 2025-12-04T10:08:29.1259604Z -2.4885e-01+5.0987e-01j, 1.1702e-01-8.9906e-01j, 2025-12-04T10:08:29.1259642Z 4.2679e-01-3.0089e-01j], 2025-12-04T10:08:29.1259691Z [-1.3736e-01+2.8444e-01j, -1.9547e-01-1.4549e+00j, 2025-12-04T10:08:29.1259743Z -5.7081e-01-4.1567e-01j, -4.0360e-02+3.7118e-01j, 2025-12-04T10:08:29.1259780Z 2.5569e-01-1.8153e-01j], 2025-12-04T10:08:29.1259833Z [ 3.2317e-01-1.1092e-01j, -4.2273e-01-1.0964e+00j, 2025-12-04T10:08:29.1259883Z 1.2298e+00+9.0961e-01j, -6.1429e-01-2.3413e-01j, 2025-12-04T10:08:29.1259922Z 1.7642e-01-1.6442e+00j], 2025-12-04T10:08:29.1259972Z [ 1.0214e+00+7.6772e-01j, 3.1844e-01-3.5588e-01j, 2025-12-04T10:08:29.1260023Z 3.1428e-01+5.4397e-01j, -8.2156e-01-1.6840e-01j, 2025-12-04T10:08:29.1260063Z -5.9945e-01-8.6882e-01j]], 2025-12-04T10:08:29.1260066Z 2025-12-04T10:08:29.1260115Z [[ 1.0539e+00-7.3211e-01j, 4.5990e-01+5.2475e-01j, 2025-12-04T10:08:29.1260165Z 1.1369e+00-7.5329e-01j, -7.3226e-01+2.0070e+00j, 2025-12-04T10:08:29.1260204Z -6.3165e-01+1.7883e-01j], 2025-12-04T10:08:29.1260255Z [-1.0193e+00-6.3350e-01j, -1.4438e-01-9.0377e-01j, 2025-12-04T10:08:29.1260305Z 8.4124e-01+5.4601e-01j, -4.2510e-01+8.2113e-03j, 2025-12-04T10:08:29.1260346Z -9.9926e-01-3.5177e-01j], 2025-12-04T10:08:29.1260398Z [ 3.3203e-01-4.2876e-01j, -8.8123e-01-2.5672e-02j, 2025-12-04T10:08:29.1260449Z 1.0533e-01-7.5240e-01j, 2.9878e-01+3.5971e-01j, 2025-12-04T10:08:29.1260486Z 6.4627e-01+2.1691e-02j], 2025-12-04T10:08:29.1260567Z [-1.5263e-02-3.8690e-01j, 8.2130e-01-6.5318e-01j, 2025-12-04T10:08:29.1260616Z 7.4210e-01+1.2504e+00j, 3.3293e-01+7.9396e-01j, 2025-12-04T10:08:29.1260655Z -1.0457e+00-3.7436e-01j], 2025-12-04T10:08:29.1260705Z [-5.6491e-01+1.4362e-01j, -1.8726e-01-1.5054e+00j, 2025-12-04T10:08:29.1260756Z -7.4748e-01+3.7488e-01j, 1.2359e+00-2.0724e-01j, 2025-12-04T10:08:29.1260807Z 1.0937e+00+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1260851Z dtype=torch.complex128) 2025-12-04T10:08:29.1260854Z 2025-12-04T10:08:29.1260887Z Expected: 2025-12-04T10:08:29.1260964Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.1261015Z 0.3401-0.5676j], 2025-12-04T10:08:29.1261091Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.1261127Z 0.2064-0.7429j], 2025-12-04T10:08:29.1261191Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.1261230Z 0.4114+0.5306j], 2025-12-04T10:08:29.1261293Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.1261329Z -0.3622+0.5375j], 2025-12-04T10:08:29.1261391Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.1261430Z 0.0867+0.1067j]], 2025-12-04T10:08:29.1261431Z 2025-12-04T10:08:29.1261494Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.1261530Z 0.5321-0.4721j], 2025-12-04T10:08:29.1261592Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.1261629Z -0.6743-0.7686j], 2025-12-04T10:08:29.1261692Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.1261728Z -0.5254-0.5482j], 2025-12-04T10:08:29.1261790Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.1261828Z -0.3257-0.6610j], 2025-12-04T10:08:29.1261891Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.1261928Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.1261930Z 2025-12-04T10:08:29.1261932Z 2025-12-04T10:08:29.1261995Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.1262031Z -0.6628-0.1173j], 2025-12-04T10:08:29.1262094Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.1262129Z 0.4268-0.3009j], 2025-12-04T10:08:29.1262192Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.1262231Z 0.2557-0.1815j], 2025-12-04T10:08:29.1262293Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.1262329Z 0.1764-1.6442j], 2025-12-04T10:08:29.1262391Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.1262432Z -0.5994-0.8688j]], 2025-12-04T10:08:29.1262434Z 2025-12-04T10:08:29.1262495Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.1262531Z -0.6316+0.1788j], 2025-12-04T10:08:29.1262594Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.1262630Z -0.9993-0.3518j], 2025-12-04T10:08:29.1262691Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.1262727Z 0.6463+0.0217j], 2025-12-04T10:08:29.1262788Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.1262827Z -1.0457-0.3744j], 2025-12-04T10:08:29.1262891Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.1263005Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1263031Z 2025-12-04T10:08:29.1263350Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1263352Z 2025-12-04T10:08:29.1263427Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1263631Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1263634Z 2025-12-04T10:08:29.1263733Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1263842Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1263887Z Traceback (most recent call last): 2025-12-04T10:08:29.1264065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1264108Z return test(*args, **kwargs) 2025-12-04T10:08:29.1264146Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1264249Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1264314Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1264481Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1264603Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1264655Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1264819Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1264877Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1264920Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1265075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1265143Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1265187Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1265326Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1265371Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1265409Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1265561Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1265611Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1265765Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1265808Z raise GradcheckError( 2025-12-04T10:08:29.1265897Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1265901Z 2025-12-04T10:08:29.1265994Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1266077Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1266156Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1266158Z 2025-12-04T10:08:29.1266243Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1266346Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1266383Z If the test 2025-12-04T10:08:29.1266475Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1266553Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1266660Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1266742Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1266744Z 2025-12-04T10:08:29.1266834Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1266918Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1266954Z the following. 2025-12-04T10:08:29.1266956Z 2025-12-04T10:08:29.1267045Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1267145Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1267207Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1267271Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1267332Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1267335Z 2025-12-04T10:08:29.1267368Z Got: 2025-12-04T10:08:29.1267442Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.1267480Z -0.1875+0.3131j], 2025-12-04T10:08:29.1267545Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.1267582Z -0.0786+0.2827j], 2025-12-04T10:08:29.1267647Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.1267683Z 0.3077+0.3986j], 2025-12-04T10:08:29.1267745Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.1267782Z -0.1509+0.2260j], 2025-12-04T10:08:29.1267848Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.1267887Z 0.0273+0.0340j]], 2025-12-04T10:08:29.1267888Z 2025-12-04T10:08:29.1267951Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.1267989Z 0.3021-0.2693j], 2025-12-04T10:08:29.1268052Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.1268088Z -4.3263-4.7783j], 2025-12-04T10:08:29.1268151Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.1268187Z 0.1501+0.1573j], 2025-12-04T10:08:29.1268248Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.1268286Z -0.0529-0.1077j], 2025-12-04T10:08:29.1268348Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.1268387Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.1268390Z 2025-12-04T10:08:29.1268391Z 2025-12-04T10:08:29.1268453Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1268489Z -0.6637-0.1175j], 2025-12-04T10:08:29.1268553Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1268590Z 0.4261-0.3012j], 2025-12-04T10:08:29.1268653Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1268690Z 0.2567-0.1808j], 2025-12-04T10:08:29.1268752Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1268787Z 0.1761-1.6446j], 2025-12-04T10:08:29.1268849Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1268888Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1268890Z 2025-12-04T10:08:29.1268952Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1268990Z -0.6307+0.1756j], 2025-12-04T10:08:29.1269052Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1269089Z -0.9972-0.3518j], 2025-12-04T10:08:29.1269163Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1269216Z 0.6467+0.0201j], 2025-12-04T10:08:29.1269277Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1269314Z -1.0443-0.3699j], 2025-12-04T10:08:29.1269376Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1269446Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1269448Z 2025-12-04T10:08:29.1269484Z Expected: 2025-12-04T10:08:29.1269556Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1269592Z 0.3401-0.5673j], 2025-12-04T10:08:29.1269683Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1269720Z 0.2078-0.7444j], 2025-12-04T10:08:29.1269783Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1269822Z 0.4109+0.5305j], 2025-12-04T10:08:29.1269883Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1269920Z -0.3607+0.5386j], 2025-12-04T10:08:29.1269983Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1270021Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1270023Z 2025-12-04T10:08:29.1270086Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1270124Z 0.5323-0.4729j], 2025-12-04T10:08:29.1270187Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1270225Z -0.6732-0.7677j], 2025-12-04T10:08:29.1270298Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1270339Z -0.5241-0.5479j], 2025-12-04T10:08:29.1270401Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1270440Z -0.3257-0.6597j], 2025-12-04T10:08:29.1270503Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1270543Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1270545Z 2025-12-04T10:08:29.1270546Z 2025-12-04T10:08:29.1270609Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1270647Z -0.6637-0.1175j], 2025-12-04T10:08:29.1270708Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1270745Z 0.4261-0.3012j], 2025-12-04T10:08:29.1270807Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1270847Z 0.2567-0.1808j], 2025-12-04T10:08:29.1270910Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1270946Z 0.1761-1.6446j], 2025-12-04T10:08:29.1271008Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1271050Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1271052Z 2025-12-04T10:08:29.1271113Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1271149Z -0.6307+0.1756j], 2025-12-04T10:08:29.1271211Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1271248Z -0.9972-0.3518j], 2025-12-04T10:08:29.1271309Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1271345Z 0.6467+0.0201j], 2025-12-04T10:08:29.1271406Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1271443Z -1.0443-0.3699j], 2025-12-04T10:08:29.1271507Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1271571Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1271596Z 2025-12-04T10:08:29.1271692Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1271694Z 2025-12-04T10:08:29.1271739Z Traceback (most recent call last): 2025-12-04T10:08:29.1271897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1271937Z method(*args, **kwargs) 2025-12-04T10:08:29.1272114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1272161Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1272201Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1272372Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1272427Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1272465Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1272626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1272668Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1272708Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1272859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1272898Z fn(*args, **kwargs) 2025-12-04T10:08:29.1273120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1273161Z raise e_tracked from e 2025-12-04T10:08:29.1273206Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1273214Z 2025-12-04T10:08:29.1273308Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1273390Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1273476Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1273478Z 2025-12-04T10:08:29.1273563Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1273665Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1273700Z If the test 2025-12-04T10:08:29.1273796Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1273858Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1273952Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1274038Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1274041Z 2025-12-04T10:08:29.1274132Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1274219Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1274255Z the following. 2025-12-04T10:08:29.1274259Z 2025-12-04T10:08:29.1274349Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1274439Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1274490Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1274554Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1274616Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1274618Z 2025-12-04T10:08:29.1274650Z Got: 2025-12-04T10:08:29.1274724Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.1274762Z -0.1875+0.3131j], 2025-12-04T10:08:29.1274830Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.1274866Z -0.0786+0.2827j], 2025-12-04T10:08:29.1274931Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.1275011Z 0.3077+0.3986j], 2025-12-04T10:08:29.1275076Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.1275112Z -0.1509+0.2260j], 2025-12-04T10:08:29.1275174Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.1275212Z 0.0273+0.0340j]], 2025-12-04T10:08:29.1275213Z 2025-12-04T10:08:29.1275279Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.1275315Z 0.3021-0.2693j], 2025-12-04T10:08:29.1275378Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.1275427Z -4.3263-4.7783j], 2025-12-04T10:08:29.1275503Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.1275541Z 0.1501+0.1573j], 2025-12-04T10:08:29.1275603Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.1275644Z -0.0529-0.1077j], 2025-12-04T10:08:29.1275707Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.1275745Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.1275747Z 2025-12-04T10:08:29.1275749Z 2025-12-04T10:08:29.1275811Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1275848Z -0.6637-0.1175j], 2025-12-04T10:08:29.1275910Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1275946Z 0.4261-0.3012j], 2025-12-04T10:08:29.1276008Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1276046Z 0.2567-0.1808j], 2025-12-04T10:08:29.1276108Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1276145Z 0.1761-1.6446j], 2025-12-04T10:08:29.1276206Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1276248Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1276250Z 2025-12-04T10:08:29.1276313Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1276349Z -0.6307+0.1756j], 2025-12-04T10:08:29.1276412Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1276449Z -0.9972-0.3518j], 2025-12-04T10:08:29.1276511Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1276547Z 0.6467+0.0201j], 2025-12-04T10:08:29.1276608Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1276647Z -1.0443-0.3699j], 2025-12-04T10:08:29.1276710Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1276776Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1276779Z 2025-12-04T10:08:29.1276814Z Expected: 2025-12-04T10:08:29.1276887Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1276923Z 0.3401-0.5673j], 2025-12-04T10:08:29.1276984Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1277019Z 0.2078-0.7444j], 2025-12-04T10:08:29.1277082Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1277118Z 0.4109+0.5305j], 2025-12-04T10:08:29.1277180Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1277216Z -0.3607+0.5386j], 2025-12-04T10:08:29.1277279Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1277319Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1277323Z 2025-12-04T10:08:29.1277385Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1277447Z 0.5323-0.4729j], 2025-12-04T10:08:29.1277510Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1277547Z -0.6732-0.7677j], 2025-12-04T10:08:29.1277608Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1277644Z -0.5241-0.5479j], 2025-12-04T10:08:29.1277706Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1277744Z -0.3257-0.6597j], 2025-12-04T10:08:29.1277806Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1277843Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1277846Z 2025-12-04T10:08:29.1277877Z 2025-12-04T10:08:29.1277940Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1277978Z -0.6637-0.1175j], 2025-12-04T10:08:29.1278040Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1278078Z 0.4261-0.3012j], 2025-12-04T10:08:29.1278140Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1278176Z 0.2567-0.1808j], 2025-12-04T10:08:29.1278239Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1278275Z 0.1761-1.6446j], 2025-12-04T10:08:29.1278338Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1278378Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1278380Z 2025-12-04T10:08:29.1278442Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1278480Z -0.6307+0.1756j], 2025-12-04T10:08:29.1278542Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1278579Z -0.9972-0.3518j], 2025-12-04T10:08:29.1278640Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1278678Z 0.6467+0.0201j], 2025-12-04T10:08:29.1278739Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1278776Z -1.0443-0.3699j], 2025-12-04T10:08:29.1278839Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1278904Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1278906Z 2025-12-04T10:08:29.1279208Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1279211Z 2025-12-04T10:08:29.1279284Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1279492Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1279496Z 2025-12-04T10:08:29.1279582Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1279676Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1279722Z Traceback (most recent call last): 2025-12-04T10:08:29.1279894Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1279936Z return test(*args, **kwargs) 2025-12-04T10:08:29.1279975Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1280080Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1280147Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1280316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1280465Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1280518Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1280681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1280739Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1280781Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1280950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1281032Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1281078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1281219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1281266Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1281304Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1281456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1281506Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1281661Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1281705Z raise GradcheckError( 2025-12-04T10:08:29.1281796Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1281799Z 2025-12-04T10:08:29.1281893Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1281975Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1282054Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1282059Z 2025-12-04T10:08:29.1282145Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1282248Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1282283Z If the test 2025-12-04T10:08:29.1282376Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1282440Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1282537Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1282620Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1282624Z 2025-12-04T10:08:29.1282717Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1282802Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1282838Z the following. 2025-12-04T10:08:29.1282842Z 2025-12-04T10:08:29.1282974Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1283067Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1283118Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1283182Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1283241Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1283243Z 2025-12-04T10:08:29.1283276Z Got: 2025-12-04T10:08:29.1283350Z tensor([[[[-0.5612+5.7406e-02j, 0.3123+1.1033e+00j, 1.1405+3.7729e-01j, 2025-12-04T10:08:29.1283400Z 0.9836-3.9860e-01j, 0.3401-5.6728e-01j], 2025-12-04T10:08:29.1283464Z [ 0.6824-1.5236e-01j, 0.2825+1.1557e-01j, 0.5370+1.6411e-01j, 2025-12-04T10:08:29.1283515Z 0.8395-5.0656e-01j, 0.2078-7.4444e-01j], 2025-12-04T10:08:29.1283579Z [-1.1234+2.1468e-01j, -1.1468+5.7362e-01j, 0.6636-4.1426e-01j, 2025-12-04T10:08:29.1283665Z 0.1234-1.7417e+00j, 0.4109+5.3045e-01j], 2025-12-04T10:08:29.1283727Z [ 1.5025+8.7788e-01j, 0.5775+6.5749e-01j, 1.3189+1.8928e-01j, 2025-12-04T10:08:29.1283776Z -0.3367-6.1260e-01j, -0.3607+5.3857e-01j], 2025-12-04T10:08:29.1283837Z [-0.5951-5.3655e-01j, -1.5396+1.1822e-01j, 1.0860-3.8168e-01j, 2025-12-04T10:08:29.1283886Z 0.2193-8.3159e-01j, 0.0854+1.0631e-01j]], 2025-12-04T10:08:29.1283888Z 2025-12-04T10:08:29.1283947Z [[ 0.3521-3.8438e-01j, -0.5150-5.0442e-02j, 0.0599-1.7112e-01j, 2025-12-04T10:08:29.1283994Z -0.1132+3.4576e-03j, 0.2537-4.1136e-01j], 2025-12-04T10:08:29.1284066Z [-0.0427-3.2344e-01j, 0.0572-1.6179e-01j, -0.0989+7.1356e-02j, 2025-12-04T10:08:29.1284126Z -0.0587-9.6529e-05j, 0.2071-1.6101e-01j], 2025-12-04T10:08:29.1284187Z [ 0.5809+1.3868e+00j, 0.2300-6.2183e-02j, -0.1172-7.3543e-02j, 2025-12-04T10:08:29.1284233Z 0.2678-4.1000e-01j, 0.8742+7.4068e-01j], 2025-12-04T10:08:29.1284296Z [ 0.0101-3.1495e-01j, -0.3015+3.3319e-01j, -0.5334+3.8510e-02j, 2025-12-04T10:08:29.1284342Z 0.2210+1.9992e-02j, 0.1421-3.0661e-01j], 2025-12-04T10:08:29.1284401Z [ 0.2046-8.5916e-02j, 0.1344+1.2888e-02j, -0.2789+2.8624e-01j, 2025-12-04T10:08:29.1284452Z 0.0256+1.0544e-01j, 0.0678-3.0551e-02j]]], 2025-12-04T10:08:29.1284454Z 2025-12-04T10:08:29.1284456Z 2025-12-04T10:08:29.1284516Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1284562Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1284622Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1284669Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1284730Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1284776Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1284839Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1284886Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1284947Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1284995Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1284997Z 2025-12-04T10:08:29.1285057Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1285103Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1285163Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1285210Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1285270Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1285315Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1285376Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1285423Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1285485Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1285545Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1285590Z dtype=torch.complex128) 2025-12-04T10:08:29.1285592Z 2025-12-04T10:08:29.1285627Z Expected: 2025-12-04T10:08:29.1285702Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1285740Z 0.3401-0.5673j], 2025-12-04T10:08:29.1285805Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1285843Z 0.2078-0.7444j], 2025-12-04T10:08:29.1285911Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1285949Z 0.4109+0.5305j], 2025-12-04T10:08:29.1286011Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1286075Z -0.3607+0.5386j], 2025-12-04T10:08:29.1286140Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1286180Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1286182Z 2025-12-04T10:08:29.1286244Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1286282Z 0.5323-0.4729j], 2025-12-04T10:08:29.1286345Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1286385Z -0.6732-0.7677j], 2025-12-04T10:08:29.1286447Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1286494Z -0.5241-0.5479j], 2025-12-04T10:08:29.1286567Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1286605Z -0.3257-0.6597j], 2025-12-04T10:08:29.1286666Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1286708Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1286710Z 2025-12-04T10:08:29.1286711Z 2025-12-04T10:08:29.1286775Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1286811Z -0.6637-0.1175j], 2025-12-04T10:08:29.1286873Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1286909Z 0.4261-0.3012j], 2025-12-04T10:08:29.1286972Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1287009Z 0.2567-0.1808j], 2025-12-04T10:08:29.1287071Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1287108Z 0.1761-1.6446j], 2025-12-04T10:08:29.1287169Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1287211Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1287213Z 2025-12-04T10:08:29.1287277Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1287315Z -0.6307+0.1756j], 2025-12-04T10:08:29.1287377Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1287414Z -0.9972-0.3518j], 2025-12-04T10:08:29.1287476Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1287512Z 0.6467+0.0201j], 2025-12-04T10:08:29.1287574Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1287610Z -1.0443-0.3699j], 2025-12-04T10:08:29.1287674Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1287742Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1287744Z 2025-12-04T10:08:29.1287827Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1287830Z 2025-12-04T10:08:29.1287876Z Traceback (most recent call last): 2025-12-04T10:08:29.1288033Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1288074Z method(*args, **kwargs) 2025-12-04T10:08:29.1288253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1288299Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1288339Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1288501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1288547Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1288584Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1288743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1288807Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1288845Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1288997Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1289035Z fn(*args, **kwargs) 2025-12-04T10:08:29.1289202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1289243Z raise e_tracked from e 2025-12-04T10:08:29.1289290Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1289292Z 2025-12-04T10:08:29.1289422Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1289515Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1289598Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1289601Z 2025-12-04T10:08:29.1289687Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1289789Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1289825Z If the test 2025-12-04T10:08:29.1289920Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1289983Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1290078Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1290159Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1290161Z 2025-12-04T10:08:29.1290253Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1290338Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1290373Z the following. 2025-12-04T10:08:29.1290375Z 2025-12-04T10:08:29.1290465Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1290557Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1290609Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1290671Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1290732Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1290734Z 2025-12-04T10:08:29.1290766Z Got: 2025-12-04T10:08:29.1290839Z tensor([[[[-0.5612+5.7406e-02j, 0.3123+1.1033e+00j, 1.1405+3.7729e-01j, 2025-12-04T10:08:29.1290887Z 0.9836-3.9860e-01j, 0.3401-5.6728e-01j], 2025-12-04T10:08:29.1290948Z [ 0.6824-1.5236e-01j, 0.2825+1.1557e-01j, 0.5370+1.6411e-01j, 2025-12-04T10:08:29.1290996Z 0.8395-5.0656e-01j, 0.2078-7.4444e-01j], 2025-12-04T10:08:29.1291058Z [-1.1234+2.1468e-01j, -1.1468+5.7362e-01j, 0.6636-4.1426e-01j, 2025-12-04T10:08:29.1291104Z 0.1234-1.7417e+00j, 0.4109+5.3045e-01j], 2025-12-04T10:08:29.1291166Z [ 1.5025+8.7788e-01j, 0.5775+6.5749e-01j, 1.3189+1.8928e-01j, 2025-12-04T10:08:29.1291212Z -0.3367-6.1260e-01j, -0.3607+5.3857e-01j], 2025-12-04T10:08:29.1291273Z [-0.5951-5.3655e-01j, -1.5396+1.1822e-01j, 1.0860-3.8168e-01j, 2025-12-04T10:08:29.1291319Z 0.2193-8.3159e-01j, 0.0854+1.0631e-01j]], 2025-12-04T10:08:29.1291321Z 2025-12-04T10:08:29.1291382Z [[ 0.3521-3.8438e-01j, -0.5150-5.0442e-02j, 0.0599-1.7112e-01j, 2025-12-04T10:08:29.1291429Z -0.1132+3.4576e-03j, 0.2537-4.1136e-01j], 2025-12-04T10:08:29.1291488Z [-0.0427-3.2344e-01j, 0.0572-1.6179e-01j, -0.0989+7.1356e-02j, 2025-12-04T10:08:29.1291536Z -0.0587-9.6529e-05j, 0.2071-1.6101e-01j], 2025-12-04T10:08:29.1291598Z [ 0.5809+1.3868e+00j, 0.2300-6.2183e-02j, -0.1172-7.3543e-02j, 2025-12-04T10:08:29.1291644Z 0.2678-4.1000e-01j, 0.8742+7.4068e-01j], 2025-12-04T10:08:29.1291703Z [ 0.0101-3.1495e-01j, -0.3015+3.3319e-01j, -0.5334+3.8510e-02j, 2025-12-04T10:08:29.1291773Z 0.2210+1.9992e-02j, 0.1421-3.0661e-01j], 2025-12-04T10:08:29.1291832Z [ 0.2046-8.5916e-02j, 0.1344+1.2888e-02j, -0.2789+2.8624e-01j, 2025-12-04T10:08:29.1291883Z 0.0256+1.0544e-01j, 0.0678-3.0551e-02j]]], 2025-12-04T10:08:29.1291885Z 2025-12-04T10:08:29.1291886Z 2025-12-04T10:08:29.1291946Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1291991Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1292051Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1292098Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1292188Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1292236Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1292295Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1292345Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1292404Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1292454Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1292456Z 2025-12-04T10:08:29.1292513Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1292560Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1292619Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1292666Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1292725Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1292772Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1292830Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1292877Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1292990Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1293053Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1293097Z dtype=torch.complex128) 2025-12-04T10:08:29.1293099Z 2025-12-04T10:08:29.1293134Z Expected: 2025-12-04T10:08:29.1293208Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1293245Z 0.3401-0.5673j], 2025-12-04T10:08:29.1293309Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1293346Z 0.2078-0.7444j], 2025-12-04T10:08:29.1293411Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1293448Z 0.4109+0.5305j], 2025-12-04T10:08:29.1293511Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1293547Z -0.3607+0.5386j], 2025-12-04T10:08:29.1293615Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1293654Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1293656Z 2025-12-04T10:08:29.1293720Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1293756Z 0.5323-0.4729j], 2025-12-04T10:08:29.1293819Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1293855Z -0.6732-0.7677j], 2025-12-04T10:08:29.1293916Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1293952Z -0.5241-0.5479j], 2025-12-04T10:08:29.1294015Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1294052Z -0.3257-0.6597j], 2025-12-04T10:08:29.1294114Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1294151Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1294181Z 2025-12-04T10:08:29.1294195Z 2025-12-04T10:08:29.1294260Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1294296Z -0.6637-0.1175j], 2025-12-04T10:08:29.1294359Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1294394Z 0.4261-0.3012j], 2025-12-04T10:08:29.1294458Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1294494Z 0.2567-0.1808j], 2025-12-04T10:08:29.1294558Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1294593Z 0.1761-1.6446j], 2025-12-04T10:08:29.1294671Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1294724Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1294726Z 2025-12-04T10:08:29.1294790Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1294830Z -0.6307+0.1756j], 2025-12-04T10:08:29.1294892Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1294929Z -0.9972-0.3518j], 2025-12-04T10:08:29.1294991Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1295026Z 0.6467+0.0201j], 2025-12-04T10:08:29.1295088Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1295124Z -1.0443-0.3699j], 2025-12-04T10:08:29.1295186Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1295254Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1295257Z 2025-12-04T10:08:29.1295561Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1295564Z 2025-12-04T10:08:29.1295639Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1295845Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1295848Z 2025-12-04T10:08:29.1295935Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1296027Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1296074Z Traceback (most recent call last): 2025-12-04T10:08:29.1296246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1296289Z return test(*args, **kwargs) 2025-12-04T10:08:29.1296325Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1296432Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1296498Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1296668Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1296792Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1296844Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1297007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1297063Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1297106Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1297273Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1297354Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1297398Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1297537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1297584Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1297624Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1297776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1297827Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1297992Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1298044Z raise GradcheckError( 2025-12-04T10:08:29.1298133Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1298136Z 2025-12-04T10:08:29.1298230Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1298311Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1298392Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1298394Z 2025-12-04T10:08:29.1298480Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1298582Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1298617Z If the test 2025-12-04T10:08:29.1298710Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1298775Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1298870Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1298952Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1298956Z 2025-12-04T10:08:29.1299046Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1299132Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1299168Z the following. 2025-12-04T10:08:29.1299170Z 2025-12-04T10:08:29.1299259Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1299348Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1299399Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1299461Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1299523Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1299526Z 2025-12-04T10:08:29.1299557Z Got: 2025-12-04T10:08:29.1299609Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299654Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299697Z nan+nanj], 2025-12-04T10:08:29.1299741Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299785Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299823Z nan+nanj], 2025-12-04T10:08:29.1299866Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299907Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1299945Z nan+nanj], 2025-12-04T10:08:29.1300002Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1300058Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1300097Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1300152Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1300205Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1300249Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1300251Z 2025-12-04T10:08:29.1300323Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1300376Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1300415Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1300465Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1300516Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1300555Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1300605Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1300655Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1300694Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1300757Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1300817Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1300856Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1300905Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1300957Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1300998Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1301000Z 2025-12-04T10:08:29.1301001Z 2025-12-04T10:08:29.1301052Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1301101Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1301140Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1301191Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1301240Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1301279Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1301330Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1301382Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1301420Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1301471Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1301521Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1301559Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1301607Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1301657Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1301698Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1301700Z 2025-12-04T10:08:29.1301750Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1301799Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1301839Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1301890Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1301941Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1301979Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1302030Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1302082Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1302120Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1302171Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1302220Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1302259Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1302311Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1302360Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1302412Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1302456Z dtype=torch.complex128) 2025-12-04T10:08:29.1302458Z 2025-12-04T10:08:29.1302495Z Expected: 2025-12-04T10:08:29.1302570Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1302609Z 0.3401-0.5673j], 2025-12-04T10:08:29.1302702Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1302743Z 0.2078-0.7444j], 2025-12-04T10:08:29.1302808Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1302844Z 0.4109+0.5305j], 2025-12-04T10:08:29.1302907Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1302977Z -0.3607+0.5386j], 2025-12-04T10:08:29.1303041Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1303079Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1303081Z 2025-12-04T10:08:29.1303158Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1303208Z 0.5323-0.4729j], 2025-12-04T10:08:29.1303270Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1303307Z -0.6732-0.7677j], 2025-12-04T10:08:29.1303372Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1303408Z -0.5241-0.5479j], 2025-12-04T10:08:29.1303471Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1303507Z -0.3257-0.6597j], 2025-12-04T10:08:29.1303569Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1303607Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1303610Z 2025-12-04T10:08:29.1303611Z 2025-12-04T10:08:29.1303674Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1303710Z -0.6637-0.1175j], 2025-12-04T10:08:29.1303776Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1303812Z 0.4261-0.3012j], 2025-12-04T10:08:29.1303876Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1303911Z 0.2567-0.1808j], 2025-12-04T10:08:29.1303976Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1304011Z 0.1761-1.6446j], 2025-12-04T10:08:29.1304074Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1304112Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1304114Z 2025-12-04T10:08:29.1304177Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1304213Z -0.6307+0.1756j], 2025-12-04T10:08:29.1304276Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1304311Z -0.9972-0.3518j], 2025-12-04T10:08:29.1304375Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1304410Z 0.6467+0.0201j], 2025-12-04T10:08:29.1304472Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1304508Z -1.0443-0.3699j], 2025-12-04T10:08:29.1304574Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1304639Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1304642Z 2025-12-04T10:08:29.1304723Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1304725Z 2025-12-04T10:08:29.1304771Z Traceback (most recent call last): 2025-12-04T10:08:29.1304928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1304969Z method(*args, **kwargs) 2025-12-04T10:08:29.1305147Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1305195Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1305233Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1305406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1305465Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1305504Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1305663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1305704Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1305741Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1305893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1305930Z fn(*args, **kwargs) 2025-12-04T10:08:29.1306111Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1306162Z raise e_tracked from e 2025-12-04T10:08:29.1306207Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1306211Z 2025-12-04T10:08:29.1306304Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1306387Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1306467Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1306470Z 2025-12-04T10:08:29.1306555Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1306658Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1306692Z If the test 2025-12-04T10:08:29.1306787Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1306851Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1306948Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1307028Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1307031Z 2025-12-04T10:08:29.1307123Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1307208Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1307244Z the following. 2025-12-04T10:08:29.1307246Z 2025-12-04T10:08:29.1307334Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1307425Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1307476Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1307539Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1307601Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1307603Z 2025-12-04T10:08:29.1307637Z Got: 2025-12-04T10:08:29.1307687Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1307733Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1307773Z nan+nanj], 2025-12-04T10:08:29.1307818Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1307862Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1307901Z nan+nanj], 2025-12-04T10:08:29.1307943Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1307985Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1308022Z nan+nanj], 2025-12-04T10:08:29.1308078Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1308131Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1308171Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1308223Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1308278Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1308320Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1308322Z 2025-12-04T10:08:29.1308383Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1308446Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1308486Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1308535Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1308585Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1308624Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1308675Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1308726Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1308766Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1308827Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1308887Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1308927Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1308975Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1309028Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1309069Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1309071Z 2025-12-04T10:08:29.1309073Z 2025-12-04T10:08:29.1309124Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1309175Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1309215Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1309267Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1309320Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1309358Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1309410Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1309462Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1309501Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1309551Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1309602Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1309640Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1309690Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1309740Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1309782Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1309784Z 2025-12-04T10:08:29.1309834Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1309884Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1309922Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1309974Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1310024Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1310063Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1310113Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1310167Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1310204Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1310255Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1310303Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1310342Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1310391Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1310442Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1310494Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1310538Z dtype=torch.complex128) 2025-12-04T10:08:29.1310542Z 2025-12-04T10:08:29.1310576Z Expected: 2025-12-04T10:08:29.1310654Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1310691Z 0.3401-0.5673j], 2025-12-04T10:08:29.1310770Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1310831Z 0.2078-0.7444j], 2025-12-04T10:08:29.1310896Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1310932Z 0.4109+0.5305j], 2025-12-04T10:08:29.1310996Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1311034Z -0.3607+0.5386j], 2025-12-04T10:08:29.1311098Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1311136Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1311139Z 2025-12-04T10:08:29.1311214Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1311263Z 0.5323-0.4729j], 2025-12-04T10:08:29.1311326Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1311364Z -0.6732-0.7677j], 2025-12-04T10:08:29.1311426Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1311466Z -0.5241-0.5479j], 2025-12-04T10:08:29.1311528Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1311565Z -0.3257-0.6597j], 2025-12-04T10:08:29.1311627Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1311665Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1311667Z 2025-12-04T10:08:29.1311669Z 2025-12-04T10:08:29.1311730Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1311766Z -0.6637-0.1175j], 2025-12-04T10:08:29.1311829Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1311867Z 0.4261-0.3012j], 2025-12-04T10:08:29.1311929Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1311969Z 0.2567-0.1808j], 2025-12-04T10:08:29.1312033Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1312068Z 0.1761-1.6446j], 2025-12-04T10:08:29.1312130Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1312169Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1312171Z 2025-12-04T10:08:29.1312232Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1312271Z -0.6307+0.1756j], 2025-12-04T10:08:29.1312334Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1312372Z -0.9972-0.3518j], 2025-12-04T10:08:29.1312436Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1312474Z 0.6467+0.0201j], 2025-12-04T10:08:29.1312539Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1312576Z -1.0443-0.3699j], 2025-12-04T10:08:29.1312640Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1312708Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1312709Z 2025-12-04T10:08:29.1313052Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1313054Z 2025-12-04T10:08:29.1313129Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1313337Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1313340Z 2025-12-04T10:08:29.1313426Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1313543Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1313606Z Traceback (most recent call last): 2025-12-04T10:08:29.1313779Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1313821Z return test(*args, **kwargs) 2025-12-04T10:08:29.1313860Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1313964Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1314030Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1314216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1314352Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1314404Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1314569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1314627Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1314669Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1314825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1314892Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1314939Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1315079Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1315125Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1315163Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1315316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1315367Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1315521Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1315563Z raise GradcheckError( 2025-12-04T10:08:29.1315653Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1315655Z 2025-12-04T10:08:29.1315748Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1315830Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1315910Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1315913Z 2025-12-04T10:08:29.1315998Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1316100Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1316137Z If the test 2025-12-04T10:08:29.1316232Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1316297Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1316392Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1316476Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1316478Z 2025-12-04T10:08:29.1316569Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1316653Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1316691Z the following. 2025-12-04T10:08:29.1316694Z 2025-12-04T10:08:29.1316784Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1316875Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1316951Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1317017Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1317078Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1317080Z 2025-12-04T10:08:29.1317113Z Got: 2025-12-04T10:08:29.1317175Z tensor([[[[-3.8784e+01-4.3703e+01j, -1.2755e+02+2.7931e+01j, 2025-12-04T10:08:29.1317229Z 1.2988e+02-2.4578e+01j, 1.3154e+01-5.0382e+01j, 2025-12-04T10:08:29.1317269Z -5.2772e+00+1.4070e+01j], 2025-12-04T10:08:29.1317322Z [ 1.5611e+01-1.4438e+01j, 1.1850e+00-9.3043e+00j, 2025-12-04T10:08:29.1317372Z 4.7216e+00+3.2779e+00j, 8.0461e+00+1.8300e+01j, 2025-12-04T10:08:29.1317426Z -4.2700e+00-1.5494e+01j], 2025-12-04T10:08:29.1317487Z [-2.3610e+01+6.0120e+00j, -4.8936e+00+5.2923e+00j, 2025-12-04T10:08:29.1317539Z -1.0649e+01-3.9485e+00j, 1.6111e+00-1.8797e+01j, 2025-12-04T10:08:29.1317577Z 9.2718e+00+5.5048e+00j], 2025-12-04T10:08:29.1317628Z [ 2.7147e+01+2.2377e+01j, 5.5576e+01-1.2430e+00j, 2025-12-04T10:08:29.1317678Z -3.1506e+01+1.4050e+01j, -9.0041e+00+2.5841e+01j, 2025-12-04T10:08:29.1317718Z -4.6332e+00-1.2998e+00j], 2025-12-04T10:08:29.1317767Z [-2.6703e+01-2.4088e+01j, -6.9110e+01+5.4290e+00j, 2025-12-04T10:08:29.1317818Z 4.8713e+01-1.7231e+01j, 9.7890e+00-3.7251e+01j, 2025-12-04T10:08:29.1317858Z 3.9395e+00+4.8082e+00j]], 2025-12-04T10:08:29.1317860Z 2025-12-04T10:08:29.1317912Z [[ 2.8142e+02-2.3259e+02j, 3.1869e+02-2.0779e+02j, 2025-12-04T10:08:29.1317962Z -1.4454e+02-1.5237e+01j, -3.2275e+02+1.5163e+02j, 2025-12-04T10:08:29.1318003Z 4.3416e+01-1.3512e+00j], 2025-12-04T10:08:29.1318053Z [-3.0455e+03+2.3761e+03j, -3.2312e+03+2.1228e+03j, 2025-12-04T10:08:29.1319912Z 1.6578e+03+3.1713e+00j, 3.3541e+03-1.6316e+03j, 2025-12-04T10:08:29.1319953Z -4.2058e+02+1.9751e+01j], 2025-12-04T10:08:29.1320008Z [ 2.1673e+01-8.2674e+00j, 1.1414e+01-1.6387e+01j, 2025-12-04T10:08:29.1320057Z 8.7072e+00-4.1742e+00j, -2.3038e+01+7.1607e+00j, 2025-12-04T10:08:29.1320097Z -3.7922e+00-5.0427e+00j], 2025-12-04T10:08:29.1320147Z [-2.6068e+01-1.1216e+01j, -7.5027e+00-4.9602e+00j, 2025-12-04T10:08:29.1320196Z 3.9834e+01+5.7592e+00j, 7.8271e+00-1.2708e+01j, 2025-12-04T10:08:29.1320235Z -1.0269e+01-6.7246e+00j], 2025-12-04T10:08:29.1320284Z [ 3.3309e+01+1.1031e+01j, 1.4523e+01+1.5508e+01j, 2025-12-04T10:08:29.1320335Z -6.3225e+01+4.9375e+00j, -7.8893e+00+1.5323e+01j, 2025-12-04T10:08:29.1320376Z 1.1316e+01+3.3800e+00j]]], 2025-12-04T10:08:29.1320383Z 2025-12-04T10:08:29.1320385Z 2025-12-04T10:08:29.1320436Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1320486Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1320526Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1320578Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1320629Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1320667Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1320718Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1320768Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1320806Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1320856Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1320906Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1320947Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1320998Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1321047Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1321089Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1321108Z 2025-12-04T10:08:29.1321170Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1321221Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1321260Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1321311Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1321360Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1321399Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1321448Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1321498Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1321536Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1321610Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1321659Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1321698Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1321752Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1321802Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1321854Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1321898Z dtype=torch.complex128) 2025-12-04T10:08:29.1321900Z 2025-12-04T10:08:29.1321934Z Expected: 2025-12-04T10:08:29.1322011Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1322050Z 0.3406-0.5682j], 2025-12-04T10:08:29.1322116Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1322152Z 0.2069-0.7450j], 2025-12-04T10:08:29.1322219Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1322256Z 0.4118+0.5311j], 2025-12-04T10:08:29.1322319Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1322356Z -0.3628+0.5383j], 2025-12-04T10:08:29.1322421Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1322460Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1322462Z 2025-12-04T10:08:29.1322525Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1322560Z 0.5325-0.4733j], 2025-12-04T10:08:29.1322623Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1322660Z -0.6729-0.7686j], 2025-12-04T10:08:29.1322722Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1322758Z -0.5258-0.5473j], 2025-12-04T10:08:29.1322821Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1322860Z -0.3244-0.6603j], 2025-12-04T10:08:29.1322922Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1322999Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1323003Z 2025-12-04T10:08:29.1323004Z 2025-12-04T10:08:29.1323066Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1323103Z -0.6623-0.1171j], 2025-12-04T10:08:29.1323165Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1323202Z 0.4266-0.2997j], 2025-12-04T10:08:29.1323265Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1323302Z 0.2556-0.1819j], 2025-12-04T10:08:29.1323366Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1323403Z 0.1768-1.6449j], 2025-12-04T10:08:29.1323468Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1323508Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1323510Z 2025-12-04T10:08:29.1323571Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1323644Z -0.6312+0.1775j], 2025-12-04T10:08:29.1323707Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1323744Z -0.9967-0.3519j], 2025-12-04T10:08:29.1323805Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1323841Z 0.6457+0.0238j], 2025-12-04T10:08:29.1323903Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1323939Z -1.0432-0.3734j], 2025-12-04T10:08:29.1324001Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1324083Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1324107Z 2025-12-04T10:08:29.1324189Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1324191Z 2025-12-04T10:08:29.1324237Z Traceback (most recent call last): 2025-12-04T10:08:29.1324399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1324441Z method(*args, **kwargs) 2025-12-04T10:08:29.1324620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1324666Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1324705Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1324867Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1324911Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1324949Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1325108Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1325149Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1325188Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1325341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1325379Z fn(*args, **kwargs) 2025-12-04T10:08:29.1325547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1325588Z raise e_tracked from e 2025-12-04T10:08:29.1325632Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1325634Z 2025-12-04T10:08:29.1325728Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1325810Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1325891Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1325893Z 2025-12-04T10:08:29.1325977Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1326082Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1326117Z If the test 2025-12-04T10:08:29.1326211Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1326273Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1326369Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1326450Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1326452Z 2025-12-04T10:08:29.1326543Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1326630Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1326667Z the following. 2025-12-04T10:08:29.1326669Z 2025-12-04T10:08:29.1326758Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1326877Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1326931Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1326994Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1327055Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1327057Z 2025-12-04T10:08:29.1327089Z Got: 2025-12-04T10:08:29.1327152Z tensor([[[[-3.8784e+01-4.3703e+01j, -1.2755e+02+2.7931e+01j, 2025-12-04T10:08:29.1327205Z 1.2988e+02-2.4578e+01j, 1.3154e+01-5.0382e+01j, 2025-12-04T10:08:29.1327245Z -5.2772e+00+1.4070e+01j], 2025-12-04T10:08:29.1327297Z [ 1.5611e+01-1.4438e+01j, 1.1850e+00-9.3043e+00j, 2025-12-04T10:08:29.1327358Z 4.7216e+00+3.2779e+00j, 8.0461e+00+1.8300e+01j, 2025-12-04T10:08:29.1327409Z -4.2700e+00-1.5494e+01j], 2025-12-04T10:08:29.1327461Z [-2.3610e+01+6.0120e+00j, -4.8936e+00+5.2923e+00j, 2025-12-04T10:08:29.1327512Z -1.0649e+01-3.9485e+00j, 1.6111e+00-1.8797e+01j, 2025-12-04T10:08:29.1327552Z 9.2718e+00+5.5048e+00j], 2025-12-04T10:08:29.1327601Z [ 2.7147e+01+2.2377e+01j, 5.5576e+01-1.2430e+00j, 2025-12-04T10:08:29.1327651Z -3.1506e+01+1.4050e+01j, -9.0041e+00+2.5841e+01j, 2025-12-04T10:08:29.1327690Z -4.6332e+00-1.2998e+00j], 2025-12-04T10:08:29.1327740Z [-2.6703e+01-2.4088e+01j, -6.9110e+01+5.4290e+00j, 2025-12-04T10:08:29.1327789Z 4.8713e+01-1.7231e+01j, 9.7890e+00-3.7251e+01j, 2025-12-04T10:08:29.1327830Z 3.9395e+00+4.8082e+00j]], 2025-12-04T10:08:29.1327832Z 2025-12-04T10:08:29.1327880Z [[ 2.8142e+02-2.3259e+02j, 3.1869e+02-2.0779e+02j, 2025-12-04T10:08:29.1327933Z -1.4454e+02-1.5237e+01j, -3.2275e+02+1.5163e+02j, 2025-12-04T10:08:29.1327971Z 4.3416e+01-1.3512e+00j], 2025-12-04T10:08:29.1328021Z [-3.0455e+03+2.3761e+03j, -3.2312e+03+2.1228e+03j, 2025-12-04T10:08:29.1328068Z 1.6578e+03+3.1713e+00j, 3.3541e+03-1.6316e+03j, 2025-12-04T10:08:29.1328110Z -4.2058e+02+1.9751e+01j], 2025-12-04T10:08:29.1328158Z [ 2.1673e+01-8.2674e+00j, 1.1414e+01-1.6387e+01j, 2025-12-04T10:08:29.1328208Z 8.7072e+00-4.1742e+00j, -2.3038e+01+7.1607e+00j, 2025-12-04T10:08:29.1328247Z -3.7922e+00-5.0427e+00j], 2025-12-04T10:08:29.1328297Z [-2.6068e+01-1.1216e+01j, -7.5027e+00-4.9602e+00j, 2025-12-04T10:08:29.1328345Z 3.9834e+01+5.7592e+00j, 7.8271e+00-1.2708e+01j, 2025-12-04T10:08:29.1328385Z -1.0269e+01-6.7246e+00j], 2025-12-04T10:08:29.1328433Z [ 3.3309e+01+1.1031e+01j, 1.4523e+01+1.5508e+01j, 2025-12-04T10:08:29.1328484Z -6.3225e+01+4.9375e+00j, -7.8893e+00+1.5323e+01j, 2025-12-04T10:08:29.1328525Z 1.1316e+01+3.3800e+00j]]], 2025-12-04T10:08:29.1328527Z 2025-12-04T10:08:29.1328530Z 2025-12-04T10:08:29.1328580Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1328631Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1328670Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1328721Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1328771Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1328809Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1328859Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1328912Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1328949Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1328999Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1329050Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1329089Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1329137Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1329187Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1329250Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1329253Z 2025-12-04T10:08:29.1329304Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1329353Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1329393Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1329444Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1329493Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1329532Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1329583Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1329643Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1329691Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1329741Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1329790Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1329831Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1329881Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1329931Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1329983Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1330026Z dtype=torch.complex128) 2025-12-04T10:08:29.1330028Z 2025-12-04T10:08:29.1330062Z Expected: 2025-12-04T10:08:29.1330137Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1330176Z 0.3406-0.5682j], 2025-12-04T10:08:29.1330239Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1330278Z 0.2069-0.7450j], 2025-12-04T10:08:29.1330343Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1330380Z 0.4118+0.5311j], 2025-12-04T10:08:29.1330442Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1330481Z -0.3628+0.5383j], 2025-12-04T10:08:29.1330544Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1330585Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1330588Z 2025-12-04T10:08:29.1330650Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1330686Z 0.5325-0.4733j], 2025-12-04T10:08:29.1330749Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1330786Z -0.6729-0.7686j], 2025-12-04T10:08:29.1330848Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1330887Z -0.5258-0.5473j], 2025-12-04T10:08:29.1330949Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1330986Z -0.3244-0.6603j], 2025-12-04T10:08:29.1331048Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1331088Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1331090Z 2025-12-04T10:08:29.1331091Z 2025-12-04T10:08:29.1331155Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1331192Z -0.6623-0.1171j], 2025-12-04T10:08:29.1331255Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1331290Z 0.4266-0.2997j], 2025-12-04T10:08:29.1331354Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1331390Z 0.2556-0.1819j], 2025-12-04T10:08:29.1331453Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1331489Z 0.1768-1.6449j], 2025-12-04T10:08:29.1331552Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1331591Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1331608Z 2025-12-04T10:08:29.1331681Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1331718Z -0.6312+0.1775j], 2025-12-04T10:08:29.1331781Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1331816Z -0.9967-0.3519j], 2025-12-04T10:08:29.1331879Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1331915Z 0.6457+0.0238j], 2025-12-04T10:08:29.1331977Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1332013Z -1.0432-0.3734j], 2025-12-04T10:08:29.1332092Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1332170Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1332172Z 2025-12-04T10:08:29.1332472Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1332475Z 2025-12-04T10:08:29.1332550Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1332754Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1332757Z 2025-12-04T10:08:29.1332844Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1332975Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1333024Z Traceback (most recent call last): 2025-12-04T10:08:29.1333199Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1333242Z return test(*args, **kwargs) 2025-12-04T10:08:29.1333280Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1333386Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1333450Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1333620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1333742Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1333795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1333958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1334017Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1334059Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1334216Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1334283Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1334329Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1334470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1334515Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1334553Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1334705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1334758Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1334912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1334953Z raise GradcheckError( 2025-12-04T10:08:29.1335078Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1335081Z 2025-12-04T10:08:29.1335176Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1335256Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1335337Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1335339Z 2025-12-04T10:08:29.1335423Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1335527Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1335562Z If the test 2025-12-04T10:08:29.1335676Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1335752Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1335847Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1335931Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1335933Z 2025-12-04T10:08:29.1336023Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1336109Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1336146Z the following. 2025-12-04T10:08:29.1336148Z 2025-12-04T10:08:29.1336237Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1336327Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1336378Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1336443Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1336505Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1336507Z 2025-12-04T10:08:29.1336539Z Got: 2025-12-04T10:08:29.1336602Z tensor([[[[-7.5011e-01+7.9726e-02j, 4.1661e-01+1.4770e+00j, 2025-12-04T10:08:29.1336656Z 1.5250e+00+5.0409e-01j, 1.3125e+00-5.3362e-01j, 2025-12-04T10:08:29.1336697Z 4.5431e-01-7.5771e-01j], 2025-12-04T10:08:29.1336749Z [ 2.4769e-01-5.4787e-02j, 1.0208e-01+4.2423e-02j, 2025-12-04T10:08:29.1336801Z 1.9503e-01+5.9522e-02j, 3.0470e-01-1.8443e-01j, 2025-12-04T10:08:29.1336839Z 7.5363e-02-2.7012e-01j], 2025-12-04T10:08:29.1336891Z [ 3.2563e-01-6.1781e-02j, 3.3314e-01-1.6612e-01j, 2025-12-04T10:08:29.1336942Z -1.9273e-01+1.2022e-01j, -3.5932e-02+5.0528e-01j, 2025-12-04T10:08:29.1336982Z -1.1919e-01-1.5403e-01j], 2025-12-04T10:08:29.1337033Z [-1.7381e-01-1.0136e-01j, -6.6712e-02-7.5859e-02j, 2025-12-04T10:08:29.1337085Z -1.5261e-01-2.1954e-02j, 3.8784e-02+7.0886e-02j, 2025-12-04T10:08:29.1337123Z 4.1758e-02-6.2216e-02j], 2025-12-04T10:08:29.1337174Z [-2.5580e-01-2.3046e-01j, -6.6189e-01+5.1646e-02j, 2025-12-04T10:08:29.1337225Z 4.6751e-01-1.6405e-01j, 9.4475e-02-3.5775e-01j, 2025-12-04T10:08:29.1337266Z 3.7398e-02+4.5822e-02j]], 2025-12-04T10:08:29.1337268Z 2025-12-04T10:08:29.1337318Z [[ 1.4246e+00-1.5105e+00j, -3.1159e+00-2.3543e+00j, 2025-12-04T10:08:29.1337368Z 1.5514e+00+4.8875e+00j, -9.1034e-01+4.8238e-01j, 2025-12-04T10:08:29.1337406Z -1.5778e+00+1.4596e+00j], 2025-12-04T10:08:29.1337455Z [ 1.5992e-01+1.9116e-01j, -1.3893e-01+7.0489e-02j, 2025-12-04T10:08:29.1337504Z 1.0628e-01+6.7161e-03j, -2.9284e-02-2.5291e-02j, 2025-12-04T10:08:29.1337543Z -1.1238e-01-1.2833e-01j], 2025-12-04T10:08:29.1337594Z [-1.8926e+01+4.0012e+01j, -1.5112e+01+4.6534e+01j, 2025-12-04T10:08:29.1337646Z -6.0961e+01+8.5739e+00j, 4.7501e+01-1.2235e+01j, 2025-12-04T10:08:29.1337684Z 2.6221e+01+1.8958e+01j], 2025-12-04T10:08:29.1337733Z [ 5.9566e-02+9.5667e-02j, -8.9025e-02-1.8668e-01j, 2025-12-04T10:08:29.1337810Z 1.7547e-01-2.7680e-01j, -6.2695e-02+4.8940e-02j, 2025-12-04T10:08:29.1337850Z 6.3067e-02+1.2735e-01j], 2025-12-04T10:08:29.1337899Z [ 4.3970e-01+1.4849e-01j, 1.9197e-01+2.0574e-01j, 2025-12-04T10:08:29.1337951Z -8.3511e-01+6.1209e-02j, -1.0595e-01+2.0204e-01j, 2025-12-04T10:08:29.1337991Z 1.4976e-01+4.6547e-02j]]], 2025-12-04T10:08:29.1337993Z 2025-12-04T10:08:29.1337994Z 2025-12-04T10:08:29.1338046Z [[[-1.9247e-01-5.9898e-01j, -2.0373e-01-4.1895e-01j, 2025-12-04T10:08:29.1338094Z 6.1013e-01+2.7049e-01j, 1.4377e+00-8.3280e-01j, 2025-12-04T10:08:29.1338134Z -6.6499e-01-1.1766e-01j], 2025-12-04T10:08:29.1338195Z [-6.6132e-01-5.8401e-01j, -2.4468e-01+9.6209e-01j, 2025-12-04T10:08:29.1338257Z -2.4876e-01+5.0988e-01j, 1.1762e-01-8.9780e-01j, 2025-12-04T10:08:29.1338295Z 4.2619e-01-3.0161e-01j], 2025-12-04T10:08:29.1338345Z [-1.3795e-01+2.8517e-01j, -1.9518e-01-1.4548e+00j, 2025-12-04T10:08:29.1338400Z -5.7144e-01-4.1533e-01j, -4.0360e-02+3.6991e-01j, 2025-12-04T10:08:29.1338440Z 2.5680e-01-1.8153e-01j], 2025-12-04T10:08:29.1338490Z [ 3.2443e-01-1.1166e-01j, -4.2329e-01-1.0968e+00j, 2025-12-04T10:08:29.1338539Z 1.2292e+00+9.1030e-01j, -6.1282e-01-2.3221e-01j, 2025-12-04T10:08:29.1338578Z 1.7643e-01-1.6447e+00j], 2025-12-04T10:08:29.1338627Z [ 1.0216e+00+7.6797e-01j, 3.1799e-01-3.5585e-01j, 2025-12-04T10:08:29.1338678Z 3.1383e-01+5.4475e-01j, -8.2130e-01-1.6836e-01j, 2025-12-04T10:08:29.1338718Z -5.9919e-01-8.6910e-01j]], 2025-12-04T10:08:29.1338720Z 2025-12-04T10:08:29.1338772Z [[ 1.0555e+00-7.3195e-01j, 4.5944e-01+5.2560e-01j, 2025-12-04T10:08:29.1338823Z 1.1356e+00-7.5032e-01j, -7.3399e-01+2.0055e+00j, 2025-12-04T10:08:29.1338863Z -6.3011e-01+1.7524e-01j], 2025-12-04T10:08:29.1338912Z [-1.0192e+00-6.3369e-01j, -1.4472e-01-9.0334e-01j, 2025-12-04T10:08:29.1338964Z 8.3985e-01+5.4672e-01j, -4.2470e-01+8.0460e-03j, 2025-12-04T10:08:29.1339003Z -9.9820e-01-3.5334e-01j], 2025-12-04T10:08:29.1339053Z [ 3.3154e-01-4.2917e-01j, -8.8055e-01-2.5479e-02j, 2025-12-04T10:08:29.1339102Z 1.0429e-01-7.5315e-01j, 2.9962e-01+3.6077e-01j, 2025-12-04T10:08:29.1339141Z 6.4636e-01+2.2084e-02j], 2025-12-04T10:08:29.1339191Z [-1.7452e-02-3.8796e-01j, 8.2227e-01-6.5336e-01j, 2025-12-04T10:08:29.1339240Z 7.4086e-01+1.2470e+00j, 3.3632e-01+7.9639e-01j, 2025-12-04T10:08:29.1339278Z -1.0463e+00-3.7173e-01j], 2025-12-04T10:08:29.1339328Z [-5.6360e-01+1.4406e-01j, -1.8765e-01-1.5054e+00j, 2025-12-04T10:08:29.1339379Z -7.4607e-01+3.7677e-01j, 1.2337e+00-2.0909e-01j, 2025-12-04T10:08:29.1339431Z 1.0935e+00+4.7941e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1339474Z dtype=torch.complex128) 2025-12-04T10:08:29.1339476Z 2025-12-04T10:08:29.1339514Z Expected: 2025-12-04T10:08:29.1339590Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1339630Z 0.3399-0.5672j], 2025-12-04T10:08:29.1339694Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1339732Z 0.2071-0.7425j], 2025-12-04T10:08:29.1339795Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1339834Z 0.4110+0.5304j], 2025-12-04T10:08:29.1339896Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1339934Z -0.3610+0.5378j], 2025-12-04T10:08:29.1339997Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1340037Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1340039Z 2025-12-04T10:08:29.1340100Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.1340138Z 0.5342-0.4740j], 2025-12-04T10:08:29.1340232Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.1340271Z -0.6736-0.7699j], 2025-12-04T10:08:29.1340333Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.1340369Z -0.5256-0.5484j], 2025-12-04T10:08:29.1340431Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.1340467Z -0.3277-0.6605j], 2025-12-04T10:08:29.1340531Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.1340569Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.1340571Z 2025-12-04T10:08:29.1340573Z 2025-12-04T10:08:29.1340665Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1340701Z -0.6650-0.1177j], 2025-12-04T10:08:29.1340765Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1340802Z 0.4262-0.3016j], 2025-12-04T10:08:29.1340868Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1340904Z 0.2568-0.1815j], 2025-12-04T10:08:29.1340967Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1341002Z 0.1764-1.6447j], 2025-12-04T10:08:29.1341065Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1341103Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1341105Z 2025-12-04T10:08:29.1341168Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1341204Z -0.6301+0.1752j], 2025-12-04T10:08:29.1341274Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1341312Z -0.9982-0.3533j], 2025-12-04T10:08:29.1341374Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1341411Z 0.6464+0.0221j], 2025-12-04T10:08:29.1341473Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1341509Z -1.0463-0.3717j], 2025-12-04T10:08:29.1341572Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1341637Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1341639Z 2025-12-04T10:08:29.1341722Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1341724Z 2025-12-04T10:08:29.1341769Z Traceback (most recent call last): 2025-12-04T10:08:29.1341927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1341968Z method(*args, **kwargs) 2025-12-04T10:08:29.1342145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1342195Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1342234Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1342395Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1342439Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1342480Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1342639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1342681Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1342717Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1342873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1342911Z fn(*args, **kwargs) 2025-12-04T10:08:29.1343148Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1343206Z raise e_tracked from e 2025-12-04T10:08:29.1343251Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1343253Z 2025-12-04T10:08:29.1343346Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1343429Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1343510Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1343512Z 2025-12-04T10:08:29.1343596Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1343715Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1343767Z If the test 2025-12-04T10:08:29.1343861Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1343925Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1344025Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1344107Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1344109Z 2025-12-04T10:08:29.1344200Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1344285Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1344321Z the following. 2025-12-04T10:08:29.1344323Z 2025-12-04T10:08:29.1344412Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1344501Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1344557Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1344621Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1344682Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1344684Z 2025-12-04T10:08:29.1344718Z Got: 2025-12-04T10:08:29.1344781Z tensor([[[[-7.5011e-01+7.9726e-02j, 4.1661e-01+1.4770e+00j, 2025-12-04T10:08:29.1344833Z 1.5250e+00+5.0409e-01j, 1.3125e+00-5.3362e-01j, 2025-12-04T10:08:29.1344872Z 4.5431e-01-7.5771e-01j], 2025-12-04T10:08:29.1344924Z [ 2.4769e-01-5.4787e-02j, 1.0208e-01+4.2423e-02j, 2025-12-04T10:08:29.1344975Z 1.9503e-01+5.9522e-02j, 3.0470e-01-1.8443e-01j, 2025-12-04T10:08:29.1345014Z 7.5363e-02-2.7012e-01j], 2025-12-04T10:08:29.1345064Z [ 3.2563e-01-6.1781e-02j, 3.3314e-01-1.6612e-01j, 2025-12-04T10:08:29.1345115Z -1.9273e-01+1.2022e-01j, -3.5932e-02+5.0528e-01j, 2025-12-04T10:08:29.1345155Z -1.1919e-01-1.5403e-01j], 2025-12-04T10:08:29.1345207Z [-1.7381e-01-1.0136e-01j, -6.6712e-02-7.5859e-02j, 2025-12-04T10:08:29.1345257Z -1.5261e-01-2.1954e-02j, 3.8784e-02+7.0886e-02j, 2025-12-04T10:08:29.1345296Z 4.1758e-02-6.2216e-02j], 2025-12-04T10:08:29.1345349Z [-2.5580e-01-2.3046e-01j, -6.6189e-01+5.1646e-02j, 2025-12-04T10:08:29.1345399Z 4.6751e-01-1.6405e-01j, 9.4475e-02-3.5775e-01j, 2025-12-04T10:08:29.1345439Z 3.7398e-02+4.5822e-02j]], 2025-12-04T10:08:29.1345441Z 2025-12-04T10:08:29.1345491Z [[ 1.4246e+00-1.5105e+00j, -3.1159e+00-2.3543e+00j, 2025-12-04T10:08:29.1345540Z 1.5514e+00+4.8875e+00j, -9.1034e-01+4.8238e-01j, 2025-12-04T10:08:29.1345579Z -1.5778e+00+1.4596e+00j], 2025-12-04T10:08:29.1345628Z [ 1.5992e-01+1.9116e-01j, -1.3893e-01+7.0489e-02j, 2025-12-04T10:08:29.1345677Z 1.0628e-01+6.7161e-03j, -2.9284e-02-2.5291e-02j, 2025-12-04T10:08:29.1345715Z -1.1238e-01-1.2833e-01j], 2025-12-04T10:08:29.1345766Z [-1.8926e+01+4.0012e+01j, -1.5112e+01+4.6534e+01j, 2025-12-04T10:08:29.1345816Z -6.0961e+01+8.5739e+00j, 4.7501e+01-1.2235e+01j, 2025-12-04T10:08:29.1345854Z 2.6221e+01+1.8958e+01j], 2025-12-04T10:08:29.1345937Z [ 5.9566e-02+9.5667e-02j, -8.9025e-02-1.8668e-01j, 2025-12-04T10:08:29.1345989Z 1.7547e-01-2.7680e-01j, -6.2695e-02+4.8940e-02j, 2025-12-04T10:08:29.1346028Z 6.3067e-02+1.2735e-01j], 2025-12-04T10:08:29.1346080Z [ 4.3970e-01+1.4849e-01j, 1.9197e-01+2.0574e-01j, 2025-12-04T10:08:29.1346129Z -8.3511e-01+6.1209e-02j, -1.0595e-01+2.0204e-01j, 2025-12-04T10:08:29.1346170Z 1.4976e-01+4.6547e-02j]]], 2025-12-04T10:08:29.1346172Z 2025-12-04T10:08:29.1346174Z 2025-12-04T10:08:29.1346224Z [[[-1.9247e-01-5.9898e-01j, -2.0373e-01-4.1895e-01j, 2025-12-04T10:08:29.1346274Z 6.1013e-01+2.7049e-01j, 1.4377e+00-8.3280e-01j, 2025-12-04T10:08:29.1346327Z -6.6499e-01-1.1766e-01j], 2025-12-04T10:08:29.1346389Z [-6.6132e-01-5.8401e-01j, -2.4468e-01+9.6209e-01j, 2025-12-04T10:08:29.1346438Z -2.4876e-01+5.0988e-01j, 1.1762e-01-8.9780e-01j, 2025-12-04T10:08:29.1346477Z 4.2619e-01-3.0161e-01j], 2025-12-04T10:08:29.1346528Z [-1.3795e-01+2.8517e-01j, -1.9518e-01-1.4548e+00j, 2025-12-04T10:08:29.1346579Z -5.7144e-01-4.1533e-01j, -4.0360e-02+3.6991e-01j, 2025-12-04T10:08:29.1346618Z 2.5680e-01-1.8153e-01j], 2025-12-04T10:08:29.1346671Z [ 3.2443e-01-1.1166e-01j, -4.2329e-01-1.0968e+00j, 2025-12-04T10:08:29.1346723Z 1.2292e+00+9.1030e-01j, -6.1282e-01-2.3221e-01j, 2025-12-04T10:08:29.1346762Z 1.7643e-01-1.6447e+00j], 2025-12-04T10:08:29.1346813Z [ 1.0216e+00+7.6797e-01j, 3.1799e-01-3.5585e-01j, 2025-12-04T10:08:29.1346863Z 3.1383e-01+5.4475e-01j, -8.2130e-01-1.6836e-01j, 2025-12-04T10:08:29.1346904Z -5.9919e-01-8.6910e-01j]], 2025-12-04T10:08:29.1346909Z 2025-12-04T10:08:29.1346958Z [[ 1.0555e+00-7.3195e-01j, 4.5944e-01+5.2560e-01j, 2025-12-04T10:08:29.1347008Z 1.1356e+00-7.5032e-01j, -7.3399e-01+2.0055e+00j, 2025-12-04T10:08:29.1347046Z -6.3011e-01+1.7524e-01j], 2025-12-04T10:08:29.1347099Z [-1.0192e+00-6.3369e-01j, -1.4472e-01-9.0334e-01j, 2025-12-04T10:08:29.1347147Z 8.3985e-01+5.4672e-01j, -4.2470e-01+8.0460e-03j, 2025-12-04T10:08:29.1347189Z -9.9820e-01-3.5334e-01j], 2025-12-04T10:08:29.1347239Z [ 3.3154e-01-4.2917e-01j, -8.8055e-01-2.5479e-02j, 2025-12-04T10:08:29.1347289Z 1.0429e-01-7.5315e-01j, 2.9962e-01+3.6077e-01j, 2025-12-04T10:08:29.1347327Z 6.4636e-01+2.2084e-02j], 2025-12-04T10:08:29.1347377Z [-1.7452e-02-3.8796e-01j, 8.2227e-01-6.5336e-01j, 2025-12-04T10:08:29.1347425Z 7.4086e-01+1.2470e+00j, 3.3632e-01+7.9639e-01j, 2025-12-04T10:08:29.1347466Z -1.0463e+00-3.7173e-01j], 2025-12-04T10:08:29.1347517Z [-5.6360e-01+1.4406e-01j, -1.8765e-01-1.5054e+00j, 2025-12-04T10:08:29.1347569Z -7.4607e-01+3.7677e-01j, 1.2337e+00-2.0909e-01j, 2025-12-04T10:08:29.1347621Z 1.0935e+00+4.7941e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1347667Z dtype=torch.complex128) 2025-12-04T10:08:29.1347672Z 2025-12-04T10:08:29.1347706Z Expected: 2025-12-04T10:08:29.1347782Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1347819Z 0.3399-0.5672j], 2025-12-04T10:08:29.1347884Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1347922Z 0.2071-0.7425j], 2025-12-04T10:08:29.1347989Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1348024Z 0.4110+0.5304j], 2025-12-04T10:08:29.1348088Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1348126Z -0.3610+0.5378j], 2025-12-04T10:08:29.1348191Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1348230Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1348232Z 2025-12-04T10:08:29.1348295Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.1348357Z 0.5342-0.4740j], 2025-12-04T10:08:29.1348423Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.1348459Z -0.6736-0.7699j], 2025-12-04T10:08:29.1348522Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.1348557Z -0.5256-0.5484j], 2025-12-04T10:08:29.1348620Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.1348656Z -0.3277-0.6605j], 2025-12-04T10:08:29.1348719Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.1348767Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.1348791Z 2025-12-04T10:08:29.1348794Z 2025-12-04T10:08:29.1348856Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1348894Z -0.6650-0.1177j], 2025-12-04T10:08:29.1348959Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1348996Z 0.4262-0.3016j], 2025-12-04T10:08:29.1349059Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1349094Z 0.2568-0.1815j], 2025-12-04T10:08:29.1349157Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1349193Z 0.1764-1.6447j], 2025-12-04T10:08:29.1349254Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1349293Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1349295Z 2025-12-04T10:08:29.1349357Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1349396Z -0.6301+0.1752j], 2025-12-04T10:08:29.1349459Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1349495Z -0.9982-0.3533j], 2025-12-04T10:08:29.1349558Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1349595Z 0.6464+0.0221j], 2025-12-04T10:08:29.1349657Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1349693Z -1.0463-0.3717j], 2025-12-04T10:08:29.1349756Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1349821Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1349823Z 2025-12-04T10:08:29.1350121Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1350124Z 2025-12-04T10:08:29.1350200Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1350405Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1350409Z 2025-12-04T10:08:29.1350494Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1350587Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1350633Z Traceback (most recent call last): 2025-12-04T10:08:29.1350804Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1350846Z return test(*args, **kwargs) 2025-12-04T10:08:29.1350883Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1350988Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1351056Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1351239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1351376Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1351430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1351593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1351649Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1351693Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1351857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1351938Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1351982Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1352124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1352170Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1352208Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1352360Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1352411Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1352565Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1352607Z raise GradcheckError( 2025-12-04T10:08:29.1352697Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1352700Z 2025-12-04T10:08:29.1352792Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1352874Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1353000Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1353002Z 2025-12-04T10:08:29.1353088Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1353190Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1353226Z If the test 2025-12-04T10:08:29.1353319Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1353381Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1353475Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1353560Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1353563Z 2025-12-04T10:08:29.1353653Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1353739Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1353776Z the following. 2025-12-04T10:08:29.1353778Z 2025-12-04T10:08:29.1353867Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1353956Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1354008Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1354069Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1354130Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1354132Z 2025-12-04T10:08:29.1354167Z Got: 2025-12-04T10:08:29.1354228Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1354282Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1354323Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1354378Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1354429Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1354501Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1354551Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1354602Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1354640Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1354691Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1354741Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1354781Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1354830Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1354880Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1354946Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1354948Z 2025-12-04T10:08:29.1354998Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1355048Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1355089Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1355138Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1355187Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1355225Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1355274Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1355324Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1355362Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1355411Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1355460Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1355499Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1355548Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1355597Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1355638Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1355641Z 2025-12-04T10:08:29.1355643Z 2025-12-04T10:08:29.1355693Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1355743Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1355782Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1355832Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1355882Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1355921Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1355969Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1356020Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1356059Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1356110Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1356158Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1356198Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1356248Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1356298Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1356339Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1356341Z 2025-12-04T10:08:29.1356390Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1356441Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1356479Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1356530Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1356578Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1356620Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1356669Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1356720Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1356778Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1356840Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1356889Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1356929Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1356978Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1357029Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1357079Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1357123Z dtype=torch.complex128) 2025-12-04T10:08:29.1357125Z 2025-12-04T10:08:29.1357159Z Expected: 2025-12-04T10:08:29.1357248Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1357301Z 0.3401-0.5673j], 2025-12-04T10:08:29.1357366Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1357403Z 0.2078-0.7444j], 2025-12-04T10:08:29.1357472Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1357509Z 0.4109+0.5305j], 2025-12-04T10:08:29.1357572Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1357609Z -0.3607+0.5386j], 2025-12-04T10:08:29.1357672Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1357710Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1357712Z 2025-12-04T10:08:29.1357775Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1357810Z 0.5323-0.4729j], 2025-12-04T10:08:29.1357874Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1357911Z -0.6732-0.7677j], 2025-12-04T10:08:29.1357974Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1358010Z -0.5241-0.5479j], 2025-12-04T10:08:29.1358075Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1358111Z -0.3257-0.6597j], 2025-12-04T10:08:29.1358174Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1358211Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1358213Z 2025-12-04T10:08:29.1358214Z 2025-12-04T10:08:29.1358277Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1358313Z -0.6637-0.1175j], 2025-12-04T10:08:29.1358380Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1358415Z 0.4261-0.3012j], 2025-12-04T10:08:29.1358479Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1358516Z 0.2567-0.1808j], 2025-12-04T10:08:29.1358579Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1358615Z 0.1761-1.6446j], 2025-12-04T10:08:29.1358681Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1358720Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1358722Z 2025-12-04T10:08:29.1358783Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1358820Z -0.6307+0.1756j], 2025-12-04T10:08:29.1358882Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1358918Z -0.9972-0.3518j], 2025-12-04T10:08:29.1358981Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1359016Z 0.6467+0.0201j], 2025-12-04T10:08:29.1361522Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1361562Z -1.0443-0.3699j], 2025-12-04T10:08:29.1361626Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1364335Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1364339Z 2025-12-04T10:08:29.1364420Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1364422Z 2025-12-04T10:08:29.1364469Z Traceback (most recent call last): 2025-12-04T10:08:29.1364628Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1364670Z method(*args, **kwargs) 2025-12-04T10:08:29.1364847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1364893Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1364973Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1365137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1365180Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1365223Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1365384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1365426Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1365463Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1365615Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1365652Z fn(*args, **kwargs) 2025-12-04T10:08:29.1365820Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1365864Z raise e_tracked from e 2025-12-04T10:08:29.1365910Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1365912Z 2025-12-04T10:08:29.1366005Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1366093Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1366174Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1366176Z 2025-12-04T10:08:29.1366263Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1366366Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1366402Z If the test 2025-12-04T10:08:29.1366495Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1366558Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1366654Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1366738Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1366740Z 2025-12-04T10:08:29.1366830Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1366918Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1366955Z the following. 2025-12-04T10:08:29.1366957Z 2025-12-04T10:08:29.1367046Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1367137Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1367190Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1367254Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1367316Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1367318Z 2025-12-04T10:08:29.1367351Z Got: 2025-12-04T10:08:29.1367416Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1367548Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1367587Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1367641Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1367724Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1367765Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1367815Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1367866Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1367904Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1367954Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1368004Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1368043Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1368092Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1368154Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1368195Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1368197Z 2025-12-04T10:08:29.1368246Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1368300Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1368338Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1368387Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1368436Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1368475Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1368524Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1368574Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1368613Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1368662Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1368714Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1368753Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1368801Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1368850Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1368894Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1368896Z 2025-12-04T10:08:29.1368897Z 2025-12-04T10:08:29.1368948Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1368997Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1369037Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1369088Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1369138Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1369177Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1369226Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1369280Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1369318Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1369368Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1369419Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1369459Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1369507Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1369557Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1369598Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1369600Z 2025-12-04T10:08:29.1369650Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1369701Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1369740Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1369790Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1369859Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1369899Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1369948Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1370036Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1370076Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1370127Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1370177Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1370218Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1370267Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1370317Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1370368Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1370413Z dtype=torch.complex128) 2025-12-04T10:08:29.1370415Z 2025-12-04T10:08:29.1370466Z Expected: 2025-12-04T10:08:29.1370543Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1370581Z 0.3401-0.5673j], 2025-12-04T10:08:29.1370646Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1370688Z 0.2078-0.7444j], 2025-12-04T10:08:29.1370753Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1370789Z 0.4109+0.5305j], 2025-12-04T10:08:29.1370852Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1370889Z -0.3607+0.5386j], 2025-12-04T10:08:29.1370952Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1370990Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1370992Z 2025-12-04T10:08:29.1371055Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1371097Z 0.5323-0.4729j], 2025-12-04T10:08:29.1371161Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1371197Z -0.6732-0.7677j], 2025-12-04T10:08:29.1371260Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1371301Z -0.5241-0.5479j], 2025-12-04T10:08:29.1371367Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1371402Z -0.3257-0.6597j], 2025-12-04T10:08:29.1371466Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1371503Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1371505Z 2025-12-04T10:08:29.1371508Z 2025-12-04T10:08:29.1371569Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1371607Z -0.6637-0.1175j], 2025-12-04T10:08:29.1371669Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1371707Z 0.4261-0.3012j], 2025-12-04T10:08:29.1371770Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1371807Z 0.2567-0.1808j], 2025-12-04T10:08:29.1371870Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1371907Z 0.1761-1.6446j], 2025-12-04T10:08:29.1371969Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1372009Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1372011Z 2025-12-04T10:08:29.1372072Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1372109Z -0.6307+0.1756j], 2025-12-04T10:08:29.1372171Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1372209Z -0.9972-0.3518j], 2025-12-04T10:08:29.1372270Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1372321Z 0.6467+0.0201j], 2025-12-04T10:08:29.1372383Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1372420Z -1.0443-0.3699j], 2025-12-04T10:08:29.1372492Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1372570Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1372572Z 2025-12-04T10:08:29.1372874Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1372876Z 2025-12-04T10:08:29.1372987Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1373216Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1373221Z 2025-12-04T10:08:29.1373309Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1373403Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1373450Z Traceback (most recent call last): 2025-12-04T10:08:29.1373624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1373665Z return test(*args, **kwargs) 2025-12-04T10:08:29.1373702Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1373807Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1373873Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1374042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1374167Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1374220Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1374384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1374440Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1374484Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1374639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1374707Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1374752Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1374892Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1374938Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1374977Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1375129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1375183Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1375339Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1375380Z raise GradcheckError( 2025-12-04T10:08:29.1375471Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1375473Z 2025-12-04T10:08:29.1375565Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1375648Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1375728Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1375747Z 2025-12-04T10:08:29.1375832Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1375934Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1375984Z If the test 2025-12-04T10:08:29.1376090Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1376154Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1376249Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1376331Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1376333Z 2025-12-04T10:08:29.1376422Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1376507Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1376543Z the following. 2025-12-04T10:08:29.1376547Z 2025-12-04T10:08:29.1376647Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1376738Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1376789Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1376855Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1376916Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1376918Z 2025-12-04T10:08:29.1376950Z Got: 2025-12-04T10:08:29.1377024Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1377063Z 0.3399-0.5672j], 2025-12-04T10:08:29.1377126Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1377163Z 0.2071-0.7425j], 2025-12-04T10:08:29.1377228Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1377264Z 0.4110+0.5304j], 2025-12-04T10:08:29.1377328Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1377365Z -0.3610+0.5378j], 2025-12-04T10:08:29.1377426Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1377466Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1377468Z 2025-12-04T10:08:29.1377531Z [[-1.0988+0.1570j, -0.8103-0.1739j, 0.7776-3.3622j, -0.4721+2.4823j, 2025-12-04T10:08:29.1377568Z -1.3900+0.9553j], 2025-12-04T10:08:29.1377631Z [-1.1652+0.8914j, 0.1777-2.1221j, 3.5317-0.1484j, -1.4368-1.5654j, 2025-12-04T10:08:29.1377668Z 0.4591-1.3401j], 2025-12-04T10:08:29.1377729Z [ 0.7359-0.3223j, 2.1508-0.8276j, 2.7059+4.0560j, 0.0778-1.6340j, 2025-12-04T10:08:29.1377765Z 0.1961-0.8144j], 2025-12-04T10:08:29.1377825Z [-0.0354-0.7195j, 1.8138-0.3152j, 0.6474+3.4303j, 0.2280-0.0901j, 2025-12-04T10:08:29.1377863Z -0.6439-0.2327j], 2025-12-04T10:08:29.1377932Z [ 0.8064-0.0707j, 0.4507+0.1942j, -1.2912+0.6826j, -0.0278+0.3969j, 2025-12-04T10:08:29.1377970Z 0.2718-0.0305j]]], 2025-12-04T10:08:29.1377972Z 2025-12-04T10:08:29.1377974Z 2025-12-04T10:08:29.1378036Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1378074Z -0.6650-0.1177j], 2025-12-04T10:08:29.1378136Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1378172Z 0.4262-0.3016j], 2025-12-04T10:08:29.1378234Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1378271Z 0.2568-0.1815j], 2025-12-04T10:08:29.1378332Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1378368Z 0.1764-1.6447j], 2025-12-04T10:08:29.1378430Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1378483Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1378485Z 2025-12-04T10:08:29.1378546Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1378583Z -0.6301+0.1752j], 2025-12-04T10:08:29.1378655Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1378706Z -0.9982-0.3533j], 2025-12-04T10:08:29.1378767Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1378804Z 0.6464+0.0221j], 2025-12-04T10:08:29.1378864Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1378902Z -1.0463-0.3717j], 2025-12-04T10:08:29.1378964Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1379031Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1379033Z 2025-12-04T10:08:29.1379068Z Expected: 2025-12-04T10:08:29.1379152Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1379189Z 0.3399-0.5672j], 2025-12-04T10:08:29.1379250Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1379290Z 0.2071-0.7425j], 2025-12-04T10:08:29.1379354Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1379391Z 0.4110+0.5304j], 2025-12-04T10:08:29.1379452Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1379489Z -0.3610+0.5378j], 2025-12-04T10:08:29.1379552Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1379589Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1379591Z 2025-12-04T10:08:29.1379653Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.1379690Z 0.5342-0.4740j], 2025-12-04T10:08:29.1379756Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.1379792Z -0.6736-0.7699j], 2025-12-04T10:08:29.1379853Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.1379895Z -0.5256-0.5484j], 2025-12-04T10:08:29.1379957Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.1379994Z -0.3277-0.6605j], 2025-12-04T10:08:29.1380056Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.1380094Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.1380096Z 2025-12-04T10:08:29.1380098Z 2025-12-04T10:08:29.1380159Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1380195Z -0.6650-0.1177j], 2025-12-04T10:08:29.1380257Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1380294Z 0.4262-0.3016j], 2025-12-04T10:08:29.1380358Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1380394Z 0.2568-0.1815j], 2025-12-04T10:08:29.1380458Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1380497Z 0.1764-1.6447j], 2025-12-04T10:08:29.1380559Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1380597Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1380599Z 2025-12-04T10:08:29.1380661Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1380698Z -0.6301+0.1752j], 2025-12-04T10:08:29.1380760Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1380797Z -0.9982-0.3533j], 2025-12-04T10:08:29.1380860Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1380896Z 0.6464+0.0221j], 2025-12-04T10:08:29.1380971Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1381007Z -1.0463-0.3717j], 2025-12-04T10:08:29.1381071Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1381166Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1381168Z 2025-12-04T10:08:29.1381251Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1381254Z 2025-12-04T10:08:29.1381299Z Traceback (most recent call last): 2025-12-04T10:08:29.1381456Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1381497Z method(*args, **kwargs) 2025-12-04T10:08:29.1381674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1381733Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1381774Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1381935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1381983Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1382021Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1382180Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1382222Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1382260Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1382413Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1382454Z fn(*args, **kwargs) 2025-12-04T10:08:29.1382621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1382663Z raise e_tracked from e 2025-12-04T10:08:29.1382707Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1382709Z 2025-12-04T10:08:29.1382804Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1382889Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1383030Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1383032Z 2025-12-04T10:08:29.1383119Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1383221Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1383258Z If the test 2025-12-04T10:08:29.1383351Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1383415Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1383511Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1383594Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1383596Z 2025-12-04T10:08:29.1383686Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1383775Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1383810Z the following. 2025-12-04T10:08:29.1383812Z 2025-12-04T10:08:29.1383900Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1383990Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1384042Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1384106Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1384168Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1384170Z 2025-12-04T10:08:29.1384202Z Got: 2025-12-04T10:08:29.1384298Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1384335Z 0.3399-0.5672j], 2025-12-04T10:08:29.1384398Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1384468Z 0.2071-0.7425j], 2025-12-04T10:08:29.1384533Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1384569Z 0.4110+0.5304j], 2025-12-04T10:08:29.1384633Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1384669Z -0.3610+0.5378j], 2025-12-04T10:08:29.1384733Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1384770Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1384773Z 2025-12-04T10:08:29.1384835Z [[-1.0988+0.1570j, -0.8103-0.1739j, 0.7776-3.3622j, -0.4721+2.4823j, 2025-12-04T10:08:29.1384872Z -1.3900+0.9553j], 2025-12-04T10:08:29.1384952Z [-1.1652+0.8914j, 0.1777-2.1221j, 3.5317-0.1484j, -1.4368-1.5654j, 2025-12-04T10:08:29.1384989Z 0.4591-1.3401j], 2025-12-04T10:08:29.1385050Z [ 0.7359-0.3223j, 2.1508-0.8276j, 2.7059+4.0560j, 0.0778-1.6340j, 2025-12-04T10:08:29.1385090Z 0.1961-0.8144j], 2025-12-04T10:08:29.1385152Z [-0.0354-0.7195j, 1.8138-0.3152j, 0.6474+3.4303j, 0.2280-0.0901j, 2025-12-04T10:08:29.1385189Z -0.6439-0.2327j], 2025-12-04T10:08:29.1385250Z [ 0.8064-0.0707j, 0.4507+0.1942j, -1.2912+0.6826j, -0.0278+0.3969j, 2025-12-04T10:08:29.1385290Z 0.2718-0.0305j]]], 2025-12-04T10:08:29.1385292Z 2025-12-04T10:08:29.1385293Z 2025-12-04T10:08:29.1385356Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1385393Z -0.6650-0.1177j], 2025-12-04T10:08:29.1385457Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1385494Z 0.4262-0.3016j], 2025-12-04T10:08:29.1385557Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1385594Z 0.2568-0.1815j], 2025-12-04T10:08:29.1385657Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1385696Z 0.1764-1.6447j], 2025-12-04T10:08:29.1385758Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1385797Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1385798Z 2025-12-04T10:08:29.1385859Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1385896Z -0.6301+0.1752j], 2025-12-04T10:08:29.1385958Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1385994Z -0.9982-0.3533j], 2025-12-04T10:08:29.1386059Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1386097Z 0.6464+0.0221j], 2025-12-04T10:08:29.1386158Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1386194Z -1.0463-0.3717j], 2025-12-04T10:08:29.1386260Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1386329Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1386331Z 2025-12-04T10:08:29.1386367Z Expected: 2025-12-04T10:08:29.1386439Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.1386475Z 0.3399-0.5672j], 2025-12-04T10:08:29.1386538Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.1386574Z 0.2071-0.7425j], 2025-12-04T10:08:29.1386637Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.1386672Z 0.4110+0.5304j], 2025-12-04T10:08:29.1386736Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.1386786Z -0.3610+0.5378j], 2025-12-04T10:08:29.1386848Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.1386886Z 0.0868+0.1064j]], 2025-12-04T10:08:29.1386899Z 2025-12-04T10:08:29.1386973Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.1387010Z 0.5342-0.4740j], 2025-12-04T10:08:29.1387072Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.1387109Z -0.6736-0.7699j], 2025-12-04T10:08:29.1387170Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.1387206Z -0.5256-0.5484j], 2025-12-04T10:08:29.1387268Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.1387305Z -0.3277-0.6605j], 2025-12-04T10:08:29.1387382Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.1387423Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.1387425Z 2025-12-04T10:08:29.1387427Z 2025-12-04T10:08:29.1387488Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.1387528Z -0.6650-0.1177j], 2025-12-04T10:08:29.1387590Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.1387626Z 0.4262-0.3016j], 2025-12-04T10:08:29.1387690Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.1387727Z 0.2568-0.1815j], 2025-12-04T10:08:29.1387789Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.1387825Z 0.1764-1.6447j], 2025-12-04T10:08:29.1387886Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.1387925Z -0.5992-0.8691j]], 2025-12-04T10:08:29.1387930Z 2025-12-04T10:08:29.1387991Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.1388029Z -0.6301+0.1752j], 2025-12-04T10:08:29.1388090Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.1388129Z -0.9982-0.3533j], 2025-12-04T10:08:29.1388191Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.1388227Z 0.6464+0.0221j], 2025-12-04T10:08:29.1388288Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.1388325Z -1.0463-0.3717j], 2025-12-04T10:08:29.1388388Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.1388454Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1388456Z 2025-12-04T10:08:29.1388752Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1388756Z 2025-12-04T10:08:29.1388830Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1389039Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1389042Z 2025-12-04T10:08:29.1389133Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1389227Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1389272Z Traceback (most recent call last): 2025-12-04T10:08:29.1389442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1389485Z return test(*args, **kwargs) 2025-12-04T10:08:29.1389536Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1389641Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1389708Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1389902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1390026Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1390079Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1390241Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1390299Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1390354Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1390513Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1390580Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1390628Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1390768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1390814Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1390852Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1391004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1391054Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1391209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1391252Z raise GradcheckError( 2025-12-04T10:08:29.1391342Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1391344Z 2025-12-04T10:08:29.1391436Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1391522Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1391601Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1391603Z 2025-12-04T10:08:29.1391689Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1391791Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1391827Z If the test 2025-12-04T10:08:29.1391919Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1391983Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1392078Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1392163Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1392165Z 2025-12-04T10:08:29.1392258Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1392344Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1392381Z the following. 2025-12-04T10:08:29.1392383Z 2025-12-04T10:08:29.1392470Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1392561Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1392612Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1392677Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1392737Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1392739Z 2025-12-04T10:08:29.1392771Z Got: 2025-12-04T10:08:29.1392846Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.1392903Z -0.1875+0.3131j], 2025-12-04T10:08:29.1393015Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.1393054Z -0.0786+0.2827j], 2025-12-04T10:08:29.1393152Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.1393189Z 0.3077+0.3986j], 2025-12-04T10:08:29.1393251Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.1393288Z -0.1509+0.2260j], 2025-12-04T10:08:29.1393350Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.1393388Z 0.0273+0.0340j]], 2025-12-04T10:08:29.1393390Z 2025-12-04T10:08:29.1393452Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.1393488Z 0.3021-0.2693j], 2025-12-04T10:08:29.1393567Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.1393606Z -4.3263-4.7783j], 2025-12-04T10:08:29.1393669Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.1393705Z 0.1501+0.1573j], 2025-12-04T10:08:29.1393771Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.1393809Z -0.0529-0.1077j], 2025-12-04T10:08:29.1393871Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.1393909Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.1393911Z 2025-12-04T10:08:29.1393913Z 2025-12-04T10:08:29.1393976Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1394011Z -0.6637-0.1175j], 2025-12-04T10:08:29.1394074Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1394109Z 0.4261-0.3012j], 2025-12-04T10:08:29.1394178Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1394213Z 0.2567-0.1808j], 2025-12-04T10:08:29.1394276Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1394313Z 0.1761-1.6446j], 2025-12-04T10:08:29.1394376Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1394413Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1394415Z 2025-12-04T10:08:29.1394478Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1394514Z -0.6307+0.1756j], 2025-12-04T10:08:29.1394577Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1394613Z -0.9972-0.3518j], 2025-12-04T10:08:29.1394675Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1394710Z 0.6467+0.0201j], 2025-12-04T10:08:29.1394775Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1394811Z -1.0443-0.3699j], 2025-12-04T10:08:29.1394875Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1394941Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1394943Z 2025-12-04T10:08:29.1394978Z Expected: 2025-12-04T10:08:29.1395050Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1395086Z 0.3401-0.5673j], 2025-12-04T10:08:29.1395146Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1395183Z 0.2078-0.7444j], 2025-12-04T10:08:29.1395247Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1395283Z 0.4109+0.5305j], 2025-12-04T10:08:29.1395345Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1395398Z -0.3607+0.5386j], 2025-12-04T10:08:29.1395460Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1395499Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1395514Z 2025-12-04T10:08:29.1395588Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1395626Z 0.5323-0.4729j], 2025-12-04T10:08:29.1395688Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1395725Z -0.6732-0.7677j], 2025-12-04T10:08:29.1395787Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1395824Z -0.5241-0.5479j], 2025-12-04T10:08:29.1395886Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1395923Z -0.3257-0.6597j], 2025-12-04T10:08:29.1395994Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1396036Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1396038Z 2025-12-04T10:08:29.1396040Z 2025-12-04T10:08:29.1396102Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1396140Z -0.6637-0.1175j], 2025-12-04T10:08:29.1396203Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1396239Z 0.4261-0.3012j], 2025-12-04T10:08:29.1396302Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1396337Z 0.2567-0.1808j], 2025-12-04T10:08:29.1396400Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1396435Z 0.1761-1.6446j], 2025-12-04T10:08:29.1396497Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1396535Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1396537Z 2025-12-04T10:08:29.1396604Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1396640Z -0.6307+0.1756j], 2025-12-04T10:08:29.1396702Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1396739Z -0.9972-0.3518j], 2025-12-04T10:08:29.1396803Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1396838Z 0.6467+0.0201j], 2025-12-04T10:08:29.1396901Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1396937Z -1.0443-0.3699j], 2025-12-04T10:08:29.1397000Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1397064Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1397067Z 2025-12-04T10:08:29.1397152Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1397154Z 2025-12-04T10:08:29.1397201Z Traceback (most recent call last): 2025-12-04T10:08:29.1397359Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1397399Z method(*args, **kwargs) 2025-12-04T10:08:29.1397579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1397625Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1397664Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1397825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1397867Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1397907Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1398065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1398121Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1398157Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1398308Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1398368Z fn(*args, **kwargs) 2025-12-04T10:08:29.1398536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1398576Z raise e_tracked from e 2025-12-04T10:08:29.1398624Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1398626Z 2025-12-04T10:08:29.1398719Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1398801Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1398884Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1398886Z 2025-12-04T10:08:29.1398980Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1399084Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1399120Z If the test 2025-12-04T10:08:29.1399214Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1399279Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1399374Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1399457Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1399459Z 2025-12-04T10:08:29.1399550Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1399635Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1399671Z the following. 2025-12-04T10:08:29.1399674Z 2025-12-04T10:08:29.1399762Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1399853Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1399903Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1399967Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1400028Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1400031Z 2025-12-04T10:08:29.1400064Z Got: 2025-12-04T10:08:29.1400137Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.1400175Z -0.1875+0.3131j], 2025-12-04T10:08:29.1400240Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.1400278Z -0.0786+0.2827j], 2025-12-04T10:08:29.1400342Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.1400379Z 0.3077+0.3986j], 2025-12-04T10:08:29.1400442Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.1400480Z -0.1509+0.2260j], 2025-12-04T10:08:29.1400548Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.1400586Z 0.0273+0.0340j]], 2025-12-04T10:08:29.1400589Z 2025-12-04T10:08:29.1400653Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.1400689Z 0.3021-0.2693j], 2025-12-04T10:08:29.1400751Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.1400787Z -4.3263-4.7783j], 2025-12-04T10:08:29.1400851Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.1400887Z 0.1501+0.1573j], 2025-12-04T10:08:29.1400948Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.1400985Z -0.0529-0.1077j], 2025-12-04T10:08:29.1401047Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.1401097Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.1401099Z 2025-12-04T10:08:29.1401101Z 2025-12-04T10:08:29.1401163Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1401222Z -0.6637-0.1175j], 2025-12-04T10:08:29.1401285Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1401323Z 0.4261-0.3012j], 2025-12-04T10:08:29.1401387Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1401425Z 0.2567-0.1808j], 2025-12-04T10:08:29.1401487Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1401524Z 0.1761-1.6446j], 2025-12-04T10:08:29.1401585Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1401624Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1401627Z 2025-12-04T10:08:29.1401706Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1401742Z -0.6307+0.1756j], 2025-12-04T10:08:29.1401805Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1401844Z -0.9972-0.3518j], 2025-12-04T10:08:29.1401907Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1401942Z 0.6467+0.0201j], 2025-12-04T10:08:29.1402004Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1402040Z -1.0443-0.3699j], 2025-12-04T10:08:29.1402104Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1402171Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1402173Z 2025-12-04T10:08:29.1402207Z Expected: 2025-12-04T10:08:29.1402282Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1402319Z 0.3401-0.5673j], 2025-12-04T10:08:29.1402381Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1402418Z 0.2078-0.7444j], 2025-12-04T10:08:29.1402484Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1402520Z 0.4109+0.5305j], 2025-12-04T10:08:29.1402581Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1402618Z -0.3607+0.5386j], 2025-12-04T10:08:29.1402680Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1402718Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1402720Z 2025-12-04T10:08:29.1402782Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1402818Z 0.5323-0.4729j], 2025-12-04T10:08:29.1402881Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1402920Z -0.6732-0.7677j], 2025-12-04T10:08:29.1403017Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1403055Z -0.5241-0.5479j], 2025-12-04T10:08:29.1403120Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1403157Z -0.3257-0.6597j], 2025-12-04T10:08:29.1403219Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1403257Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1403259Z 2025-12-04T10:08:29.1403261Z 2025-12-04T10:08:29.1403322Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1403360Z -0.6637-0.1175j], 2025-12-04T10:08:29.1403422Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1403458Z 0.4261-0.3012j], 2025-12-04T10:08:29.1403522Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1403574Z 0.2567-0.1808j], 2025-12-04T10:08:29.1403637Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1403673Z 0.1761-1.6446j], 2025-12-04T10:08:29.1403768Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1403806Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1403808Z 2025-12-04T10:08:29.1403871Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1403909Z -0.6307+0.1756j], 2025-12-04T10:08:29.1403971Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1404006Z -0.9972-0.3518j], 2025-12-04T10:08:29.1404070Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1404105Z 0.6467+0.0201j], 2025-12-04T10:08:29.1404185Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1404224Z -1.0443-0.3699j], 2025-12-04T10:08:29.1404287Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1404351Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1404355Z 2025-12-04T10:08:29.1404661Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1404664Z 2025-12-04T10:08:29.1404737Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1404945Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1404947Z 2025-12-04T10:08:29.1405036Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1405130Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1405177Z Traceback (most recent call last): 2025-12-04T10:08:29.1405352Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1405395Z return test(*args, **kwargs) 2025-12-04T10:08:29.1405431Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1405537Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1405602Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1405775Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1405900Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1405953Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1406118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1406178Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1406221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1406377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1406443Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1406488Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1406627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1406673Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1406724Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1406876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1406926Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1407101Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1407144Z raise GradcheckError( 2025-12-04T10:08:29.1407233Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1407236Z 2025-12-04T10:08:29.1407328Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1407409Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1407490Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1407492Z 2025-12-04T10:08:29.1407586Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1407691Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1407725Z If the test 2025-12-04T10:08:29.1407819Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1407884Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1407980Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1408060Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1408062Z 2025-12-04T10:08:29.1408155Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1408240Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1408277Z the following. 2025-12-04T10:08:29.1408279Z 2025-12-04T10:08:29.1408369Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1408460Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1408510Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1408573Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1408635Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1408637Z 2025-12-04T10:08:29.1408670Z Got: 2025-12-04T10:08:29.1408732Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1408787Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1408826Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1408881Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1408932Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1411245Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1411298Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1411356Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1411395Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1411446Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1411495Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1411538Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1411589Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1411640Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1411683Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1411685Z 2025-12-04T10:08:29.1411733Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1411785Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1411823Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1411874Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1411953Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1411993Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1412041Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1412093Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1412162Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1412214Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1412262Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1412302Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1412350Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1412402Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1412442Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1412444Z 2025-12-04T10:08:29.1412446Z 2025-12-04T10:08:29.1412497Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1412562Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1412603Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1412653Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1412706Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1412745Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1412796Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1412847Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1412886Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1412979Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1413030Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1413069Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1413119Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1413171Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1413215Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1413217Z 2025-12-04T10:08:29.1413266Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1413319Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1413359Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1413410Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1413459Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1413499Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1413548Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1413598Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1413636Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1413687Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1413736Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1413777Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1413828Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1413880Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1413934Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1413978Z dtype=torch.complex128) 2025-12-04T10:08:29.1413979Z 2025-12-04T10:08:29.1414015Z Expected: 2025-12-04T10:08:29.1414091Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1414130Z 0.3401-0.5673j], 2025-12-04T10:08:29.1414193Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1414231Z 0.2078-0.7444j], 2025-12-04T10:08:29.1414295Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1414331Z 0.4109+0.5305j], 2025-12-04T10:08:29.1414439Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1414477Z -0.3607+0.5386j], 2025-12-04T10:08:29.1414540Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1414601Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1414626Z 2025-12-04T10:08:29.1414690Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1414727Z 0.5323-0.4729j], 2025-12-04T10:08:29.1414789Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1414826Z -0.6732-0.7677j], 2025-12-04T10:08:29.1414888Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1414925Z -0.5241-0.5479j], 2025-12-04T10:08:29.1414986Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1415023Z -0.3257-0.6597j], 2025-12-04T10:08:29.1415106Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1415144Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1415146Z 2025-12-04T10:08:29.1415148Z 2025-12-04T10:08:29.1415210Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1415249Z -0.6637-0.1175j], 2025-12-04T10:08:29.1415312Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1415348Z 0.4261-0.3012j], 2025-12-04T10:08:29.1415411Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1415448Z 0.2567-0.1808j], 2025-12-04T10:08:29.1415511Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1415548Z 0.1761-1.6446j], 2025-12-04T10:08:29.1415609Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1415652Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1415655Z 2025-12-04T10:08:29.1415716Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1415753Z -0.6307+0.1756j], 2025-12-04T10:08:29.1415816Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1415854Z -0.9972-0.3518j], 2025-12-04T10:08:29.1415918Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1415953Z 0.6467+0.0201j], 2025-12-04T10:08:29.1416015Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1416050Z -1.0443-0.3699j], 2025-12-04T10:08:29.1416114Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1416181Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1416183Z 2025-12-04T10:08:29.1416267Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1416270Z 2025-12-04T10:08:29.1416314Z Traceback (most recent call last): 2025-12-04T10:08:29.1416476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1416519Z method(*args, **kwargs) 2025-12-04T10:08:29.1416698Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1416744Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1416783Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1416942Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1416988Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1417025Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1417186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1417240Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1417277Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1417444Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1417495Z fn(*args, **kwargs) 2025-12-04T10:08:29.1417663Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1417705Z raise e_tracked from e 2025-12-04T10:08:29.1417749Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1417751Z 2025-12-04T10:08:29.1417846Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1417928Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1418008Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1418023Z 2025-12-04T10:08:29.1418108Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1418210Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1418246Z If the test 2025-12-04T10:08:29.1418342Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1418405Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1418499Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1418581Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1418583Z 2025-12-04T10:08:29.1418673Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1418758Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1418794Z the following. 2025-12-04T10:08:29.1418796Z 2025-12-04T10:08:29.1418887Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1418978Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1419030Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1419096Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1419158Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1419160Z 2025-12-04T10:08:29.1419192Z Got: 2025-12-04T10:08:29.1419255Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.1419309Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.1419349Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.1419401Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.1419453Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.1419492Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.1419545Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.1419596Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.1419635Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.1419683Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.1419736Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.1419774Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.1419825Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.1419874Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.1419915Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.1419917Z 2025-12-04T10:08:29.1419966Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.1420016Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.1420054Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.1420118Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.1420167Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.1420206Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.1420255Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.1420325Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.1420364Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.1420414Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.1420463Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.1420502Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.1420551Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.1420600Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.1420640Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.1420643Z 2025-12-04T10:08:29.1420644Z 2025-12-04T10:08:29.1420708Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1420759Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1420798Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1420850Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1420901Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1420939Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1420988Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1421040Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1421078Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1421128Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1421177Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1421217Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1421267Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1421318Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1421358Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1421360Z 2025-12-04T10:08:29.1421411Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1421462Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1421501Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1421551Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1421601Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1421639Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1421690Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1421739Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1421778Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1421829Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1421880Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1421918Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1421968Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1422021Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1422073Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1422117Z dtype=torch.complex128) 2025-12-04T10:08:29.1422119Z 2025-12-04T10:08:29.1422153Z Expected: 2025-12-04T10:08:29.1422230Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1422267Z 0.3401-0.5673j], 2025-12-04T10:08:29.1422331Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1422367Z 0.2078-0.7444j], 2025-12-04T10:08:29.1422431Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1422497Z 0.4109+0.5305j], 2025-12-04T10:08:29.1422560Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1422596Z -0.3607+0.5386j], 2025-12-04T10:08:29.1422670Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1422720Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1422722Z 2025-12-04T10:08:29.1422785Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1422821Z 0.5323-0.4729j], 2025-12-04T10:08:29.1422884Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1422920Z -0.6732-0.7677j], 2025-12-04T10:08:29.1423025Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1423061Z -0.5241-0.5479j], 2025-12-04T10:08:29.1423124Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1423188Z -0.3257-0.6597j], 2025-12-04T10:08:29.1423252Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1423289Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1423291Z 2025-12-04T10:08:29.1423294Z 2025-12-04T10:08:29.1423359Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1423395Z -0.6637-0.1175j], 2025-12-04T10:08:29.1423458Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1423493Z 0.4261-0.3012j], 2025-12-04T10:08:29.1423557Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1423592Z 0.2567-0.1808j], 2025-12-04T10:08:29.1423655Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1423690Z 0.1761-1.6446j], 2025-12-04T10:08:29.1423753Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1423792Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1423794Z 2025-12-04T10:08:29.1423856Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1423892Z -0.6307+0.1756j], 2025-12-04T10:08:29.1423957Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1423994Z -0.9972-0.3518j], 2025-12-04T10:08:29.1424056Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1424091Z 0.6467+0.0201j], 2025-12-04T10:08:29.1424153Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1424189Z -1.0443-0.3699j], 2025-12-04T10:08:29.1424252Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1424317Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1424320Z 2025-12-04T10:08:29.1424624Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1424628Z 2025-12-04T10:08:29.1424703Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1424909Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1424912Z 2025-12-04T10:08:29.1424999Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1425092Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1425138Z Traceback (most recent call last): 2025-12-04T10:08:29.1425310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1425375Z return test(*args, **kwargs) 2025-12-04T10:08:29.1425412Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1425518Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1425617Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1425787Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1425909Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1425961Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1426125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1426193Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1426238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1426394Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1426464Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1426510Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1426653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1426697Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1426736Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1426887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1426937Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1427092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1427136Z raise GradcheckError( 2025-12-04T10:08:29.1427226Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1427228Z 2025-12-04T10:08:29.1427323Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1427404Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1427485Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1427487Z 2025-12-04T10:08:29.1427572Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1427676Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1427711Z If the test 2025-12-04T10:08:29.1427805Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1427868Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1427965Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1428047Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1428050Z 2025-12-04T10:08:29.1428142Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1428227Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1428263Z the following. 2025-12-04T10:08:29.1428265Z 2025-12-04T10:08:29.1428353Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1428443Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1428494Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1428558Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1428619Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1428634Z 2025-12-04T10:08:29.1428666Z Got: 2025-12-04T10:08:29.1428739Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.1428790Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.1428878Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.1428927Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.1428989Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.1429036Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.1429097Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.1429144Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.1429205Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.1429254Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.1429259Z 2025-12-04T10:08:29.1429329Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.1429376Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.1429436Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.1429485Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.1429544Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.1429591Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.1429650Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.1429696Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.1429756Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.1429807Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.1429809Z 2025-12-04T10:08:29.1429811Z 2025-12-04T10:08:29.1429873Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1429920Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1429979Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1430027Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1430087Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1430134Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1430193Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1430240Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1430299Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1430347Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1430349Z 2025-12-04T10:08:29.1430408Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1430456Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1430515Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1430562Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1430623Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1430669Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1430728Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1430773Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1430834Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1430894Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1430939Z dtype=torch.complex128) 2025-12-04T10:08:29.1430941Z 2025-12-04T10:08:29.1430975Z Expected: 2025-12-04T10:08:29.1431050Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1431100Z 0.3401-0.5673j], 2025-12-04T10:08:29.1431165Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1431201Z 0.2078-0.7444j], 2025-12-04T10:08:29.1431288Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1431325Z 0.4109+0.5305j], 2025-12-04T10:08:29.1431388Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1431424Z -0.3607+0.5386j], 2025-12-04T10:08:29.1431488Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1431526Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1431527Z 2025-12-04T10:08:29.1431590Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1431629Z 0.5323-0.4729j], 2025-12-04T10:08:29.1431705Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1431745Z -0.6732-0.7677j], 2025-12-04T10:08:29.1431807Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1431843Z -0.5241-0.5479j], 2025-12-04T10:08:29.1431907Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1431943Z -0.3257-0.6597j], 2025-12-04T10:08:29.1432007Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1432044Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1432046Z 2025-12-04T10:08:29.1432048Z 2025-12-04T10:08:29.1432114Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1432149Z -0.6637-0.1175j], 2025-12-04T10:08:29.1432212Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1432247Z 0.4261-0.3012j], 2025-12-04T10:08:29.1432313Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1432349Z 0.2567-0.1808j], 2025-12-04T10:08:29.1432412Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1432449Z 0.1761-1.6446j], 2025-12-04T10:08:29.1432511Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1432549Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1432552Z 2025-12-04T10:08:29.1432614Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1432651Z -0.6307+0.1756j], 2025-12-04T10:08:29.1432713Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1432750Z -0.9972-0.3518j], 2025-12-04T10:08:29.1432811Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1432847Z 0.6467+0.0201j], 2025-12-04T10:08:29.1432910Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1433002Z -1.0443-0.3699j], 2025-12-04T10:08:29.1433065Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1433133Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1433135Z 2025-12-04T10:08:29.1433218Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1433220Z 2025-12-04T10:08:29.1433266Z Traceback (most recent call last): 2025-12-04T10:08:29.1433425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1433467Z method(*args, **kwargs) 2025-12-04T10:08:29.1433645Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1433692Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1433751Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1433912Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1433975Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1434036Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1434195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1434237Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1434273Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1434425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1434463Z fn(*args, **kwargs) 2025-12-04T10:08:29.1434650Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1434693Z raise e_tracked from e 2025-12-04T10:08:29.1434739Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1434741Z 2025-12-04T10:08:29.1434834Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1434920Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1435002Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1435004Z 2025-12-04T10:08:29.1435088Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1435192Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1435227Z If the test 2025-12-04T10:08:29.1435322Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1435384Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1435481Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1435563Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1435565Z 2025-12-04T10:08:29.1435657Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1435745Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1435782Z the following. 2025-12-04T10:08:29.1435785Z 2025-12-04T10:08:29.1435873Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1435963Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1436014Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1436078Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1436139Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1436141Z 2025-12-04T10:08:29.1436173Z Got: 2025-12-04T10:08:29.1436247Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.1436297Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.1436359Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.1436408Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.1436469Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.1436515Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.1436576Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.1436623Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.1436683Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.1436732Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.1436734Z 2025-12-04T10:08:29.1436795Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.1436858Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.1436918Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.1436963Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.1437044Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.1437091Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.1437151Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.1437195Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.1437256Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.1437306Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.1437308Z 2025-12-04T10:08:29.1437310Z 2025-12-04T10:08:29.1437370Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1437427Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1437489Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1437534Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1437597Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1437644Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1437704Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1437750Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1437810Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1437859Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1437862Z 2025-12-04T10:08:29.1437920Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1437967Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1438028Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1438075Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1438134Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1438181Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1438239Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1438285Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1438345Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1438406Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1438449Z dtype=torch.complex128) 2025-12-04T10:08:29.1438451Z 2025-12-04T10:08:29.1438487Z Expected: 2025-12-04T10:08:29.1438561Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1438602Z 0.3401-0.5673j], 2025-12-04T10:08:29.1438666Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1438702Z 0.2078-0.7444j], 2025-12-04T10:08:29.1438766Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1438805Z 0.4109+0.5305j], 2025-12-04T10:08:29.1438869Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1438906Z -0.3607+0.5386j], 2025-12-04T10:08:29.1438971Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1439010Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1439012Z 2025-12-04T10:08:29.1439074Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1439111Z 0.5323-0.4729j], 2025-12-04T10:08:29.1439173Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1439226Z -0.6732-0.7677j], 2025-12-04T10:08:29.1439288Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1439325Z -0.5241-0.5479j], 2025-12-04T10:08:29.1439386Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1439444Z -0.3257-0.6597j], 2025-12-04T10:08:29.1439508Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1439546Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1439548Z 2025-12-04T10:08:29.1439550Z 2025-12-04T10:08:29.1439615Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1439650Z -0.6637-0.1175j], 2025-12-04T10:08:29.1439713Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1439748Z 0.4261-0.3012j], 2025-12-04T10:08:29.1439822Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1439860Z 0.2567-0.1808j], 2025-12-04T10:08:29.1439924Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1439959Z 0.1761-1.6446j], 2025-12-04T10:08:29.1440027Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1440066Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1440068Z 2025-12-04T10:08:29.1440130Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1440166Z -0.6307+0.1756j], 2025-12-04T10:08:29.1440229Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1440265Z -0.9972-0.3518j], 2025-12-04T10:08:29.1440328Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1440363Z 0.6467+0.0201j], 2025-12-04T10:08:29.1440426Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1440462Z -1.0443-0.3699j], 2025-12-04T10:08:29.1440526Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1440591Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1440595Z 2025-12-04T10:08:29.1440896Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1440898Z 2025-12-04T10:08:29.1440973Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1441180Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1441182Z 2025-12-04T10:08:29.1441270Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1441365Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1441411Z Traceback (most recent call last): 2025-12-04T10:08:29.1441582Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1441625Z return test(*args, **kwargs) 2025-12-04T10:08:29.1441662Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1441768Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1441833Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1442003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1442123Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1442189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1442349Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1442431Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1442474Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1442632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1442700Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1442745Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1442885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1442970Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1443032Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1443185Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1443236Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1443391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1443437Z raise GradcheckError( 2025-12-04T10:08:29.1443526Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1443528Z 2025-12-04T10:08:29.1443622Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1443704Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1443786Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1443788Z 2025-12-04T10:08:29.1443872Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1443978Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1444013Z If the test 2025-12-04T10:08:29.1444107Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1444171Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1444267Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1444348Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1444350Z 2025-12-04T10:08:29.1444441Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1444526Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1444563Z the following. 2025-12-04T10:08:29.1444565Z 2025-12-04T10:08:29.1444653Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1444745Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1444796Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1444861Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1444922Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1444927Z 2025-12-04T10:08:29.1444959Z Got: 2025-12-04T10:08:29.1445011Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445056Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445097Z nan+nanj], 2025-12-04T10:08:29.1445140Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445184Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445223Z nan+nanj], 2025-12-04T10:08:29.1445266Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445307Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1445345Z nan+nanj], 2025-12-04T10:08:29.1445419Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1445475Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1445515Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1445580Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1445647Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1445690Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1445692Z 2025-12-04T10:08:29.1445742Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1445794Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1445833Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1445883Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1445932Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1445972Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1446040Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1446091Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1446131Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1446181Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1446232Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1446272Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1446320Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1446370Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1446412Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1446414Z 2025-12-04T10:08:29.1446416Z 2025-12-04T10:08:29.1446468Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1446518Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1446557Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1446609Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1446660Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1446697Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1446750Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1446802Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1446841Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1446890Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1446940Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1446979Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1447029Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1447078Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1447120Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1447122Z 2025-12-04T10:08:29.1447173Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1447224Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1447263Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1447315Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1447366Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1447404Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1447454Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1447503Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1447543Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1447592Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1447642Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1447680Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1447733Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1447795Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1447847Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1447890Z dtype=torch.complex128) 2025-12-04T10:08:29.1447902Z 2025-12-04T10:08:29.1447948Z Expected: 2025-12-04T10:08:29.1448025Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1448064Z 0.3401-0.5673j], 2025-12-04T10:08:29.1448128Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1448166Z 0.2078-0.7444j], 2025-12-04T10:08:29.1448230Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1448269Z 0.4109+0.5305j], 2025-12-04T10:08:29.1448333Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1448372Z -0.3607+0.5386j], 2025-12-04T10:08:29.1448447Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1448486Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1448488Z 2025-12-04T10:08:29.1448552Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1448593Z 0.5323-0.4729j], 2025-12-04T10:08:29.1448655Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1448692Z -0.6732-0.7677j], 2025-12-04T10:08:29.1448754Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1448790Z -0.5241-0.5479j], 2025-12-04T10:08:29.1448852Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1448888Z -0.3257-0.6597j], 2025-12-04T10:08:29.1448949Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1448991Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1448994Z 2025-12-04T10:08:29.1448996Z 2025-12-04T10:08:29.1449058Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1449095Z -0.6637-0.1175j], 2025-12-04T10:08:29.1449158Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1449195Z 0.4261-0.3012j], 2025-12-04T10:08:29.1449258Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1449295Z 0.2567-0.1808j], 2025-12-04T10:08:29.1449356Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1449393Z 0.1761-1.6446j], 2025-12-04T10:08:29.1449454Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1449494Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1449496Z 2025-12-04T10:08:29.1449558Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1449596Z -0.6307+0.1756j], 2025-12-04T10:08:29.1449659Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1449695Z -0.9972-0.3518j], 2025-12-04T10:08:29.1449758Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1449795Z 0.6467+0.0201j], 2025-12-04T10:08:29.1449859Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1449896Z -1.0443-0.3699j], 2025-12-04T10:08:29.1449959Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1450024Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1450026Z 2025-12-04T10:08:29.1450110Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1450112Z 2025-12-04T10:08:29.1450157Z Traceback (most recent call last): 2025-12-04T10:08:29.1450315Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1450367Z method(*args, **kwargs) 2025-12-04T10:08:29.1450554Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1450611Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1450651Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1450811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1450855Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1450892Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1451051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1451092Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1451143Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1451296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1451335Z fn(*args, **kwargs) 2025-12-04T10:08:29.1451502Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1451546Z raise e_tracked from e 2025-12-04T10:08:29.1451591Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1451593Z 2025-12-04T10:08:29.1451686Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1451770Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1451851Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1451853Z 2025-12-04T10:08:29.1451938Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1452043Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1452079Z If the test 2025-12-04T10:08:29.1452172Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1452235Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1452333Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1452415Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1452417Z 2025-12-04T10:08:29.1452507Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1452593Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1452628Z the following. 2025-12-04T10:08:29.1452630Z 2025-12-04T10:08:29.1452719Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1452811Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1452864Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1452973Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1453037Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1453042Z 2025-12-04T10:08:29.1453074Z Got: 2025-12-04T10:08:29.1453125Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453170Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453212Z nan+nanj], 2025-12-04T10:08:29.1453258Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453302Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453340Z nan+nanj], 2025-12-04T10:08:29.1453382Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453424Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.1453463Z nan+nanj], 2025-12-04T10:08:29.1453547Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.1453602Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.1453641Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.1453696Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.1453779Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.1453822Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.1453824Z 2025-12-04T10:08:29.1453875Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.1453926Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.1454128Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.1454178Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.1454230Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.1454270Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.1454340Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.1454394Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.1454434Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.1454485Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.1454539Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.1454578Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.1454628Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.1454677Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.1454718Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.1454720Z 2025-12-04T10:08:29.1454722Z 2025-12-04T10:08:29.1454771Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.1454821Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.1454859Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.1454912Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.1454962Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.1455000Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.1455049Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.1455102Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.1455140Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.1455191Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.1455239Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.1455278Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.1455328Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.1455378Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.1455419Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.1455421Z 2025-12-04T10:08:29.1455476Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.1455526Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.1455565Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.1455615Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.1455671Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.1455711Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.1455762Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.1455811Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.1455850Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.1455899Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.1455949Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.1455987Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.1456041Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.1456102Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.1456153Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1456198Z dtype=torch.complex128) 2025-12-04T10:08:29.1456210Z 2025-12-04T10:08:29.1456265Z Expected: 2025-12-04T10:08:29.1456343Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1456381Z 0.3401-0.5673j], 2025-12-04T10:08:29.1456446Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1456482Z 0.2078-0.7444j], 2025-12-04T10:08:29.1456548Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1456584Z 0.4109+0.5305j], 2025-12-04T10:08:29.1456647Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1456684Z -0.3607+0.5386j], 2025-12-04T10:08:29.1456761Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1456800Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1456802Z 2025-12-04T10:08:29.1456866Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1456906Z 0.5323-0.4729j], 2025-12-04T10:08:29.1456969Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1457007Z -0.6732-0.7677j], 2025-12-04T10:08:29.1457071Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1457107Z -0.5241-0.5479j], 2025-12-04T10:08:29.1457170Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1457206Z -0.3257-0.6597j], 2025-12-04T10:08:29.1457268Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1457307Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1457310Z 2025-12-04T10:08:29.1457315Z 2025-12-04T10:08:29.1457377Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1457413Z -0.6637-0.1175j], 2025-12-04T10:08:29.1457475Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1457512Z 0.4261-0.3012j], 2025-12-04T10:08:29.1457576Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1457612Z 0.2567-0.1808j], 2025-12-04T10:08:29.1457675Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1457710Z 0.1761-1.6446j], 2025-12-04T10:08:29.1457772Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1457811Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1457813Z 2025-12-04T10:08:29.1457875Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1457914Z -0.6307+0.1756j], 2025-12-04T10:08:29.1457978Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1458016Z -0.9972-0.3518j], 2025-12-04T10:08:29.1458078Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1458116Z 0.6467+0.0201j], 2025-12-04T10:08:29.1458178Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1458214Z -1.0443-0.3699j], 2025-12-04T10:08:29.1458278Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1458346Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1458348Z 2025-12-04T10:08:29.1458649Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1458666Z 2025-12-04T10:08:29.1458741Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1458962Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1458977Z 2025-12-04T10:08:29.1459066Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1459161Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1459209Z Traceback (most recent call last): 2025-12-04T10:08:29.1459381Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1459425Z return test(*args, **kwargs) 2025-12-04T10:08:29.1459462Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1459581Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1459651Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1459818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1459943Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1459997Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1460160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1460216Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1460259Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1460414Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1460486Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1460531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1460672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1460718Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1460756Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1460907Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1460959Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1461112Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1461154Z raise GradcheckError( 2025-12-04T10:08:29.1461242Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1461245Z 2025-12-04T10:08:29.1461340Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1461422Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1461503Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1461507Z 2025-12-04T10:08:29.1461592Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1461694Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1461730Z If the test 2025-12-04T10:08:29.1461823Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1461886Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1461982Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1462065Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1462081Z 2025-12-04T10:08:29.1462172Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1462257Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1462292Z the following. 2025-12-04T10:08:29.1462304Z 2025-12-04T10:08:29.1462405Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1462495Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1462547Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1462610Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1462672Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1462674Z 2025-12-04T10:08:29.1462706Z Got: 2025-12-04T10:08:29.1462780Z tensor([[[[-0.7499+7.9689e-02j, 0.4165+1.4766e+00j, 1.5247+5.0402e-01j, 2025-12-04T10:08:29.1462829Z 1.3123-5.3347e-01j, 0.4542-7.5753e-01j], 2025-12-04T10:08:29.1462909Z [-0.2588+5.7469e-02j, -0.1069-4.4588e-02j, -0.2044-6.2121e-02j, 2025-12-04T10:08:29.1463002Z -0.3187+1.9331e-01j, -0.0786+2.8273e-01j], 2025-12-04T10:08:29.1463065Z [-0.8428+1.5904e-01j, -0.8617+4.2893e-01j, 0.4993-3.1053e-01j, 2025-12-04T10:08:29.1463113Z 0.0946-1.3069e+00j, 0.3077+3.9864e-01j], 2025-12-04T10:08:29.1463173Z [ 0.6304+3.6678e-01j, 0.2421+2.7488e-01j, 0.5533+7.8709e-02j, 2025-12-04T10:08:29.1463220Z -0.1413-2.5671e-01j, -0.1509+2.2603e-01j], 2025-12-04T10:08:29.1463282Z [-0.1904-1.7169e-01j, -0.4927+3.7829e-02j, 0.3475-1.2213e-01j, 2025-12-04T10:08:29.1463329Z 0.0702-2.6610e-01j, 0.0273+3.4017e-02j]], 2025-12-04T10:08:29.1463333Z 2025-12-04T10:08:29.1463393Z [[-0.2735+2.7945e-01j, 0.5785+4.5411e-01j, -0.2751-9.2563e-01j, 2025-12-04T10:08:29.1463438Z 0.1731-8.7656e-02j, 0.3021-2.6932e-01j], 2025-12-04T10:08:29.1463501Z [10.2294+1.2576e+00j, -1.5731-4.2476e+00j, 13.9668+4.4408e-01j, 2025-12-04T10:08:29.1463550Z -9.0056-2.5138e-01j, -7.9876-8.4908e+00j], 2025-12-04T10:08:29.1463610Z [-0.1736+2.4183e-01j, -0.1565+2.8948e-01j, -0.4142-1.7474e-02j, 2025-12-04T10:08:29.1463655Z 0.3292-2.3187e-02j, 0.1501+1.5730e-01j], 2025-12-04T10:08:29.1463717Z [-0.0505-8.0762e-02j, 0.0752+1.5787e-01j, -0.1486+2.3338e-01j, 2025-12-04T10:08:29.1463764Z 0.0531-4.1295e-02j, -0.0529-1.0772e-01j], 2025-12-04T10:08:29.1463846Z [ 0.8451+2.8546e-01j, 0.3707+3.9648e-01j, -1.6023+1.2035e-01j, 2025-12-04T10:08:29.1463898Z -0.2033+3.8601e-01j, 0.2856+8.8294e-02j]]], 2025-12-04T10:08:29.1463900Z 2025-12-04T10:08:29.1463902Z 2025-12-04T10:08:29.1463961Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1464008Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1464069Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1464116Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1464177Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1464226Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1464289Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1464339Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1464399Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1464450Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1464452Z 2025-12-04T10:08:29.1464510Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1464556Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1464615Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1464664Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1464742Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1464787Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1464846Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1464919Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1464980Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1465040Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1465086Z dtype=torch.complex128) 2025-12-04T10:08:29.1465088Z 2025-12-04T10:08:29.1465122Z Expected: 2025-12-04T10:08:29.1465197Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1465234Z 0.3401-0.5673j], 2025-12-04T10:08:29.1465300Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1465354Z 0.2078-0.7444j], 2025-12-04T10:08:29.1465420Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1465457Z 0.4109+0.5305j], 2025-12-04T10:08:29.1465522Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1465560Z -0.3607+0.5386j], 2025-12-04T10:08:29.1465624Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1465662Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1465664Z 2025-12-04T10:08:29.1465727Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1465762Z 0.5323-0.4729j], 2025-12-04T10:08:29.1465825Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1465862Z -0.6732-0.7677j], 2025-12-04T10:08:29.1465924Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1465963Z -0.5241-0.5479j], 2025-12-04T10:08:29.1466026Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1466062Z -0.3257-0.6597j], 2025-12-04T10:08:29.1466125Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1466164Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1466166Z 2025-12-04T10:08:29.1466168Z 2025-12-04T10:08:29.1466231Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1466267Z -0.6637-0.1175j], 2025-12-04T10:08:29.1466332Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1466367Z 0.4261-0.3012j], 2025-12-04T10:08:29.1466434Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1466469Z 0.2567-0.1808j], 2025-12-04T10:08:29.1466535Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1466572Z 0.1761-1.6446j], 2025-12-04T10:08:29.1466635Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1466674Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1466678Z 2025-12-04T10:08:29.1466740Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1466780Z -0.6307+0.1756j], 2025-12-04T10:08:29.1466843Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1466880Z -0.9972-0.3518j], 2025-12-04T10:08:29.1466942Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1466980Z 0.6467+0.0201j], 2025-12-04T10:08:29.1467044Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1467080Z -1.0443-0.3699j], 2025-12-04T10:08:29.1467145Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1467223Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1467225Z 2025-12-04T10:08:29.1467307Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1467328Z 2025-12-04T10:08:29.1467385Z Traceback (most recent call last): 2025-12-04T10:08:29.1467543Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1467585Z method(*args, **kwargs) 2025-12-04T10:08:29.1467761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1467808Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1467846Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1468007Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1468064Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1468103Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1468260Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1468305Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1468341Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1468497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1468534Z fn(*args, **kwargs) 2025-12-04T10:08:29.1468704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1468745Z raise e_tracked from e 2025-12-04T10:08:29.1468790Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1468792Z 2025-12-04T10:08:29.1468886Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1468970Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1469051Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1469053Z 2025-12-04T10:08:29.1469139Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1469243Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1469277Z If the test 2025-12-04T10:08:29.1469372Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1469434Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1469529Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1469610Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1469613Z 2025-12-04T10:08:29.1469705Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1469790Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1469827Z the following. 2025-12-04T10:08:29.1469829Z 2025-12-04T10:08:29.1469917Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1470010Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1470060Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1470124Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1470185Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1470187Z 2025-12-04T10:08:29.1470220Z Got: 2025-12-04T10:08:29.1470291Z tensor([[[[-0.7499+7.9689e-02j, 0.4165+1.4766e+00j, 1.5247+5.0402e-01j, 2025-12-04T10:08:29.1470341Z 1.3123-5.3347e-01j, 0.4542-7.5753e-01j], 2025-12-04T10:08:29.1470405Z [-0.2588+5.7469e-02j, -0.1069-4.4588e-02j, -0.2044-6.2121e-02j, 2025-12-04T10:08:29.1470466Z -0.3187+1.9331e-01j, -0.0786+2.8273e-01j], 2025-12-04T10:08:29.1470531Z [-0.8428+1.5904e-01j, -0.8617+4.2893e-01j, 0.4993-3.1053e-01j, 2025-12-04T10:08:29.1470577Z 0.0946-1.3069e+00j, 0.3077+3.9864e-01j], 2025-12-04T10:08:29.1470658Z [ 0.6304+3.6678e-01j, 0.2421+2.7488e-01j, 0.5533+7.8709e-02j, 2025-12-04T10:08:29.1470705Z -0.1413-2.5671e-01j, -0.1509+2.2603e-01j], 2025-12-04T10:08:29.1470766Z [-0.1904-1.7169e-01j, -0.4927+3.7829e-02j, 0.3475-1.2213e-01j, 2025-12-04T10:08:29.1470813Z 0.0702-2.6610e-01j, 0.0273+3.4017e-02j]], 2025-12-04T10:08:29.1470815Z 2025-12-04T10:08:29.1470875Z [[-0.2735+2.7945e-01j, 0.5785+4.5411e-01j, -0.2751-9.2563e-01j, 2025-12-04T10:08:29.1470919Z 0.1731-8.7656e-02j, 0.3021-2.6932e-01j], 2025-12-04T10:08:29.1470983Z [10.2294+1.2576e+00j, -1.5731-4.2476e+00j, 13.9668+4.4408e-01j, 2025-12-04T10:08:29.1471042Z -9.0056-2.5138e-01j, -7.9876-8.4908e+00j], 2025-12-04T10:08:29.1471104Z [-0.1736+2.4183e-01j, -0.1565+2.8948e-01j, -0.4142-1.7474e-02j, 2025-12-04T10:08:29.1471149Z 0.3292-2.3187e-02j, 0.1501+1.5730e-01j], 2025-12-04T10:08:29.1471209Z [-0.0505-8.0762e-02j, 0.0752+1.5787e-01j, -0.1486+2.3338e-01j, 2025-12-04T10:08:29.1471255Z 0.0531-4.1295e-02j, -0.0529-1.0772e-01j], 2025-12-04T10:08:29.1471318Z [ 0.8451+2.8546e-01j, 0.3707+3.9648e-01j, -1.6023+1.2035e-01j, 2025-12-04T10:08:29.1471370Z -0.2033+3.8601e-01j, 0.2856+8.8294e-02j]]], 2025-12-04T10:08:29.1471372Z 2025-12-04T10:08:29.1471373Z 2025-12-04T10:08:29.1471433Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1471479Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1471540Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1471585Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1471649Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1471695Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1471755Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1471803Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1471862Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1471909Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1471912Z 2025-12-04T10:08:29.1471971Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1472017Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1472079Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1472127Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1472186Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1472233Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1472291Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1472336Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1472399Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1472460Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1472503Z dtype=torch.complex128) 2025-12-04T10:08:29.1472505Z 2025-12-04T10:08:29.1472541Z Expected: 2025-12-04T10:08:29.1472617Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1472656Z 0.3401-0.5673j], 2025-12-04T10:08:29.1472721Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1472759Z 0.2078-0.7444j], 2025-12-04T10:08:29.1472824Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1472874Z 0.4109+0.5305j], 2025-12-04T10:08:29.1472972Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1473010Z -0.3607+0.5386j], 2025-12-04T10:08:29.1473100Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1473140Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1473142Z 2025-12-04T10:08:29.1473204Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1473241Z 0.5323-0.4729j], 2025-12-04T10:08:29.1473304Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1473341Z -0.6732-0.7677j], 2025-12-04T10:08:29.1473402Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1473439Z -0.5241-0.5479j], 2025-12-04T10:08:29.1473516Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1473555Z -0.3257-0.6597j], 2025-12-04T10:08:29.1473617Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1473656Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1473659Z 2025-12-04T10:08:29.1473662Z 2025-12-04T10:08:29.1473726Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1473763Z -0.6637-0.1175j], 2025-12-04T10:08:29.1473826Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1473861Z 0.4261-0.3012j], 2025-12-04T10:08:29.1473924Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1473959Z 0.2567-0.1808j], 2025-12-04T10:08:29.1474022Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1474058Z 0.1761-1.6446j], 2025-12-04T10:08:29.1474126Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1474165Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1474167Z 2025-12-04T10:08:29.1474229Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1474268Z -0.6307+0.1756j], 2025-12-04T10:08:29.1474335Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1474371Z -0.9972-0.3518j], 2025-12-04T10:08:29.1474434Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1474470Z 0.6467+0.0201j], 2025-12-04T10:08:29.1474531Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1474567Z -1.0443-0.3699j], 2025-12-04T10:08:29.1474631Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1474696Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1474699Z 2025-12-04T10:08:29.1475002Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1475005Z 2025-12-04T10:08:29.1475080Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1475288Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1475290Z 2025-12-04T10:08:29.1475376Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1475471Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1475519Z Traceback (most recent call last): 2025-12-04T10:08:29.1475690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1475752Z return test(*args, **kwargs) 2025-12-04T10:08:29.1475789Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1475918Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1475983Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1476152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1476273Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1476325Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1476505Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1476565Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1476608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1476763Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1476831Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1476876Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1477014Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1477061Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1477099Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1477251Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1477302Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1477457Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1477499Z raise GradcheckError( 2025-12-04T10:08:29.1477588Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1477592Z 2025-12-04T10:08:29.1477687Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1477770Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1477851Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1477853Z 2025-12-04T10:08:29.1477937Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1478043Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1478077Z If the test 2025-12-04T10:08:29.1478171Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1478235Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1478330Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1478412Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1478416Z 2025-12-04T10:08:29.1478509Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1478593Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1478630Z the following. 2025-12-04T10:08:29.1478632Z 2025-12-04T10:08:29.1478721Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1478811Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1478863Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1478928Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1479006Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1479010Z 2025-12-04T10:08:29.1479042Z Got: 2025-12-04T10:08:29.1479107Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.1479161Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.1479223Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.1479277Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.1479330Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.1479369Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.1479419Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.1479470Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.1479510Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.1479559Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.1479625Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.1479667Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.1479717Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.1479766Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.1479811Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.1479813Z 2025-12-04T10:08:29.1479862Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.1479915Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.1479953Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.1480003Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.1480052Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.1480093Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.1480141Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.1480193Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.1480234Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.1480285Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.1480335Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.1480375Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.1480424Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.1480477Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.1480518Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.1480520Z 2025-12-04T10:08:29.1480521Z 2025-12-04T10:08:29.1480572Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1480621Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1480663Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1480713Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1480764Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1480803Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1480857Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1480908Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1480949Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1480999Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1481049Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1481087Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1481136Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1481186Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1481227Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1481229Z 2025-12-04T10:08:29.1481279Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1481329Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1481381Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1481431Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1481483Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1481543Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1481595Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1481644Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1481683Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1481732Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1481783Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1481822Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1481873Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1481923Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1481988Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1482032Z dtype=torch.complex128) 2025-12-04T10:08:29.1482034Z 2025-12-04T10:08:29.1482069Z Expected: 2025-12-04T10:08:29.1482144Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1482184Z 0.3406-0.5682j], 2025-12-04T10:08:29.1482249Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1482286Z 0.2069-0.7450j], 2025-12-04T10:08:29.1482350Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1482387Z 0.4118+0.5311j], 2025-12-04T10:08:29.1482449Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1482487Z -0.3628+0.5383j], 2025-12-04T10:08:29.1482548Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1482588Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1482591Z 2025-12-04T10:08:29.1482653Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1482690Z 0.5325-0.4733j], 2025-12-04T10:08:29.1482753Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1482793Z -0.6729-0.7686j], 2025-12-04T10:08:29.1482855Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1482892Z -0.5258-0.5473j], 2025-12-04T10:08:29.1482995Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1483033Z -0.3244-0.6603j], 2025-12-04T10:08:29.1483094Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1483132Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1483134Z 2025-12-04T10:08:29.1483136Z 2025-12-04T10:08:29.1483199Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1483238Z -0.6623-0.1171j], 2025-12-04T10:08:29.1483301Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1483337Z 0.4266-0.2997j], 2025-12-04T10:08:29.1483401Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1483438Z 0.2556-0.1819j], 2025-12-04T10:08:29.1483502Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1483537Z 0.1768-1.6449j], 2025-12-04T10:08:29.1483600Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1483638Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1483640Z 2025-12-04T10:08:29.1483702Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1483739Z -0.6312+0.1775j], 2025-12-04T10:08:29.1483804Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1483857Z -0.9967-0.3519j], 2025-12-04T10:08:29.1483919Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1483955Z 0.6457+0.0238j], 2025-12-04T10:08:29.1484029Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1484078Z -1.0432-0.3734j], 2025-12-04T10:08:29.1484142Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1484206Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1484208Z 2025-12-04T10:08:29.1484292Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1484294Z 2025-12-04T10:08:29.1484341Z Traceback (most recent call last): 2025-12-04T10:08:29.1484503Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1484559Z method(*args, **kwargs) 2025-12-04T10:08:29.1484740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1484786Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1484827Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1484989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1485035Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1485072Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1485233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1485275Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1485313Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1485467Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1485508Z fn(*args, **kwargs) 2025-12-04T10:08:29.1485677Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1485720Z raise e_tracked from e 2025-12-04T10:08:29.1485766Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1485768Z 2025-12-04T10:08:29.1485861Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1485944Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1486025Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1486027Z 2025-12-04T10:08:29.1486113Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1486214Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1486251Z If the test 2025-12-04T10:08:29.1486347Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1486410Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1486504Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1486588Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1486591Z 2025-12-04T10:08:29.1486685Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1486772Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1486809Z the following. 2025-12-04T10:08:29.1486812Z 2025-12-04T10:08:29.1486904Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1486994Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1487046Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1487124Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1487188Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1487190Z 2025-12-04T10:08:29.1487224Z Got: 2025-12-04T10:08:29.1487285Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.1487363Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.1487404Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.1487457Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.1487508Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.1487550Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.1487602Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.1487655Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.1487693Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.1487762Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.1487815Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.1487856Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.1487905Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.1487959Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.1488001Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.1488005Z 2025-12-04T10:08:29.1488057Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.1488107Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.1488146Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.1488199Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.1488250Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.1488288Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.1488338Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.1488392Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.1488433Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.1488483Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.1488536Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.1488574Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.1488623Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.1488675Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.1488716Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.1488719Z 2025-12-04T10:08:29.1488721Z 2025-12-04T10:08:29.1488770Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1488821Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1488860Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1488911Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1488963Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1489003Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1489053Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1489109Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1489148Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1489198Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1489247Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1489287Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1489338Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1489387Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1489427Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1489431Z 2025-12-04T10:08:29.1489482Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1489548Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1489587Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1489638Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1489710Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1489751Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1489801Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1489851Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1489888Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1489943Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1489994Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1490033Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1490082Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1490147Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1490200Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1490243Z dtype=torch.complex128) 2025-12-04T10:08:29.1490245Z 2025-12-04T10:08:29.1490282Z Expected: 2025-12-04T10:08:29.1490359Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1490396Z 0.3406-0.5682j], 2025-12-04T10:08:29.1490464Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1490503Z 0.2069-0.7450j], 2025-12-04T10:08:29.1490568Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1490604Z 0.4118+0.5311j], 2025-12-04T10:08:29.1490674Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1490711Z -0.3628+0.5383j], 2025-12-04T10:08:29.1490776Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1490815Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1490817Z 2025-12-04T10:08:29.1490882Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1490922Z 0.5325-0.4733j], 2025-12-04T10:08:29.1490987Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1491024Z -0.6729-0.7686j], 2025-12-04T10:08:29.1491086Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1491122Z -0.5258-0.5473j], 2025-12-04T10:08:29.1491186Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1491223Z -0.3244-0.6603j], 2025-12-04T10:08:29.1491288Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1491326Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1491327Z 2025-12-04T10:08:29.1491329Z 2025-12-04T10:08:29.1491396Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1491433Z -0.6623-0.1171j], 2025-12-04T10:08:29.1491497Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1491534Z 0.4266-0.2997j], 2025-12-04T10:08:29.1491602Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1491641Z 0.2556-0.1819j], 2025-12-04T10:08:29.1491706Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1491743Z 0.1768-1.6449j], 2025-12-04T10:08:29.1491806Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1491849Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1491850Z 2025-12-04T10:08:29.1491913Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1491951Z -0.6312+0.1775j], 2025-12-04T10:08:29.1492028Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1492066Z -0.9967-0.3519j], 2025-12-04T10:08:29.1492128Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1492187Z 0.6457+0.0238j], 2025-12-04T10:08:29.1492249Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1492287Z -1.0432-0.3734j], 2025-12-04T10:08:29.1492352Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1492419Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1492422Z 2025-12-04T10:08:29.1492718Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1492731Z 2025-12-04T10:08:29.1492808Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1493048Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1493052Z 2025-12-04T10:08:29.1493141Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1493236Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1493284Z Traceback (most recent call last): 2025-12-04T10:08:29.1493460Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1493502Z return test(*args, **kwargs) 2025-12-04T10:08:29.1493542Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1493651Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1493719Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1493887Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1494012Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1494065Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1494227Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1494282Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1494327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1494482Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1494552Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1494596Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1494735Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1494783Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1494821Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1494973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.1495015Z _gradcheck_real_imag( 2025-12-04T10:08:29.1495171Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1505, in _gradcheck_real_imag 2025-12-04T10:08:29.1495208Z gradcheck_fn( 2025-12-04T10:08:29.1495355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.1495403Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.1497096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.1497138Z raise GradcheckError( 2025-12-04T10:08:29.1497376Z torch.autograd.gradcheck.GradcheckError: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1497431Z numerical:(2.2877583977282128+2512.0369106069234j) 2025-12-04T10:08:29.1497486Z analytical:(2.2877583962149695+0.5241653412004752j) 2025-12-04T10:08:29.1497488Z 2025-12-04T10:08:29.1497589Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1497697Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1497799Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1497801Z 2025-12-04T10:08:29.1499732Z Numerical: 2025-12-04T10:08:29.1499811Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.1499863Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1499901Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1499973Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.1500021Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500059Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1500122Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.1500170Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500206Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1500240Z ..., 2025-12-04T10:08:29.1500301Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500347Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500386Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1500449Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500494Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500531Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1500593Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1500641Z ..., 10.0033-4.4409e-10j, -8.3182+0.0000e+00j, 2025-12-04T10:08:29.1500713Z 12.6339+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1500749Z Analytical: 2025-12-04T10:08:29.1500819Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.1500868Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1500906Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1500968Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.1501018Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1501060Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1501121Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.1501168Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1501205Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1501241Z ..., 2025-12-04T10:08:29.1501300Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1501346Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1501382Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1501443Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1501487Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1501524Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1501585Z [-0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1501636Z ..., 10.0033+1.0039e-16j, -8.3182-8.3477e-17j, 2025-12-04T10:08:29.1501718Z 12.6339+1.2679e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1501721Z 2025-12-04T10:08:29.1501796Z The max per-element difference (slow mode) is: 9724.518089195833. 2025-12-04T10:08:29.1501798Z 2025-12-04T10:08:29.1501810Z 2025-12-04T10:08:29.1501910Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1501912Z 2025-12-04T10:08:29.1501958Z Traceback (most recent call last): 2025-12-04T10:08:29.1502117Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1502159Z method(*args, **kwargs) 2025-12-04T10:08:29.1502335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1502380Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1502421Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1502598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1502642Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1502681Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1502845Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1502886Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1502923Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1503220Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1503259Z fn(*args, **kwargs) 2025-12-04T10:08:29.1503425Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1503466Z raise e_tracked from e 2025-12-04T10:08:29.1503626Z Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.1503680Z numerical:(2.2877583977282128+2512.0369106069234j) 2025-12-04T10:08:29.1503734Z analytical:(2.2877583962149695+0.5241653412004752j) 2025-12-04T10:08:29.1503738Z 2025-12-04T10:08:29.1503841Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.1503946Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.1504045Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.1504047Z 2025-12-04T10:08:29.1504084Z Numerical: 2025-12-04T10:08:29.1504156Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.1504205Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504243Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1504307Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.1504354Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504391Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1504452Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.1504500Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504536Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1504570Z ..., 2025-12-04T10:08:29.1504629Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504675Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504711Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1504772Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504817Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504855Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1504913Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1504978Z ..., 10.0033-4.4409e-10j, -8.3182+0.0000e+00j, 2025-12-04T10:08:29.1505048Z 12.6339+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1505097Z Analytical: 2025-12-04T10:08:29.1505180Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.1505230Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1505270Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1505332Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.1505378Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1505416Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1505477Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.1505524Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1505561Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.1505610Z ..., 2025-12-04T10:08:29.1505670Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1505716Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1505752Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1505815Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1505860Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.1505897Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.1505958Z [-0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.1506005Z ..., 10.0033+1.0039e-16j, -8.3182-8.3477e-17j, 2025-12-04T10:08:29.1506074Z 12.6339+1.2679e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1506080Z 2025-12-04T10:08:29.1506153Z The max per-element difference (slow mode) is: 9724.518089195833. 2025-12-04T10:08:29.1506155Z 2025-12-04T10:08:29.1506157Z 2025-12-04T10:08:29.1506454Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1506457Z 2025-12-04T10:08:29.1506533Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1506742Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1506745Z 2025-12-04T10:08:29.1506832Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1506927Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1506972Z Traceback (most recent call last): 2025-12-04T10:08:29.1507145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1507188Z return test(*args, **kwargs) 2025-12-04T10:08:29.1507225Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1507331Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1507400Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1507568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1507689Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1507742Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1507904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1507963Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1508019Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1508175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1508263Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1508309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1508449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1508495Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1508533Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1508686Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1508736Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1508902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1508946Z raise GradcheckError( 2025-12-04T10:08:29.1509037Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1509039Z 2025-12-04T10:08:29.1509132Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1509216Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1509296Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1509299Z 2025-12-04T10:08:29.1509386Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1509491Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1509526Z If the test 2025-12-04T10:08:29.1509620Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1509681Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1509780Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1509862Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1509864Z 2025-12-04T10:08:29.1509958Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1510045Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1510082Z the following. 2025-12-04T10:08:29.1510084Z 2025-12-04T10:08:29.1510172Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1510262Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1510313Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1510377Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1510438Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1510443Z 2025-12-04T10:08:29.1510477Z Got: 2025-12-04T10:08:29.1510539Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.1510594Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.1510634Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.1510689Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.1510741Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.1510780Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.1510830Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.1510881Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.1510920Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.1510970Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.1511019Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.1511060Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.1511122Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.1511172Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.1511214Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.1511227Z 2025-12-04T10:08:29.1511289Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.1511341Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.1511379Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.1511429Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.1511477Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.1511517Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.1511565Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.1511618Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.1511656Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.1511720Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.1511769Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.1511808Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.1511859Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.1511909Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.1511950Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.1511952Z 2025-12-04T10:08:29.1511954Z 2025-12-04T10:08:29.1512004Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1512053Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1512092Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1512142Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1512193Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1512232Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1512285Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1512335Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1512375Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1512427Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1512477Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1512515Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1512565Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1512613Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1512655Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1512657Z 2025-12-04T10:08:29.1512706Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1512756Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1512796Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1512848Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1512897Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1512977Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1513030Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1513082Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1513120Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1513171Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1513219Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1513260Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1513309Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1513361Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1513412Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1513474Z dtype=torch.complex128) 2025-12-04T10:08:29.1513476Z 2025-12-04T10:08:29.1513510Z Expected: 2025-12-04T10:08:29.1513587Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1513625Z 0.3406-0.5682j], 2025-12-04T10:08:29.1513723Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1513762Z 0.2069-0.7450j], 2025-12-04T10:08:29.1513827Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1513864Z 0.4118+0.5311j], 2025-12-04T10:08:29.1513928Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1513965Z -0.3628+0.5383j], 2025-12-04T10:08:29.1514028Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1514067Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1514069Z 2025-12-04T10:08:29.1514147Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1514186Z 0.5325-0.4733j], 2025-12-04T10:08:29.1514249Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1514286Z -0.6729-0.7686j], 2025-12-04T10:08:29.1514350Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1514388Z -0.5258-0.5473j], 2025-12-04T10:08:29.1514450Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1514487Z -0.3244-0.6603j], 2025-12-04T10:08:29.1514549Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1514588Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1514590Z 2025-12-04T10:08:29.1514592Z 2025-12-04T10:08:29.1514654Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1514690Z -0.6623-0.1171j], 2025-12-04T10:08:29.1514755Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1514792Z 0.4266-0.2997j], 2025-12-04T10:08:29.1514857Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1514896Z 0.2556-0.1819j], 2025-12-04T10:08:29.1514958Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1514994Z 0.1768-1.6449j], 2025-12-04T10:08:29.1515057Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1515097Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1515099Z 2025-12-04T10:08:29.1515161Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1515198Z -0.6312+0.1775j], 2025-12-04T10:08:29.1515261Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1515298Z -0.9967-0.3519j], 2025-12-04T10:08:29.1515361Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1515397Z 0.6457+0.0238j], 2025-12-04T10:08:29.1515459Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1515500Z -1.0432-0.3734j], 2025-12-04T10:08:29.1515565Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1515633Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1515635Z 2025-12-04T10:08:29.1515718Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1515720Z 2025-12-04T10:08:29.1515764Z Traceback (most recent call last): 2025-12-04T10:08:29.1515922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1515962Z method(*args, **kwargs) 2025-12-04T10:08:29.1516141Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1516197Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1516236Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1516423Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1516468Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1516506Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1516665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1516706Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1516743Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1516893Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1516941Z fn(*args, **kwargs) 2025-12-04T10:08:29.1517110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1517150Z raise e_tracked from e 2025-12-04T10:08:29.1517195Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1517200Z 2025-12-04T10:08:29.1517294Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1517375Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1517456Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1517458Z 2025-12-04T10:08:29.1517542Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1517646Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1517681Z If the test 2025-12-04T10:08:29.1517775Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1517840Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1517935Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1518018Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1518022Z 2025-12-04T10:08:29.1518112Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1518197Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1518233Z the following. 2025-12-04T10:08:29.1518235Z 2025-12-04T10:08:29.1518324Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1518413Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1518464Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1518527Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1518592Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1518594Z 2025-12-04T10:08:29.1518626Z Got: 2025-12-04T10:08:29.1518688Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.1518740Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.1518783Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.1518835Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.1518888Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.1518926Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.1518978Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.1519028Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.1519067Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.1519116Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.1519167Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.1519220Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.1519270Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.1519319Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.1519386Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.1519388Z 2025-12-04T10:08:29.1519438Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.1519491Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.1519530Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.1519583Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.1519632Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.1519671Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.1519720Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.1519783Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.1519824Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.1519874Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.1519923Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.1519964Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.1520013Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.1520062Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.1520103Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.1520104Z 2025-12-04T10:08:29.1520106Z 2025-12-04T10:08:29.1520156Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1520205Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1520244Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1520295Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1520349Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1520388Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1520438Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1520488Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1520528Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1520579Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1520627Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1520666Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1520715Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1520764Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1520805Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1520807Z 2025-12-04T10:08:29.1520860Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1520912Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1520953Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1521004Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1521054Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1521095Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1521146Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1521195Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1521233Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1521283Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1521336Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1521375Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1521425Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1521475Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1521538Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1521582Z dtype=torch.complex128) 2025-12-04T10:08:29.1521584Z 2025-12-04T10:08:29.1521619Z Expected: 2025-12-04T10:08:29.1521694Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1521754Z 0.3406-0.5682j], 2025-12-04T10:08:29.1521820Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1521859Z 0.2069-0.7450j], 2025-12-04T10:08:29.1521924Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1521961Z 0.4118+0.5311j], 2025-12-04T10:08:29.1522024Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1522060Z -0.3628+0.5383j], 2025-12-04T10:08:29.1522125Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1522176Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1522179Z 2025-12-04T10:08:29.1522244Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1522280Z 0.5325-0.4733j], 2025-12-04T10:08:29.1522343Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1522383Z -0.6729-0.7686j], 2025-12-04T10:08:29.1522445Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1522481Z -0.5258-0.5473j], 2025-12-04T10:08:29.1522544Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1522580Z -0.3244-0.6603j], 2025-12-04T10:08:29.1522643Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1522680Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1522682Z 2025-12-04T10:08:29.1522684Z 2025-12-04T10:08:29.1522749Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1522786Z -0.6623-0.1171j], 2025-12-04T10:08:29.1522850Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1522885Z 0.4266-0.2997j], 2025-12-04T10:08:29.1522990Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1523026Z 0.2556-0.1819j], 2025-12-04T10:08:29.1523089Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1523125Z 0.1768-1.6449j], 2025-12-04T10:08:29.1523187Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1523225Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1523227Z 2025-12-04T10:08:29.1523289Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1523327Z -0.6312+0.1775j], 2025-12-04T10:08:29.1523391Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1523428Z -0.9967-0.3519j], 2025-12-04T10:08:29.1523491Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1523526Z 0.6457+0.0238j], 2025-12-04T10:08:29.1523590Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1523626Z -1.0432-0.3734j], 2025-12-04T10:08:29.1523690Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1523754Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1523757Z 2025-12-04T10:08:29.1524049Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1524051Z 2025-12-04T10:08:29.1524128Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1524360Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1524363Z 2025-12-04T10:08:29.1524480Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1524575Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1524622Z Traceback (most recent call last): 2025-12-04T10:08:29.1524795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1524838Z return test(*args, **kwargs) 2025-12-04T10:08:29.1524875Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1524980Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1525059Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1525232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1525353Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1525408Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1525572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1525628Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1525672Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1525827Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1525895Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1525942Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1526083Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1526127Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1526169Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1526321Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1526371Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1526524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1526566Z raise GradcheckError( 2025-12-04T10:08:29.1526655Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1526657Z 2025-12-04T10:08:29.1526751Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1526834Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1526915Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1526917Z 2025-12-04T10:08:29.1527002Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1527108Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1527143Z If the test 2025-12-04T10:08:29.1527236Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1527299Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1527393Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1527476Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1527478Z 2025-12-04T10:08:29.1527568Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1527667Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1527702Z the following. 2025-12-04T10:08:29.1527704Z 2025-12-04T10:08:29.1527796Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1527908Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1527960Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1528023Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1528084Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1528086Z 2025-12-04T10:08:29.1528118Z Got: 2025-12-04T10:08:29.1528190Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.1528240Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.1528305Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.1528366Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.1528429Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.1528476Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.1528541Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.1528588Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.1528649Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.1528698Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.1528700Z 2025-12-04T10:08:29.1528761Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.1528806Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.1528867Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.1528911Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.1528975Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.1529022Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.1529082Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.1529130Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.1529190Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.1529243Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.1529245Z 2025-12-04T10:08:29.1529247Z 2025-12-04T10:08:29.1529307Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1529354Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1529414Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1529460Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1529520Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1529567Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1529626Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1529675Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1529735Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1529784Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1529786Z 2025-12-04T10:08:29.1529845Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1529891Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1529950Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1530000Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1530063Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1530123Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1530182Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1530228Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1530311Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1530373Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1530416Z dtype=torch.complex128) 2025-12-04T10:08:29.1530421Z 2025-12-04T10:08:29.1530455Z Expected: 2025-12-04T10:08:29.1530529Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1530566Z 0.3401-0.5673j], 2025-12-04T10:08:29.1530630Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1530667Z 0.2078-0.7444j], 2025-12-04T10:08:29.1530746Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1530784Z 0.4109+0.5305j], 2025-12-04T10:08:29.1530847Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1530884Z -0.3607+0.5386j], 2025-12-04T10:08:29.1530950Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1530989Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1530991Z 2025-12-04T10:08:29.1531054Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1531089Z 0.5323-0.4729j], 2025-12-04T10:08:29.1531154Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1531191Z -0.6732-0.7677j], 2025-12-04T10:08:29.1531254Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1531289Z -0.5241-0.5479j], 2025-12-04T10:08:29.1531353Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1531390Z -0.3257-0.6597j], 2025-12-04T10:08:29.1531453Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1531491Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1531493Z 2025-12-04T10:08:29.1531495Z 2025-12-04T10:08:29.1531559Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1531594Z -0.6637-0.1175j], 2025-12-04T10:08:29.1531659Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1531696Z 0.4261-0.3012j], 2025-12-04T10:08:29.1531760Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1531796Z 0.2567-0.1808j], 2025-12-04T10:08:29.1531859Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1531895Z 0.1761-1.6446j], 2025-12-04T10:08:29.1531958Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1531998Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1532000Z 2025-12-04T10:08:29.1532062Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1532100Z -0.6307+0.1756j], 2025-12-04T10:08:29.1532163Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1532199Z -0.9972-0.3518j], 2025-12-04T10:08:29.1532263Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1532298Z 0.6467+0.0201j], 2025-12-04T10:08:29.1532359Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1532396Z -1.0443-0.3699j], 2025-12-04T10:08:29.1532458Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1532524Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1532539Z 2025-12-04T10:08:29.1532622Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1532624Z 2025-12-04T10:08:29.1532670Z Traceback (most recent call last): 2025-12-04T10:08:29.1532838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1532892Z method(*args, **kwargs) 2025-12-04T10:08:29.1533103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1533151Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1533189Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1533350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1533394Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1533432Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1533612Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1533655Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1533691Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1533846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1533884Z fn(*args, **kwargs) 2025-12-04T10:08:29.1534052Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1534093Z raise e_tracked from e 2025-12-04T10:08:29.1534139Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1534141Z 2025-12-04T10:08:29.1534233Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1534317Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1534400Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1534402Z 2025-12-04T10:08:29.1534485Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1534587Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1534623Z If the test 2025-12-04T10:08:29.1534718Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1534780Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1534876Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1534956Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1534958Z 2025-12-04T10:08:29.1535049Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1535132Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1535170Z the following. 2025-12-04T10:08:29.1535171Z 2025-12-04T10:08:29.1535259Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1535349Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1535402Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1535467Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1535529Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1535531Z 2025-12-04T10:08:29.1535563Z Got: 2025-12-04T10:08:29.1535634Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.1535685Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.1535747Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.1535795Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.1535871Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.1535918Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.1535978Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.1536057Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.1536117Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.1536166Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.1536168Z 2025-12-04T10:08:29.1536227Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.1536272Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.1536333Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.1536377Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.1536450Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.1536499Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.1536559Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.1536604Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.1536667Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.1536716Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.1536719Z 2025-12-04T10:08:29.1536720Z 2025-12-04T10:08:29.1536780Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.1536824Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.1536884Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.1536928Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.1536989Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.1537037Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.1537096Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.1537142Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.1537203Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.1537251Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.1537253Z 2025-12-04T10:08:29.1537313Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.1537359Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.1537418Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.1537466Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.1537525Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.1537570Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.1537630Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.1537676Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.1537736Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.1537798Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1537842Z dtype=torch.complex128) 2025-12-04T10:08:29.1537844Z 2025-12-04T10:08:29.1537879Z Expected: 2025-12-04T10:08:29.1537952Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.1537990Z 0.3401-0.5673j], 2025-12-04T10:08:29.1538052Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.1538089Z 0.2078-0.7444j], 2025-12-04T10:08:29.1538154Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.1538191Z 0.4109+0.5305j], 2025-12-04T10:08:29.1538267Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.1538305Z -0.3607+0.5386j], 2025-12-04T10:08:29.1538368Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.1538429Z 0.0854+0.1063j]], 2025-12-04T10:08:29.1538431Z 2025-12-04T10:08:29.1538493Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.1538530Z 0.5323-0.4729j], 2025-12-04T10:08:29.1538593Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.1538630Z -0.6732-0.7677j], 2025-12-04T10:08:29.1538691Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.1538728Z -0.5241-0.5479j], 2025-12-04T10:08:29.1538789Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.1538825Z -0.3257-0.6597j], 2025-12-04T10:08:29.1538901Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.1538940Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.1538942Z 2025-12-04T10:08:29.1538944Z 2025-12-04T10:08:29.1539009Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.1539046Z -0.6637-0.1175j], 2025-12-04T10:08:29.1539109Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.1539147Z 0.4261-0.3012j], 2025-12-04T10:08:29.1539210Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.1539247Z 0.2567-0.1808j], 2025-12-04T10:08:29.1539309Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.1539344Z 0.1761-1.6446j], 2025-12-04T10:08:29.1539407Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.1539448Z -0.5996-0.8700j]], 2025-12-04T10:08:29.1539449Z 2025-12-04T10:08:29.1539512Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.1539548Z -0.6307+0.1756j], 2025-12-04T10:08:29.1539611Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.1539649Z -0.9972-0.3518j], 2025-12-04T10:08:29.1539712Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.1539749Z 0.6467+0.0201j], 2025-12-04T10:08:29.1539810Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.1539846Z -1.0443-0.3699j], 2025-12-04T10:08:29.1539910Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.1539976Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1539978Z 2025-12-04T10:08:29.1540281Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1540284Z 2025-12-04T10:08:29.1540362Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1540570Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1540572Z 2025-12-04T10:08:29.1540658Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1540755Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1540802Z Traceback (most recent call last): 2025-12-04T10:08:29.1540972Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1541028Z return test(*args, **kwargs) 2025-12-04T10:08:29.1541065Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1541171Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1541247Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1541426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1541547Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1541599Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1541762Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1541818Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1541874Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1542031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1542101Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1542148Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1542287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1542334Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1542371Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1542523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1542574Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1542731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1542773Z raise GradcheckError( 2025-12-04T10:08:29.1542862Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1542864Z 2025-12-04T10:08:29.1543000Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1543084Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1543165Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1543167Z 2025-12-04T10:08:29.1543252Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1543355Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1543390Z If the test 2025-12-04T10:08:29.1543483Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1543545Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1543641Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1543723Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1543725Z 2025-12-04T10:08:29.1543817Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1543905Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1543942Z the following. 2025-12-04T10:08:29.1543944Z 2025-12-04T10:08:29.1544032Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1544123Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1544173Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1544237Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1544298Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1544300Z 2025-12-04T10:08:29.1544332Z Got: 2025-12-04T10:08:29.1544412Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.1544468Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.1544509Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.1544599Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.1544652Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.1544692Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.1544743Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.1544794Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.1544833Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.1544886Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.1544936Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.1544975Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.1545048Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.1545101Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.1545144Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.1545146Z 2025-12-04T10:08:29.1545197Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.1545248Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.1545288Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.1545364Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.1545413Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.1545452Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.1545502Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.1545551Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.1545589Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.1545640Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.1545691Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.1545731Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.1545780Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.1545833Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.1545874Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.1545876Z 2025-12-04T10:08:29.1545878Z 2025-12-04T10:08:29.1545929Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1545977Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1546016Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1546065Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1546116Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1546154Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1546207Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1546258Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1546297Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1546346Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1546397Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1546436Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1546486Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1546535Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1546576Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1546578Z 2025-12-04T10:08:29.1546627Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1546677Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1546716Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1546767Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1546827Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1546867Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1546917Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1546989Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1547028Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1547079Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1547128Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1547167Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1547218Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1547268Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1547320Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1547363Z dtype=torch.complex128) 2025-12-04T10:08:29.1547380Z 2025-12-04T10:08:29.1547416Z Expected: 2025-12-04T10:08:29.1547491Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1547529Z 0.3406-0.5682j], 2025-12-04T10:08:29.1547594Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1547633Z 0.2069-0.7450j], 2025-12-04T10:08:29.1547697Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1547733Z 0.4118+0.5311j], 2025-12-04T10:08:29.1547796Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1547834Z -0.3628+0.5383j], 2025-12-04T10:08:29.1547895Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1547935Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1547937Z 2025-12-04T10:08:29.1548001Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1548038Z 0.5325-0.4733j], 2025-12-04T10:08:29.1548101Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1548138Z -0.6729-0.7686j], 2025-12-04T10:08:29.1548200Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1548238Z -0.5258-0.5473j], 2025-12-04T10:08:29.1548300Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1548337Z -0.3244-0.6603j], 2025-12-04T10:08:29.1548401Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1548440Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1548442Z 2025-12-04T10:08:29.1548443Z 2025-12-04T10:08:29.1548505Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1548543Z -0.6623-0.1171j], 2025-12-04T10:08:29.1548607Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1548644Z 0.4266-0.2997j], 2025-12-04T10:08:29.1548707Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1548743Z 0.2556-0.1819j], 2025-12-04T10:08:29.1548807Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1548844Z 0.1768-1.6449j], 2025-12-04T10:08:29.1548905Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1548946Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1548948Z 2025-12-04T10:08:29.1549010Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1549046Z -0.6312+0.1775j], 2025-12-04T10:08:29.1549109Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1549145Z -0.9967-0.3519j], 2025-12-04T10:08:29.1549208Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1549256Z 0.6457+0.0238j], 2025-12-04T10:08:29.1549318Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1549354Z -1.0432-0.3734j], 2025-12-04T10:08:29.1549438Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1549504Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1549506Z 2025-12-04T10:08:29.1549589Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1549591Z 2025-12-04T10:08:29.1549637Z Traceback (most recent call last): 2025-12-04T10:08:29.1549793Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1549834Z method(*args, **kwargs) 2025-12-04T10:08:29.1550022Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1550070Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1550111Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1550275Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1550320Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1550357Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1550516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1550557Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1550594Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1550746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1550784Z fn(*args, **kwargs) 2025-12-04T10:08:29.1550951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1550993Z raise e_tracked from e 2025-12-04T10:08:29.1551038Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1551042Z 2025-12-04T10:08:29.1551137Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1551219Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1551300Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1551302Z 2025-12-04T10:08:29.1551386Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1551488Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1551523Z If the test 2025-12-04T10:08:29.1551617Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1551680Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1551775Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1551856Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1551859Z 2025-12-04T10:08:29.1551951Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1552037Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1552072Z the following. 2025-12-04T10:08:29.1552074Z 2025-12-04T10:08:29.1552163Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1552252Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1552304Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1552367Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1552429Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1552455Z 2025-12-04T10:08:29.1552487Z Got: 2025-12-04T10:08:29.1552549Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.1552602Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.1552675Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.1552728Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.1552781Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.1552820Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.1552872Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.1552922Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.1553009Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.1553059Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.1553109Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.1553168Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.1553219Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.1553269Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.1553310Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.1553316Z 2025-12-04T10:08:29.1553366Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.1553416Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.1553455Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.1553504Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.1553554Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.1553592Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.1553643Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.1553691Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.1553734Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.1553784Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.1553833Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.1553872Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.1553925Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.1553975Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.1554016Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.1554018Z 2025-12-04T10:08:29.1554020Z 2025-12-04T10:08:29.1554069Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.1554119Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.1554157Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.1554209Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.1554259Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.1554299Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.1554349Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.1554401Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.1554439Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.1554492Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.1554541Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.1554580Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.1554628Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.1554678Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.1554718Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.1554720Z 2025-12-04T10:08:29.1554770Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.1554820Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.1554884Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.1554934Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.1554984Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.1555022Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.1555105Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.1555156Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.1555195Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.1555244Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.1555294Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.1555334Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.1555383Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.1555433Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.1555498Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.1555544Z dtype=torch.complex128) 2025-12-04T10:08:29.1555546Z 2025-12-04T10:08:29.1555580Z Expected: 2025-12-04T10:08:29.1555656Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1555695Z 0.3406-0.5682j], 2025-12-04T10:08:29.1555761Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1555797Z 0.2069-0.7450j], 2025-12-04T10:08:29.1555862Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1555898Z 0.4118+0.5311j], 2025-12-04T10:08:29.1555963Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1555999Z -0.3628+0.5383j], 2025-12-04T10:08:29.1556063Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1556102Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1556104Z 2025-12-04T10:08:29.1556172Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1556208Z 0.5325-0.4733j], 2025-12-04T10:08:29.1556271Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1556310Z -0.6729-0.7686j], 2025-12-04T10:08:29.1556373Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1556409Z -0.5258-0.5473j], 2025-12-04T10:08:29.1556472Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1556508Z -0.3244-0.6603j], 2025-12-04T10:08:29.1556570Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1556608Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1556610Z 2025-12-04T10:08:29.1556612Z 2025-12-04T10:08:29.1556675Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1556712Z -0.6623-0.1171j], 2025-12-04T10:08:29.1556776Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1556811Z 0.4266-0.2997j], 2025-12-04T10:08:29.1556875Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1556913Z 0.2556-0.1819j], 2025-12-04T10:08:29.1556979Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1557017Z 0.1768-1.6449j], 2025-12-04T10:08:29.1557079Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1557117Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1557119Z 2025-12-04T10:08:29.1557181Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1557220Z -0.6312+0.1775j], 2025-12-04T10:08:29.1557282Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1557332Z -0.9967-0.3519j], 2025-12-04T10:08:29.1557394Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1557432Z 0.6457+0.0238j], 2025-12-04T10:08:29.1557495Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1557554Z -1.0432-0.3734j], 2025-12-04T10:08:29.1557619Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1557685Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1557687Z 2025-12-04T10:08:29.1557979Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1557982Z 2025-12-04T10:08:29.1558058Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1558276Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1558279Z 2025-12-04T10:08:29.1558367Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1558461Z _______ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 _______ 2025-12-04T10:08:29.1558508Z Traceback (most recent call last): 2025-12-04T10:08:29.1558681Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1558725Z return test(*args, **kwargs) 2025-12-04T10:08:29.1558762Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1558867Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1558934Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1559105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1559228Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1559283Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1559445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1559501Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1559544Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1559701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1559768Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1559814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1559956Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1560001Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1560039Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1560193Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1560244Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1560401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1560443Z raise GradcheckError( 2025-12-04T10:08:29.1560532Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1560534Z 2025-12-04T10:08:29.1560627Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1560711Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1560808Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1560810Z 2025-12-04T10:08:29.1560897Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1561020Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1561058Z If the test 2025-12-04T10:08:29.1561150Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1561215Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1561311Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1561395Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1561397Z 2025-12-04T10:08:29.1561487Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1561585Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1561622Z the following. 2025-12-04T10:08:29.1561625Z 2025-12-04T10:08:29.1561713Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1561804Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1561856Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1561919Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1561981Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1561983Z 2025-12-04T10:08:29.1562016Z Got: 2025-12-04T10:08:29.1562092Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1562129Z 0.3406-0.5682j], 2025-12-04T10:08:29.1562194Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1562230Z 0.2069-0.7450j], 2025-12-04T10:08:29.1562297Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1562333Z 0.4118+0.5311j], 2025-12-04T10:08:29.1562397Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1562435Z -0.3628+0.5383j], 2025-12-04T10:08:29.1562499Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1562537Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1562539Z 2025-12-04T10:08:29.1562602Z [[ 0.1674-0.1713j, -0.3545-0.2779j, 0.1689+0.5668j, -0.1060+0.0538j, 2025-12-04T10:08:29.1562638Z -0.1849+0.1651j], 2025-12-04T10:08:29.1562701Z [-0.9004-1.0602j, 0.7728-0.3992j, -0.5939-0.0333j, 0.1645+0.1399j, 2025-12-04T10:08:29.1562738Z 0.6325+0.7115j], 2025-12-04T10:08:29.1562801Z [ 0.1296-0.1809j, 0.1168-0.2165j, 0.3090+0.0125j, -0.2459+0.0177j, 2025-12-04T10:08:29.1562839Z -0.1126-0.1173j], 2025-12-04T10:08:29.1562904Z [ 0.5659+0.8880j, -0.8454-1.7403j, 1.6164-2.5944j, -0.5832+0.4623j, 2025-12-04T10:08:29.1562979Z 0.5937+1.1849j], 2025-12-04T10:08:29.1563042Z [-0.4574-0.1542j, -0.1986-0.2144j, 0.8701-0.0632j, 0.1097-0.2102j, 2025-12-04T10:08:29.1563083Z -0.1554-0.0473j]]], 2025-12-04T10:08:29.1563085Z 2025-12-04T10:08:29.1563087Z 2025-12-04T10:08:29.1563149Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1563187Z -0.6623-0.1171j], 2025-12-04T10:08:29.1563250Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1563287Z 0.4266-0.2997j], 2025-12-04T10:08:29.1563350Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1563387Z 0.2556-0.1819j], 2025-12-04T10:08:29.1563449Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1563486Z 0.1768-1.6449j], 2025-12-04T10:08:29.1563575Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1563616Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1563618Z 2025-12-04T10:08:29.1563681Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1563744Z -0.6312+0.1775j], 2025-12-04T10:08:29.1563811Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1563848Z -0.9967-0.3519j], 2025-12-04T10:08:29.1563911Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1563947Z 0.6457+0.0238j], 2025-12-04T10:08:29.1564009Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1564046Z -1.0432-0.3734j], 2025-12-04T10:08:29.1564108Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1564189Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1564194Z 2025-12-04T10:08:29.1564228Z Expected: 2025-12-04T10:08:29.1564301Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1564336Z 0.3406-0.5682j], 2025-12-04T10:08:29.1564400Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1564436Z 0.2069-0.7450j], 2025-12-04T10:08:29.1564499Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1564534Z 0.4118+0.5311j], 2025-12-04T10:08:29.1564597Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1564633Z -0.3628+0.5383j], 2025-12-04T10:08:29.1564696Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1564732Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1564735Z 2025-12-04T10:08:29.1564799Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1564835Z 0.5325-0.4733j], 2025-12-04T10:08:29.1564897Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1564934Z -0.6729-0.7686j], 2025-12-04T10:08:29.1564998Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1565035Z -0.5258-0.5473j], 2025-12-04T10:08:29.1565096Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1565132Z -0.3244-0.6603j], 2025-12-04T10:08:29.1565194Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1565231Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1565233Z 2025-12-04T10:08:29.1565235Z 2025-12-04T10:08:29.1565297Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1565333Z -0.6623-0.1171j], 2025-12-04T10:08:29.1565397Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1565433Z 0.4266-0.2997j], 2025-12-04T10:08:29.1565495Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1565532Z 0.2556-0.1819j], 2025-12-04T10:08:29.1565595Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1565633Z 0.1768-1.6449j], 2025-12-04T10:08:29.1565694Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1565733Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1565735Z 2025-12-04T10:08:29.1565796Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1565834Z -0.6312+0.1775j], 2025-12-04T10:08:29.1565897Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1565934Z -0.9967-0.3519j], 2025-12-04T10:08:29.1566014Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1566050Z 0.6457+0.0238j], 2025-12-04T10:08:29.1566110Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1566168Z -1.0432-0.3734j], 2025-12-04T10:08:29.1566232Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1566297Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1566299Z 2025-12-04T10:08:29.1566381Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1566384Z 2025-12-04T10:08:29.1566429Z Traceback (most recent call last): 2025-12-04T10:08:29.1566587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1566627Z method(*args, **kwargs) 2025-12-04T10:08:29.1566817Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1566864Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1566903Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1567065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1567110Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1567147Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1567307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1567347Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1567384Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1567537Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1567577Z fn(*args, **kwargs) 2025-12-04T10:08:29.1567745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1567786Z raise e_tracked from e 2025-12-04T10:08:29.1567830Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1567834Z 2025-12-04T10:08:29.1567928Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1568011Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1568093Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1568095Z 2025-12-04T10:08:29.1568179Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1568282Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1568316Z If the test 2025-12-04T10:08:29.1568412Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1568475Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1568571Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1568653Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1568657Z 2025-12-04T10:08:29.1568748Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1568833Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1568868Z the following. 2025-12-04T10:08:29.1568870Z 2025-12-04T10:08:29.1568959Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1569048Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1569100Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1569164Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1569237Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1569239Z 2025-12-04T10:08:29.1569271Z Got: 2025-12-04T10:08:29.1569345Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1569393Z 0.3406-0.5682j], 2025-12-04T10:08:29.1569467Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1569504Z 0.2069-0.7450j], 2025-12-04T10:08:29.1569569Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1569604Z 0.4118+0.5311j], 2025-12-04T10:08:29.1569667Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1569703Z -0.3628+0.5383j], 2025-12-04T10:08:29.1569766Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1569804Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1569806Z 2025-12-04T10:08:29.1569880Z [[ 0.1674-0.1713j, -0.3545-0.2779j, 0.1689+0.5668j, -0.1060+0.0538j, 2025-12-04T10:08:29.1569917Z -0.1849+0.1651j], 2025-12-04T10:08:29.1569980Z [-0.9004-1.0602j, 0.7728-0.3992j, -0.5939-0.0333j, 0.1645+0.1399j, 2025-12-04T10:08:29.1570017Z 0.6325+0.7115j], 2025-12-04T10:08:29.1570081Z [ 0.1296-0.1809j, 0.1168-0.2165j, 0.3090+0.0125j, -0.2459+0.0177j, 2025-12-04T10:08:29.1570117Z -0.1126-0.1173j], 2025-12-04T10:08:29.1570181Z [ 0.5659+0.8880j, -0.8454-1.7403j, 1.6164-2.5944j, -0.5832+0.4623j, 2025-12-04T10:08:29.1570216Z 0.5937+1.1849j], 2025-12-04T10:08:29.1570279Z [-0.4574-0.1542j, -0.1986-0.2144j, 0.8701-0.0632j, 0.1097-0.2102j, 2025-12-04T10:08:29.1570317Z -0.1554-0.0473j]]], 2025-12-04T10:08:29.1570319Z 2025-12-04T10:08:29.1570321Z 2025-12-04T10:08:29.1570383Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1570423Z -0.6623-0.1171j], 2025-12-04T10:08:29.1570486Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1570522Z 0.4266-0.2997j], 2025-12-04T10:08:29.1570584Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1570622Z 0.2556-0.1819j], 2025-12-04T10:08:29.1570685Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1570720Z 0.1768-1.6449j], 2025-12-04T10:08:29.1570782Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1570820Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1570822Z 2025-12-04T10:08:29.1570883Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1570920Z -0.6312+0.1775j], 2025-12-04T10:08:29.1570982Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1571019Z -0.9967-0.3519j], 2025-12-04T10:08:29.1571081Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1571117Z 0.6457+0.0238j], 2025-12-04T10:08:29.1571177Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1571216Z -1.0432-0.3734j], 2025-12-04T10:08:29.1571278Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1571343Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1571345Z 2025-12-04T10:08:29.1571380Z Expected: 2025-12-04T10:08:29.1571452Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.1571487Z 0.3406-0.5682j], 2025-12-04T10:08:29.1571549Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.1571585Z 0.2069-0.7450j], 2025-12-04T10:08:29.1571649Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.1571696Z 0.4118+0.5311j], 2025-12-04T10:08:29.1571758Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.1571794Z -0.3628+0.5383j], 2025-12-04T10:08:29.1571879Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.1571916Z 0.0876+0.1073j]], 2025-12-04T10:08:29.1571918Z 2025-12-04T10:08:29.1571981Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.1572017Z 0.5325-0.4733j], 2025-12-04T10:08:29.1572079Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.1572115Z -0.6729-0.7686j], 2025-12-04T10:08:29.1572180Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.1572218Z -0.5258-0.5473j], 2025-12-04T10:08:29.1572293Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.1572333Z -0.3244-0.6603j], 2025-12-04T10:08:29.1572396Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.1572434Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.1572437Z 2025-12-04T10:08:29.1572439Z 2025-12-04T10:08:29.1572500Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.1572538Z -0.6623-0.1171j], 2025-12-04T10:08:29.1572600Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.1572636Z 0.4266-0.2997j], 2025-12-04T10:08:29.1572698Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.1572735Z 0.2556-0.1819j], 2025-12-04T10:08:29.1572796Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.1572832Z 0.1768-1.6449j], 2025-12-04T10:08:29.1572897Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.1572982Z -0.6011-0.8699j]], 2025-12-04T10:08:29.1572984Z 2025-12-04T10:08:29.1573045Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.1573084Z -0.6312+0.1775j], 2025-12-04T10:08:29.1573146Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.1573183Z -0.9967-0.3519j], 2025-12-04T10:08:29.1573245Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.1573281Z 0.6457+0.0238j], 2025-12-04T10:08:29.1573341Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.1573378Z -1.0432-0.3734j], 2025-12-04T10:08:29.1573440Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.1573506Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.1573509Z 2025-12-04T10:08:29.1573804Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1573808Z 2025-12-04T10:08:29.1573882Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1574090Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.1574092Z 2025-12-04T10:08:29.1574178Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1574271Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1574317Z Traceback (most recent call last): 2025-12-04T10:08:29.1574489Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1574546Z return test(*args, **kwargs) 2025-12-04T10:08:29.1574585Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1574703Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1574782Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1574948Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1575070Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1575121Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1575284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1575363Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1575407Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1575567Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1575636Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1575680Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1575821Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1575868Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1575906Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1576059Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1576111Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1576267Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1576309Z raise GradcheckError( 2025-12-04T10:08:29.1576399Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1576402Z 2025-12-04T10:08:29.1576496Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1576578Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1576657Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1576659Z 2025-12-04T10:08:29.1576743Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1576844Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1576880Z If the test 2025-12-04T10:08:29.1576973Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1577039Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1577132Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1577215Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1577219Z 2025-12-04T10:08:29.1577311Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1577397Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1577432Z the following. 2025-12-04T10:08:29.1577435Z 2025-12-04T10:08:29.1577524Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1577615Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1577666Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1577731Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1577793Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1577807Z 2025-12-04T10:08:29.1577840Z Got: 2025-12-04T10:08:29.1577897Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1577946Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1578014Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1578060Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1578109Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1578111Z 2025-12-04T10:08:29.1578159Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1578204Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1578250Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1578295Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1578345Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1578348Z 2025-12-04T10:08:29.1578361Z 2025-12-04T10:08:29.1578407Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1578451Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1578495Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1578542Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1578588Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1578590Z 2025-12-04T10:08:29.1578636Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1578681Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1578725Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1578770Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1578835Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1578877Z dtype=torch.float64) 2025-12-04T10:08:29.1578881Z 2025-12-04T10:08:29.1578915Z Expected: 2025-12-04T10:08:29.1578969Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1579015Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1579060Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1579106Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1579154Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1579156Z 2025-12-04T10:08:29.1579200Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1579245Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1579290Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1579338Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1579386Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1579388Z 2025-12-04T10:08:29.1579390Z 2025-12-04T10:08:29.1579437Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1579480Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1579524Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1579569Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1579618Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1579620Z 2025-12-04T10:08:29.1579664Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1579709Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1579752Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1579798Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1579861Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1579904Z dtype=torch.float64) 2025-12-04T10:08:29.1579908Z 2025-12-04T10:08:29.1579991Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1580005Z 2025-12-04T10:08:29.1580052Z Traceback (most recent call last): 2025-12-04T10:08:29.1580209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1580269Z method(*args, **kwargs) 2025-12-04T10:08:29.1580448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1580493Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1580533Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1580693Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1580738Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1580775Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1580946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1580988Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1581025Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1581178Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1581217Z fn(*args, **kwargs) 2025-12-04T10:08:29.1581383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1581424Z raise e_tracked from e 2025-12-04T10:08:29.1581469Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1581471Z 2025-12-04T10:08:29.1581564Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1581645Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1581728Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1581732Z 2025-12-04T10:08:29.1581815Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1581918Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1581955Z If the test 2025-12-04T10:08:29.1582049Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1582111Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1582206Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1582287Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1582290Z 2025-12-04T10:08:29.1582380Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1582465Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1582500Z the following. 2025-12-04T10:08:29.1582504Z 2025-12-04T10:08:29.1582593Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1582683Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1582736Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1582804Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1582865Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1582867Z 2025-12-04T10:08:29.1582899Z Got: 2025-12-04T10:08:29.1582998Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1583045Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1583092Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1583136Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1583184Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1583186Z 2025-12-04T10:08:29.1583248Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1583294Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1583338Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1583396Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1583457Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1583459Z 2025-12-04T10:08:29.1583463Z 2025-12-04T10:08:29.1583508Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1583552Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1583597Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1583640Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1583687Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1583689Z 2025-12-04T10:08:29.1583734Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1583795Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1583840Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1583885Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1583955Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1583996Z dtype=torch.float64) 2025-12-04T10:08:29.1583998Z 2025-12-04T10:08:29.1584033Z Expected: 2025-12-04T10:08:29.1584086Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1584134Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1584178Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1584223Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1584269Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1584270Z 2025-12-04T10:08:29.1584316Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1584363Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1584409Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1584453Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1584505Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1584507Z 2025-12-04T10:08:29.1584509Z 2025-12-04T10:08:29.1584553Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1584597Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1584640Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1584685Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1584732Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1584734Z 2025-12-04T10:08:29.1584780Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1584827Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1584872Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1584916Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1584979Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1586919Z dtype=torch.float64) 2025-12-04T10:08:29.1586922Z 2025-12-04T10:08:29.1587219Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1587222Z 2025-12-04T10:08:29.1587296Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1587498Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1587501Z 2025-12-04T10:08:29.1587609Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1587703Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1587750Z Traceback (most recent call last): 2025-12-04T10:08:29.1587958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1588002Z return test(*args, **kwargs) 2025-12-04T10:08:29.1588039Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1588144Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1588209Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1588378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1588513Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1588569Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1588731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1588788Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1588831Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1588987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1589054Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1589097Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1589238Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1589284Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1589327Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1589478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1589529Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1589688Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1589730Z raise GradcheckError( 2025-12-04T10:08:29.1589819Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1589821Z 2025-12-04T10:08:29.1589915Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1589996Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1590079Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1590081Z 2025-12-04T10:08:29.1590167Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1590270Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1590305Z If the test 2025-12-04T10:08:29.1590400Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1590466Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1590561Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1590643Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1590645Z 2025-12-04T10:08:29.1590735Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1590820Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1590856Z the following. 2025-12-04T10:08:29.1590858Z 2025-12-04T10:08:29.1590948Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1591050Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1591101Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1591164Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1591248Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1591250Z 2025-12-04T10:08:29.1591283Z Got: 2025-12-04T10:08:29.1591339Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1591388Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1591436Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1591480Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1591528Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1591530Z 2025-12-04T10:08:29.1591574Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1591631Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1591678Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1591723Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1591772Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1591776Z 2025-12-04T10:08:29.1591778Z 2025-12-04T10:08:29.1591823Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1591867Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1591911Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1591955Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1592003Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1592005Z 2025-12-04T10:08:29.1592050Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1592095Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1592140Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1592186Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1592249Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1592293Z dtype=torch.float64) 2025-12-04T10:08:29.1592296Z 2025-12-04T10:08:29.1592331Z Expected: 2025-12-04T10:08:29.1592384Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1592429Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1592474Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1592518Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1592564Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1592566Z 2025-12-04T10:08:29.1592611Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1592655Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1592702Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1592747Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1592797Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1592800Z 2025-12-04T10:08:29.1592802Z 2025-12-04T10:08:29.1592846Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1592890Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1592985Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1593030Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1593076Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1593078Z 2025-12-04T10:08:29.1593123Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1593167Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1593211Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1593277Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1593340Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1593381Z dtype=torch.float64) 2025-12-04T10:08:29.1593396Z 2025-12-04T10:08:29.1593495Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1593497Z 2025-12-04T10:08:29.1593542Z Traceback (most recent call last): 2025-12-04T10:08:29.1593700Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1593740Z method(*args, **kwargs) 2025-12-04T10:08:29.1593917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1593962Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1594001Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1594177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1594221Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1594260Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1594421Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1594464Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1594500Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1594651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1594688Z fn(*args, **kwargs) 2025-12-04T10:08:29.1594854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1594894Z raise e_tracked from e 2025-12-04T10:08:29.1594942Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1594945Z 2025-12-04T10:08:29.1595038Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1595120Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1595202Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1595205Z 2025-12-04T10:08:29.1595289Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1595390Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1595426Z If the test 2025-12-04T10:08:29.1595519Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1595581Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1595675Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1595757Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1595760Z 2025-12-04T10:08:29.1595850Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1595933Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1595972Z the following. 2025-12-04T10:08:29.1595974Z 2025-12-04T10:08:29.1596063Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1596151Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1596202Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1596266Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1596325Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1596327Z 2025-12-04T10:08:29.1596360Z Got: 2025-12-04T10:08:29.1596415Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1596464Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1596521Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1596566Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1596614Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1596626Z 2025-12-04T10:08:29.1596681Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1596727Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1596772Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1596817Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1596867Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1596869Z 2025-12-04T10:08:29.1596871Z 2025-12-04T10:08:29.1596915Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1596959Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1597012Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1597059Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1597106Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1597109Z 2025-12-04T10:08:29.1597155Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1597201Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1597245Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1597290Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1597353Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1597394Z dtype=torch.float64) 2025-12-04T10:08:29.1597396Z 2025-12-04T10:08:29.1597430Z Expected: 2025-12-04T10:08:29.1597484Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1597528Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1597575Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1597619Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1597666Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1597668Z 2025-12-04T10:08:29.1597715Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1597760Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1597803Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1597848Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1597896Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1597898Z 2025-12-04T10:08:29.1597900Z 2025-12-04T10:08:29.1597945Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1597988Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1598032Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1598079Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1598128Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1598129Z 2025-12-04T10:08:29.1598174Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1598221Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1598264Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1598310Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1598371Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1598412Z dtype=torch.float64) 2025-12-04T10:08:29.1598414Z 2025-12-04T10:08:29.1598706Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1598723Z 2025-12-04T10:08:29.1598797Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1598999Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1599029Z 2025-12-04T10:08:29.1599116Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1599210Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1599255Z Traceback (most recent call last): 2025-12-04T10:08:29.1599426Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1599469Z return test(*args, **kwargs) 2025-12-04T10:08:29.1599507Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1599611Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1599691Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1599861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1599985Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1600037Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1600200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1600257Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1600299Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1600455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1600522Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1600567Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1600707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1600755Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1600793Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1600944Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1600993Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1601149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1601190Z raise GradcheckError( 2025-12-04T10:08:29.1601280Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1601282Z 2025-12-04T10:08:29.1601376Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1601459Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1601538Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1601540Z 2025-12-04T10:08:29.1601628Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1601731Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1601766Z If the test 2025-12-04T10:08:29.1601859Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1601926Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1602020Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1602103Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1602105Z 2025-12-04T10:08:29.1602197Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1602292Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1602330Z the following. 2025-12-04T10:08:29.1602332Z 2025-12-04T10:08:29.1602442Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1602534Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1602585Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1602648Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1602708Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1602710Z 2025-12-04T10:08:29.1602743Z Got: 2025-12-04T10:08:29.1602798Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1602846Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1602892Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1603000Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1603048Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1603050Z 2025-12-04T10:08:29.1603097Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1603143Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1603188Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1603233Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1603282Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1603284Z 2025-12-04T10:08:29.1603286Z 2025-12-04T10:08:29.1603330Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1603374Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1603417Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1603462Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1603510Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1603513Z 2025-12-04T10:08:29.1603557Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1603602Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1603649Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1603697Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1603763Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1603805Z dtype=torch.float64) 2025-12-04T10:08:29.1603807Z 2025-12-04T10:08:29.1603841Z Expected: 2025-12-04T10:08:29.1603895Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1603939Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1603984Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1604029Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1604076Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1604078Z 2025-12-04T10:08:29.1604122Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1604169Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1604215Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1604260Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1604308Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1604310Z 2025-12-04T10:08:29.1604312Z 2025-12-04T10:08:29.1604357Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1604400Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1604444Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1604491Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1604538Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1604556Z 2025-12-04T10:08:29.1604601Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1604648Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1604720Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1604766Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1604828Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1604871Z dtype=torch.float64) 2025-12-04T10:08:29.1604873Z 2025-12-04T10:08:29.1604958Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1604960Z 2025-12-04T10:08:29.1605005Z Traceback (most recent call last): 2025-12-04T10:08:29.1605160Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1605199Z method(*args, **kwargs) 2025-12-04T10:08:29.1605391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1605437Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1605477Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1605639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1605682Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1605719Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1605876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1605917Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1605953Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1606109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1606151Z fn(*args, **kwargs) 2025-12-04T10:08:29.1606316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1606358Z raise e_tracked from e 2025-12-04T10:08:29.1606405Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1606407Z 2025-12-04T10:08:29.1606501Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1606582Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1606663Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1606665Z 2025-12-04T10:08:29.1606749Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1606852Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1606887Z If the test 2025-12-04T10:08:29.1606982Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1607044Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1607139Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1607222Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1607224Z 2025-12-04T10:08:29.1607314Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1607400Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1607436Z the following. 2025-12-04T10:08:29.1607438Z 2025-12-04T10:08:29.1607527Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1607618Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1607669Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1607732Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1607806Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1607808Z 2025-12-04T10:08:29.1607839Z Got: 2025-12-04T10:08:29.1607895Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1607962Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1608010Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1608054Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1608102Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1608104Z 2025-12-04T10:08:29.1608148Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1608194Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1608238Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1608284Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1608344Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1608348Z 2025-12-04T10:08:29.1608351Z 2025-12-04T10:08:29.1608395Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1608440Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1608485Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1608530Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1608575Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1608577Z 2025-12-04T10:08:29.1608622Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1608666Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1608711Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1608755Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1608818Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1608862Z dtype=torch.float64) 2025-12-04T10:08:29.1608865Z 2025-12-04T10:08:29.1608899Z Expected: 2025-12-04T10:08:29.1608952Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1608996Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1609043Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1609087Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1609133Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1609135Z 2025-12-04T10:08:29.1609179Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1609223Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1609268Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1609312Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1609362Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1609365Z 2025-12-04T10:08:29.1609367Z 2025-12-04T10:08:29.1609411Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1609456Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1609499Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1609545Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1609591Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1609593Z 2025-12-04T10:08:29.1609640Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1609685Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1609728Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1609773Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1609835Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1609876Z dtype=torch.float64) 2025-12-04T10:08:29.1609896Z 2025-12-04T10:08:29.1610190Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1610213Z 2025-12-04T10:08:29.1610289Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1610491Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1610493Z 2025-12-04T10:08:29.1610582Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1610675Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1610722Z Traceback (most recent call last): 2025-12-04T10:08:29.1610902Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1610948Z return test(*args, **kwargs) 2025-12-04T10:08:29.1610986Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1611090Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1611155Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1611322Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1611444Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1611495Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1611656Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1611714Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1611757Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1611913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1611981Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1612024Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1612165Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1612210Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1612249Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1612400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1612450Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1612604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1612648Z raise GradcheckError( 2025-12-04T10:08:29.1612737Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1612739Z 2025-12-04T10:08:29.1612836Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1612917Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1613033Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1613036Z 2025-12-04T10:08:29.1613120Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1613222Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1613258Z If the test 2025-12-04T10:08:29.1613351Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1613414Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1613526Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1613608Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1613623Z 2025-12-04T10:08:29.1613726Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1613812Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1613848Z the following. 2025-12-04T10:08:29.1613850Z 2025-12-04T10:08:29.1613939Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1614029Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1614082Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1614144Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1614219Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1614223Z 2025-12-04T10:08:29.1614255Z Got: 2025-12-04T10:08:29.1614311Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1614357Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1614407Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1614451Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1614500Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1614502Z 2025-12-04T10:08:29.1614546Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1614591Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1614635Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1614680Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1614728Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1614730Z 2025-12-04T10:08:29.1614734Z 2025-12-04T10:08:29.1614779Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1614823Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1614866Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1614912Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1614958Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1614960Z 2025-12-04T10:08:29.1615005Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1615049Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1615093Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1615137Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1615205Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1615246Z dtype=torch.float64) 2025-12-04T10:08:29.1615248Z 2025-12-04T10:08:29.1615285Z Expected: 2025-12-04T10:08:29.1615337Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1615382Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1615427Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1615473Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1615519Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1615521Z 2025-12-04T10:08:29.1615566Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1615610Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1615655Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1615699Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1615748Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1615750Z 2025-12-04T10:08:29.1615752Z 2025-12-04T10:08:29.1615798Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1615857Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1615900Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1615947Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1616015Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1616019Z 2025-12-04T10:08:29.1616064Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1616109Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1616152Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1616198Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1616259Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1616302Z dtype=torch.float64) 2025-12-04T10:08:29.1616304Z 2025-12-04T10:08:29.1616399Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1616402Z 2025-12-04T10:08:29.1616448Z Traceback (most recent call last): 2025-12-04T10:08:29.1616604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1616647Z method(*args, **kwargs) 2025-12-04T10:08:29.1616823Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1616869Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1616908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1617068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1617110Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1617148Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1617307Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1617350Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1617386Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1617538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1617577Z fn(*args, **kwargs) 2025-12-04T10:08:29.1617744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1617784Z raise e_tracked from e 2025-12-04T10:08:29.1617829Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1617831Z 2025-12-04T10:08:29.1617924Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1618005Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1618086Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1618090Z 2025-12-04T10:08:29.1618174Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1618276Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1618311Z If the test 2025-12-04T10:08:29.1618407Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1618468Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1618563Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1618644Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1618646Z 2025-12-04T10:08:29.1618737Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1618820Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1618856Z the following. 2025-12-04T10:08:29.1618858Z 2025-12-04T10:08:29.1618959Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1619050Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1619101Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1619186Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1619247Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1619249Z 2025-12-04T10:08:29.1619282Z Got: 2025-12-04T10:08:29.1619337Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1619384Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1619430Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1619475Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1619522Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1619524Z 2025-12-04T10:08:29.1619586Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1619632Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1619677Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1619722Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1619774Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1619776Z 2025-12-04T10:08:29.1619778Z 2025-12-04T10:08:29.1619822Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1619866Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1619910Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1619954Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1620001Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1620003Z 2025-12-04T10:08:29.1620047Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1620092Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1620137Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1620181Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1620244Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1620286Z dtype=torch.float64) 2025-12-04T10:08:29.1620288Z 2025-12-04T10:08:29.1620322Z Expected: 2025-12-04T10:08:29.1620376Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1620420Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1620466Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1620509Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1620557Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1620559Z 2025-12-04T10:08:29.1620603Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1620649Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1620693Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1620739Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1620788Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1620791Z 2025-12-04T10:08:29.1620793Z 2025-12-04T10:08:29.1620838Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1620882Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1620925Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1620970Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1621015Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1621017Z 2025-12-04T10:08:29.1621063Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1621106Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1621164Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1621208Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1621270Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1621331Z dtype=torch.float64) 2025-12-04T10:08:29.1621333Z 2025-12-04T10:08:29.1621624Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1621627Z 2025-12-04T10:08:29.1621701Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1621905Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1621907Z 2025-12-04T10:08:29.1622004Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1622099Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1622144Z Traceback (most recent call last): 2025-12-04T10:08:29.1622316Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1622360Z return test(*args, **kwargs) 2025-12-04T10:08:29.1622397Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1622502Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1622565Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1622731Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1622851Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1622907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1623120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1623178Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1623221Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1623377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1623442Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1623487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1623626Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1623671Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1623711Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1623862Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1623911Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1624068Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1624109Z raise GradcheckError( 2025-12-04T10:08:29.1624199Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1624201Z 2025-12-04T10:08:29.1624293Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1624375Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1624456Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1624458Z 2025-12-04T10:08:29.1624542Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1624664Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1624699Z If the test 2025-12-04T10:08:29.1624793Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1624881Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1624978Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1625061Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1625064Z 2025-12-04T10:08:29.1625155Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1625239Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1625275Z the following. 2025-12-04T10:08:29.1625277Z 2025-12-04T10:08:29.1625365Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1625471Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1625523Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1625587Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1625650Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1625652Z 2025-12-04T10:08:29.1625684Z Got: 2025-12-04T10:08:29.1625739Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1625787Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1625834Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1625879Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1625926Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1625928Z 2025-12-04T10:08:29.1625976Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1626021Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1626067Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1626112Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1626161Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1626164Z 2025-12-04T10:08:29.1626167Z 2025-12-04T10:08:29.1626212Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1626257Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1626302Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1626346Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1626392Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1626394Z 2025-12-04T10:08:29.1626438Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1626483Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1626527Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1626573Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1626635Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1626677Z dtype=torch.float64) 2025-12-04T10:08:29.1626680Z 2025-12-04T10:08:29.1626715Z Expected: 2025-12-04T10:08:29.1626769Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1626813Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1626858Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1626903Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1626950Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1626952Z 2025-12-04T10:08:29.1626996Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1627041Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1627085Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1627144Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1627194Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1627196Z 2025-12-04T10:08:29.1627210Z 2025-12-04T10:08:29.1627265Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1627310Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1627354Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1627401Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1627446Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1627448Z 2025-12-04T10:08:29.1627494Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1627537Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1627582Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1627641Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1627707Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1627748Z dtype=torch.float64) 2025-12-04T10:08:29.1627749Z 2025-12-04T10:08:29.1627835Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1627837Z 2025-12-04T10:08:29.1627884Z Traceback (most recent call last): 2025-12-04T10:08:29.1628039Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1628078Z method(*args, **kwargs) 2025-12-04T10:08:29.1628253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1628298Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1628338Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1628499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1628546Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1628583Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1628743Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1628786Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1628823Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1628974Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1629013Z fn(*args, **kwargs) 2025-12-04T10:08:29.1629179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1629219Z raise e_tracked from e 2025-12-04T10:08:29.1629265Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1629270Z 2025-12-04T10:08:29.1629363Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1629446Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1629526Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1629530Z 2025-12-04T10:08:29.1629616Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1629719Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1629755Z If the test 2025-12-04T10:08:29.1629848Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1629910Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1630004Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1630086Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1630100Z 2025-12-04T10:08:29.1630191Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1630276Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1630323Z the following. 2025-12-04T10:08:29.1630347Z 2025-12-04T10:08:29.1630437Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1630527Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1630579Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1630642Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1630703Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1630705Z 2025-12-04T10:08:29.1630737Z Got: 2025-12-04T10:08:29.1630794Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1630840Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1630901Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1630945Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1630994Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1630997Z 2025-12-04T10:08:29.1631043Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1631087Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1631131Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1631176Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1631227Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1631229Z 2025-12-04T10:08:29.1631231Z 2025-12-04T10:08:29.1631274Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1631319Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1631361Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1631407Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1631453Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1631455Z 2025-12-04T10:08:29.1631502Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1631550Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1631598Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1631642Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1631705Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1631746Z dtype=torch.float64) 2025-12-04T10:08:29.1631748Z 2025-12-04T10:08:29.1631783Z Expected: 2025-12-04T10:08:29.1631836Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1631881Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1631926Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1631972Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1632018Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1632020Z 2025-12-04T10:08:29.1632065Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1632114Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1632159Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1632204Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1632253Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1632255Z 2025-12-04T10:08:29.1632257Z 2025-12-04T10:08:29.1632302Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1632346Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1632390Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1632435Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1632494Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1632496Z 2025-12-04T10:08:29.1632540Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1632595Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1632652Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1632697Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1632758Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1632799Z dtype=torch.float64) 2025-12-04T10:08:29.1632801Z 2025-12-04T10:08:29.1633147Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1633149Z 2025-12-04T10:08:29.1633247Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1633452Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1633456Z 2025-12-04T10:08:29.1633544Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1633641Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1633685Z Traceback (most recent call last): 2025-12-04T10:08:29.1633861Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1633902Z return test(*args, **kwargs) 2025-12-04T10:08:29.1633941Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1634046Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1634111Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1634280Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1634403Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1634457Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1634620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1634676Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1634719Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1634873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1634940Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1634984Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1635124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1635171Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1635213Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1635366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1635415Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1635569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1635614Z raise GradcheckError( 2025-12-04T10:08:29.1635703Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1635705Z 2025-12-04T10:08:29.1635798Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1635901Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1635981Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1635983Z 2025-12-04T10:08:29.1636080Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1636196Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1636232Z If the test 2025-12-04T10:08:29.1636327Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1636389Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1636484Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1636567Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1636569Z 2025-12-04T10:08:29.1636669Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1636758Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1636794Z the following. 2025-12-04T10:08:29.1636796Z 2025-12-04T10:08:29.1636886Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1636977Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1637028Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1637091Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1637151Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1637153Z 2025-12-04T10:08:29.1637186Z Got: 2025-12-04T10:08:29.1637244Z tensor([[[[-0.2718, 0.4023, -0.2886, -2.0572, 0.8617], 2025-12-04T10:08:29.1637290Z [-0.8466, 0.4577, -0.5941, -0.5979, 0.3840], 2025-12-04T10:08:29.1637338Z [-0.9354, -0.1574, -0.3456, -1.5513, -0.3520], 2025-12-04T10:08:29.1637388Z [-0.8259, 1.4445, 1.3606, 0.4498, 0.7210], 2025-12-04T10:08:29.1637439Z [-0.1940, 1.0860, -0.2763, -0.5038, -0.8057]], 2025-12-04T10:08:29.1637440Z 2025-12-04T10:08:29.1637486Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1637532Z [ 1.7377, -1.1775, -0.8656, -0.1678, 0.2485], 2025-12-04T10:08:29.1637577Z [ 1.2858, 0.1665, -0.3299, 0.6027, -2.3239], 2025-12-04T10:08:29.1637623Z [ 0.4440, -1.2709, -1.1622, -0.4258, -0.8472], 2025-12-04T10:08:29.1637672Z [ 0.7699, -0.0568, -0.2380, 0.3615, -1.2294]]], 2025-12-04T10:08:29.1637674Z 2025-12-04T10:08:29.1637676Z 2025-12-04T10:08:29.1637720Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1637764Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1637807Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1637851Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1637899Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1637901Z 2025-12-04T10:08:29.1637946Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1637989Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1638036Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1638080Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1638144Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1638185Z dtype=torch.float64) 2025-12-04T10:08:29.1638187Z 2025-12-04T10:08:29.1638222Z Expected: 2025-12-04T10:08:29.1638274Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1638319Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1638363Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1638408Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1638466Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1638468Z 2025-12-04T10:08:29.1638514Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1638558Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1638625Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1638670Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1638720Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1638722Z 2025-12-04T10:08:29.1638723Z 2025-12-04T10:08:29.1638768Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1638812Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1638856Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1638900Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1638960Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1638964Z 2025-12-04T10:08:29.1639010Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1639055Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1639100Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1639148Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1639210Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1639251Z dtype=torch.float64) 2025-12-04T10:08:29.1639253Z 2025-12-04T10:08:29.1639336Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1639338Z 2025-12-04T10:08:29.1639384Z Traceback (most recent call last): 2025-12-04T10:08:29.1639539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1639579Z method(*args, **kwargs) 2025-12-04T10:08:29.1639756Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1639803Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1639843Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1640005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1640048Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1640087Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1640243Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1640285Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1640324Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1640473Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1640513Z fn(*args, **kwargs) 2025-12-04T10:08:29.1640680Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1640721Z raise e_tracked from e 2025-12-04T10:08:29.1640766Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1640769Z 2025-12-04T10:08:29.1640865Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1640949Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1641030Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1641033Z 2025-12-04T10:08:29.1641116Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1641219Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1641255Z If the test 2025-12-04T10:08:29.1641351Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1641422Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1641517Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1641619Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1641632Z 2025-12-04T10:08:29.1641724Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1641809Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1641845Z the following. 2025-12-04T10:08:29.1641847Z 2025-12-04T10:08:29.1641935Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1642026Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1642077Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1642140Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1642214Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1642216Z 2025-12-04T10:08:29.1642248Z Got: 2025-12-04T10:08:29.1642304Z tensor([[[[-0.2718, 0.4023, -0.2886, -2.0572, 0.8617], 2025-12-04T10:08:29.1642351Z [-0.8466, 0.4577, -0.5941, -0.5979, 0.3840], 2025-12-04T10:08:29.1642399Z [-0.9354, -0.1574, -0.3456, -1.5513, -0.3520], 2025-12-04T10:08:29.1642443Z [-0.8259, 1.4445, 1.3606, 0.4498, 0.7210], 2025-12-04T10:08:29.1642494Z [-0.1940, 1.0860, -0.2763, -0.5038, -0.8057]], 2025-12-04T10:08:29.1642496Z 2025-12-04T10:08:29.1642540Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1642585Z [ 1.7377, -1.1775, -0.8656, -0.1678, 0.2485], 2025-12-04T10:08:29.1642629Z [ 1.2858, 0.1665, -0.3299, 0.6027, -2.3239], 2025-12-04T10:08:29.1642675Z [ 0.4440, -1.2709, -1.1622, -0.4258, -0.8472], 2025-12-04T10:08:29.1642726Z [ 0.7699, -0.0568, -0.2380, 0.3615, -1.2294]]], 2025-12-04T10:08:29.1642729Z 2025-12-04T10:08:29.1642731Z 2025-12-04T10:08:29.1642775Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1642818Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1642864Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1642908Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1643003Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1643006Z 2025-12-04T10:08:29.1643050Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1643095Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1643139Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1643184Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1643247Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1643291Z dtype=torch.float64) 2025-12-04T10:08:29.1643293Z 2025-12-04T10:08:29.1643327Z Expected: 2025-12-04T10:08:29.1643382Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1643426Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1643475Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1643518Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1643566Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1643568Z 2025-12-04T10:08:29.1643613Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1643658Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1643704Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1643748Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1643798Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1643800Z 2025-12-04T10:08:29.1643826Z 2025-12-04T10:08:29.1643871Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1643916Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1643960Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1644033Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1644081Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1644082Z 2025-12-04T10:08:29.1644128Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1644171Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1644215Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1644261Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1644326Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1644367Z dtype=torch.float64) 2025-12-04T10:08:29.1644369Z 2025-12-04T10:08:29.1644684Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1644688Z 2025-12-04T10:08:29.1644763Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1644965Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1644968Z 2025-12-04T10:08:29.1645055Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1645148Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1645193Z Traceback (most recent call last): 2025-12-04T10:08:29.1645365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1645409Z return test(*args, **kwargs) 2025-12-04T10:08:29.1645446Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1645554Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1645621Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1645790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1645909Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1645962Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1646122Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1646179Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1646222Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1646380Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1646447Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1646492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1646630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1646677Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1646715Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1646866Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1646916Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1647071Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1647124Z raise GradcheckError( 2025-12-04T10:08:29.1647213Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1647215Z 2025-12-04T10:08:29.1647318Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1647412Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1647492Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1647494Z 2025-12-04T10:08:29.1647578Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1647681Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1647716Z If the test 2025-12-04T10:08:29.1647810Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1647871Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1647978Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1648059Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1648061Z 2025-12-04T10:08:29.1648155Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1648239Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1648277Z the following. 2025-12-04T10:08:29.1648279Z 2025-12-04T10:08:29.1648368Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1648458Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1648510Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1648573Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1648634Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1648638Z 2025-12-04T10:08:29.1648670Z Got: 2025-12-04T10:08:29.1648726Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1648772Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1648819Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1648865Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1648914Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1648916Z 2025-12-04T10:08:29.1648960Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1649006Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1649050Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1649095Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1649143Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1649145Z 2025-12-04T10:08:29.1649147Z 2025-12-04T10:08:29.1649193Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1649236Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1649281Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1649325Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1649374Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1649376Z 2025-12-04T10:08:29.1649421Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1649465Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1649509Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1649553Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1649616Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1649657Z dtype=torch.float64) 2025-12-04T10:08:29.1649659Z 2025-12-04T10:08:29.1649693Z Expected: 2025-12-04T10:08:29.1649761Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1649805Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1649851Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1649916Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1649964Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1649965Z 2025-12-04T10:08:29.1650010Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1650054Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1650099Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1650143Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1650192Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1650194Z 2025-12-04T10:08:29.1650196Z 2025-12-04T10:08:29.1650239Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1650296Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1650340Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1650387Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1650434Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1650436Z 2025-12-04T10:08:29.1650481Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1650526Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1650570Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1650614Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1650676Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1650716Z dtype=torch.float64) 2025-12-04T10:08:29.1650718Z 2025-12-04T10:08:29.1650801Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1650807Z 2025-12-04T10:08:29.1650852Z Traceback (most recent call last): 2025-12-04T10:08:29.1651006Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1651045Z method(*args, **kwargs) 2025-12-04T10:08:29.1651223Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1651268Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1651309Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1651470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1651512Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1651550Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1651710Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1651752Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1651788Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1651943Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1651983Z fn(*args, **kwargs) 2025-12-04T10:08:29.1652152Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1652193Z raise e_tracked from e 2025-12-04T10:08:29.1652239Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1652241Z 2025-12-04T10:08:29.1652334Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1652418Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1652498Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1652500Z 2025-12-04T10:08:29.1652603Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1652706Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1652742Z If the test 2025-12-04T10:08:29.1652857Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1652919Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1653051Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1653134Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1653136Z 2025-12-04T10:08:29.1653227Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1653312Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1653348Z the following. 2025-12-04T10:08:29.1653351Z 2025-12-04T10:08:29.1653458Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1653551Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1653603Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1653668Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1653729Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1653731Z 2025-12-04T10:08:29.1653764Z Got: 2025-12-04T10:08:29.1653818Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1653865Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1653912Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1653957Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1654003Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1654005Z 2025-12-04T10:08:29.1654050Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1654096Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1654141Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1654185Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1654238Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1654240Z 2025-12-04T10:08:29.1654242Z 2025-12-04T10:08:29.1654285Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1654330Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1654372Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1654417Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1654462Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1654463Z 2025-12-04T10:08:29.1654509Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1654553Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1654598Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1654642Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1654704Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1654748Z dtype=torch.float64) 2025-12-04T10:08:29.1654751Z 2025-12-04T10:08:29.1654785Z Expected: 2025-12-04T10:08:29.1654838Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1654881Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1654927Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1654970Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1655016Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1655018Z 2025-12-04T10:08:29.1655062Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1655109Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1655169Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1655215Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1655263Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1655301Z 2025-12-04T10:08:29.1655303Z 2025-12-04T10:08:29.1655350Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1655393Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1655437Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1655484Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1655531Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1655532Z 2025-12-04T10:08:29.1655577Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1655621Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1655676Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1655723Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1655784Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1655827Z dtype=torch.float64) 2025-12-04T10:08:29.1655830Z 2025-12-04T10:08:29.1656117Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1656120Z 2025-12-04T10:08:29.1656195Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1656396Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1656399Z 2025-12-04T10:08:29.1656485Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1656578Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1656624Z Traceback (most recent call last): 2025-12-04T10:08:29.1656795Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1656839Z return test(*args, **kwargs) 2025-12-04T10:08:29.1656877Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1656981Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1657046Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1657213Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1657334Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1657388Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1657551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1657608Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1657652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1657806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1657871Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1657916Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1658053Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1658099Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1658138Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1658301Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1658350Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1658514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1658565Z raise GradcheckError( 2025-12-04T10:08:29.1658654Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1658656Z 2025-12-04T10:08:29.1658748Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1658831Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1658911Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1658913Z 2025-12-04T10:08:29.1658998Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1659112Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1659149Z If the test 2025-12-04T10:08:29.1659241Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1659305Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1659399Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1659482Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1659484Z 2025-12-04T10:08:29.1659574Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1659660Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1659695Z the following. 2025-12-04T10:08:29.1659698Z 2025-12-04T10:08:29.1659786Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1659877Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1659928Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1659992Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1660052Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1660055Z 2025-12-04T10:08:29.1660088Z Got: 2025-12-04T10:08:29.1660143Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1660190Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1660236Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1660281Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1660327Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1660329Z 2025-12-04T10:08:29.1660374Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1660418Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1660464Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1660508Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1660558Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1660561Z 2025-12-04T10:08:29.1660562Z 2025-12-04T10:08:29.1660607Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1660651Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1660694Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1660738Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1660784Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1660786Z 2025-12-04T10:08:29.1660832Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1660876Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1660921Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1660978Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1661041Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1661082Z dtype=torch.float64) 2025-12-04T10:08:29.1661097Z 2025-12-04T10:08:29.1661131Z Expected: 2025-12-04T10:08:29.1661196Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1661243Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1661290Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1661333Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1661380Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1661382Z 2025-12-04T10:08:29.1661425Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1661471Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1661535Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1661582Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1661631Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1661633Z 2025-12-04T10:08:29.1661634Z 2025-12-04T10:08:29.1661681Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1661725Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1661768Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1661812Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1661858Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1661859Z 2025-12-04T10:08:29.1661903Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1661948Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1661990Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1662037Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1662101Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1662142Z dtype=torch.float64) 2025-12-04T10:08:29.1662144Z 2025-12-04T10:08:29.1662226Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1662229Z 2025-12-04T10:08:29.1662275Z Traceback (most recent call last): 2025-12-04T10:08:29.1662432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1662471Z method(*args, **kwargs) 2025-12-04T10:08:29.1662649Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1662694Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1662734Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1662895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1662975Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1663013Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1663174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1663216Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1663253Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1663403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1663441Z fn(*args, **kwargs) 2025-12-04T10:08:29.1663607Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1663649Z raise e_tracked from e 2025-12-04T10:08:29.1663693Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1663695Z 2025-12-04T10:08:29.1663811Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1663893Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1663974Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1663988Z 2025-12-04T10:08:29.1664087Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1664191Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1664226Z If the test 2025-12-04T10:08:29.1664320Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1664381Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1664475Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1664556Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1664560Z 2025-12-04T10:08:29.1664664Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1664750Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1664788Z the following. 2025-12-04T10:08:29.1664791Z 2025-12-04T10:08:29.1664881Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1664970Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1665022Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1665085Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1665147Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1665148Z 2025-12-04T10:08:29.1665180Z Got: 2025-12-04T10:08:29.1665237Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1665283Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1665329Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1665374Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1665421Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1665423Z 2025-12-04T10:08:29.1665469Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1665515Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1665558Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1665603Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1665652Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1665654Z 2025-12-04T10:08:29.1665656Z 2025-12-04T10:08:29.1665701Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1665744Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1665789Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1665835Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1665882Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1665883Z 2025-12-04T10:08:29.1665929Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1665974Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1666019Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1666064Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1666126Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1666166Z dtype=torch.float64) 2025-12-04T10:08:29.1666168Z 2025-12-04T10:08:29.1666202Z Expected: 2025-12-04T10:08:29.1666254Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1666299Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1666343Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1666401Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1666447Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1666449Z 2025-12-04T10:08:29.1666495Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1666559Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1666606Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1666651Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1666700Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1666702Z 2025-12-04T10:08:29.1666704Z 2025-12-04T10:08:29.1666747Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1666792Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1666835Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1666882Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1666940Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1666941Z 2025-12-04T10:08:29.1666988Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1667032Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1667078Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1667122Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1667184Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1667224Z dtype=torch.float64) 2025-12-04T10:08:29.1667228Z 2025-12-04T10:08:29.1667516Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1667518Z 2025-12-04T10:08:29.1667595Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1667795Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1667798Z 2025-12-04T10:08:29.1667886Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1667978Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1668026Z Traceback (most recent call last): 2025-12-04T10:08:29.1668195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1668238Z return test(*args, **kwargs) 2025-12-04T10:08:29.1668275Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1668381Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1668447Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1668616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1668735Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1668790Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1668953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1669008Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1669051Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1669205Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1669272Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1669327Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1669468Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1669513Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1669576Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1669727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1669779Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1669935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1669976Z raise GradcheckError( 2025-12-04T10:08:29.1670066Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1670068Z 2025-12-04T10:08:29.1670162Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1670255Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1670336Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1670339Z 2025-12-04T10:08:29.1670422Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1670527Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1670561Z If the test 2025-12-04T10:08:29.1670655Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1670717Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1670811Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1670891Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1670894Z 2025-12-04T10:08:29.1670984Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1671071Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1671106Z the following. 2025-12-04T10:08:29.1671108Z 2025-12-04T10:08:29.1671197Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1671289Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1671341Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1671403Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1671465Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1671467Z 2025-12-04T10:08:29.1671499Z Got: 2025-12-04T10:08:29.1671556Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1671603Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1671650Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1671695Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1671747Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1671748Z 2025-12-04T10:08:29.1671793Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1671838Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1671884Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1671929Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1671979Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1671981Z 2025-12-04T10:08:29.1671983Z 2025-12-04T10:08:29.1672028Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1672072Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1672116Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1672160Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1672210Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1672223Z 2025-12-04T10:08:29.1672271Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1672318Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1672391Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1672436Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1672499Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1672540Z dtype=torch.float64) 2025-12-04T10:08:29.1672542Z 2025-12-04T10:08:29.1672577Z Expected: 2025-12-04T10:08:29.1672633Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1672678Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1672723Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1672767Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1672827Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1672829Z 2025-12-04T10:08:29.1672875Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1672920Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1673006Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1673050Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1673100Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1673102Z 2025-12-04T10:08:29.1673103Z 2025-12-04T10:08:29.1673147Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1673190Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1673234Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1673278Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1673324Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1673328Z 2025-12-04T10:08:29.1673373Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1673418Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1673464Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1673510Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1673572Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1673612Z dtype=torch.float64) 2025-12-04T10:08:29.1673617Z 2025-12-04T10:08:29.1673701Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1673703Z 2025-12-04T10:08:29.1673749Z Traceback (most recent call last): 2025-12-04T10:08:29.1673904Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1673944Z method(*args, **kwargs) 2025-12-04T10:08:29.1674121Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1674168Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1674209Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1674371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1674414Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1674451Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1674608Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1674649Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1674685Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1674838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1674875Z fn(*args, **kwargs) 2025-12-04T10:08:29.1675065Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1675105Z raise e_tracked from e 2025-12-04T10:08:29.1675152Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1675168Z 2025-12-04T10:08:29.1675274Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1675356Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1675436Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1675439Z 2025-12-04T10:08:29.1675525Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1675626Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1675662Z If the test 2025-12-04T10:08:29.1675756Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1675834Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1675930Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1676012Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1676015Z 2025-12-04T10:08:29.1676108Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1676194Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1676231Z the following. 2025-12-04T10:08:29.1676233Z 2025-12-04T10:08:29.1676321Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1676413Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1676463Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1676528Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1676590Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1676592Z 2025-12-04T10:08:29.1676626Z Got: 2025-12-04T10:08:29.1676682Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1676729Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1676777Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1676822Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1676869Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1676871Z 2025-12-04T10:08:29.1676916Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1676960Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1677005Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1677050Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1677101Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1677105Z 2025-12-04T10:08:29.1677108Z 2025-12-04T10:08:29.1677152Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1677197Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1677242Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1677287Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1677334Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1677336Z 2025-12-04T10:08:29.1677380Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1677425Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1677468Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1677512Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1677576Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1677617Z dtype=torch.float64) 2025-12-04T10:08:29.1677632Z 2025-12-04T10:08:29.1677667Z Expected: 2025-12-04T10:08:29.1677721Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1679508Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1679572Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1679629Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1679676Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1679678Z 2025-12-04T10:08:29.1679723Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1679769Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1679812Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1679857Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1679906Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1679908Z 2025-12-04T10:08:29.1679910Z 2025-12-04T10:08:29.1679972Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1680016Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1680061Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1680109Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1680156Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1680159Z 2025-12-04T10:08:29.1680203Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1680248Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1680292Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1680341Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1680406Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1680447Z dtype=torch.float64) 2025-12-04T10:08:29.1680452Z 2025-12-04T10:08:29.1680753Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1680758Z 2025-12-04T10:08:29.1680833Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1681036Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1681039Z 2025-12-04T10:08:29.1681125Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1681219Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1681265Z Traceback (most recent call last): 2025-12-04T10:08:29.1681438Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1681481Z return test(*args, **kwargs) 2025-12-04T10:08:29.1681518Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1681624Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1681691Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1681858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1681985Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1682040Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1682202Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1682259Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1682319Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1682475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1682541Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1682608Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1682749Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1682795Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1682833Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1683028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1683080Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1683258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1683302Z raise GradcheckError( 2025-12-04T10:08:29.1683394Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1683396Z 2025-12-04T10:08:29.1683489Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1683573Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1683652Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1683654Z 2025-12-04T10:08:29.1683738Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1683841Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1683877Z If the test 2025-12-04T10:08:29.1683969Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1684031Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1684128Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1684209Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1684211Z 2025-12-04T10:08:29.1684304Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1684389Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1684427Z the following. 2025-12-04T10:08:29.1684429Z 2025-12-04T10:08:29.1684518Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1684609Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1684660Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1684723Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1684784Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1684786Z 2025-12-04T10:08:29.1684821Z Got: 2025-12-04T10:08:29.1684875Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1684922Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1684969Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1685015Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1685063Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1685064Z 2025-12-04T10:08:29.1685109Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1685154Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1685199Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1685245Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1685295Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1685297Z 2025-12-04T10:08:29.1685299Z 2025-12-04T10:08:29.1685343Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1685405Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1685450Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1685494Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1685580Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1685583Z 2025-12-04T10:08:29.1685629Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1685673Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1685716Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1685761Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1685823Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1685866Z dtype=torch.float64) 2025-12-04T10:08:29.1685868Z 2025-12-04T10:08:29.1685902Z Expected: 2025-12-04T10:08:29.1685971Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1686017Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1686063Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1686106Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1686155Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1686157Z 2025-12-04T10:08:29.1686202Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1686247Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1686290Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1686335Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1686384Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1686386Z 2025-12-04T10:08:29.1686388Z 2025-12-04T10:08:29.1686433Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1686478Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1686523Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1686566Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1686613Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1686616Z 2025-12-04T10:08:29.1686661Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1686706Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1686749Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1686795Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1686858Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1686899Z dtype=torch.float64) 2025-12-04T10:08:29.1686900Z 2025-12-04T10:08:29.1686983Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1686985Z 2025-12-04T10:08:29.1687032Z Traceback (most recent call last): 2025-12-04T10:08:29.1687189Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1687229Z method(*args, **kwargs) 2025-12-04T10:08:29.1687408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1687454Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1687493Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1687653Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1687697Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1687734Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1687896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1687950Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1687987Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1688137Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1688196Z fn(*args, **kwargs) 2025-12-04T10:08:29.1688363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1688405Z raise e_tracked from e 2025-12-04T10:08:29.1688449Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1688451Z 2025-12-04T10:08:29.1688546Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1688627Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1688708Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1688710Z 2025-12-04T10:08:29.1688808Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1688912Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1688948Z If the test 2025-12-04T10:08:29.1689041Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1689104Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1689197Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1689279Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1689281Z 2025-12-04T10:08:29.1689371Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1689456Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1689492Z the following. 2025-12-04T10:08:29.1689494Z 2025-12-04T10:08:29.1689585Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1689675Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1689726Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1689788Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1689851Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1689853Z 2025-12-04T10:08:29.1689885Z Got: 2025-12-04T10:08:29.1689942Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1689988Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1690034Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1690078Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1690125Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1690127Z 2025-12-04T10:08:29.1690172Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1690218Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1690262Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1690309Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1690359Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1690362Z 2025-12-04T10:08:29.1690364Z 2025-12-04T10:08:29.1690408Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1690452Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1690495Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1690539Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1690586Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1690588Z 2025-12-04T10:08:29.1690635Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1690678Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1690741Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1690785Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1690851Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1690917Z dtype=torch.float64) 2025-12-04T10:08:29.1690919Z 2025-12-04T10:08:29.1690954Z Expected: 2025-12-04T10:08:29.1691007Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1691052Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1691097Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1691141Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1691187Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1691189Z 2025-12-04T10:08:29.1691234Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1691278Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1691338Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1691384Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1691434Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1691437Z 2025-12-04T10:08:29.1691439Z 2025-12-04T10:08:29.1691483Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1691527Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1691570Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1691615Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1691661Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1691664Z 2025-12-04T10:08:29.1691709Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1691753Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1691797Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1691843Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1691904Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1691945Z dtype=torch.float64) 2025-12-04T10:08:29.1691948Z 2025-12-04T10:08:29.1692242Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1692245Z 2025-12-04T10:08:29.1692319Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1692521Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1692524Z 2025-12-04T10:08:29.1692612Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1692705Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1692751Z Traceback (most recent call last): 2025-12-04T10:08:29.1692922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1693012Z return test(*args, **kwargs) 2025-12-04T10:08:29.1693049Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1693153Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1693217Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1693384Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1693504Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1693557Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1693739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1693830Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1693873Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1694028Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1694095Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1694138Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1694278Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1694323Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1694362Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1694535Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1694586Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1694742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1694784Z raise GradcheckError( 2025-12-04T10:08:29.1694874Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1694876Z 2025-12-04T10:08:29.1694969Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1695050Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1695131Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1695133Z 2025-12-04T10:08:29.1695218Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1695323Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1695360Z If the test 2025-12-04T10:08:29.1695453Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1695515Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1695611Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1695692Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1695694Z 2025-12-04T10:08:29.1695784Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1695869Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1695905Z the following. 2025-12-04T10:08:29.1695907Z 2025-12-04T10:08:29.1695995Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1696084Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1696137Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1696199Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1696261Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1696264Z 2025-12-04T10:08:29.1696297Z Got: 2025-12-04T10:08:29.1696354Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1696401Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1696450Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1696494Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1696542Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1696543Z 2025-12-04T10:08:29.1696588Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1696633Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1696678Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1696746Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1696795Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1696798Z 2025-12-04T10:08:29.1696813Z 2025-12-04T10:08:29.1696868Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1696913Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1696956Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1697001Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1697049Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1697050Z 2025-12-04T10:08:29.1697098Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1697142Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1697186Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1697247Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1697311Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1697352Z dtype=torch.float64) 2025-12-04T10:08:29.1697354Z 2025-12-04T10:08:29.1697390Z Expected: 2025-12-04T10:08:29.1697445Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1697490Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1697534Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1697578Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1697624Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1697626Z 2025-12-04T10:08:29.1697671Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1697714Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1697759Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1697805Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1697855Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1697857Z 2025-12-04T10:08:29.1697859Z 2025-12-04T10:08:29.1697905Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1697951Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1697995Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1698040Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1698085Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1698088Z 2025-12-04T10:08:29.1698132Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1698178Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1698222Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1698266Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1698329Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1698370Z dtype=torch.float64) 2025-12-04T10:08:29.1698372Z 2025-12-04T10:08:29.1698454Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1698458Z 2025-12-04T10:08:29.1698503Z Traceback (most recent call last): 2025-12-04T10:08:29.1698657Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1698697Z method(*args, **kwargs) 2025-12-04T10:08:29.1698873Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1698919Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1698957Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1699118Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1699175Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1699213Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1699385Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1699439Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1699475Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1699627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1699664Z fn(*args, **kwargs) 2025-12-04T10:08:29.1699831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1699871Z raise e_tracked from e 2025-12-04T10:08:29.1699916Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1699918Z 2025-12-04T10:08:29.1700025Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1700107Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1700189Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1700192Z 2025-12-04T10:08:29.1700278Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1700380Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1700415Z If the test 2025-12-04T10:08:29.1700510Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1700571Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1700667Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1700748Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1700750Z 2025-12-04T10:08:29.1700843Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1700927Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1700964Z the following. 2025-12-04T10:08:29.1700966Z 2025-12-04T10:08:29.1701055Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1701146Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1701197Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1701260Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1701320Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1701322Z 2025-12-04T10:08:29.1701355Z Got: 2025-12-04T10:08:29.1701410Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1701457Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1701504Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1701550Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1701597Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1701601Z 2025-12-04T10:08:29.1701645Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1701695Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1701739Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1701784Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1701834Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1701836Z 2025-12-04T10:08:29.1701837Z 2025-12-04T10:08:29.1701882Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1701926Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1701970Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1702014Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1702074Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1702076Z 2025-12-04T10:08:29.1702121Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1702175Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1702231Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1702279Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1702342Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1702382Z dtype=torch.float64) 2025-12-04T10:08:29.1702384Z 2025-12-04T10:08:29.1702418Z Expected: 2025-12-04T10:08:29.1702472Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1702516Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1702561Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1702620Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1702670Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1702672Z 2025-12-04T10:08:29.1702717Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1702766Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1702811Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1702857Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1702905Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1702907Z 2025-12-04T10:08:29.1702910Z 2025-12-04T10:08:29.1702998Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1703043Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1703087Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1703131Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1703179Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1703181Z 2025-12-04T10:08:29.1703227Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1703271Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1703319Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1703363Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1703425Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1703464Z dtype=torch.float64) 2025-12-04T10:08:29.1703466Z 2025-12-04T10:08:29.1703755Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1703758Z 2025-12-04T10:08:29.1703832Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1704036Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1704038Z 2025-12-04T10:08:29.1704125Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1704220Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1704266Z Traceback (most recent call last): 2025-12-04T10:08:29.1704435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1704479Z return test(*args, **kwargs) 2025-12-04T10:08:29.1704516Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1704620Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1704684Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1704872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1704993Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1705071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1705232Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1705289Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1705331Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1705488Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1705554Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1705620Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1705761Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1705806Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1705845Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1706000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1706050Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1706206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1706246Z raise GradcheckError( 2025-12-04T10:08:29.1706335Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1706338Z 2025-12-04T10:08:29.1706431Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1706515Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1706596Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1706598Z 2025-12-04T10:08:29.1706682Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1706786Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1706822Z If the test 2025-12-04T10:08:29.1706918Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1706979Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1707073Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1707153Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1707155Z 2025-12-04T10:08:29.1707245Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1707332Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1707369Z the following. 2025-12-04T10:08:29.1707371Z 2025-12-04T10:08:29.1707460Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1707553Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1707604Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1707667Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1707728Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1707730Z 2025-12-04T10:08:29.1707763Z Got: 2025-12-04T10:08:29.1707818Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1707865Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1707912Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1707958Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1708020Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1708023Z 2025-12-04T10:08:29.1708067Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1708113Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1708182Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1708228Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1708277Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1708279Z 2025-12-04T10:08:29.1708281Z 2025-12-04T10:08:29.1708326Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1708370Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1708415Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1708458Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1708519Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1708522Z 2025-12-04T10:08:29.1708567Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1708611Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1708654Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1708703Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1708765Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1708807Z dtype=torch.float64) 2025-12-04T10:08:29.1708809Z 2025-12-04T10:08:29.1708844Z Expected: 2025-12-04T10:08:29.1708897Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1708941Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1708987Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1709030Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1709081Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1709083Z 2025-12-04T10:08:29.1709129Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1709173Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1709217Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1709265Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1709314Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1709317Z 2025-12-04T10:08:29.1709319Z 2025-12-04T10:08:29.1709363Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1709407Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1709450Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1709495Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1709540Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1709542Z 2025-12-04T10:08:29.1709590Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1709636Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1709681Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1709727Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1709788Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1709828Z dtype=torch.float64) 2025-12-04T10:08:29.1709830Z 2025-12-04T10:08:29.1709912Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1709914Z 2025-12-04T10:08:29.1709959Z Traceback (most recent call last): 2025-12-04T10:08:29.1710114Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1710153Z method(*args, **kwargs) 2025-12-04T10:08:29.1710330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1710390Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1710430Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1710601Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1710657Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1710693Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1710853Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1710893Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1710930Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1711080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1711119Z fn(*args, **kwargs) 2025-12-04T10:08:29.1711303Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1711343Z raise e_tracked from e 2025-12-04T10:08:29.1711389Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1711392Z 2025-12-04T10:08:29.1711486Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1711569Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1711649Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1711651Z 2025-12-04T10:08:29.1711737Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1711839Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1711874Z If the test 2025-12-04T10:08:29.1711968Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1712032Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1712126Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1712209Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1712212Z 2025-12-04T10:08:29.1712302Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1712387Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1712423Z the following. 2025-12-04T10:08:29.1712425Z 2025-12-04T10:08:29.1712514Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1712602Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1712653Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1712715Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1712777Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1712779Z 2025-12-04T10:08:29.1712811Z Got: 2025-12-04T10:08:29.1712867Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1712914Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1712995Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1713040Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1713088Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1713090Z 2025-12-04T10:08:29.1713137Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1713181Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1713227Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1713271Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1713321Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1713323Z 2025-12-04T10:08:29.1713345Z 2025-12-04T10:08:29.1713391Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1713435Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1713478Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1713552Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1713599Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1713601Z 2025-12-04T10:08:29.1713646Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1713692Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1713738Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1713782Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1713844Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1713884Z dtype=torch.float64) 2025-12-04T10:08:29.1713889Z 2025-12-04T10:08:29.1713945Z Expected: 2025-12-04T10:08:29.1713999Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1714044Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1714089Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1714135Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1714182Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1714183Z 2025-12-04T10:08:29.1714229Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1714273Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1714318Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1714364Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1714412Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1714414Z 2025-12-04T10:08:29.1714416Z 2025-12-04T10:08:29.1714462Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1714508Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1714552Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1714595Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1714644Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1714646Z 2025-12-04T10:08:29.1714690Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1714734Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1714778Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1714823Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1714884Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1714925Z dtype=torch.float64) 2025-12-04T10:08:29.1714926Z 2025-12-04T10:08:29.1715214Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1715217Z 2025-12-04T10:08:29.1715293Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1715494Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1715498Z 2025-12-04T10:08:29.1715584Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1715678Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1715723Z Traceback (most recent call last): 2025-12-04T10:08:29.1715895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1715956Z return test(*args, **kwargs) 2025-12-04T10:08:29.1715994Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1716098Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1716163Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1716366Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1716488Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1716540Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1716702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1716757Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1716812Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1716970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1717036Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1717081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1717222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1717266Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1717305Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1717455Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1717506Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1717662Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1717705Z raise GradcheckError( 2025-12-04T10:08:29.1717795Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1717797Z 2025-12-04T10:08:29.1717889Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1717974Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1718053Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1718055Z 2025-12-04T10:08:29.1718140Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1718242Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1718278Z If the test 2025-12-04T10:08:29.1718371Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1718432Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1718526Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1718609Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1718611Z 2025-12-04T10:08:29.1718700Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1718788Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1718824Z the following. 2025-12-04T10:08:29.1718826Z 2025-12-04T10:08:29.1718916Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1719005Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1719056Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1719119Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1719181Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1719183Z 2025-12-04T10:08:29.1719216Z Got: 2025-12-04T10:08:29.1719294Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1719341Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1719387Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1719463Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1719511Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1719513Z 2025-12-04T10:08:29.1719558Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1719602Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1719648Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1719693Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1719743Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1719745Z 2025-12-04T10:08:29.1719747Z 2025-12-04T10:08:29.1719791Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1719850Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1719894Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1719938Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1719985Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1719987Z 2025-12-04T10:08:29.1720032Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1720076Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1720120Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1720163Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1720227Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1720268Z dtype=torch.float64) 2025-12-04T10:08:29.1720270Z 2025-12-04T10:08:29.1720307Z Expected: 2025-12-04T10:08:29.1720360Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1720406Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1720450Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1720494Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1720542Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1720544Z 2025-12-04T10:08:29.1720589Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1720633Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1720677Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1720723Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1720772Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1720774Z 2025-12-04T10:08:29.1720775Z 2025-12-04T10:08:29.1720820Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1720865Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1720910Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1720954Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1721000Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1721004Z 2025-12-04T10:08:29.1721048Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1721093Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1721135Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1721180Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1721241Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1721283Z dtype=torch.float64) 2025-12-04T10:08:29.1721284Z 2025-12-04T10:08:29.1721366Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1721368Z 2025-12-04T10:08:29.1721416Z Traceback (most recent call last): 2025-12-04T10:08:29.1721585Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1721625Z method(*args, **kwargs) 2025-12-04T10:08:29.1721811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1721869Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1721907Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1722069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1722111Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1722149Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1722309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1722363Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1722400Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1722552Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1722591Z fn(*args, **kwargs) 2025-12-04T10:08:29.1722757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1722798Z raise e_tracked from e 2025-12-04T10:08:29.1722843Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1722845Z 2025-12-04T10:08:29.1722973Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1723056Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1723136Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1723138Z 2025-12-04T10:08:29.1723223Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1723329Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1723363Z If the test 2025-12-04T10:08:29.1723457Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1723520Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1723614Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1723695Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1723697Z 2025-12-04T10:08:29.1723788Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1723872Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1723909Z the following. 2025-12-04T10:08:29.1723911Z 2025-12-04T10:08:29.1724000Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1724092Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1724145Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1724207Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1724270Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1724272Z 2025-12-04T10:08:29.1724304Z Got: 2025-12-04T10:08:29.1724363Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1724409Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1724456Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1724501Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1724548Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1724550Z 2025-12-04T10:08:29.1724594Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1724640Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1724705Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1724750Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1724799Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1724839Z 2025-12-04T10:08:29.1724841Z 2025-12-04T10:08:29.1724887Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1724930Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1724974Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1725018Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1725066Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1725068Z 2025-12-04T10:08:29.1725113Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1725158Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1725218Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1725265Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1725327Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1725370Z dtype=torch.float64) 2025-12-04T10:08:29.1725374Z 2025-12-04T10:08:29.1725409Z Expected: 2025-12-04T10:08:29.1725464Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1725508Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1725554Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1725599Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1725646Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1725649Z 2025-12-04T10:08:29.1725695Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1725739Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1725784Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1725829Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1725878Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1725880Z 2025-12-04T10:08:29.1725883Z 2025-12-04T10:08:29.1725928Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1725972Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1726015Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1726059Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1726104Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1726106Z 2025-12-04T10:08:29.1726151Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1726194Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1726239Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1726285Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1726347Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1726387Z dtype=torch.float64) 2025-12-04T10:08:29.1726390Z 2025-12-04T10:08:29.1726683Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1726685Z 2025-12-04T10:08:29.1726760Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1726964Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1726966Z 2025-12-04T10:08:29.1727053Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1727159Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1727205Z Traceback (most recent call last): 2025-12-04T10:08:29.1727374Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1727452Z return test(*args, **kwargs) 2025-12-04T10:08:29.1727490Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1727596Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1727660Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1727828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1727948Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1728014Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1728177Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1728234Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1728278Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1728435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1728501Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1728545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1728684Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1728729Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1728768Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1728919Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1728970Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1729125Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1729168Z raise GradcheckError( 2025-12-04T10:08:29.1729256Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1729258Z 2025-12-04T10:08:29.1729350Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1729432Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1729512Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1729514Z 2025-12-04T10:08:29.1729600Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1729703Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1729739Z If the test 2025-12-04T10:08:29.1729832Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1729893Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1729989Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1730070Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1730072Z 2025-12-04T10:08:29.1730163Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1730247Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1730284Z the following. 2025-12-04T10:08:29.1730285Z 2025-12-04T10:08:29.1730375Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1730465Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1730531Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1730593Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1730654Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1730667Z 2025-12-04T10:08:29.1730717Z Got: 2025-12-04T10:08:29.1730775Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1730821Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1730868Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1730912Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1730960Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1730962Z 2025-12-04T10:08:29.1731006Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1731051Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1731112Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1731158Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1731207Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1731209Z 2025-12-04T10:08:29.1731211Z 2025-12-04T10:08:29.1731258Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1731301Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1731345Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1731388Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1731435Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1731437Z 2025-12-04T10:08:29.1731482Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1731526Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1731569Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1731615Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1731678Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1731719Z dtype=torch.float64) 2025-12-04T10:08:29.1731721Z 2025-12-04T10:08:29.1731755Z Expected: 2025-12-04T10:08:29.1731811Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1731857Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1731903Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1731947Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1731992Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1731994Z 2025-12-04T10:08:29.1732038Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1732082Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1732126Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1732171Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1732221Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1732223Z 2025-12-04T10:08:29.1732225Z 2025-12-04T10:08:29.1732268Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1732313Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1732357Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1732401Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1732446Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1732448Z 2025-12-04T10:08:29.1732494Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1732537Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1732581Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1732624Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1732700Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1732740Z dtype=torch.float64) 2025-12-04T10:08:29.1732742Z 2025-12-04T10:08:29.1732827Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1732842Z 2025-12-04T10:08:29.1732899Z Traceback (most recent call last): 2025-12-04T10:08:29.1733089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1733128Z method(*args, **kwargs) 2025-12-04T10:08:29.1733306Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1733352Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1733389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1733571Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1733616Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1733653Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1733810Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1733853Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1733889Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1734042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1734079Z fn(*args, **kwargs) 2025-12-04T10:08:29.1734246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1734286Z raise e_tracked from e 2025-12-04T10:08:29.1734331Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1734333Z 2025-12-04T10:08:29.1734427Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1734510Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1734590Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1734592Z 2025-12-04T10:08:29.1734680Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1734782Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1734817Z If the test 2025-12-04T10:08:29.1734909Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1734971Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1735068Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1735151Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1735153Z 2025-12-04T10:08:29.1735243Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1735331Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1735367Z the following. 2025-12-04T10:08:29.1735369Z 2025-12-04T10:08:29.1735457Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1735549Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1735601Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1735664Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1735726Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1735728Z 2025-12-04T10:08:29.1735761Z Got: 2025-12-04T10:08:29.1735816Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1735863Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1735910Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1735982Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1736029Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1736032Z 2025-12-04T10:08:29.1736076Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1736154Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1736199Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1736244Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1736293Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1736295Z 2025-12-04T10:08:29.1736297Z 2025-12-04T10:08:29.1736340Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1736385Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1736430Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1736489Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1736538Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1736540Z 2025-12-04T10:08:29.1736586Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1736629Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1736677Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1736721Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1736786Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1736828Z dtype=torch.float64) 2025-12-04T10:08:29.1736830Z 2025-12-04T10:08:29.1736863Z Expected: 2025-12-04T10:08:29.1736917Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1736961Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1737007Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1737052Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1737100Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1737102Z 2025-12-04T10:08:29.1737145Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1737190Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1737236Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1737280Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1737330Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1737332Z 2025-12-04T10:08:29.1737333Z 2025-12-04T10:08:29.1737378Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1737421Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1737466Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1737509Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1737556Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1737559Z 2025-12-04T10:08:29.1737603Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1737648Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1737692Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1737737Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1737798Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1737839Z dtype=torch.float64) 2025-12-04T10:08:29.1737841Z 2025-12-04T10:08:29.1738131Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1738134Z 2025-12-04T10:08:29.1738207Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1738433Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1738435Z 2025-12-04T10:08:29.1738522Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1738638Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1738684Z Traceback (most recent call last): 2025-12-04T10:08:29.1738855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1738897Z return test(*args, **kwargs) 2025-12-04T10:08:29.1738934Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1739038Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1739102Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1739282Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1739404Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1739457Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1739621Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1739678Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1739720Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1739876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1739942Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1739988Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1740130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1740175Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1740213Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1740369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1740419Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1740576Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1740618Z raise GradcheckError( 2025-12-04T10:08:29.1740708Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1740710Z 2025-12-04T10:08:29.1740802Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1740886Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1740966Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1740968Z 2025-12-04T10:08:29.1741053Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1741158Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1741194Z If the test 2025-12-04T10:08:29.1741287Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1741349Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1741442Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1741524Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1741526Z 2025-12-04T10:08:29.1741616Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1741702Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1741752Z the following. 2025-12-04T10:08:29.1741754Z 2025-12-04T10:08:29.1741841Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1741958Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1742010Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1742074Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1742134Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1742136Z 2025-12-04T10:08:29.1742169Z Got: 2025-12-04T10:08:29.1742223Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1742270Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1742316Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1742361Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1742422Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1742425Z 2025-12-04T10:08:29.1742470Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1742515Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1742562Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1742606Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1742657Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1742659Z 2025-12-04T10:08:29.1742661Z 2025-12-04T10:08:29.1742705Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1742749Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1742793Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1742840Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1742886Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1742889Z 2025-12-04T10:08:29.1742982Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1743028Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1743074Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1743122Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1743183Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1743227Z dtype=torch.float64) 2025-12-04T10:08:29.1743228Z 2025-12-04T10:08:29.1743264Z Expected: 2025-12-04T10:08:29.1743318Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1743362Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1743407Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1743450Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1743497Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1743500Z 2025-12-04T10:08:29.1743544Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1743588Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1743632Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1743680Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1743728Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1743730Z 2025-12-04T10:08:29.1743732Z 2025-12-04T10:08:29.1743776Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1743819Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1743864Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1743907Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1743953Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1743955Z 2025-12-04T10:08:29.1743999Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1744064Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1744108Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1744153Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1744244Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1744286Z dtype=torch.float64) 2025-12-04T10:08:29.1744288Z 2025-12-04T10:08:29.1744371Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1744374Z 2025-12-04T10:08:29.1744420Z Traceback (most recent call last): 2025-12-04T10:08:29.1744578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1744617Z method(*args, **kwargs) 2025-12-04T10:08:29.1744811Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1744858Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1744898Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1745058Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1745102Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1745139Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1745296Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1745337Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1745375Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1745525Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1745565Z fn(*args, **kwargs) 2025-12-04T10:08:29.1745733Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1745774Z raise e_tracked from e 2025-12-04T10:08:29.1745819Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1745821Z 2025-12-04T10:08:29.1745918Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1746002Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1746085Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1746087Z 2025-12-04T10:08:29.1746171Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1746273Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1746309Z If the test 2025-12-04T10:08:29.1746403Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1746465Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1746562Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1746643Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1746646Z 2025-12-04T10:08:29.1746738Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1746823Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1746859Z the following. 2025-12-04T10:08:29.1746861Z 2025-12-04T10:08:29.1746950Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1747039Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1747092Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1747154Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1747215Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1747233Z 2025-12-04T10:08:29.1747265Z Got: 2025-12-04T10:08:29.1747321Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1747367Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1747425Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1747481Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1747530Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1747532Z 2025-12-04T10:08:29.1747576Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1747621Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1747664Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1747709Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1747759Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1747761Z 2025-12-04T10:08:29.1747763Z 2025-12-04T10:08:29.1747832Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1747877Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1747923Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1747969Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1748016Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1748020Z 2025-12-04T10:08:29.1748065Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1748109Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1748153Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1748197Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1748259Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1748301Z dtype=torch.float64) 2025-12-04T10:08:29.1748303Z 2025-12-04T10:08:29.1748341Z Expected: 2025-12-04T10:08:29.1748393Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1748438Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1748483Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1748529Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1748577Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1748578Z 2025-12-04T10:08:29.1748623Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1748668Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1748713Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1748757Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1748806Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1748808Z 2025-12-04T10:08:29.1748810Z 2025-12-04T10:08:29.1748854Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1748899Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1748942Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1748987Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1749034Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1749036Z 2025-12-04T10:08:29.1749081Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1749125Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1749169Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1749212Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1749275Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1749315Z dtype=torch.float64) 2025-12-04T10:08:29.1749318Z 2025-12-04T10:08:29.1749610Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1749624Z 2025-12-04T10:08:29.1749710Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1749922Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1749925Z 2025-12-04T10:08:29.1750014Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1750107Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1750153Z Traceback (most recent call last): 2025-12-04T10:08:29.1750324Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1750380Z return test(*args, **kwargs) 2025-12-04T10:08:29.1750419Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1750524Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1750588Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1750759Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1750879Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1750931Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1751093Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1751149Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1751194Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1751350Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1751417Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1751463Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1751604Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1751649Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1751687Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1751838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1751888Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1752042Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1752086Z raise GradcheckError( 2025-12-04T10:08:29.1752175Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1752177Z 2025-12-04T10:08:29.1752269Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1752352Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1752433Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1752435Z 2025-12-04T10:08:29.1752520Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1752623Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1752658Z If the test 2025-12-04T10:08:29.1752752Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1752813Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1752909Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1753049Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1753052Z 2025-12-04T10:08:29.1753141Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1753255Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1753292Z the following. 2025-12-04T10:08:29.1753294Z 2025-12-04T10:08:29.1753383Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1753472Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1753524Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1753587Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1753648Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1753650Z 2025-12-04T10:08:29.1753683Z Got: 2025-12-04T10:08:29.1753757Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1753806Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1753853Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1753897Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1753949Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1753951Z 2025-12-04T10:08:29.1753995Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1754040Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1754084Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1754129Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1754178Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1754180Z 2025-12-04T10:08:29.1754182Z 2025-12-04T10:08:29.1754227Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1754272Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1754317Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1754363Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1754409Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1754412Z 2025-12-04T10:08:29.1754457Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1754501Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1754545Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1754589Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1754651Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1754692Z dtype=torch.float64) 2025-12-04T10:08:29.1754694Z 2025-12-04T10:08:29.1754728Z Expected: 2025-12-04T10:08:29.1754780Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1754829Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1754874Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1754919Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1754967Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1754969Z 2025-12-04T10:08:29.1755013Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1755057Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1755101Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1755146Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1755195Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1755197Z 2025-12-04T10:08:29.1755199Z 2025-12-04T10:08:29.1755243Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1755287Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1755351Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1755396Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1755441Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1755454Z 2025-12-04T10:08:29.1755510Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1755555Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1755600Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1755644Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1755706Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1755747Z dtype=torch.float64) 2025-12-04T10:08:29.1755749Z 2025-12-04T10:08:29.1755830Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1755832Z 2025-12-04T10:08:29.1755878Z Traceback (most recent call last): 2025-12-04T10:08:29.1756051Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1756092Z method(*args, **kwargs) 2025-12-04T10:08:29.1756269Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1756318Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1756357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1756516Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1756559Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1756598Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1756754Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1756795Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1756835Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1756987Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1757024Z fn(*args, **kwargs) 2025-12-04T10:08:29.1757195Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1757235Z raise e_tracked from e 2025-12-04T10:08:29.1757282Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1757284Z 2025-12-04T10:08:29.1757376Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1757458Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1757538Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1757542Z 2025-12-04T10:08:29.1757626Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1757730Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1757766Z If the test 2025-12-04T10:08:29.1757859Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1757922Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1758017Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1758098Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1758100Z 2025-12-04T10:08:29.1758190Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1758275Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1758311Z the following. 2025-12-04T10:08:29.1758313Z 2025-12-04T10:08:29.1758401Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1758507Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1758558Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1758620Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1758708Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1758710Z 2025-12-04T10:08:29.1758745Z Got: 2025-12-04T10:08:29.1758800Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1758847Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1758893Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1758938Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1758985Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1758987Z 2025-12-04T10:08:29.1759033Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1759089Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1759137Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1759182Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1759232Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1759235Z 2025-12-04T10:08:29.1759237Z 2025-12-04T10:08:29.1759282Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1759329Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1759375Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1759421Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1759471Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1759473Z 2025-12-04T10:08:29.1759517Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1759562Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1759606Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1759651Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1759714Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1759755Z dtype=torch.float64) 2025-12-04T10:08:29.1759758Z 2025-12-04T10:08:29.1759793Z Expected: 2025-12-04T10:08:29.1759846Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1759890Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1759935Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1759978Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1760028Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1760030Z 2025-12-04T10:08:29.1760074Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1760120Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1760164Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1760211Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1760259Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1760261Z 2025-12-04T10:08:29.1760263Z 2025-12-04T10:08:29.1760309Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1760353Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1760397Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1760441Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1760487Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1760489Z 2025-12-04T10:08:29.1760534Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1760579Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1760623Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1760667Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1760743Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1760783Z dtype=torch.float64) 2025-12-04T10:08:29.1760784Z 2025-12-04T10:08:29.1761105Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1761107Z 2025-12-04T10:08:29.1761182Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1761384Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1761386Z 2025-12-04T10:08:29.1761472Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1761578Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1761625Z Traceback (most recent call last): 2025-12-04T10:08:29.1761797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1761840Z return test(*args, **kwargs) 2025-12-04T10:08:29.1761878Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1761983Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1762048Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1762217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1762336Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1762389Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1762551Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1762607Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1762652Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1762807Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1762872Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1762917Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1763094Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1763140Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1763178Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1763331Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1763381Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1763536Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1763578Z raise GradcheckError( 2025-12-04T10:08:29.1763669Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1763671Z 2025-12-04T10:08:29.1763764Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1763846Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1763925Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1763930Z 2025-12-04T10:08:29.1764014Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1764118Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1764171Z If the test 2025-12-04T10:08:29.1764266Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1764326Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1764449Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1764530Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1764532Z 2025-12-04T10:08:29.1764622Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1764706Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1764743Z the following. 2025-12-04T10:08:29.1764745Z 2025-12-04T10:08:29.1764832Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1764922Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1764989Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1765055Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1765116Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1765118Z 2025-12-04T10:08:29.1765152Z Got: 2025-12-04T10:08:29.1765208Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1765255Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1765301Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1765347Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1765394Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1765396Z 2025-12-04T10:08:29.1765441Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1765486Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1765531Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1765578Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1765628Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1765630Z 2025-12-04T10:08:29.1765633Z 2025-12-04T10:08:29.1765678Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1765723Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1765767Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1765811Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1765857Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1765859Z 2025-12-04T10:08:29.1765903Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1765947Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1765990Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1766036Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1766100Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1766142Z dtype=torch.float64) 2025-12-04T10:08:29.1766144Z 2025-12-04T10:08:29.1766178Z Expected: 2025-12-04T10:08:29.1766232Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1766278Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1766323Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1766366Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1766413Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1766414Z 2025-12-04T10:08:29.1766458Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1766504Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1766547Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1766596Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1766661Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1766663Z 2025-12-04T10:08:29.1766665Z 2025-12-04T10:08:29.1766712Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1766775Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1766821Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1766866Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1766913Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1766915Z 2025-12-04T10:08:29.1766960Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1767003Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1767047Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1767091Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1767170Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1767212Z dtype=torch.float64) 2025-12-04T10:08:29.1767214Z 2025-12-04T10:08:29.1767297Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1767299Z 2025-12-04T10:08:29.1767346Z Traceback (most recent call last): 2025-12-04T10:08:29.1767501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1767540Z method(*args, **kwargs) 2025-12-04T10:08:29.1767718Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1767763Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1767804Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1767964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1768010Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1768047Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1768206Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1768248Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1768287Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1768437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1768476Z fn(*args, **kwargs) 2025-12-04T10:08:29.1768643Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1768684Z raise e_tracked from e 2025-12-04T10:08:29.1768729Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1768731Z 2025-12-04T10:08:29.1768827Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1768911Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1768991Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1768994Z 2025-12-04T10:08:29.1769080Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1769184Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1769220Z If the test 2025-12-04T10:08:29.1769313Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1769375Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1769469Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1769550Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1769552Z 2025-12-04T10:08:29.1769644Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1769742Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1769777Z the following. 2025-12-04T10:08:29.1769779Z 2025-12-04T10:08:29.1769869Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1769988Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1770041Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1770104Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1770166Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1770168Z 2025-12-04T10:08:29.1770200Z Got: 2025-12-04T10:08:29.1770257Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1770303Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1770349Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1770405Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1772208Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1772211Z 2025-12-04T10:08:29.1772260Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1772310Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1772355Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1772402Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1772452Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1772455Z 2025-12-04T10:08:29.1772458Z 2025-12-04T10:08:29.1772503Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1772547Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1772590Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1772635Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1772685Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1772687Z 2025-12-04T10:08:29.1772732Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1772776Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1772824Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1772868Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1772974Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1773016Z dtype=torch.float64) 2025-12-04T10:08:29.1773018Z 2025-12-04T10:08:29.1773052Z Expected: 2025-12-04T10:08:29.1773105Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1773152Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1773196Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1773240Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1773290Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1773292Z 2025-12-04T10:08:29.1773337Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1773381Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1773428Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1773472Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1773522Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1773524Z 2025-12-04T10:08:29.1773526Z 2025-12-04T10:08:29.1773574Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1773618Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1773662Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1773706Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1773753Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1773780Z 2025-12-04T10:08:29.1773826Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1773872Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1773915Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1773989Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1774051Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1774092Z dtype=torch.float64) 2025-12-04T10:08:29.1774094Z 2025-12-04T10:08:29.1774386Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1774389Z 2025-12-04T10:08:29.1774464Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1774684Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1774687Z 2025-12-04T10:08:29.1774776Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1774871Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1774919Z Traceback (most recent call last): 2025-12-04T10:08:29.1775089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1775131Z return test(*args, **kwargs) 2025-12-04T10:08:29.1775170Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1775274Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1775339Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1775510Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1775633Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1775688Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1775852Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1775908Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1775951Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1776105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1776172Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1776215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1776356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1776402Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1776442Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1776594Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1776644Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1776797Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1776839Z raise GradcheckError( 2025-12-04T10:08:29.1776928Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1776930Z 2025-12-04T10:08:29.1777024Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1777107Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1777201Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1777203Z 2025-12-04T10:08:29.1777289Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1777401Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1777450Z If the test 2025-12-04T10:08:29.1777543Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1777606Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1777700Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1777783Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1777785Z 2025-12-04T10:08:29.1777875Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1777972Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1778010Z the following. 2025-12-04T10:08:29.1778012Z 2025-12-04T10:08:29.1778100Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1778191Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1778246Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1778309Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1778370Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1778372Z 2025-12-04T10:08:29.1778404Z Got: 2025-12-04T10:08:29.1778461Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1778508Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1778556Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1778600Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1778649Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1778652Z 2025-12-04T10:08:29.1778696Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1778742Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1778787Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1778835Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1778884Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1778886Z 2025-12-04T10:08:29.1778888Z 2025-12-04T10:08:29.1778932Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1778976Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1779019Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1779063Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1779110Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1779112Z 2025-12-04T10:08:29.1779159Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1779203Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1779246Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1779292Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1779355Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1779396Z dtype=torch.float64) 2025-12-04T10:08:29.1779398Z 2025-12-04T10:08:29.1779433Z Expected: 2025-12-04T10:08:29.1779485Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1779529Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1779574Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1779618Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1779665Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1779680Z 2025-12-04T10:08:29.1779728Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1779772Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1779817Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1779889Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1779939Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1779941Z 2025-12-04T10:08:29.1779943Z 2025-12-04T10:08:29.1779988Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1780031Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1780075Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1780119Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1780165Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1780167Z 2025-12-04T10:08:29.1780225Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1780271Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1780315Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1780361Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1780427Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1780467Z dtype=torch.float64) 2025-12-04T10:08:29.1780469Z 2025-12-04T10:08:29.1780551Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1780553Z 2025-12-04T10:08:29.1780599Z Traceback (most recent call last): 2025-12-04T10:08:29.1780753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1780793Z method(*args, **kwargs) 2025-12-04T10:08:29.1780971Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1781018Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1781056Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1781217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1781262Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1781301Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1781459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1781502Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1781537Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1781690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1781727Z fn(*args, **kwargs) 2025-12-04T10:08:29.1781895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1781937Z raise e_tracked from e 2025-12-04T10:08:29.1781981Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1781983Z 2025-12-04T10:08:29.1782077Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1782160Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1782241Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1782243Z 2025-12-04T10:08:29.1782326Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1782429Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1782463Z If the test 2025-12-04T10:08:29.1782558Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1782619Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1782738Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1782819Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1782821Z 2025-12-04T10:08:29.1782978Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1783063Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1783100Z the following. 2025-12-04T10:08:29.1783102Z 2025-12-04T10:08:29.1783191Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1783281Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1783333Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1783395Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1783455Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1783460Z 2025-12-04T10:08:29.1783509Z Got: 2025-12-04T10:08:29.1783565Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1783613Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1783661Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1783708Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1783756Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1783759Z 2025-12-04T10:08:29.1783803Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1783848Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1783892Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1783939Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1783987Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1783989Z 2025-12-04T10:08:29.1783991Z 2025-12-04T10:08:29.1784037Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1784080Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1784123Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1784167Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1784215Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1784217Z 2025-12-04T10:08:29.1784261Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1784305Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1784348Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1784392Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1784454Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1784495Z dtype=torch.float64) 2025-12-04T10:08:29.1784498Z 2025-12-04T10:08:29.1784531Z Expected: 2025-12-04T10:08:29.1784586Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1784630Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1784676Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1784719Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1784767Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1784769Z 2025-12-04T10:08:29.1784813Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1784858Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1784901Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1784947Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1784995Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1784998Z 2025-12-04T10:08:29.1785000Z 2025-12-04T10:08:29.1785044Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1785106Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1785150Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1785194Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1785264Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1785266Z 2025-12-04T10:08:29.1785311Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1785355Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1785399Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1785443Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1785504Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1785544Z dtype=torch.float64) 2025-12-04T10:08:29.1785546Z 2025-12-04T10:08:29.1785847Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1785852Z 2025-12-04T10:08:29.1785926Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1786131Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1786134Z 2025-12-04T10:08:29.1786222Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1786315Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1786360Z Traceback (most recent call last): 2025-12-04T10:08:29.1786530Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1786572Z return test(*args, **kwargs) 2025-12-04T10:08:29.1786611Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1786716Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1786779Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1786949Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1787070Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1787123Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1787284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1787341Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1787383Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1787539Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1787608Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1787653Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1787794Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1787840Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1787878Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1788031Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1788080Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1788236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1788276Z raise GradcheckError( 2025-12-04T10:08:29.1788380Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1788383Z 2025-12-04T10:08:29.1788476Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1788569Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1788660Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1788662Z 2025-12-04T10:08:29.1788746Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1788851Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1788885Z If the test 2025-12-04T10:08:29.1788978Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1789039Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1789144Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1789226Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1789229Z 2025-12-04T10:08:29.1789321Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1789407Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1789444Z the following. 2025-12-04T10:08:29.1789446Z 2025-12-04T10:08:29.1789534Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1789625Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1789675Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1789739Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1789799Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1789802Z 2025-12-04T10:08:29.1789835Z Got: 2025-12-04T10:08:29.1789891Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1789939Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1789985Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1790030Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1790079Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1790082Z 2025-12-04T10:08:29.1790126Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1790171Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1790215Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1790260Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1790309Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1790311Z 2025-12-04T10:08:29.1790313Z 2025-12-04T10:08:29.1790357Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1790402Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1790447Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1790491Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1790537Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1790540Z 2025-12-04T10:08:29.1790584Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1790629Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1790675Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1790721Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1790784Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1790826Z dtype=torch.float64) 2025-12-04T10:08:29.1790828Z 2025-12-04T10:08:29.1790862Z Expected: 2025-12-04T10:08:29.1790915Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1790960Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1791021Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1791064Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1791112Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1791135Z 2025-12-04T10:08:29.1791180Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1791225Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1791269Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1791315Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1791363Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1791366Z 2025-12-04T10:08:29.1791368Z 2025-12-04T10:08:29.1791412Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1791456Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1791519Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1791564Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1791609Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1791611Z 2025-12-04T10:08:29.1791660Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1791704Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1791748Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1791792Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1791853Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1791893Z dtype=torch.float64) 2025-12-04T10:08:29.1791895Z 2025-12-04T10:08:29.1791978Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1791980Z 2025-12-04T10:08:29.1792024Z Traceback (most recent call last): 2025-12-04T10:08:29.1792184Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1792223Z method(*args, **kwargs) 2025-12-04T10:08:29.1792401Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1792448Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1792487Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1792646Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1792690Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1792727Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1792886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1792971Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1793010Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1793164Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1793201Z fn(*args, **kwargs) 2025-12-04T10:08:29.1793371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1793411Z raise e_tracked from e 2025-12-04T10:08:29.1793457Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1793459Z 2025-12-04T10:08:29.1793553Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1793637Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1793717Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1793719Z 2025-12-04T10:08:29.1793804Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1793929Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1793964Z If the test 2025-12-04T10:08:29.1794057Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1794148Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1794246Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1794328Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1794330Z 2025-12-04T10:08:29.1794421Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1794506Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1794542Z the following. 2025-12-04T10:08:29.1794544Z 2025-12-04T10:08:29.1794633Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1794741Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1794797Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1794859Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1794920Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1794926Z 2025-12-04T10:08:29.1794960Z Got: 2025-12-04T10:08:29.1795016Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1795063Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1795109Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1795154Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1795201Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1795203Z 2025-12-04T10:08:29.1795248Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1795293Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1795341Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1795386Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1795436Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1795438Z 2025-12-04T10:08:29.1795441Z 2025-12-04T10:08:29.1795486Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1795531Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1795576Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1795621Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1795666Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1795668Z 2025-12-04T10:08:29.1795713Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1795757Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1795801Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1795846Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1795909Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1795949Z dtype=torch.float64) 2025-12-04T10:08:29.1795952Z 2025-12-04T10:08:29.1795987Z Expected: 2025-12-04T10:08:29.1796041Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1796086Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1796130Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1796174Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1796221Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1796224Z 2025-12-04T10:08:29.1796267Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1796312Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1796358Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1796417Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1796465Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1796467Z 2025-12-04T10:08:29.1796469Z 2025-12-04T10:08:29.1796535Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1796580Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1796624Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1796668Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1796714Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1796716Z 2025-12-04T10:08:29.1796760Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1796807Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1796852Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1796910Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1796974Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1797015Z dtype=torch.float64) 2025-12-04T10:08:29.1797017Z 2025-12-04T10:08:29.1797306Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1797309Z 2025-12-04T10:08:29.1797384Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1797585Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1797588Z 2025-12-04T10:08:29.1797674Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1797768Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1797813Z Traceback (most recent call last): 2025-12-04T10:08:29.1797984Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1798030Z return test(*args, **kwargs) 2025-12-04T10:08:29.1798068Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1798172Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1798237Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1798404Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1798525Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1798577Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1798742Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1798798Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1798840Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1799000Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1799067Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1799110Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1799250Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1799295Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1799334Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1799487Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1799551Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1799704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1799766Z raise GradcheckError( 2025-12-04T10:08:29.1799856Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1799858Z 2025-12-04T10:08:29.1799950Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1800033Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1800113Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1800115Z 2025-12-04T10:08:29.1800201Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1800304Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1800357Z If the test 2025-12-04T10:08:29.1800450Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1800512Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1800606Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1800689Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1800692Z 2025-12-04T10:08:29.1800781Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1800867Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1800902Z the following. 2025-12-04T10:08:29.1800904Z 2025-12-04T10:08:29.1800994Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1801083Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1801136Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1801201Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1801261Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1801263Z 2025-12-04T10:08:29.1801296Z Got: 2025-12-04T10:08:29.1801353Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1801400Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1801446Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1801493Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1801540Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1801542Z 2025-12-04T10:08:29.1801587Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1801631Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1801676Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1801722Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1801773Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1801775Z 2025-12-04T10:08:29.1801777Z 2025-12-04T10:08:29.1801820Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1801866Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1801909Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1801954Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1801999Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1802001Z 2025-12-04T10:08:29.1802047Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1802091Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1802136Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1802179Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1802257Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1802299Z dtype=torch.float64) 2025-12-04T10:08:29.1802300Z 2025-12-04T10:08:29.1802336Z Expected: 2025-12-04T10:08:29.1802389Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1802460Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1802506Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1802550Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1802596Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1802599Z 2025-12-04T10:08:29.1802643Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1802688Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1802735Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1802781Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1802843Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1802845Z 2025-12-04T10:08:29.1802847Z 2025-12-04T10:08:29.1802892Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1802993Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1803040Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1803084Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1803131Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1803133Z 2025-12-04T10:08:29.1803177Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1803222Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1803266Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1803310Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1803373Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1803416Z dtype=torch.float64) 2025-12-04T10:08:29.1803418Z 2025-12-04T10:08:29.1803501Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1803503Z 2025-12-04T10:08:29.1803549Z Traceback (most recent call last): 2025-12-04T10:08:29.1803705Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1803745Z method(*args, **kwargs) 2025-12-04T10:08:29.1803922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1803968Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1804006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1804167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1804212Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1804249Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1804407Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1804449Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1804488Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1804641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1804679Z fn(*args, **kwargs) 2025-12-04T10:08:29.1804847Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1804888Z raise e_tracked from e 2025-12-04T10:08:29.1804933Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1804935Z 2025-12-04T10:08:29.1805033Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1805134Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1805215Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1805217Z 2025-12-04T10:08:29.1805300Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1805433Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1805468Z If the test 2025-12-04T10:08:29.1805565Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1805625Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1805722Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1805804Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1805806Z 2025-12-04T10:08:29.1805896Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1806001Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1806039Z the following. 2025-12-04T10:08:29.1806041Z 2025-12-04T10:08:29.1806131Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1806223Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1806275Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1806338Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1806400Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1806402Z 2025-12-04T10:08:29.1806434Z Got: 2025-12-04T10:08:29.1806490Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1806535Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1806584Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1806631Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1806679Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1806681Z 2025-12-04T10:08:29.1806726Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1806773Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1806821Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1806867Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1806915Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1806918Z 2025-12-04T10:08:29.1806919Z 2025-12-04T10:08:29.1806964Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1807007Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1807051Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1807095Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1807143Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1807146Z 2025-12-04T10:08:29.1807191Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1807236Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1807283Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1807329Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1807391Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1807432Z dtype=torch.float64) 2025-12-04T10:08:29.1807434Z 2025-12-04T10:08:29.1807469Z Expected: 2025-12-04T10:08:29.1807522Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1807568Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1807613Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1807657Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1807703Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1807720Z 2025-12-04T10:08:29.1807766Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1807810Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1807875Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1807920Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1807971Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1807973Z 2025-12-04T10:08:29.1807975Z 2025-12-04T10:08:29.1808018Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1808062Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1808107Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1808152Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1808198Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1808215Z 2025-12-04T10:08:29.1808263Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1808307Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1808352Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1808398Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1808460Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1808500Z dtype=torch.float64) 2025-12-04T10:08:29.1808501Z 2025-12-04T10:08:29.1808791Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1808793Z 2025-12-04T10:08:29.1808869Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1809071Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1809074Z 2025-12-04T10:08:29.1809160Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1809257Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1809303Z Traceback (most recent call last): 2025-12-04T10:08:29.1809476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1809519Z return test(*args, **kwargs) 2025-12-04T10:08:29.1809555Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1809660Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1809727Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1809897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1810020Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1810078Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1810240Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1810297Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1810340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1810499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1810566Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1810609Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1810753Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1810815Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1810854Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1811017Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1811081Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1811235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1811276Z raise GradcheckError( 2025-12-04T10:08:29.1811366Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1811368Z 2025-12-04T10:08:29.1811462Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1811543Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1811643Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1811645Z 2025-12-04T10:08:29.1811730Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1811834Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1811870Z If the test 2025-12-04T10:08:29.1811965Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1812025Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1812122Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1812202Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1812204Z 2025-12-04T10:08:29.1812295Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1812381Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1812421Z the following. 2025-12-04T10:08:29.1812423Z 2025-12-04T10:08:29.1812513Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1812602Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1812656Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1812718Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1812780Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1812782Z 2025-12-04T10:08:29.1812815Z Got: 2025-12-04T10:08:29.1812874Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1812921Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1813016Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1813061Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1813109Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1813112Z 2025-12-04T10:08:29.1813157Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1813203Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1813249Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1813297Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1813347Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1813349Z 2025-12-04T10:08:29.1813351Z 2025-12-04T10:08:29.1813396Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1813439Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1813483Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1813526Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1813573Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1813575Z 2025-12-04T10:08:29.1813620Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1813689Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1813733Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1813781Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1813879Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1813923Z dtype=torch.float64) 2025-12-04T10:08:29.1813925Z 2025-12-04T10:08:29.1813960Z Expected: 2025-12-04T10:08:29.1814013Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1814057Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1814102Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1814146Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1814192Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1814194Z 2025-12-04T10:08:29.1814257Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1814302Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1814348Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1814394Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1814445Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1814446Z 2025-12-04T10:08:29.1814448Z 2025-12-04T10:08:29.1814493Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1814538Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1814582Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1814626Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1814672Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1814673Z 2025-12-04T10:08:29.1814718Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1814767Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1814813Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1814858Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1814923Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1814963Z dtype=torch.float64) 2025-12-04T10:08:29.1814965Z 2025-12-04T10:08:29.1815051Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1815053Z 2025-12-04T10:08:29.1815098Z Traceback (most recent call last): 2025-12-04T10:08:29.1815255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1815296Z method(*args, **kwargs) 2025-12-04T10:08:29.1815475Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1815523Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1815561Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1815720Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1815765Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1815804Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1815963Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1816005Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1816041Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1816192Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1816231Z fn(*args, **kwargs) 2025-12-04T10:08:29.1816399Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1816459Z raise e_tracked from e 2025-12-04T10:08:29.1816504Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1816506Z 2025-12-04T10:08:29.1816599Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1816705Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1816785Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1816787Z 2025-12-04T10:08:29.1816872Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1816975Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1817010Z If the test 2025-12-04T10:08:29.1817104Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1817165Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1817274Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1817359Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1817362Z 2025-12-04T10:08:29.1817453Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1817539Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1817576Z the following. 2025-12-04T10:08:29.1817578Z 2025-12-04T10:08:29.1817666Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1817759Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1817811Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1817876Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1817938Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1817940Z 2025-12-04T10:08:29.1817977Z Got: 2025-12-04T10:08:29.1818033Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1818080Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1818126Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1818172Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1818219Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1818221Z 2025-12-04T10:08:29.1818266Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1818310Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1818355Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1818400Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1818449Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1818451Z 2025-12-04T10:08:29.1818453Z 2025-12-04T10:08:29.1818498Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1818543Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1818586Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1818635Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1818683Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1818688Z 2025-12-04T10:08:29.1818733Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1818778Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1818821Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1818865Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1818927Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1818970Z dtype=torch.float64) 2025-12-04T10:08:29.1818972Z 2025-12-04T10:08:29.1819006Z Expected: 2025-12-04T10:08:29.1819060Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1819119Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1819164Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1819207Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1819282Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1819285Z 2025-12-04T10:08:29.1819330Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1819375Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1819420Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1819466Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1819514Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1819516Z 2025-12-04T10:08:29.1819518Z 2025-12-04T10:08:29.1819564Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1819620Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1819666Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1819709Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1819756Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1819760Z 2025-12-04T10:08:29.1819805Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1819849Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1819894Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1819938Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1820000Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1820042Z dtype=torch.float64) 2025-12-04T10:08:29.1820044Z 2025-12-04T10:08:29.1820337Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1820340Z 2025-12-04T10:08:29.1820414Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1820619Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1820621Z 2025-12-04T10:08:29.1820709Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1820803Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1820848Z Traceback (most recent call last): 2025-12-04T10:08:29.1821023Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1821064Z return test(*args, **kwargs) 2025-12-04T10:08:29.1821103Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1821210Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1821277Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1821449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1821573Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1821624Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1821786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1821843Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1821885Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1822043Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1822122Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1822167Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1822330Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1822376Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1822414Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1822568Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1822617Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1822772Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1822813Z raise GradcheckError( 2025-12-04T10:08:29.1822917Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1822919Z 2025-12-04T10:08:29.1823050Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1823134Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1823216Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1823219Z 2025-12-04T10:08:29.1823304Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1823406Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1823443Z If the test 2025-12-04T10:08:29.1823536Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1823597Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1823691Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1823776Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1823778Z 2025-12-04T10:08:29.1823870Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1823955Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1823993Z the following. 2025-12-04T10:08:29.1823995Z 2025-12-04T10:08:29.1824083Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1824173Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1824223Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1824286Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1824348Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1824350Z 2025-12-04T10:08:29.1824383Z Got: 2025-12-04T10:08:29.1824437Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1824487Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1824533Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1824584Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1824633Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1824638Z 2025-12-04T10:08:29.1824684Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1824728Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1824773Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1824817Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1824867Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1824869Z 2025-12-04T10:08:29.1824871Z 2025-12-04T10:08:29.1824917Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1824961Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1825043Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1825088Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1825138Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1825156Z 2025-12-04T10:08:29.1825215Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1825260Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1825304Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1825350Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1825412Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1825453Z dtype=torch.float64) 2025-12-04T10:08:29.1825455Z 2025-12-04T10:08:29.1825489Z Expected: 2025-12-04T10:08:29.1825542Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1825605Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1825655Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1825699Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1825749Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1825752Z 2025-12-04T10:08:29.1825796Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1825843Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1825886Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1825932Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1825980Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1825982Z 2025-12-04T10:08:29.1825984Z 2025-12-04T10:08:29.1826029Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1826072Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1826117Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1826162Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1826209Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1826211Z 2025-12-04T10:08:29.1826256Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1826301Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1826347Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1826393Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1826455Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1826496Z dtype=torch.float64) 2025-12-04T10:08:29.1826498Z 2025-12-04T10:08:29.1826584Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1826586Z 2025-12-04T10:08:29.1826630Z Traceback (most recent call last): 2025-12-04T10:08:29.1826786Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1826826Z method(*args, **kwargs) 2025-12-04T10:08:29.1827004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1827052Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1827091Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1827253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1827296Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1827333Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1827497Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1827537Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1827574Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1827740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1827778Z fn(*args, **kwargs) 2025-12-04T10:08:29.1827966Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1828019Z raise e_tracked from e 2025-12-04T10:08:29.1828064Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1828066Z 2025-12-04T10:08:29.1828159Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1828241Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1828322Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1828324Z 2025-12-04T10:08:29.1828410Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1828527Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1828563Z If the test 2025-12-04T10:08:29.1828657Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1828718Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1828814Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1828897Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1828899Z 2025-12-04T10:08:29.1828989Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1829077Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1829112Z the following. 2025-12-04T10:08:29.1829114Z 2025-12-04T10:08:29.1829203Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1829294Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1829346Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1829409Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1829472Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1829475Z 2025-12-04T10:08:29.1829508Z Got: 2025-12-04T10:08:29.1829564Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1829610Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1829657Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1829701Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1829748Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1829750Z 2025-12-04T10:08:29.1829794Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1829840Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1829884Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1829931Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1829980Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1829982Z 2025-12-04T10:08:29.1829986Z 2025-12-04T10:08:29.1830031Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1830076Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1830120Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1830164Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1830210Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1830212Z 2025-12-04T10:08:29.1830259Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1830302Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1830347Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1830407Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1830472Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1830512Z dtype=torch.float64) 2025-12-04T10:08:29.1830514Z 2025-12-04T10:08:29.1830559Z Expected: 2025-12-04T10:08:29.1830628Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1830674Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1830719Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1830763Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1830810Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1830812Z 2025-12-04T10:08:29.1830858Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1830902Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1830948Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1831005Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1831055Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1831057Z 2025-12-04T10:08:29.1831059Z 2025-12-04T10:08:29.1831103Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1831150Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1831193Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1831239Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1831284Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1831287Z 2025-12-04T10:08:29.1831334Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1831378Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1831423Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1831468Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1831531Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1831572Z dtype=torch.float64) 2025-12-04T10:08:29.1831574Z 2025-12-04T10:08:29.1831863Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1831867Z 2025-12-04T10:08:29.1831944Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1832145Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1832147Z 2025-12-04T10:08:29.1832235Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1832327Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1832376Z Traceback (most recent call last): 2025-12-04T10:08:29.1832547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1832590Z return test(*args, **kwargs) 2025-12-04T10:08:29.1832630Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1832735Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1832799Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1833005Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1833127Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1833179Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1833361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1833417Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1833460Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1833648Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1833716Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1833759Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1833899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1833944Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1833983Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1834158Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1834210Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1834365Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1834411Z raise GradcheckError( 2025-12-04T10:08:29.1834500Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1834502Z 2025-12-04T10:08:29.1834598Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1834678Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1834759Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1834761Z 2025-12-04T10:08:29.1834845Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1834949Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1834984Z If the test 2025-12-04T10:08:29.1835081Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1835143Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1835238Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1835322Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1835323Z 2025-12-04T10:08:29.1835413Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1835497Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1835532Z the following. 2025-12-04T10:08:29.1835534Z 2025-12-04T10:08:29.1835623Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1835712Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1835763Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1835829Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1835889Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1835891Z 2025-12-04T10:08:29.1835923Z Got: 2025-12-04T10:08:29.1835980Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1836027Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1836074Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1836118Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1836167Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1836169Z 2025-12-04T10:08:29.1836214Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1836259Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1836303Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1836348Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1836411Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1836413Z 2025-12-04T10:08:29.1836416Z 2025-12-04T10:08:29.1836460Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1836526Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1836571Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1836615Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1836661Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1836663Z 2025-12-04T10:08:29.1836708Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1836752Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1836797Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1836840Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1836916Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1836959Z dtype=torch.float64) 2025-12-04T10:08:29.1836961Z 2025-12-04T10:08:29.1836999Z Expected: 2025-12-04T10:08:29.1837052Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1837100Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1837146Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1837190Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1837236Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1837237Z 2025-12-04T10:08:29.1837282Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1837326Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1837371Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1837416Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1837466Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1837469Z 2025-12-04T10:08:29.1837471Z 2025-12-04T10:08:29.1837515Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1837560Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1837606Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1837651Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1837696Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1837698Z 2025-12-04T10:08:29.1837743Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1837789Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1837833Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1837878Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1837941Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1837986Z dtype=torch.float64) 2025-12-04T10:08:29.1837988Z 2025-12-04T10:08:29.1838069Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1838071Z 2025-12-04T10:08:29.1838117Z Traceback (most recent call last): 2025-12-04T10:08:29.1838274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1838315Z method(*args, **kwargs) 2025-12-04T10:08:29.1838491Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1838537Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1838576Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1838736Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1838779Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1838829Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1838988Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1839029Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1839091Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1839244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1839281Z fn(*args, **kwargs) 2025-12-04T10:08:29.1839449Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1839489Z raise e_tracked from e 2025-12-04T10:08:29.1839534Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1839536Z 2025-12-04T10:08:29.1839629Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1839726Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1839807Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1839810Z 2025-12-04T10:08:29.1839894Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1840000Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1840035Z If the test 2025-12-04T10:08:29.1840128Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1840188Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1840284Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1840366Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1840369Z 2025-12-04T10:08:29.1840459Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1840548Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1840585Z the following. 2025-12-04T10:08:29.1840587Z 2025-12-04T10:08:29.1840676Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1840771Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1840823Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1840889Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1840950Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1840952Z 2025-12-04T10:08:29.1840986Z Got: 2025-12-04T10:08:29.1841041Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1841090Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1841139Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1841184Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1841233Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1841235Z 2025-12-04T10:08:29.1841280Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1841325Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1841375Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1841419Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1841469Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1841471Z 2025-12-04T10:08:29.1841472Z 2025-12-04T10:08:29.1841517Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1841561Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1841606Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1841650Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1841698Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1841714Z 2025-12-04T10:08:29.1841759Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1841804Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1841848Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1841918Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1841982Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1842026Z dtype=torch.float64) 2025-12-04T10:08:29.1842028Z 2025-12-04T10:08:29.1842062Z Expected: 2025-12-04T10:08:29.1842115Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1842159Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1842204Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1842247Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1842308Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1842312Z 2025-12-04T10:08:29.1842356Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1842402Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1842445Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1842493Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1842541Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1842543Z 2025-12-04T10:08:29.1842545Z 2025-12-04T10:08:29.1842590Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1842633Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1842679Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1842723Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1842769Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1842771Z 2025-12-04T10:08:29.1842818Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1842862Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1842906Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1842991Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1843055Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1843095Z dtype=torch.float64) 2025-12-04T10:08:29.1843096Z 2025-12-04T10:08:29.1843385Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1843387Z 2025-12-04T10:08:29.1843460Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1843662Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1843666Z 2025-12-04T10:08:29.1843751Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1843845Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1843891Z Traceback (most recent call last): 2025-12-04T10:08:29.1844061Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1844103Z return test(*args, **kwargs) 2025-12-04T10:08:29.1844140Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1844246Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1844309Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1844478Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1844624Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1844677Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1844875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1844932Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1844974Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1845130Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1845195Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1845239Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1845400Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1845449Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1845486Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1845639Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1845689Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1845846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1845887Z raise GradcheckError( 2025-12-04T10:08:29.1845978Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1845980Z 2025-12-04T10:08:29.1846073Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1846155Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1846237Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1846240Z 2025-12-04T10:08:29.1846325Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1846428Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1846465Z If the test 2025-12-04T10:08:29.1846561Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1846621Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1846716Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1846798Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1846800Z 2025-12-04T10:08:29.1846891Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1846975Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1847014Z the following. 2025-12-04T10:08:29.1847016Z 2025-12-04T10:08:29.1847105Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1847195Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1847247Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1847312Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1847372Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1847374Z 2025-12-04T10:08:29.1847409Z Got: 2025-12-04T10:08:29.1847465Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1847512Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1847558Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1847603Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1847650Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1847662Z 2025-12-04T10:08:29.1847709Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1847753Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1847798Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1847863Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1847913Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1847915Z 2025-12-04T10:08:29.1847917Z 2025-12-04T10:08:29.1847962Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1848005Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1848050Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1848094Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1848141Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1848143Z 2025-12-04T10:08:29.1848200Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1848247Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1848290Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1848335Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1848400Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1848442Z dtype=torch.float64) 2025-12-04T10:08:29.1848444Z 2025-12-04T10:08:29.1848478Z Expected: 2025-12-04T10:08:29.1848531Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1848575Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1848620Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1848664Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1848711Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1848713Z 2025-12-04T10:08:29.1848757Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1848803Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1848847Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1848892Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1848943Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1848945Z 2025-12-04T10:08:29.1848949Z 2025-12-04T10:08:29.1848994Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1849038Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1849082Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1849127Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1849173Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1849175Z 2025-12-04T10:08:29.1849221Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1849266Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1849312Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1849356Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1849419Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1849460Z dtype=torch.float64) 2025-12-04T10:08:29.1849462Z 2025-12-04T10:08:29.1849545Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1849547Z 2025-12-04T10:08:29.1849591Z Traceback (most recent call last): 2025-12-04T10:08:29.1849748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1849786Z method(*args, **kwargs) 2025-12-04T10:08:29.1849964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1850010Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1850060Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1850219Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1850282Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1850320Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1850480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1850521Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1850559Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1850711Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1850749Z fn(*args, **kwargs) 2025-12-04T10:08:29.1850928Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1850972Z raise e_tracked from e 2025-12-04T10:08:29.1851016Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1851019Z 2025-12-04T10:08:29.1851112Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1851196Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1851277Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1851279Z 2025-12-04T10:08:29.1851364Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1851465Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1851501Z If the test 2025-12-04T10:08:29.1851595Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1851657Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1851752Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1851834Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1851836Z 2025-12-04T10:08:29.1851925Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1852012Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1852048Z the following. 2025-12-04T10:08:29.1852050Z 2025-12-04T10:08:29.1852138Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1852227Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1852278Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1852342Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1852403Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1852405Z 2025-12-04T10:08:29.1852437Z Got: 2025-12-04T10:08:29.1852494Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1852541Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1852587Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1852633Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1852681Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1852683Z 2025-12-04T10:08:29.1852728Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1852772Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1852817Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1852862Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1852912Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1852914Z 2025-12-04T10:08:29.1852915Z 2025-12-04T10:08:29.1853001Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1853067Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1853111Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1853155Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1853226Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1853228Z 2025-12-04T10:08:29.1853275Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1853319Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1853363Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1853407Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1853470Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1853510Z dtype=torch.float64) 2025-12-04T10:08:29.1853512Z 2025-12-04T10:08:29.1853547Z Expected: 2025-12-04T10:08:29.1853615Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1853666Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1853710Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1853755Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1853804Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1853806Z 2025-12-04T10:08:29.1853853Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1853897Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1853941Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1853985Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1854035Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1854037Z 2025-12-04T10:08:29.1854039Z 2025-12-04T10:08:29.1854084Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1854129Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1854173Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1854217Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1854264Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1854267Z 2025-12-04T10:08:29.1854312Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1854360Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1854403Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1854448Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1854509Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1854551Z dtype=torch.float64) 2025-12-04T10:08:29.1854552Z 2025-12-04T10:08:29.1854843Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1854846Z 2025-12-04T10:08:29.1854923Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1855125Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1855129Z 2025-12-04T10:08:29.1855215Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1855308Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1855353Z Traceback (most recent call last): 2025-12-04T10:08:29.1855524Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1855566Z return test(*args, **kwargs) 2025-12-04T10:08:29.1855604Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1855723Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1855789Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1855973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1856107Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1856158Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1856323Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1856379Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1856424Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1856593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1856662Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1856706Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1856849Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1856894Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1856933Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1857086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1857136Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1857290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1857332Z raise GradcheckError( 2025-12-04T10:08:29.1857423Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1857427Z 2025-12-04T10:08:29.1857519Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1857601Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1857682Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1857685Z 2025-12-04T10:08:29.1857770Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1857873Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1857909Z If the test 2025-12-04T10:08:29.1858001Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1858063Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1858156Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1858238Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1858241Z 2025-12-04T10:08:29.1858331Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1858418Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1858455Z the following. 2025-12-04T10:08:29.1858457Z 2025-12-04T10:08:29.1858547Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1858637Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1858690Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1858753Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1858814Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1858816Z 2025-12-04T10:08:29.1858849Z Got: 2025-12-04T10:08:29.1858905Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1858952Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1859012Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1859056Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1859107Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1859131Z 2025-12-04T10:08:29.1859182Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1859226Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1859271Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1859316Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1859367Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1859369Z 2025-12-04T10:08:29.1859371Z 2025-12-04T10:08:29.1859415Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1859459Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1859516Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1859561Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1859607Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1859610Z 2025-12-04T10:08:29.1859656Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1859701Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1859745Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1859789Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1859853Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1859893Z dtype=torch.float64) 2025-12-04T10:08:29.1859895Z 2025-12-04T10:08:29.1859930Z Expected: 2025-12-04T10:08:29.1859983Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1860028Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1860074Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1860118Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1860166Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1860169Z 2025-12-04T10:08:29.1860215Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1860259Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1860304Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1860350Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1860400Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1860401Z 2025-12-04T10:08:29.1860403Z 2025-12-04T10:08:29.1860448Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1860491Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1860537Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1860584Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1860632Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1860634Z 2025-12-04T10:08:29.1860678Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1860725Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1860769Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1860814Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1860876Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1860920Z dtype=torch.float64) 2025-12-04T10:08:29.1860922Z 2025-12-04T10:08:29.1861004Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1861006Z 2025-12-04T10:08:29.1861052Z Traceback (most recent call last): 2025-12-04T10:08:29.1861207Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1861260Z method(*args, **kwargs) 2025-12-04T10:08:29.1861435Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1861502Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1861542Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1861702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1861745Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1861784Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1861941Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1861984Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1862019Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1862186Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1862225Z fn(*args, **kwargs) 2025-12-04T10:08:29.1862392Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1862434Z raise e_tracked from e 2025-12-04T10:08:29.1862479Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1862481Z 2025-12-04T10:08:29.1862575Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1862656Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1862738Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1862740Z 2025-12-04T10:08:29.1862823Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1864656Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1864694Z If the test 2025-12-04T10:08:29.1864790Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1864852Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1864952Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1865033Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1865038Z 2025-12-04T10:08:29.1865131Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1865215Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1865252Z the following. 2025-12-04T10:08:29.1865254Z 2025-12-04T10:08:29.1865343Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1865436Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1865489Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1865552Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1865612Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1865616Z 2025-12-04T10:08:29.1865648Z Got: 2025-12-04T10:08:29.1865705Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1865753Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1865800Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1865844Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1865894Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1865896Z 2025-12-04T10:08:29.1865940Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1865986Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1866030Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1866102Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1866152Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1866154Z 2025-12-04T10:08:29.1866155Z 2025-12-04T10:08:29.1866233Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1866278Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1866321Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1866365Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1866411Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1866414Z 2025-12-04T10:08:29.1866458Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1866503Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1866547Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1866607Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1866672Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1866714Z dtype=torch.float64) 2025-12-04T10:08:29.1866716Z 2025-12-04T10:08:29.1866750Z Expected: 2025-12-04T10:08:29.1866808Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1866852Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1866901Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1866944Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1866992Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1866994Z 2025-12-04T10:08:29.1867037Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1867083Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1867127Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1867176Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1867227Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1867229Z 2025-12-04T10:08:29.1867230Z 2025-12-04T10:08:29.1867274Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1867322Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1867365Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1867410Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1867456Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1867458Z 2025-12-04T10:08:29.1867504Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1867547Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1867592Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1867636Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1867700Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1867741Z dtype=torch.float64) 2025-12-04T10:08:29.1867744Z 2025-12-04T10:08:29.1868037Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1868040Z 2025-12-04T10:08:29.1868114Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1868317Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1868319Z 2025-12-04T10:08:29.1868407Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1868500Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1868567Z Traceback (most recent call last): 2025-12-04T10:08:29.1868739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1868784Z return test(*args, **kwargs) 2025-12-04T10:08:29.1868849Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1868955Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1869019Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1869188Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1869309Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1869362Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1869538Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1869598Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1869641Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1869799Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1869864Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1869908Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1870049Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1870098Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1870136Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1870287Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1870338Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1870493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1870536Z raise GradcheckError( 2025-12-04T10:08:29.1870626Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1870629Z 2025-12-04T10:08:29.1870722Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1870805Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1870885Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1870887Z 2025-12-04T10:08:29.1870972Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1871075Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1871110Z If the test 2025-12-04T10:08:29.1871207Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1871269Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1871364Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1871447Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1871449Z 2025-12-04T10:08:29.1871540Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1871624Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1871661Z the following. 2025-12-04T10:08:29.1871663Z 2025-12-04T10:08:29.1871752Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1871841Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1871892Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1871969Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1872031Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1872034Z 2025-12-04T10:08:29.1872065Z Got: 2025-12-04T10:08:29.1872122Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1872188Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1872236Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1872280Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1872328Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1872330Z 2025-12-04T10:08:29.1872374Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1872419Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1872463Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1872508Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1872570Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1872573Z 2025-12-04T10:08:29.1872574Z 2025-12-04T10:08:29.1872620Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1872663Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1872709Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1872753Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1872801Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1872803Z 2025-12-04T10:08:29.1872848Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1872893Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1872972Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1873018Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1873083Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1873126Z dtype=torch.float64) 2025-12-04T10:08:29.1873128Z 2025-12-04T10:08:29.1873161Z Expected: 2025-12-04T10:08:29.1873215Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1873261Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1873307Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1873350Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1873397Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1873399Z 2025-12-04T10:08:29.1873444Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1873490Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1873534Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1873579Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1873629Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1873632Z 2025-12-04T10:08:29.1873633Z 2025-12-04T10:08:29.1873677Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1873721Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1873768Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1873812Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1873858Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1873860Z 2025-12-04T10:08:29.1873905Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1873949Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1873993Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1874037Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1874099Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1874157Z dtype=torch.float64) 2025-12-04T10:08:29.1874159Z 2025-12-04T10:08:29.1874242Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1874244Z 2025-12-04T10:08:29.1874288Z Traceback (most recent call last): 2025-12-04T10:08:29.1874476Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1874515Z method(*args, **kwargs) 2025-12-04T10:08:29.1874694Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1874739Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1874778Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1874938Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1874983Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1875034Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1875197Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1875239Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1875277Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1875430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1875467Z fn(*args, **kwargs) 2025-12-04T10:08:29.1875634Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1875674Z raise e_tracked from e 2025-12-04T10:08:29.1875719Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1875721Z 2025-12-04T10:08:29.1875814Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1875897Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1875979Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1875981Z 2025-12-04T10:08:29.1876066Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1876171Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1876206Z If the test 2025-12-04T10:08:29.1876299Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1876362Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1876458Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1876542Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1876543Z 2025-12-04T10:08:29.1876633Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1876720Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1876757Z the following. 2025-12-04T10:08:29.1876759Z 2025-12-04T10:08:29.1876848Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1876939Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1876990Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1877053Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1877114Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1877116Z 2025-12-04T10:08:29.1877149Z Got: 2025-12-04T10:08:29.1877204Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1877251Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1877296Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1877341Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1877401Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1877403Z 2025-12-04T10:08:29.1877450Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1877495Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1877564Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1877609Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1877659Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1877661Z 2025-12-04T10:08:29.1877663Z 2025-12-04T10:08:29.1877706Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1877750Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1877798Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1877843Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1877888Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1877910Z 2025-12-04T10:08:29.1877957Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1878001Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1878046Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1878094Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1878157Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1878197Z dtype=torch.float64) 2025-12-04T10:08:29.1878200Z 2025-12-04T10:08:29.1878235Z Expected: 2025-12-04T10:08:29.1878287Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1878332Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1878376Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1878421Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1878467Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1878471Z 2025-12-04T10:08:29.1878515Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1878560Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1878604Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1878650Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1878699Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1878701Z 2025-12-04T10:08:29.1878703Z 2025-12-04T10:08:29.1878747Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1878791Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1878835Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1878879Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1878925Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1878926Z 2025-12-04T10:08:29.1878971Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1879017Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1879060Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1879106Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1879169Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1879211Z dtype=torch.float64) 2025-12-04T10:08:29.1879213Z 2025-12-04T10:08:29.1879501Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1879505Z 2025-12-04T10:08:29.1879578Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1879779Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1879792Z 2025-12-04T10:08:29.1879878Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1879972Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1880039Z Traceback (most recent call last): 2025-12-04T10:08:29.1880212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1880253Z return test(*args, **kwargs) 2025-12-04T10:08:29.1880291Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1880396Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1880461Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1880641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1880765Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1880817Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1880983Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1881040Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1881082Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1881236Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1881302Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1881346Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1881486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1881533Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1881571Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1881723Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1881773Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1881927Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1881968Z raise GradcheckError( 2025-12-04T10:08:29.1882058Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1882061Z 2025-12-04T10:08:29.1882153Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1882234Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1882316Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1882319Z 2025-12-04T10:08:29.1882404Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1882506Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1882542Z If the test 2025-12-04T10:08:29.1882636Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1882697Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1882790Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1882874Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1882876Z 2025-12-04T10:08:29.1883018Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1883104Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1883142Z the following. 2025-12-04T10:08:29.1883161Z 2025-12-04T10:08:29.1883252Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1883343Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1883396Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1883494Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1883555Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1883557Z 2025-12-04T10:08:29.1883590Z Got: 2025-12-04T10:08:29.1883645Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1883693Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1883739Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1883785Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1883831Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1883833Z 2025-12-04T10:08:29.1883897Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1883942Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1883986Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1884031Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1884082Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1884084Z 2025-12-04T10:08:29.1884085Z 2025-12-04T10:08:29.1884129Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1884173Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1884216Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1884260Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1884306Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1884308Z 2025-12-04T10:08:29.1884353Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1884400Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1884444Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1884488Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1884553Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1884593Z dtype=torch.float64) 2025-12-04T10:08:29.1884595Z 2025-12-04T10:08:29.1884630Z Expected: 2025-12-04T10:08:29.1884682Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1884727Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1884772Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1884817Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1884864Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1884866Z 2025-12-04T10:08:29.1884911Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1884957Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1885002Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1885047Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1885097Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1885099Z 2025-12-04T10:08:29.1885101Z 2025-12-04T10:08:29.1885146Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1885189Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1885233Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1885276Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1885322Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1885324Z 2025-12-04T10:08:29.1885368Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1885413Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1885468Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1885513Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1885574Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1885640Z dtype=torch.float64) 2025-12-04T10:08:29.1885642Z 2025-12-04T10:08:29.1885724Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1885726Z 2025-12-04T10:08:29.1885774Z Traceback (most recent call last): 2025-12-04T10:08:29.1885930Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1885971Z method(*args, **kwargs) 2025-12-04T10:08:29.1886149Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1886195Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1886250Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1886411Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1886454Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1886496Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1886655Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1886695Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1886733Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1886886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1886924Z fn(*args, **kwargs) 2025-12-04T10:08:29.1887092Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1887139Z raise e_tracked from e 2025-12-04T10:08:29.1887183Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1887186Z 2025-12-04T10:08:29.1887280Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1887363Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1887444Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1887447Z 2025-12-04T10:08:29.1887531Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1887636Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1887672Z If the test 2025-12-04T10:08:29.1887766Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1887827Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1887924Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1888005Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1888007Z 2025-12-04T10:08:29.1888098Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1888185Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1888221Z the following. 2025-12-04T10:08:29.1888223Z 2025-12-04T10:08:29.1888312Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1888401Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1888452Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1888515Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1888578Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1888580Z 2025-12-04T10:08:29.1888611Z Got: 2025-12-04T10:08:29.1888668Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1888727Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1888773Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1888817Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1888894Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1888896Z 2025-12-04T10:08:29.1888942Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1888988Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1889032Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1889077Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1889125Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1889127Z 2025-12-04T10:08:29.1889129Z 2025-12-04T10:08:29.1889174Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1889231Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1889277Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1889321Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1889367Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1889374Z 2025-12-04T10:08:29.1889418Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1889463Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1889506Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1889552Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1889614Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1889655Z dtype=torch.float64) 2025-12-04T10:08:29.1889657Z 2025-12-04T10:08:29.1889691Z Expected: 2025-12-04T10:08:29.1889744Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1889792Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1889837Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1889881Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1889929Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1889931Z 2025-12-04T10:08:29.1889976Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1890021Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1890066Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1890110Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1890159Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1890161Z 2025-12-04T10:08:29.1890163Z 2025-12-04T10:08:29.1890206Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1890250Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1890296Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1890340Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1890386Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1890389Z 2025-12-04T10:08:29.1890435Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1890479Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1890524Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1890568Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1890631Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1890672Z dtype=torch.float64) 2025-12-04T10:08:29.1890674Z 2025-12-04T10:08:29.1890964Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1890976Z 2025-12-04T10:08:29.1891051Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1891263Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1891276Z 2025-12-04T10:08:29.1891364Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1891456Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1891502Z Traceback (most recent call last): 2025-12-04T10:08:29.1891674Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1891716Z return test(*args, **kwargs) 2025-12-04T10:08:29.1891753Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1891874Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1891938Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1892110Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1892232Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1892285Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1892446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1892502Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1892545Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1892702Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1892771Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1892814Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1892998Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1893045Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1893084Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1893235Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1893285Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1893439Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1893481Z raise GradcheckError( 2025-12-04T10:08:29.1893570Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1893573Z 2025-12-04T10:08:29.1893666Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1893747Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1893830Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1893832Z 2025-12-04T10:08:29.1893916Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1894019Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1894053Z If the test 2025-12-04T10:08:29.1894148Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1894210Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1894305Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1894387Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1894412Z 2025-12-04T10:08:29.1894501Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1894587Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1894648Z the following. 2025-12-04T10:08:29.1894650Z 2025-12-04T10:08:29.1894740Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1894829Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1894882Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1894944Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1895005Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1895008Z 2025-12-04T10:08:29.1895040Z Got: 2025-12-04T10:08:29.1895099Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1895166Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1895217Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1895262Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1895311Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1895314Z 2025-12-04T10:08:29.1895360Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1895405Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1895449Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1895495Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1895544Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1895547Z 2025-12-04T10:08:29.1895549Z 2025-12-04T10:08:29.1895594Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1895637Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1895685Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1895729Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1895776Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1895777Z 2025-12-04T10:08:29.1895823Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1895869Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1895915Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1895959Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1896022Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1896062Z dtype=torch.float64) 2025-12-04T10:08:29.1896064Z 2025-12-04T10:08:29.1896099Z Expected: 2025-12-04T10:08:29.1896154Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1896200Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1896245Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1896290Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1896337Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1896338Z 2025-12-04T10:08:29.1896385Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1896429Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1896474Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1896520Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1896569Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1896571Z 2025-12-04T10:08:29.1896572Z 2025-12-04T10:08:29.1896618Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1896662Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1896705Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1896763Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1896809Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1896811Z 2025-12-04T10:08:29.1896856Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1896927Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1896973Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1897017Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1897079Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1897119Z dtype=torch.float64) 2025-12-04T10:08:29.1897120Z 2025-12-04T10:08:29.1897203Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1897205Z 2025-12-04T10:08:29.1897251Z Traceback (most recent call last): 2025-12-04T10:08:29.1897418Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1897460Z method(*args, **kwargs) 2025-12-04T10:08:29.1897637Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1897686Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1897725Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1897886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1897928Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1897973Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1898129Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1898171Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1898208Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1898361Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1898401Z fn(*args, **kwargs) 2025-12-04T10:08:29.1898569Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1898610Z raise e_tracked from e 2025-12-04T10:08:29.1898657Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1898659Z 2025-12-04T10:08:29.1898753Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1898834Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1898914Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1898916Z 2025-12-04T10:08:29.1899001Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1899104Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1899140Z If the test 2025-12-04T10:08:29.1899233Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1899295Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1899390Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1899472Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1899474Z 2025-12-04T10:08:29.1899563Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1899648Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1899685Z the following. 2025-12-04T10:08:29.1899686Z 2025-12-04T10:08:29.1899774Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1899865Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1899934Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1899997Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1900058Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1900060Z 2025-12-04T10:08:29.1900109Z Got: 2025-12-04T10:08:29.1900173Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1900223Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1900269Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1900314Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1900361Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1900363Z 2025-12-04T10:08:29.1900408Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1900452Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1900497Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1900554Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1900605Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1900606Z 2025-12-04T10:08:29.1900608Z 2025-12-04T10:08:29.1900652Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1900699Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1900742Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1900787Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1900833Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1900837Z 2025-12-04T10:08:29.1900881Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1900926Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1900970Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1901015Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1901079Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1901120Z dtype=torch.float64) 2025-12-04T10:08:29.1901122Z 2025-12-04T10:08:29.1901155Z Expected: 2025-12-04T10:08:29.1901211Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1901257Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1901303Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1901346Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1901394Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1901396Z 2025-12-04T10:08:29.1901439Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1901484Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1901528Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1901577Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1901626Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1901628Z 2025-12-04T10:08:29.1901629Z 2025-12-04T10:08:29.1901674Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1901720Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1901764Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1901809Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1901856Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1901858Z 2025-12-04T10:08:29.1901902Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1901947Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1901990Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1902036Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1902098Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1902154Z dtype=torch.float64) 2025-12-04T10:08:29.1902156Z 2025-12-04T10:08:29.1902455Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1902471Z 2025-12-04T10:08:29.1902545Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1902748Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1902750Z 2025-12-04T10:08:29.1902837Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1902968Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1903033Z Traceback (most recent call last): 2025-12-04T10:08:29.1903209Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1903251Z return test(*args, **kwargs) 2025-12-04T10:08:29.1903292Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1903397Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1903462Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1903630Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1903753Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1903806Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1903968Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1904026Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1904068Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1904222Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1904288Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1904332Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1904472Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1904518Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1904555Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1904708Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1904759Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1904915Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1904956Z raise GradcheckError( 2025-12-04T10:08:29.1905050Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1905053Z 2025-12-04T10:08:29.1905145Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1905227Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1905307Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1905310Z 2025-12-04T10:08:29.1905394Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1905497Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1905533Z If the test 2025-12-04T10:08:29.1905627Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1905704Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1905798Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1905911Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1905913Z 2025-12-04T10:08:29.1906005Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1906089Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1906127Z the following. 2025-12-04T10:08:29.1906130Z 2025-12-04T10:08:29.1906219Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1906309Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1906360Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1906438Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1906500Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1906502Z 2025-12-04T10:08:29.1906534Z Got: 2025-12-04T10:08:29.1906591Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1906639Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1906686Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1906731Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1906778Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1906780Z 2025-12-04T10:08:29.1906826Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1906870Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1906917Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1906964Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1907016Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1907018Z 2025-12-04T10:08:29.1907020Z 2025-12-04T10:08:29.1907066Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1907111Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1907156Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1907201Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1907248Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1907250Z 2025-12-04T10:08:29.1907294Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1907339Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1907382Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1907428Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1907490Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1907534Z dtype=torch.float64) 2025-12-04T10:08:29.1907536Z 2025-12-04T10:08:29.1907570Z Expected: 2025-12-04T10:08:29.1907623Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1907668Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1907717Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1907761Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1907808Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1907811Z 2025-12-04T10:08:29.1907855Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1907899Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1907943Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1907988Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1908036Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1908051Z 2025-12-04T10:08:29.1908052Z 2025-12-04T10:08:29.1908098Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1908141Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1908186Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1908251Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1908299Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1908301Z 2025-12-04T10:08:29.1908345Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1908391Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1908435Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1908481Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1908546Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1908587Z dtype=torch.float64) 2025-12-04T10:08:29.1908607Z 2025-12-04T10:08:29.1908691Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1908693Z 2025-12-04T10:08:29.1908738Z Traceback (most recent call last): 2025-12-04T10:08:29.1908897Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1908936Z method(*args, **kwargs) 2025-12-04T10:08:29.1909113Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1909158Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1909197Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1909356Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1909400Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1909436Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1909600Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1909641Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1909678Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1909834Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1909872Z fn(*args, **kwargs) 2025-12-04T10:08:29.1910038Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1910079Z raise e_tracked from e 2025-12-04T10:08:29.1910123Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1910127Z 2025-12-04T10:08:29.1910220Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1910301Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1910384Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1910386Z 2025-12-04T10:08:29.1910472Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1910574Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1910611Z If the test 2025-12-04T10:08:29.1910704Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1910766Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1910863Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1910945Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1910947Z 2025-12-04T10:08:29.1911037Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1911124Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1911184Z the following. 2025-12-04T10:08:29.1911188Z 2025-12-04T10:08:29.1911276Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1911366Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1911437Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1911501Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1911561Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1911563Z 2025-12-04T10:08:29.1911595Z Got: 2025-12-04T10:08:29.1911651Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1911697Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1911744Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1911790Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1911852Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1911855Z 2025-12-04T10:08:29.1911899Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1911945Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1911990Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1912037Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1912086Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1912089Z 2025-12-04T10:08:29.1912090Z 2025-12-04T10:08:29.1912134Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1912178Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1912222Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1912267Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1912312Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1912314Z 2025-12-04T10:08:29.1912361Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1912405Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1912450Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1912496Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1912559Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1912600Z dtype=torch.float64) 2025-12-04T10:08:29.1912602Z 2025-12-04T10:08:29.1912637Z Expected: 2025-12-04T10:08:29.1912689Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1912734Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1912779Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1912823Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1912869Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1912873Z 2025-12-04T10:08:29.1912919Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1913016Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1913061Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1913107Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1913157Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1913159Z 2025-12-04T10:08:29.1913161Z 2025-12-04T10:08:29.1913204Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1913249Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1913292Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1913337Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1913382Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1913385Z 2025-12-04T10:08:29.1913430Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1913491Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1913535Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1913580Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1913671Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1913713Z dtype=torch.float64) 2025-12-04T10:08:29.1913714Z 2025-12-04T10:08:29.1914004Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1914006Z 2025-12-04T10:08:29.1914082Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1914301Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1914306Z 2025-12-04T10:08:29.1914393Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1914486Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1914534Z Traceback (most recent call last): 2025-12-04T10:08:29.1914704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1914746Z return test(*args, **kwargs) 2025-12-04T10:08:29.1914783Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1914888Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1914952Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1915120Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1915244Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1915295Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1915459Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1915515Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1915558Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1915712Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1915778Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1915821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1915960Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1916006Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1916045Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1916196Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1916248Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1916403Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1916445Z raise GradcheckError( 2025-12-04T10:08:29.1916534Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1916536Z 2025-12-04T10:08:29.1916630Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1916711Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1916792Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1916805Z 2025-12-04T10:08:29.1916893Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1916996Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1917032Z If the test 2025-12-04T10:08:29.1917145Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1917206Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1917300Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1917382Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1917384Z 2025-12-04T10:08:29.1917475Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1917560Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1917595Z the following. 2025-12-04T10:08:29.1917597Z 2025-12-04T10:08:29.1917698Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1917789Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1917841Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1917905Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1917968Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1917970Z 2025-12-04T10:08:29.1918002Z Got: 2025-12-04T10:08:29.1918058Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1918105Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1918153Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1918197Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1918245Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1918247Z 2025-12-04T10:08:29.1918292Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1918339Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1918383Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1918428Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1918479Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1918482Z 2025-12-04T10:08:29.1918484Z 2025-12-04T10:08:29.1918529Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1918572Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1918616Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1918660Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1918706Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1918708Z 2025-12-04T10:08:29.1918754Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1918798Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1918843Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1918888Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1918951Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1918993Z dtype=torch.float64) 2025-12-04T10:08:29.1918995Z 2025-12-04T10:08:29.1919030Z Expected: 2025-12-04T10:08:29.1919083Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1919127Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1919173Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1919217Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1919263Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1919265Z 2025-12-04T10:08:29.1919310Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1919373Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1919418Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1919463Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1919525Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1919542Z 2025-12-04T10:08:29.1919543Z 2025-12-04T10:08:29.1919588Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1919633Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1919676Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1919721Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1919766Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1919769Z 2025-12-04T10:08:29.1919813Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1919858Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1919921Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1919967Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1920028Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1920073Z dtype=torch.float64) 2025-12-04T10:08:29.1920075Z 2025-12-04T10:08:29.1920158Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1920160Z 2025-12-04T10:08:29.1920206Z Traceback (most recent call last): 2025-12-04T10:08:29.1920363Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1920402Z method(*args, **kwargs) 2025-12-04T10:08:29.1920578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1920624Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1920665Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1920825Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1920867Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1920907Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1921064Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1921106Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1921142Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1921293Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1921330Z fn(*args, **kwargs) 2025-12-04T10:08:29.1921500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1921542Z raise e_tracked from e 2025-12-04T10:08:29.1921588Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1921590Z 2025-12-04T10:08:29.1921682Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1921765Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1921848Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1921850Z 2025-12-04T10:08:29.1921935Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1922038Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1922072Z If the test 2025-12-04T10:08:29.1922166Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1922227Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1922321Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1922415Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1922417Z 2025-12-04T10:08:29.1922509Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1922615Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1922652Z the following. 2025-12-04T10:08:29.1922654Z 2025-12-04T10:08:29.1922742Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1922833Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1922883Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1923038Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1923100Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1923102Z 2025-12-04T10:08:29.1923135Z Got: 2025-12-04T10:08:29.1923209Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1923259Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1923305Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1923350Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1923400Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1923404Z 2025-12-04T10:08:29.1923449Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1923493Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1923538Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1923584Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1923633Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1923635Z 2025-12-04T10:08:29.1923637Z 2025-12-04T10:08:29.1923682Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1923727Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1923774Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1923818Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1923865Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1923868Z 2025-12-04T10:08:29.1923913Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1923958Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1924004Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1924049Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1924114Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1924156Z dtype=torch.float64) 2025-12-04T10:08:29.1924157Z 2025-12-04T10:08:29.1924191Z Expected: 2025-12-04T10:08:29.1924244Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1924288Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1924335Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1924378Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1924425Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1924429Z 2025-12-04T10:08:29.1924473Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1924518Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1924562Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1924608Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1924658Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1924660Z 2025-12-04T10:08:29.1924663Z 2025-12-04T10:08:29.1924707Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1924751Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1924812Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1924857Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1924902Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1924907Z 2025-12-04T10:08:29.1924980Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1925025Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1925070Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1925114Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1925176Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1925216Z dtype=torch.float64) 2025-12-04T10:08:29.1925218Z 2025-12-04T10:08:29.1925528Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1925532Z 2025-12-04T10:08:29.1925608Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1925810Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1925813Z 2025-12-04T10:08:29.1925900Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1925994Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1926038Z Traceback (most recent call last): 2025-12-04T10:08:29.1926215Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1926257Z return test(*args, **kwargs) 2025-12-04T10:08:29.1926293Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1926401Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1926466Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1926641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1926767Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1926821Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1926982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1927040Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1927081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1927246Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1927312Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1927357Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1927499Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1927545Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1927584Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1927739Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1927789Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1927945Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1927988Z raise GradcheckError( 2025-12-04T10:08:29.1928079Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1928092Z 2025-12-04T10:08:29.1928186Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1928266Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1928348Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1928372Z 2025-12-04T10:08:29.1928459Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1928563Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1928598Z If the test 2025-12-04T10:08:29.1928692Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1928753Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1928850Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1928930Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1928945Z 2025-12-04T10:08:29.1929039Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1929123Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1929161Z the following. 2025-12-04T10:08:29.1929164Z 2025-12-04T10:08:29.1929254Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1929344Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1929395Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1929459Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1929519Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1929521Z 2025-12-04T10:08:29.1929554Z Got: 2025-12-04T10:08:29.1929610Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1929658Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1929708Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1929757Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1929804Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1929808Z 2025-12-04T10:08:29.1929853Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1929899Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1929943Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1929988Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1930037Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1930039Z 2025-12-04T10:08:29.1930041Z 2025-12-04T10:08:29.1930087Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1930130Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1930175Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1930220Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1930267Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1930270Z 2025-12-04T10:08:29.1930322Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1930369Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1930413Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1930458Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1930524Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1930567Z dtype=torch.float64) 2025-12-04T10:08:29.1930569Z 2025-12-04T10:08:29.1930605Z Expected: 2025-12-04T10:08:29.1930659Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1930702Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1930751Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1930807Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1930854Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1930856Z 2025-12-04T10:08:29.1930901Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1930973Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1931018Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1931063Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1931112Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1931113Z 2025-12-04T10:08:29.1931116Z 2025-12-04T10:08:29.1931160Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1931206Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1931251Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1931312Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1931361Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1931362Z 2025-12-04T10:08:29.1931408Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1931452Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1931498Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1931542Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1931605Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1931645Z dtype=torch.float64) 2025-12-04T10:08:29.1931647Z 2025-12-04T10:08:29.1931730Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1931732Z 2025-12-04T10:08:29.1931778Z Traceback (most recent call last): 2025-12-04T10:08:29.1931935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1931974Z method(*args, **kwargs) 2025-12-04T10:08:29.1932153Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1932198Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1932240Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1932402Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1932446Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1932483Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1932644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1932685Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1932722Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1932875Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1932915Z fn(*args, **kwargs) 2025-12-04T10:08:29.1933135Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1933177Z raise e_tracked from e 2025-12-04T10:08:29.1933222Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1933224Z 2025-12-04T10:08:29.1933317Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1933400Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1933480Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1933482Z 2025-12-04T10:08:29.1933568Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1933670Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1933728Z If the test 2025-12-04T10:08:29.1933821Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1933884Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1933993Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1934088Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1934090Z 2025-12-04T10:08:29.1934180Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1934266Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1934301Z the following. 2025-12-04T10:08:29.1934303Z 2025-12-04T10:08:29.1934393Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1934485Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1934555Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1934621Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1934683Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1934685Z 2025-12-04T10:08:29.1934717Z Got: 2025-12-04T10:08:29.1934774Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1934821Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1934868Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1934913Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1934960Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1934962Z 2025-12-04T10:08:29.1935007Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1935051Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1935096Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1935142Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1935194Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1935196Z 2025-12-04T10:08:29.1935198Z 2025-12-04T10:08:29.1935242Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1935288Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1935331Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1935376Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1935421Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1935423Z 2025-12-04T10:08:29.1935468Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1935514Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1935561Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1935605Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1935670Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1935711Z dtype=torch.float64) 2025-12-04T10:08:29.1935712Z 2025-12-04T10:08:29.1935748Z Expected: 2025-12-04T10:08:29.1935800Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1935848Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1935892Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1935937Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1935983Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1935985Z 2025-12-04T10:08:29.1936030Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1936075Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1936120Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1936164Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1936232Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1936234Z 2025-12-04T10:08:29.1936236Z 2025-12-04T10:08:29.1936281Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1936324Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1936392Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1936436Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1936483Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1936484Z 2025-12-04T10:08:29.1936529Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1936574Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1936617Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1936662Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1936735Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1936778Z dtype=torch.float64) 2025-12-04T10:08:29.1936780Z 2025-12-04T10:08:29.1937077Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1937080Z 2025-12-04T10:08:29.1937155Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1937355Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1937358Z 2025-12-04T10:08:29.1937445Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1937538Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1937583Z Traceback (most recent call last): 2025-12-04T10:08:29.1937757Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1937799Z return test(*args, **kwargs) 2025-12-04T10:08:29.1937836Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1937943Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1938008Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1938175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1938297Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1938349Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1938514Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1938570Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1938613Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1938768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1938835Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1938879Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1939019Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1939064Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1939103Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1939253Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1939305Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1939470Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1939511Z raise GradcheckError( 2025-12-04T10:08:29.1939601Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1939626Z 2025-12-04T10:08:29.1939718Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1939804Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1939885Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1939887Z 2025-12-04T10:08:29.1939973Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1940076Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1940112Z If the test 2025-12-04T10:08:29.1940218Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1940281Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1940374Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1940456Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1940459Z 2025-12-04T10:08:29.1940550Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1940636Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1940671Z the following. 2025-12-04T10:08:29.1940673Z 2025-12-04T10:08:29.1940763Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1940852Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1940903Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1940966Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1941029Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1941031Z 2025-12-04T10:08:29.1941064Z Got: 2025-12-04T10:08:29.1941120Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1941168Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1941215Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1941261Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1941307Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1941309Z 2025-12-04T10:08:29.1941354Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1941398Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1941443Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1941487Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1941537Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1941540Z 2025-12-04T10:08:29.1941542Z 2025-12-04T10:08:29.1941586Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1941630Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1941678Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1941722Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1941767Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1941769Z 2025-12-04T10:08:29.1941814Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1941857Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1941901Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1941945Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1942008Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1942063Z dtype=torch.float64) 2025-12-04T10:08:29.1942065Z 2025-12-04T10:08:29.1942101Z Expected: 2025-12-04T10:08:29.1942154Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1942199Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1942275Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1942319Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1942367Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1942369Z 2025-12-04T10:08:29.1942414Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1942458Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1942503Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1942549Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1942597Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1942599Z 2025-12-04T10:08:29.1942620Z 2025-12-04T10:08:29.1942666Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1942709Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1942753Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1942799Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1942846Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1942848Z 2025-12-04T10:08:29.1942892Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1942985Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1943029Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1943074Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1943136Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1943177Z dtype=torch.float64) 2025-12-04T10:08:29.1943181Z 2025-12-04T10:08:29.1943266Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1943268Z 2025-12-04T10:08:29.1943314Z Traceback (most recent call last): 2025-12-04T10:08:29.1943469Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1943510Z method(*args, **kwargs) 2025-12-04T10:08:29.1943685Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1943731Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1943770Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1943929Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1943972Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1944013Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1944175Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1944215Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1944252Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1944406Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1944444Z fn(*args, **kwargs) 2025-12-04T10:08:29.1944611Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1944652Z raise e_tracked from e 2025-12-04T10:08:29.1944697Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1944698Z 2025-12-04T10:08:29.1944793Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1944874Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1944978Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1944980Z 2025-12-04T10:08:29.1945063Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1945165Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1945229Z If the test 2025-12-04T10:08:29.1945323Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1945384Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1945479Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1945559Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1945562Z 2025-12-04T10:08:29.1945652Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1945737Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1945791Z the following. 2025-12-04T10:08:29.1945793Z 2025-12-04T10:08:29.1945882Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1945974Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1946028Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1946091Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1946153Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1946155Z 2025-12-04T10:08:29.1946189Z Got: 2025-12-04T10:08:29.1946246Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1946292Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1946339Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1946383Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1946431Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1946435Z 2025-12-04T10:08:29.1946479Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1946525Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1946569Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1946616Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1946664Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1946666Z 2025-12-04T10:08:29.1946668Z 2025-12-04T10:08:29.1946713Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1946756Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1946801Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1946845Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1946891Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1946893Z 2025-12-04T10:08:29.1946938Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1946984Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1947028Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1947073Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1947138Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1947179Z dtype=torch.float64) 2025-12-04T10:08:29.1947181Z 2025-12-04T10:08:29.1947215Z Expected: 2025-12-04T10:08:29.1947268Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1947311Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1947357Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1947400Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1947447Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1947449Z 2025-12-04T10:08:29.1947507Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1947551Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1947596Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1947642Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1947712Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1947714Z 2025-12-04T10:08:29.1947716Z 2025-12-04T10:08:29.1947760Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1947805Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1947848Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1947892Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1947937Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1947939Z 2025-12-04T10:08:29.1947984Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1948040Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1948086Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1948130Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1948194Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1948234Z dtype=torch.float64) 2025-12-04T10:08:29.1948236Z 2025-12-04T10:08:29.1948524Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1948526Z 2025-12-04T10:08:29.1948600Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1948801Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1948804Z 2025-12-04T10:08:29.1948891Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1948984Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1949030Z Traceback (most recent call last): 2025-12-04T10:08:29.1949200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1949244Z return test(*args, **kwargs) 2025-12-04T10:08:29.1949282Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1949386Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1949450Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1949619Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1949743Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1949796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1949958Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1950015Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1950057Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1950212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1950278Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1950321Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1950461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1950518Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1950558Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1950709Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1950780Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1950935Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1950978Z raise GradcheckError( 2025-12-04T10:08:29.1951067Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1951069Z 2025-12-04T10:08:29.1951162Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1951242Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1951323Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1951325Z 2025-12-04T10:08:29.1951419Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1951523Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1951557Z If the test 2025-12-04T10:08:29.1951656Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1951716Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1951813Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1951894Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1951897Z 2025-12-04T10:08:29.1951990Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1952075Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1952112Z the following. 2025-12-04T10:08:29.1952114Z 2025-12-04T10:08:29.1952203Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1952295Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1952347Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1952411Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1952474Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1952475Z 2025-12-04T10:08:29.1952507Z Got: 2025-12-04T10:08:29.1952563Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1952610Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1952657Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1952701Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1952750Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1952752Z 2025-12-04T10:08:29.1952797Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1952843Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1952887Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1952975Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1953026Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1953028Z 2025-12-04T10:08:29.1953031Z 2025-12-04T10:08:29.1953076Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1953122Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1953166Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1953210Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1953257Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1953258Z 2025-12-04T10:08:29.1953303Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1953349Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1953422Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1953467Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1953530Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1953599Z dtype=torch.float64) 2025-12-04T10:08:29.1953601Z 2025-12-04T10:08:29.1953636Z Expected: 2025-12-04T10:08:29.1953691Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1953736Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1953782Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1953825Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1953873Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1953875Z 2025-12-04T10:08:29.1953920Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1953980Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1954027Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1954072Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1954122Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1954125Z 2025-12-04T10:08:29.1954127Z 2025-12-04T10:08:29.1954171Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1954215Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1954258Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1954303Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1954350Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1954352Z 2025-12-04T10:08:29.1954398Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1954442Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1954488Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1954532Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1954594Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1954635Z dtype=torch.float64) 2025-12-04T10:08:29.1954638Z 2025-12-04T10:08:29.1954721Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1954723Z 2025-12-04T10:08:29.1954768Z Traceback (most recent call last): 2025-12-04T10:08:29.1954924Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1954963Z method(*args, **kwargs) 2025-12-04T10:08:29.1956885Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1956932Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1956977Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1957143Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1957186Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1957224Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1957383Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1957425Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1957462Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1957614Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1957651Z fn(*args, **kwargs) 2025-12-04T10:08:29.1957818Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1957858Z raise e_tracked from e 2025-12-04T10:08:29.1957921Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1957923Z 2025-12-04T10:08:29.1958017Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1958100Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1958205Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1958209Z 2025-12-04T10:08:29.1958295Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1958397Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1958433Z If the test 2025-12-04T10:08:29.1958527Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1958589Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1958685Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1958782Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1958785Z 2025-12-04T10:08:29.1958875Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1958962Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1959001Z the following. 2025-12-04T10:08:29.1959004Z 2025-12-04T10:08:29.1959092Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1959182Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1959233Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1959297Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1959358Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1959360Z 2025-12-04T10:08:29.1959393Z Got: 2025-12-04T10:08:29.1959448Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1959501Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1959547Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1959592Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1959642Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1959644Z 2025-12-04T10:08:29.1959689Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1959734Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1959779Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1959824Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1959874Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1959876Z 2025-12-04T10:08:29.1959878Z 2025-12-04T10:08:29.1959923Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1959968Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1960013Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1960058Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1960104Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1960107Z 2025-12-04T10:08:29.1960154Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1960197Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1960242Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1960286Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1960350Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1960390Z dtype=torch.float64) 2025-12-04T10:08:29.1960394Z 2025-12-04T10:08:29.1960427Z Expected: 2025-12-04T10:08:29.1960481Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1960527Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1960586Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1960630Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1960677Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1960692Z 2025-12-04T10:08:29.1960747Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1960793Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1960837Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1960884Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1960933Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1960935Z 2025-12-04T10:08:29.1960936Z 2025-12-04T10:08:29.1960981Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1961024Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1961081Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1961127Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1961173Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1961175Z 2025-12-04T10:08:29.1961219Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1961266Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1961309Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1961355Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1961416Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1961457Z dtype=torch.float64) 2025-12-04T10:08:29.1961460Z 2025-12-04T10:08:29.1961752Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1961756Z 2025-12-04T10:08:29.1961831Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1962036Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1962039Z 2025-12-04T10:08:29.1962126Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1962219Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1962265Z Traceback (most recent call last): 2025-12-04T10:08:29.1962437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1962478Z return test(*args, **kwargs) 2025-12-04T10:08:29.1962516Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1962621Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1962688Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1962855Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1963130Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1963184Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1963346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1963403Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1963446Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1963598Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1963689Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1963733Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1963886Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1963946Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1963984Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1964136Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1964186Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1964341Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1964382Z raise GradcheckError( 2025-12-04T10:08:29.1964473Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1964475Z 2025-12-04T10:08:29.1964591Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1964675Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1964756Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1964760Z 2025-12-04T10:08:29.1964847Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1964949Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1964985Z If the test 2025-12-04T10:08:29.1965079Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1965142Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1965235Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1965317Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1965320Z 2025-12-04T10:08:29.1965411Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1965497Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1965533Z the following. 2025-12-04T10:08:29.1965537Z 2025-12-04T10:08:29.1965627Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1965718Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1965769Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1965833Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1965893Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1965896Z 2025-12-04T10:08:29.1965928Z Got: 2025-12-04T10:08:29.1965983Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1966031Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1966078Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1966124Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1966171Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1966173Z 2025-12-04T10:08:29.1966220Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1966265Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1966310Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1966353Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1966402Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1966404Z 2025-12-04T10:08:29.1966406Z 2025-12-04T10:08:29.1966450Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1966494Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1966537Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1966595Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1966643Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1966644Z 2025-12-04T10:08:29.1966689Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1966757Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1966802Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1966846Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1966910Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1966950Z dtype=torch.float64) 2025-12-04T10:08:29.1966953Z 2025-12-04T10:08:29.1966987Z Expected: 2025-12-04T10:08:29.1967041Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1967085Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1967131Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1967189Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1967237Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1967239Z 2025-12-04T10:08:29.1967283Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1967330Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1967373Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1967418Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1967467Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1967468Z 2025-12-04T10:08:29.1967470Z 2025-12-04T10:08:29.1967514Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1967557Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1967601Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1967646Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1967694Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1967696Z 2025-12-04T10:08:29.1967739Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1967784Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1967831Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1967875Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1967938Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1967979Z dtype=torch.float64) 2025-12-04T10:08:29.1967981Z 2025-12-04T10:08:29.1968063Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1968065Z 2025-12-04T10:08:29.1968110Z Traceback (most recent call last): 2025-12-04T10:08:29.1968264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1968307Z method(*args, **kwargs) 2025-12-04T10:08:29.1968486Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1968530Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1968571Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1968730Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1968774Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1968811Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1968970Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1969012Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1969049Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1969200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1969250Z fn(*args, **kwargs) 2025-12-04T10:08:29.1969415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1969483Z raise e_tracked from e 2025-12-04T10:08:29.1969528Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1969530Z 2025-12-04T10:08:29.1969624Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1969706Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1969787Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1969789Z 2025-12-04T10:08:29.1969873Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1969977Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1970011Z If the test 2025-12-04T10:08:29.1970118Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1970182Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1970277Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1970359Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1970362Z 2025-12-04T10:08:29.1970452Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1970538Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1970574Z the following. 2025-12-04T10:08:29.1970576Z 2025-12-04T10:08:29.1970666Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1970755Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1970807Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1970872Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1970933Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1970935Z 2025-12-04T10:08:29.1970967Z Got: 2025-12-04T10:08:29.1971023Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1971071Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1971118Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1971162Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1971209Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1971211Z 2025-12-04T10:08:29.1971255Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1971300Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1971344Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1971390Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1971440Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1971442Z 2025-12-04T10:08:29.1971444Z 2025-12-04T10:08:29.1971488Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1971534Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1971578Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1971622Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1971668Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1971670Z 2025-12-04T10:08:29.1971715Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1971759Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1971803Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1971846Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1971910Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1971966Z dtype=torch.float64) 2025-12-04T10:08:29.1971968Z 2025-12-04T10:08:29.1972003Z Expected: 2025-12-04T10:08:29.1972056Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1972122Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1972167Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1972211Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1972258Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1972259Z 2025-12-04T10:08:29.1972304Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1972348Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1972393Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1972437Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1972500Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1972503Z 2025-12-04T10:08:29.1972504Z 2025-12-04T10:08:29.1972549Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1972593Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1972638Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1972682Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1972728Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1972729Z 2025-12-04T10:08:29.1972775Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1972818Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1972862Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1972906Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1973013Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1973055Z dtype=torch.float64) 2025-12-04T10:08:29.1973057Z 2025-12-04T10:08:29.1973348Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1973351Z 2025-12-04T10:08:29.1973426Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1973628Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1973630Z 2025-12-04T10:08:29.1973717Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1973809Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1973855Z Traceback (most recent call last): 2025-12-04T10:08:29.1974025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1974069Z return test(*args, **kwargs) 2025-12-04T10:08:29.1974106Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1974213Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1974279Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1974448Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1974570Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1974622Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1974788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1974862Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1974905Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1975072Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1975159Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1975202Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1975342Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1975387Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1975425Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1975577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1975627Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1975800Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1975844Z raise GradcheckError( 2025-12-04T10:08:29.1975933Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1975937Z 2025-12-04T10:08:29.1976031Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1976112Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1976192Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1976194Z 2025-12-04T10:08:29.1976281Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1976384Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1976419Z If the test 2025-12-04T10:08:29.1976512Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1976575Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1976669Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1976749Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1976754Z 2025-12-04T10:08:29.1976843Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1976928Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1976964Z the following. 2025-12-04T10:08:29.1976966Z 2025-12-04T10:08:29.1977055Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1977145Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1977196Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1977259Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1977322Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1977324Z 2025-12-04T10:08:29.1977355Z Got: 2025-12-04T10:08:29.1977412Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1977458Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1977506Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1977550Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1977599Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1977602Z 2025-12-04T10:08:29.1977646Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1977691Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1977734Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1977780Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1977829Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1977847Z 2025-12-04T10:08:29.1977848Z 2025-12-04T10:08:29.1977894Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1977937Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1977981Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1978050Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1978098Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1978100Z 2025-12-04T10:08:29.1978145Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1978189Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1978233Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1978278Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1978340Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1978381Z dtype=torch.float64) 2025-12-04T10:08:29.1978399Z 2025-12-04T10:08:29.1978435Z Expected: 2025-12-04T10:08:29.1978488Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1978533Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1978579Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1978624Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1978671Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1978672Z 2025-12-04T10:08:29.1978717Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1978761Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1978805Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1978849Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1978898Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1978900Z 2025-12-04T10:08:29.1978902Z 2025-12-04T10:08:29.1978949Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1978993Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1979040Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1979086Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1979131Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1979133Z 2025-12-04T10:08:29.1979178Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1979222Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1979265Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1979309Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1979371Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1979412Z dtype=torch.float64) 2025-12-04T10:08:29.1979415Z 2025-12-04T10:08:29.1979500Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1979502Z 2025-12-04T10:08:29.1979548Z Traceback (most recent call last): 2025-12-04T10:08:29.1979704Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1979745Z method(*args, **kwargs) 2025-12-04T10:08:29.1979922Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1979967Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1980006Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1980166Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1980209Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1980247Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1980405Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1980466Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1980501Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1980665Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1980712Z fn(*args, **kwargs) 2025-12-04T10:08:29.1980879Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1980918Z raise e_tracked from e 2025-12-04T10:08:29.1980963Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1980965Z 2025-12-04T10:08:29.1981058Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1981140Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1981232Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1981238Z 2025-12-04T10:08:29.1981323Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1981425Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1981463Z If the test 2025-12-04T10:08:29.1981556Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1981619Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1981714Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1981796Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1981798Z 2025-12-04T10:08:29.1981889Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1981974Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1982015Z the following. 2025-12-04T10:08:29.1982018Z 2025-12-04T10:08:29.1982106Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1982196Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1982249Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1982313Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1982372Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1982374Z 2025-12-04T10:08:29.1982407Z Got: 2025-12-04T10:08:29.1982462Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1982508Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1982554Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1982599Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1982645Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1982648Z 2025-12-04T10:08:29.1982695Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1982739Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1982784Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1982830Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1982881Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1982883Z 2025-12-04T10:08:29.1982885Z 2025-12-04T10:08:29.1982959Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1983004Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1983049Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1983093Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1983140Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1983142Z 2025-12-04T10:08:29.1983187Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1983257Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1983300Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1983346Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1983434Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1983477Z dtype=torch.float64) 2025-12-04T10:08:29.1983479Z 2025-12-04T10:08:29.1983514Z Expected: 2025-12-04T10:08:29.1983567Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1983611Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1983656Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1983699Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1983747Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1983749Z 2025-12-04T10:08:29.1983807Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1983856Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1983900Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1983945Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1983996Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1983998Z 2025-12-04T10:08:29.1983999Z 2025-12-04T10:08:29.1984045Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1984088Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1984133Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1984177Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1984223Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1984225Z 2025-12-04T10:08:29.1984270Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1984317Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1984361Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1984407Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1984470Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1984511Z dtype=torch.float64) 2025-12-04T10:08:29.1984513Z 2025-12-04T10:08:29.1984803Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1984805Z 2025-12-04T10:08:29.1984878Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1985078Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1985082Z 2025-12-04T10:08:29.1985168Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1985262Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1985307Z Traceback (most recent call last): 2025-12-04T10:08:29.1985480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1985522Z return test(*args, **kwargs) 2025-12-04T10:08:29.1985560Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1985664Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1985729Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1985895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1986017Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1986081Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1986258Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1986326Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1986368Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1986523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1986589Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1986633Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1986773Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1986832Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1986872Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1987025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1987075Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1987230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1987271Z raise GradcheckError( 2025-12-04T10:08:29.1987361Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1987363Z 2025-12-04T10:08:29.1987460Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1987542Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1987622Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1987624Z 2025-12-04T10:08:29.1987711Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1987815Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1987850Z If the test 2025-12-04T10:08:29.1987945Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1988007Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1988100Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1988181Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1988183Z 2025-12-04T10:08:29.1988273Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1988357Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1988394Z the following. 2025-12-04T10:08:29.1988395Z 2025-12-04T10:08:29.1988484Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1988575Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1988625Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1988689Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1988751Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1988753Z 2025-12-04T10:08:29.1988786Z Got: 2025-12-04T10:08:29.1988841Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1988889Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1988935Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1988980Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1989027Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1989029Z 2025-12-04T10:08:29.1989074Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1989130Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1989176Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1989220Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1989281Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1989294Z 2025-12-04T10:08:29.1989296Z 2025-12-04T10:08:29.1989341Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1989385Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1989429Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1989473Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1989519Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1989521Z 2025-12-04T10:08:29.1989567Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1989611Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1989666Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1989713Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1989775Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1989821Z dtype=torch.float64) 2025-12-04T10:08:29.1989823Z 2025-12-04T10:08:29.1989857Z Expected: 2025-12-04T10:08:29.1989911Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1989955Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1990000Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1990044Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1990091Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1990092Z 2025-12-04T10:08:29.1990137Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1990182Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1990227Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1990272Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1990321Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1990324Z 2025-12-04T10:08:29.1990327Z 2025-12-04T10:08:29.1990372Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1990415Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1990459Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1990503Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1990549Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1990551Z 2025-12-04T10:08:29.1990595Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1990639Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1990684Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1990731Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1990793Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1990835Z dtype=torch.float64) 2025-12-04T10:08:29.1990837Z 2025-12-04T10:08:29.1990921Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.1990923Z 2025-12-04T10:08:29.1990968Z Traceback (most recent call last): 2025-12-04T10:08:29.1991124Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.1991163Z method(*args, **kwargs) 2025-12-04T10:08:29.1991340Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.1991385Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.1991425Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1991597Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1991641Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1991678Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1991856Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.1991897Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.1991934Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1992086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.1992124Z fn(*args, **kwargs) 2025-12-04T10:08:29.1992290Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.1992331Z raise e_tracked from e 2025-12-04T10:08:29.1992390Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.1992392Z 2025-12-04T10:08:29.1992487Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1992568Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1992652Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1992654Z 2025-12-04T10:08:29.1992739Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1992841Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1992877Z If the test 2025-12-04T10:08:29.1993009Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1993071Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1993166Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1993251Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1993254Z 2025-12-04T10:08:29.1993344Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1993429Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1993467Z the following. 2025-12-04T10:08:29.1993469Z 2025-12-04T10:08:29.1993558Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.1993646Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.1993697Z operation' in the backward pass. Please see 2025-12-04T10:08:29.1993759Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.1993820Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.1993822Z 2025-12-04T10:08:29.1993854Z Got: 2025-12-04T10:08:29.1993910Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.1993957Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.1994005Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.1994049Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.1994097Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.1994100Z 2025-12-04T10:08:29.1994144Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.1994190Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.1994233Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.1994279Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.1994328Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.1994330Z 2025-12-04T10:08:29.1994332Z 2025-12-04T10:08:29.1994376Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1994420Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1994487Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1994532Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1994578Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1994580Z 2025-12-04T10:08:29.1994654Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1994699Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1994743Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1994787Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1994850Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1994890Z dtype=torch.float64) 2025-12-04T10:08:29.1994892Z 2025-12-04T10:08:29.1994927Z Expected: 2025-12-04T10:08:29.1994979Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.1995023Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.1995083Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.1995128Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.1995175Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.1995178Z 2025-12-04T10:08:29.1995225Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.1995269Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.1995315Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.1995359Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.1995409Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.1995411Z 2025-12-04T10:08:29.1995413Z 2025-12-04T10:08:29.1995457Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.1995501Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.1995544Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.1995592Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.1995639Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.1995641Z 2025-12-04T10:08:29.1995686Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.1995732Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.1995776Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.1995820Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.1995882Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.1995924Z dtype=torch.float64) 2025-12-04T10:08:29.1995926Z 2025-12-04T10:08:29.1996214Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.1996219Z 2025-12-04T10:08:29.1996295Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.1996494Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.1996498Z 2025-12-04T10:08:29.1996586Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.1996678Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.1996724Z Traceback (most recent call last): 2025-12-04T10:08:29.1996896Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.1996938Z return test(*args, **kwargs) 2025-12-04T10:08:29.1996974Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1997080Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.1997168Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.1997335Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.1997479Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.1997532Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1997695Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.1997751Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.1997795Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1997950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.1998027Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.1998071Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1998210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.1998257Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.1998296Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.1998447Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.1998497Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.1998651Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.1998692Z raise GradcheckError( 2025-12-04T10:08:29.1998781Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.1998785Z 2025-12-04T10:08:29.1998878Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.1998959Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.1999040Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.1999043Z 2025-12-04T10:08:29.1999128Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.1999231Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.1999267Z If the test 2025-12-04T10:08:29.1999361Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.1999424Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.1999518Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.1999600Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.1999602Z 2025-12-04T10:08:29.1999697Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.1999782Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.1999818Z the following. 2025-12-04T10:08:29.1999821Z 2025-12-04T10:08:29.1999912Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2000002Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2000056Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2000120Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2000182Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2000184Z 2025-12-04T10:08:29.2000216Z Got: 2025-12-04T10:08:29.2000272Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2000318Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2000366Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2000423Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2000472Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2000474Z 2025-12-04T10:08:29.2000518Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2000586Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2000631Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2000677Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2000725Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2000728Z 2025-12-04T10:08:29.2000730Z 2025-12-04T10:08:29.2000774Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2000818Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2000861Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2000917Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2000965Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2000967Z 2025-12-04T10:08:29.2001012Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2001058Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2001104Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2001147Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2001211Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2001251Z dtype=torch.float64) 2025-12-04T10:08:29.2001254Z 2025-12-04T10:08:29.2001290Z Expected: 2025-12-04T10:08:29.2001342Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2001389Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2001434Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2001480Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2001527Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2001529Z 2025-12-04T10:08:29.2001574Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2001622Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2001667Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2001711Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2001761Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2001763Z 2025-12-04T10:08:29.2001765Z 2025-12-04T10:08:29.2001809Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2001855Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2001899Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2001942Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2001990Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2001992Z 2025-12-04T10:08:29.2002039Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2002083Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2002130Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2002176Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2002237Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2002280Z dtype=torch.float64) 2025-12-04T10:08:29.2002282Z 2025-12-04T10:08:29.2002363Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2002365Z 2025-12-04T10:08:29.2002416Z Traceback (most recent call last): 2025-12-04T10:08:29.2002572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2002614Z method(*args, **kwargs) 2025-12-04T10:08:29.2002806Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2002852Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2002916Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2003128Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2003170Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2003209Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2003369Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2003412Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2003449Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2003624Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2003666Z fn(*args, **kwargs) 2025-12-04T10:08:29.2003833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2003876Z raise e_tracked from e 2025-12-04T10:08:29.2003923Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2003925Z 2025-12-04T10:08:29.2004018Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2004099Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2004179Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2004181Z 2025-12-04T10:08:29.2004264Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2004369Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2004403Z If the test 2025-12-04T10:08:29.2004501Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2004562Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2004658Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2004741Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2004743Z 2025-12-04T10:08:29.2004835Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2004920Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2004957Z the following. 2025-12-04T10:08:29.2004959Z 2025-12-04T10:08:29.2005047Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2005138Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2005189Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2005254Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2005314Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2005317Z 2025-12-04T10:08:29.2005350Z Got: 2025-12-04T10:08:29.2005409Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2005459Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2005505Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2005553Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2005599Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2005603Z 2025-12-04T10:08:29.2005649Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2005694Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2005738Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2005783Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2005846Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2005848Z 2025-12-04T10:08:29.2005849Z 2025-12-04T10:08:29.2005894Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2005938Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2006012Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2006059Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2006106Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2006108Z 2025-12-04T10:08:29.2006152Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2006197Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2006241Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2006285Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2006367Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2006410Z dtype=torch.float64) 2025-12-04T10:08:29.2006412Z 2025-12-04T10:08:29.2006446Z Expected: 2025-12-04T10:08:29.2006500Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2006544Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2006591Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2006634Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2006682Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2006684Z 2025-12-04T10:08:29.2006727Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2006773Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2006817Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2006863Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2006912Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2006916Z 2025-12-04T10:08:29.2006918Z 2025-12-04T10:08:29.2006961Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2007005Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2007053Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2007097Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2007143Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2007145Z 2025-12-04T10:08:29.2007190Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2007233Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2007388Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2007433Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2007495Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2007538Z dtype=torch.float64) 2025-12-04T10:08:29.2007540Z 2025-12-04T10:08:29.2007832Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2007835Z 2025-12-04T10:08:29.2007909Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2008110Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2008112Z 2025-12-04T10:08:29.2008200Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2008293Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2008339Z Traceback (most recent call last): 2025-12-04T10:08:29.2008509Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2008569Z return test(*args, **kwargs) 2025-12-04T10:08:29.2008606Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2008725Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2008801Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2008973Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2009095Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2009147Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2009309Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2009379Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2009422Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2009577Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2009646Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2009691Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2009831Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2009878Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2009916Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2010069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2010120Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2010274Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2010317Z raise GradcheckError( 2025-12-04T10:08:29.2010407Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2010410Z 2025-12-04T10:08:29.2010504Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2010585Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2010665Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2010667Z 2025-12-04T10:08:29.2010752Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2010856Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2010891Z If the test 2025-12-04T10:08:29.2010985Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2011050Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2011146Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2011227Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2011230Z 2025-12-04T10:08:29.2011324Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2011408Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2011447Z the following. 2025-12-04T10:08:29.2011449Z 2025-12-04T10:08:29.2011538Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2011628Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2011679Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2011741Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2011803Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2011816Z 2025-12-04T10:08:29.2011849Z Got: 2025-12-04T10:08:29.2011903Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2011952Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2012021Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2012069Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2012117Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2012120Z 2025-12-04T10:08:29.2012164Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2012210Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2012255Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2012301Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2012349Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2012351Z 2025-12-04T10:08:29.2012368Z 2025-12-04T10:08:29.2012413Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2012457Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2012500Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2012546Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2012593Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2012595Z 2025-12-04T10:08:29.2012639Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2012683Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2012727Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2012774Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2012836Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2012878Z dtype=torch.float64) 2025-12-04T10:08:29.2012881Z 2025-12-04T10:08:29.2012916Z Expected: 2025-12-04T10:08:29.2013013Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2013057Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2013104Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2013150Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2013199Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2013201Z 2025-12-04T10:08:29.2013245Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2013290Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2013334Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2013380Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2013430Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2013433Z 2025-12-04T10:08:29.2013435Z 2025-12-04T10:08:29.2013480Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2013525Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2013568Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2013614Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2013662Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2013664Z 2025-12-04T10:08:29.2013710Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2013754Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2013798Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2013842Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2013906Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2013948Z dtype=torch.float64) 2025-12-04T10:08:29.2013950Z 2025-12-04T10:08:29.2014033Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2014052Z 2025-12-04T10:08:29.2014097Z Traceback (most recent call last): 2025-12-04T10:08:29.2014255Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2014322Z method(*args, **kwargs) 2025-12-04T10:08:29.2014501Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2014546Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2014586Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2014745Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2014789Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2014827Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2015003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2015048Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2015087Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2015239Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2015278Z fn(*args, **kwargs) 2025-12-04T10:08:29.2015446Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2015485Z raise e_tracked from e 2025-12-04T10:08:29.2015534Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2015536Z 2025-12-04T10:08:29.2015629Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2015787Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2015868Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2015873Z 2025-12-04T10:08:29.2015958Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2016059Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2016096Z If the test 2025-12-04T10:08:29.2016190Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2016252Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2016345Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2016428Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2016431Z 2025-12-04T10:08:29.2016521Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2016607Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2016643Z the following. 2025-12-04T10:08:29.2016647Z 2025-12-04T10:08:29.2016737Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2016826Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2016878Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2016942Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2017004Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2017006Z 2025-12-04T10:08:29.2017039Z Got: 2025-12-04T10:08:29.2017094Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2017141Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2017187Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2017231Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2017279Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2017281Z 2025-12-04T10:08:29.2017341Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2017387Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2017432Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2017477Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2017555Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2017557Z 2025-12-04T10:08:29.2017559Z 2025-12-04T10:08:29.2017603Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2017647Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2017690Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2017734Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2017780Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2017782Z 2025-12-04T10:08:29.2017828Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2017885Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2017931Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2017975Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2018042Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2018082Z dtype=torch.float64) 2025-12-04T10:08:29.2018084Z 2025-12-04T10:08:29.2018119Z Expected: 2025-12-04T10:08:29.2018172Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2018217Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2018262Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2018306Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2018353Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2018357Z 2025-12-04T10:08:29.2018400Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2018448Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2018491Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2018536Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2018587Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2018589Z 2025-12-04T10:08:29.2018591Z 2025-12-04T10:08:29.2018635Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2018679Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2018723Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2018767Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2018813Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2018815Z 2025-12-04T10:08:29.2018859Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2018904Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2018948Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2018992Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2019053Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2019096Z dtype=torch.float64) 2025-12-04T10:08:29.2019098Z 2025-12-04T10:08:29.2019390Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2019393Z 2025-12-04T10:08:29.2019468Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2019671Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2019673Z 2025-12-04T10:08:29.2019771Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2019865Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2019910Z Traceback (most recent call last): 2025-12-04T10:08:29.2020106Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2020149Z return test(*args, **kwargs) 2025-12-04T10:08:29.2020186Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2020291Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2020356Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2020523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2020655Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2020709Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2020872Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2020929Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2020972Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2021127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2021195Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2021238Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2021378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2021423Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2021463Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2021616Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2021665Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2021822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2021863Z raise GradcheckError( 2025-12-04T10:08:29.2021953Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2021955Z 2025-12-04T10:08:29.2022049Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2022130Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2022210Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2022212Z 2025-12-04T10:08:29.2022299Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2022402Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2022438Z If the test 2025-12-04T10:08:29.2022530Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2022594Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2022687Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2022769Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2022771Z 2025-12-04T10:08:29.2022860Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2023000Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2023036Z the following. 2025-12-04T10:08:29.2023038Z 2025-12-04T10:08:29.2023128Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2023234Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2023285Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2023348Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2023435Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2023437Z 2025-12-04T10:08:29.2023471Z Got: 2025-12-04T10:08:29.2023527Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2023574Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2023620Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2023666Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2023712Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2023714Z 2025-12-04T10:08:29.2023760Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2023821Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2023869Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2023914Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2023964Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2023968Z 2025-12-04T10:08:29.2023969Z 2025-12-04T10:08:29.2024014Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2024058Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2024143Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2024188Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2024235Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2024237Z 2025-12-04T10:08:29.2024284Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2024329Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2024377Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2024421Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2024484Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2024526Z dtype=torch.float64) 2025-12-04T10:08:29.2024528Z 2025-12-04T10:08:29.2024563Z Expected: 2025-12-04T10:08:29.2024616Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2024661Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2024705Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2024749Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2024795Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2024798Z 2025-12-04T10:08:29.2024842Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2024887Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2024933Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2024978Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2025026Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2025028Z 2025-12-04T10:08:29.2025031Z 2025-12-04T10:08:29.2025078Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2025122Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2025166Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2025210Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2025257Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2025259Z 2025-12-04T10:08:29.2025303Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2025347Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2025390Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2025448Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2025510Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2025552Z dtype=torch.float64) 2025-12-04T10:08:29.2025565Z 2025-12-04T10:08:29.2025657Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2025659Z 2025-12-04T10:08:29.2025706Z Traceback (most recent call last): 2025-12-04T10:08:29.2025859Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2025899Z method(*args, **kwargs) 2025-12-04T10:08:29.2026075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2026122Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2026161Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2026333Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2026377Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2026414Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2026578Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2026619Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2026657Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2026808Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2026846Z fn(*args, **kwargs) 2025-12-04T10:08:29.2027012Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2027052Z raise e_tracked from e 2025-12-04T10:08:29.2027098Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2027100Z 2025-12-04T10:08:29.2027194Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2027275Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2027358Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2027360Z 2025-12-04T10:08:29.2027443Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2027546Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2027581Z If the test 2025-12-04T10:08:29.2027676Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2027737Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2027833Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2027914Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2027917Z 2025-12-04T10:08:29.2028006Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2028091Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2028128Z the following. 2025-12-04T10:08:29.2028131Z 2025-12-04T10:08:29.2028220Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2028309Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2028362Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2028424Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2028485Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2028487Z 2025-12-04T10:08:29.2028519Z Got: 2025-12-04T10:08:29.2028578Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2028626Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2028686Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2028729Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2028777Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2028796Z 2025-12-04T10:08:29.2028850Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2028896Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2028940Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2028985Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2029034Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2029036Z 2025-12-04T10:08:29.2029037Z 2025-12-04T10:08:29.2029082Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2029125Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2029185Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2029230Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2029277Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2029280Z 2025-12-04T10:08:29.2029325Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2029371Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2029415Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2029460Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2029521Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2029568Z dtype=torch.float64) 2025-12-04T10:08:29.2029570Z 2025-12-04T10:08:29.2029605Z Expected: 2025-12-04T10:08:29.2029658Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2029703Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2029750Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2029795Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2029843Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2029845Z 2025-12-04T10:08:29.2029892Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2029936Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2029981Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2030027Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2030076Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2030078Z 2025-12-04T10:08:29.2030080Z 2025-12-04T10:08:29.2030124Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2030168Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2030211Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2030257Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2030303Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2030305Z 2025-12-04T10:08:29.2030350Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2030396Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2030442Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2030485Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2030548Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2030588Z dtype=torch.float64) 2025-12-04T10:08:29.2030590Z 2025-12-04T10:08:29.2030879Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2030892Z 2025-12-04T10:08:29.2030968Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2031168Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2031180Z 2025-12-04T10:08:29.2031278Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2031371Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2031417Z Traceback (most recent call last): 2025-12-04T10:08:29.2031587Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2031630Z return test(*args, **kwargs) 2025-12-04T10:08:29.2031667Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2031771Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2031848Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2032016Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2032138Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2032192Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2032353Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2032410Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2032452Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2032606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2032673Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2032717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2032858Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2032904Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2032986Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2033139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2033191Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2033346Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2033388Z raise GradcheckError( 2025-12-04T10:08:29.2033478Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2033480Z 2025-12-04T10:08:29.2033574Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2033656Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2033737Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2033739Z 2025-12-04T10:08:29.2033825Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2033929Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2033963Z If the test 2025-12-04T10:08:29.2034057Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2034118Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2034212Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2034293Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2034295Z 2025-12-04T10:08:29.2034386Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2034488Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2034526Z the following. 2025-12-04T10:08:29.2034528Z 2025-12-04T10:08:29.2034629Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2034731Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2034785Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2034847Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2034908Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2034910Z 2025-12-04T10:08:29.2034943Z Got: 2025-12-04T10:08:29.2035003Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2035049Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2035096Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2035154Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2035203Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2035204Z 2025-12-04T10:08:29.2035249Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2035296Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2035340Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2035385Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2035433Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2035435Z 2025-12-04T10:08:29.2035437Z 2025-12-04T10:08:29.2035482Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2035525Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2035568Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2035613Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2035661Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2035663Z 2025-12-04T10:08:29.2035708Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2035754Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2035799Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2035845Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2035907Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2035949Z dtype=torch.float64) 2025-12-04T10:08:29.2035951Z 2025-12-04T10:08:29.2035985Z Expected: 2025-12-04T10:08:29.2036038Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2036083Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2036128Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2036173Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2036220Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2036221Z 2025-12-04T10:08:29.2036268Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2036312Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2036358Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2036404Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2036453Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2036455Z 2025-12-04T10:08:29.2036456Z 2025-12-04T10:08:29.2036500Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2036544Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2036587Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2036632Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2036677Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2036691Z 2025-12-04T10:08:29.2036737Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2036781Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2036849Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2036894Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2036956Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2036996Z dtype=torch.float64) 2025-12-04T10:08:29.2036998Z 2025-12-04T10:08:29.2037080Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2037082Z 2025-12-04T10:08:29.2037127Z Traceback (most recent call last): 2025-12-04T10:08:29.2037284Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2037323Z method(*args, **kwargs) 2025-12-04T10:08:29.2037515Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2037562Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2037600Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2037764Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2037806Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2037846Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2038003Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2038045Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2038081Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2038233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2038274Z fn(*args, **kwargs) 2025-12-04T10:08:29.2038442Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2038481Z raise e_tracked from e 2025-12-04T10:08:29.2038529Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2038531Z 2025-12-04T10:08:29.2038623Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2038706Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2038786Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2038788Z 2025-12-04T10:08:29.2038873Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2038974Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2039009Z If the test 2025-12-04T10:08:29.2039102Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2039165Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2039259Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2039342Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2039344Z 2025-12-04T10:08:29.2039435Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2039520Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2039556Z the following. 2025-12-04T10:08:29.2039558Z 2025-12-04T10:08:29.2039646Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2039737Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2039788Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2039852Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2039930Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2039932Z 2025-12-04T10:08:29.2039965Z Got: 2025-12-04T10:08:29.2040021Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2040092Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2040139Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2040183Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2040230Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2040232Z 2025-12-04T10:08:29.2040277Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2040321Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2040367Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2040411Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2040475Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2040480Z 2025-12-04T10:08:29.2040481Z 2025-12-04T10:08:29.2040526Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2040571Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2040617Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2040662Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2040708Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2040710Z 2025-12-04T10:08:29.2040757Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2040803Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2040846Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2040891Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2040954Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2040999Z dtype=torch.float64) 2025-12-04T10:08:29.2041001Z 2025-12-04T10:08:29.2041035Z Expected: 2025-12-04T10:08:29.2041089Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2041133Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2041181Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2041224Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2041273Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2041275Z 2025-12-04T10:08:29.2041319Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2041364Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2041407Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2041454Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2041502Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2041505Z 2025-12-04T10:08:29.2041507Z 2025-12-04T10:08:29.2041551Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2041594Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2041639Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2041684Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2041731Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2041733Z 2025-12-04T10:08:29.2041777Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2041823Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2041867Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2041913Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2041975Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2042016Z dtype=torch.float64) 2025-12-04T10:08:29.2042031Z 2025-12-04T10:08:29.2042326Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2042349Z 2025-12-04T10:08:29.2042424Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2042625Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2042627Z 2025-12-04T10:08:29.2042713Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2042805Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2042851Z Traceback (most recent call last): 2025-12-04T10:08:29.2043085Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2043128Z return test(*args, **kwargs) 2025-12-04T10:08:29.2043167Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2043271Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2043337Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2043506Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2043628Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2043679Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2043843Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2043902Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2043946Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2044103Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2044170Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2044215Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2044355Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2044400Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2044438Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2044590Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2044641Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2044796Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2044837Z raise GradcheckError( 2025-12-04T10:08:29.2044926Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2044928Z 2025-12-04T10:08:29.2045023Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2045104Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2045183Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2045186Z 2025-12-04T10:08:29.2045271Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2045374Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2045410Z If the test 2025-12-04T10:08:29.2045503Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2045566Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2045676Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2045758Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2045773Z 2025-12-04T10:08:29.2045878Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2045963Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2046001Z the following. 2025-12-04T10:08:29.2046003Z 2025-12-04T10:08:29.2046091Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2046183Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2046235Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2046302Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2046364Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2046381Z 2025-12-04T10:08:29.2046416Z Got: 2025-12-04T10:08:29.2046471Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2046518Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2046567Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2046614Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2046662Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2046664Z 2025-12-04T10:08:29.2046709Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2046753Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2046799Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2046843Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2046893Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2046895Z 2025-12-04T10:08:29.2046898Z 2025-12-04T10:08:29.2046943Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2046987Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2047030Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2047076Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2047123Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2047126Z 2025-12-04T10:08:29.2047171Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2047215Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2047259Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2047303Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2047365Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2047407Z dtype=torch.float64) 2025-12-04T10:08:29.2047409Z 2025-12-04T10:08:29.2047445Z Expected: 2025-12-04T10:08:29.2047499Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2047543Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2047589Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2047634Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2047684Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2047686Z 2025-12-04T10:08:29.2047733Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2049543Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2049591Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2049636Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2049685Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2049687Z 2025-12-04T10:08:29.2049688Z 2025-12-04T10:08:29.2049734Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2049795Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2049839Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2049883Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2049957Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2049959Z 2025-12-04T10:08:29.2050004Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2050049Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2050093Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2050137Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2050200Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2050241Z dtype=torch.float64) 2025-12-04T10:08:29.2050243Z 2025-12-04T10:08:29.2050348Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2050354Z 2025-12-04T10:08:29.2050400Z Traceback (most recent call last): 2025-12-04T10:08:29.2050557Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2050598Z method(*args, **kwargs) 2025-12-04T10:08:29.2050776Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2050821Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2050861Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2051021Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2051065Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2051102Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2051264Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2051307Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2051343Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2051498Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2051539Z fn(*args, **kwargs) 2025-12-04T10:08:29.2051706Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2051747Z raise e_tracked from e 2025-12-04T10:08:29.2051792Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2051794Z 2025-12-04T10:08:29.2051889Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2051970Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2052052Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2052061Z 2025-12-04T10:08:29.2052146Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2052249Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2052283Z If the test 2025-12-04T10:08:29.2052383Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2052445Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2052540Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2052621Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2052623Z 2025-12-04T10:08:29.2052713Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2052801Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2052837Z the following. 2025-12-04T10:08:29.2052839Z 2025-12-04T10:08:29.2052985Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2053076Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2053127Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2053228Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2053289Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2053291Z 2025-12-04T10:08:29.2053323Z Got: 2025-12-04T10:08:29.2053380Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2053427Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2053473Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2053517Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2053565Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2053567Z 2025-12-04T10:08:29.2053626Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2053674Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2053717Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2053763Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2053814Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2053816Z 2025-12-04T10:08:29.2053818Z 2025-12-04T10:08:29.2053863Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2053907Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2053951Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2053994Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2054041Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2054043Z 2025-12-04T10:08:29.2054088Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2054133Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2054178Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2054223Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2054286Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2054328Z dtype=torch.float64) 2025-12-04T10:08:29.2054330Z 2025-12-04T10:08:29.2054364Z Expected: 2025-12-04T10:08:29.2054417Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2054462Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2054506Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2054551Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2054597Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2054599Z 2025-12-04T10:08:29.2054643Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2054689Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2054733Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2054777Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2054827Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2054832Z 2025-12-04T10:08:29.2054834Z 2025-12-04T10:08:29.2054878Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2054922Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2054966Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2055012Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2055057Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2055059Z 2025-12-04T10:08:29.2055104Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2055148Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2055208Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2055253Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2055315Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2055378Z dtype=torch.float64) 2025-12-04T10:08:29.2055382Z 2025-12-04T10:08:29.2055675Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2055677Z 2025-12-04T10:08:29.2055752Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2055954Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2055956Z 2025-12-04T10:08:29.2056057Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2056153Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2056199Z Traceback (most recent call last): 2025-12-04T10:08:29.2056371Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2056414Z return test(*args, **kwargs) 2025-12-04T10:08:29.2056451Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2056556Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2056620Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2056788Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2056909Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2056964Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2057127Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2057185Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2057229Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2057382Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2057449Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2057492Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2057632Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2057677Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2057717Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2057869Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2057920Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2058075Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2058117Z raise GradcheckError( 2025-12-04T10:08:29.2058206Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2058208Z 2025-12-04T10:08:29.2058301Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2058382Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2058462Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2058464Z 2025-12-04T10:08:29.2058548Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2058664Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2058699Z If the test 2025-12-04T10:08:29.2058794Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2058875Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2058971Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2059054Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2059056Z 2025-12-04T10:08:29.2059148Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2059234Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2059270Z the following. 2025-12-04T10:08:29.2059272Z 2025-12-04T10:08:29.2059362Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2059465Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2059517Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2059580Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2059644Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2059646Z 2025-12-04T10:08:29.2059678Z Got: 2025-12-04T10:08:29.2059734Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2059780Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2059826Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2059870Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2059918Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2059920Z 2025-12-04T10:08:29.2059964Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2060013Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2060058Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2060103Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2060152Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2060155Z 2025-12-04T10:08:29.2060158Z 2025-12-04T10:08:29.2060203Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2060246Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2060291Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2060336Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2060383Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2060385Z 2025-12-04T10:08:29.2060430Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2060474Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2060519Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2060564Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2060627Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2060668Z dtype=torch.float64) 2025-12-04T10:08:29.2060670Z 2025-12-04T10:08:29.2060706Z Expected: 2025-12-04T10:08:29.2060759Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2060804Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2060849Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2060893Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2060939Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2060941Z 2025-12-04T10:08:29.2060985Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2061029Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2061074Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2061135Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2061184Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2061186Z 2025-12-04T10:08:29.2061199Z 2025-12-04T10:08:29.2061260Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2061306Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2061349Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2061395Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2061440Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2061442Z 2025-12-04T10:08:29.2061487Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2061531Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2061575Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2061636Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2061700Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2061740Z dtype=torch.float64) 2025-12-04T10:08:29.2061743Z 2025-12-04T10:08:29.2061827Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2061829Z 2025-12-04T10:08:29.2061874Z Traceback (most recent call last): 2025-12-04T10:08:29.2062029Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2062069Z method(*args, **kwargs) 2025-12-04T10:08:29.2062245Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2062291Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2062330Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2062493Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2062536Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2062574Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2062732Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2062775Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2062811Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2063008Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2063046Z fn(*args, **kwargs) 2025-12-04T10:08:29.2063212Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2063252Z raise e_tracked from e 2025-12-04T10:08:29.2063301Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2063305Z 2025-12-04T10:08:29.2063397Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2063480Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2063560Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2063565Z 2025-12-04T10:08:29.2063650Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2063753Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2063787Z If the test 2025-12-04T10:08:29.2063881Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2063943Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2064038Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2064120Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2064144Z 2025-12-04T10:08:29.2064235Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2064319Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2064370Z the following. 2025-12-04T10:08:29.2064372Z 2025-12-04T10:08:29.2064473Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2064565Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2064616Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2064679Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2064738Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2064741Z 2025-12-04T10:08:29.2064773Z Got: 2025-12-04T10:08:29.2064828Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2064875Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2064943Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2064989Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2065036Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2065039Z 2025-12-04T10:08:29.2065086Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2065131Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2065176Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2065220Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2065270Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2065272Z 2025-12-04T10:08:29.2065274Z 2025-12-04T10:08:29.2065319Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2065362Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2065406Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2065454Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2065501Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2065503Z 2025-12-04T10:08:29.2065547Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2065594Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2065638Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2065683Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2065746Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2065787Z dtype=torch.float64) 2025-12-04T10:08:29.2065789Z 2025-12-04T10:08:29.2065823Z Expected: 2025-12-04T10:08:29.2065876Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2065920Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2065966Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2066010Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2066058Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2066059Z 2025-12-04T10:08:29.2066103Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2066150Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2066194Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2066240Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2066288Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2066290Z 2025-12-04T10:08:29.2066292Z 2025-12-04T10:08:29.2066336Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2066379Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2066423Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2066467Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2066525Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2066527Z 2025-12-04T10:08:29.2066572Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2066616Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2066692Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2066737Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2066800Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2066839Z dtype=torch.float64) 2025-12-04T10:08:29.2066841Z 2025-12-04T10:08:29.2067130Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2067132Z 2025-12-04T10:08:29.2067218Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2067420Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2067423Z 2025-12-04T10:08:29.2067511Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2067605Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2067650Z Traceback (most recent call last): 2025-12-04T10:08:29.2067822Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2067863Z return test(*args, **kwargs) 2025-12-04T10:08:29.2067900Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2068006Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2068073Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2068244Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2068365Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2068418Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2068579Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2068636Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2068678Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2068833Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2068898Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2068944Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2069082Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2069128Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2069168Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2069320Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2069369Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2069523Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2069564Z raise GradcheckError( 2025-12-04T10:08:29.2069654Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2069656Z 2025-12-04T10:08:29.2069749Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2069841Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2069921Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2069924Z 2025-12-04T10:08:29.2070018Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2070132Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2070167Z If the test 2025-12-04T10:08:29.2070262Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2070323Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2070417Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2070498Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2070500Z 2025-12-04T10:08:29.2070603Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2070689Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2070726Z the following. 2025-12-04T10:08:29.2070728Z 2025-12-04T10:08:29.2070818Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2070908Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2070959Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2071023Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2071083Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2071085Z 2025-12-04T10:08:29.2071118Z Got: 2025-12-04T10:08:29.2071173Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2071220Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2071267Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2071315Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2071362Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2071365Z 2025-12-04T10:08:29.2071410Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2071456Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2071501Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2071546Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2071597Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2071599Z 2025-12-04T10:08:29.2071601Z 2025-12-04T10:08:29.2071645Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2071689Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2071733Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2071777Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2071826Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2071828Z 2025-12-04T10:08:29.2071872Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2071917Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2071962Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2072007Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2072070Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2072111Z dtype=torch.float64) 2025-12-04T10:08:29.2072113Z 2025-12-04T10:08:29.2072147Z Expected: 2025-12-04T10:08:29.2072200Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2072245Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2072290Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2072333Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2072392Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2072394Z 2025-12-04T10:08:29.2072438Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2072483Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2072555Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2072602Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2072650Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2072652Z 2025-12-04T10:08:29.2072654Z 2025-12-04T10:08:29.2072698Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2072741Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2072785Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2072830Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2072888Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2072891Z 2025-12-04T10:08:29.2072993Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2073037Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2073081Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2073129Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2073193Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2073233Z dtype=torch.float64) 2025-12-04T10:08:29.2073235Z 2025-12-04T10:08:29.2073318Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2073320Z 2025-12-04T10:08:29.2073364Z Traceback (most recent call last): 2025-12-04T10:08:29.2073522Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2073561Z method(*args, **kwargs) 2025-12-04T10:08:29.2073740Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2073786Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2073828Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2073990Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2074036Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2074073Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2074233Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2074273Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2074310Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2074461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2074503Z fn(*args, **kwargs) 2025-12-04T10:08:29.2074669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2074710Z raise e_tracked from e 2025-12-04T10:08:29.2074757Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2074761Z 2025-12-04T10:08:29.2074855Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2074938Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2075018Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2075020Z 2025-12-04T10:08:29.2075106Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2075208Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2075243Z If the test 2025-12-04T10:08:29.2075337Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2075419Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2075515Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2075612Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2075628Z 2025-12-04T10:08:29.2075718Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2075804Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2075840Z the following. 2025-12-04T10:08:29.2075842Z 2025-12-04T10:08:29.2075931Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2076020Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2076072Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2076136Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2076217Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2076219Z 2025-12-04T10:08:29.2076251Z Got: 2025-12-04T10:08:29.2076307Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2076355Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2076404Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2076449Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2076497Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2076499Z 2025-12-04T10:08:29.2076543Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2076588Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2076632Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2076678Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2076730Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2076733Z 2025-12-04T10:08:29.2076735Z 2025-12-04T10:08:29.2076779Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2076823Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2076868Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2076912Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2076958Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2076960Z 2025-12-04T10:08:29.2077005Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2077048Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2077092Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2077135Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2077200Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2077241Z dtype=torch.float64) 2025-12-04T10:08:29.2077244Z 2025-12-04T10:08:29.2077279Z Expected: 2025-12-04T10:08:29.2077332Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2077376Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2077422Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2077466Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2077512Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2077514Z 2025-12-04T10:08:29.2077560Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2077605Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2077650Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2077694Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2077744Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2077745Z 2025-12-04T10:08:29.2077767Z 2025-12-04T10:08:29.2077814Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2077857Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2077903Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2077971Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2078020Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2078022Z 2025-12-04T10:08:29.2078066Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2078111Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2078154Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2078199Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2078261Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2078302Z dtype=torch.float64) 2025-12-04T10:08:29.2078304Z 2025-12-04T10:08:29.2078610Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2078614Z 2025-12-04T10:08:29.2078690Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2078891Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2078894Z 2025-12-04T10:08:29.2078981Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2079077Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2079124Z Traceback (most recent call last): 2025-12-04T10:08:29.2079299Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2079341Z return test(*args, **kwargs) 2025-12-04T10:08:29.2079380Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2079485Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2079551Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2079719Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2079841Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2079893Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2080056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2080113Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2080157Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2080311Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2080379Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2080423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2080563Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2080609Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2080647Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2081978Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2082032Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2082838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2082896Z raise GradcheckError( 2025-12-04T10:08:29.2083037Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2083039Z 2025-12-04T10:08:29.2083138Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2083236Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2083317Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2083319Z 2025-12-04T10:08:29.2083406Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2083510Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2083545Z If the test 2025-12-04T10:08:29.2083654Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2083715Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2085759Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2085848Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2085851Z 2025-12-04T10:08:29.2085947Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2086034Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2086072Z the following. 2025-12-04T10:08:29.2086074Z 2025-12-04T10:08:29.2086163Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2086255Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2086306Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2086372Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2086432Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2086437Z 2025-12-04T10:08:29.2086469Z Got: 2025-12-04T10:08:29.2086526Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2086574Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2086620Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2086669Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2086716Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2086720Z 2025-12-04T10:08:29.2086764Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2086811Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2086856Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2086902Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2086953Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2086955Z 2025-12-04T10:08:29.2086957Z 2025-12-04T10:08:29.2087005Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2087050Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2087095Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2087138Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2087186Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2087188Z 2025-12-04T10:08:29.2087234Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2087280Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2087324Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2087371Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2087502Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2087546Z dtype=torch.float64) 2025-12-04T10:08:29.2087548Z 2025-12-04T10:08:29.2087582Z Expected: 2025-12-04T10:08:29.2087670Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2087716Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2087763Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2087818Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2087866Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2087868Z 2025-12-04T10:08:29.2087912Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2087957Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2088001Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2088047Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2088097Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2088101Z 2025-12-04T10:08:29.2088103Z 2025-12-04T10:08:29.2088149Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2088197Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2088241Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2088286Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2088333Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2088335Z 2025-12-04T10:08:29.2088381Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2088425Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2088469Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2088515Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2088578Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2088621Z dtype=torch.float64) 2025-12-04T10:08:29.2088623Z 2025-12-04T10:08:29.2088706Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2088711Z 2025-12-04T10:08:29.2088758Z Traceback (most recent call last): 2025-12-04T10:08:29.2088917Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2088956Z method(*args, **kwargs) 2025-12-04T10:08:29.2089134Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2089179Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2089218Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2089378Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2089422Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2089460Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2089620Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2089662Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2089699Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2089851Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2089889Z fn(*args, **kwargs) 2025-12-04T10:08:29.2090056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2090096Z raise e_tracked from e 2025-12-04T10:08:29.2090142Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2090144Z 2025-12-04T10:08:29.2090236Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2090334Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2090415Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2090417Z 2025-12-04T10:08:29.2090529Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2090633Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2090669Z If the test 2025-12-04T10:08:29.2090775Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2090836Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2090931Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2091015Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2091017Z 2025-12-04T10:08:29.2091107Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2091195Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2091231Z the following. 2025-12-04T10:08:29.2091233Z 2025-12-04T10:08:29.2091324Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2091415Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2091467Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2091530Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2091593Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2091595Z 2025-12-04T10:08:29.2091628Z Got: 2025-12-04T10:08:29.2091683Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2091730Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2091776Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2091821Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2091869Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2091871Z 2025-12-04T10:08:29.2091916Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2091962Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2092008Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2092052Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2092105Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2092107Z 2025-12-04T10:08:29.2092109Z 2025-12-04T10:08:29.2092152Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2092196Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2092240Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2092284Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2092330Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2092333Z 2025-12-04T10:08:29.2092379Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2092422Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2092469Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2092513Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2092576Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2092617Z dtype=torch.float64) 2025-12-04T10:08:29.2092619Z 2025-12-04T10:08:29.2092655Z Expected: 2025-12-04T10:08:29.2092708Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2092753Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2092798Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2092842Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2092888Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2092904Z 2025-12-04T10:08:29.2093029Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2093075Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2093153Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2093199Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2093248Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2093266Z 2025-12-04T10:08:29.2093267Z 2025-12-04T10:08:29.2093316Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2093360Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2093404Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2093448Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2093494Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2093496Z 2025-12-04T10:08:29.2093541Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2093587Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2093631Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2093681Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2093743Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2093784Z dtype=torch.float64) 2025-12-04T10:08:29.2093788Z 2025-12-04T10:08:29.2094080Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2094082Z 2025-12-04T10:08:29.2094156Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2094358Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2094361Z 2025-12-04T10:08:29.2094448Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2094543Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2094588Z Traceback (most recent call last): 2025-12-04T10:08:29.2094758Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2094800Z return test(*args, **kwargs) 2025-12-04T10:08:29.2094839Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2094942Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2095007Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2095174Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2095295Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2095350Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2095512Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2095570Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2095614Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2095768Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2095834Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2095877Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2096037Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2096084Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2096123Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2096302Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2096354Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2096508Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2096562Z raise GradcheckError( 2025-12-04T10:08:29.2096652Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2096654Z 2025-12-04T10:08:29.2096746Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2096829Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2096909Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2096911Z 2025-12-04T10:08:29.2096997Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2097101Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2097138Z If the test 2025-12-04T10:08:29.2097233Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2097295Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2097390Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2097471Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2097473Z 2025-12-04T10:08:29.2097563Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2097648Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2097683Z the following. 2025-12-04T10:08:29.2097686Z 2025-12-04T10:08:29.2097776Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2097866Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2097920Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2097982Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2098044Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2098047Z 2025-12-04T10:08:29.2098080Z Got: 2025-12-04T10:08:29.2098135Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2098181Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2098228Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2098273Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2098321Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2098323Z 2025-12-04T10:08:29.2098369Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2098414Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2098460Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2098504Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2098554Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2098557Z 2025-12-04T10:08:29.2098559Z 2025-12-04T10:08:29.2098603Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2098646Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2098689Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2098734Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2098779Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2098781Z 2025-12-04T10:08:29.2098829Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2098887Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2098933Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2098999Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2099063Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2099104Z dtype=torch.float64) 2025-12-04T10:08:29.2099117Z 2025-12-04T10:08:29.2099153Z Expected: 2025-12-04T10:08:29.2099206Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2099251Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2099296Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2099340Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2099387Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2099390Z 2025-12-04T10:08:29.2099434Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2099479Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2099523Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2099572Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2099621Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2099623Z 2025-12-04T10:08:29.2099624Z 2025-12-04T10:08:29.2099670Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2099714Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2099757Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2099801Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2099847Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2099849Z 2025-12-04T10:08:29.2099893Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2099938Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2099981Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2100026Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2100089Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2100131Z dtype=torch.float64) 2025-12-04T10:08:29.2100132Z 2025-12-04T10:08:29.2100214Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2100217Z 2025-12-04T10:08:29.2100263Z Traceback (most recent call last): 2025-12-04T10:08:29.2100416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2100456Z method(*args, **kwargs) 2025-12-04T10:08:29.2100631Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2100678Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2100716Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2100877Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2100922Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2100958Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2101116Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2101157Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2101193Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2101344Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2101382Z fn(*args, **kwargs) 2025-12-04T10:08:29.2101564Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2101605Z raise e_tracked from e 2025-12-04T10:08:29.2101650Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2101652Z 2025-12-04T10:08:29.2101766Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2101848Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2101929Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2101941Z 2025-12-04T10:08:29.2102025Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2102128Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2102162Z If the test 2025-12-04T10:08:29.2102256Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2102317Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2102412Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2102494Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2102497Z 2025-12-04T10:08:29.2102588Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2102673Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2102711Z the following. 2025-12-04T10:08:29.2102714Z 2025-12-04T10:08:29.2102804Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2102893Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2102985Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2103048Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2103109Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2103111Z 2025-12-04T10:08:29.2103143Z Got: 2025-12-04T10:08:29.2103199Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2103245Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2103292Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2103338Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2103386Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2103388Z 2025-12-04T10:08:29.2103433Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2103480Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2103527Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2103572Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2103621Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2103623Z 2025-12-04T10:08:29.2103625Z 2025-12-04T10:08:29.2103670Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2103715Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2103759Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2103805Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2103852Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2103854Z 2025-12-04T10:08:29.2103898Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2103943Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2103987Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2104032Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2104094Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2104136Z dtype=torch.float64) 2025-12-04T10:08:29.2104138Z 2025-12-04T10:08:29.2104171Z Expected: 2025-12-04T10:08:29.2104227Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2104293Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2104338Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2104411Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2104459Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2104460Z 2025-12-04T10:08:29.2104505Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2104566Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2104611Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2104655Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2104704Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2104706Z 2025-12-04T10:08:29.2104708Z 2025-12-04T10:08:29.2104752Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2104798Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2104842Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2104886Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2104934Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2104936Z 2025-12-04T10:08:29.2104981Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2105025Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2105070Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2105114Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2105176Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2105216Z dtype=torch.float64) 2025-12-04T10:08:29.2105217Z 2025-12-04T10:08:29.2105510Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2105513Z 2025-12-04T10:08:29.2105589Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2105793Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2105795Z 2025-12-04T10:08:29.2105883Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2105976Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2106022Z Traceback (most recent call last): 2025-12-04T10:08:29.2106190Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2106233Z return test(*args, **kwargs) 2025-12-04T10:08:29.2106269Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2106374Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2106439Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2106610Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2106731Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2106785Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2106946Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2107002Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2107044Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2107214Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2107281Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2107359Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2107500Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2107545Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2107595Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2107746Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2107797Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2107950Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2107992Z raise GradcheckError( 2025-12-04T10:08:29.2108081Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2108084Z 2025-12-04T10:08:29.2108177Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2108262Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2108343Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2108345Z 2025-12-04T10:08:29.2108428Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2108533Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2108568Z If the test 2025-12-04T10:08:29.2108662Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2108722Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2108817Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2108899Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2108902Z 2025-12-04T10:08:29.2108992Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2109078Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2109114Z the following. 2025-12-04T10:08:29.2109116Z 2025-12-04T10:08:29.2109206Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2109296Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2109348Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2109410Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2109471Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2109473Z 2025-12-04T10:08:29.2109505Z Got: 2025-12-04T10:08:29.2109561Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2109608Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2109655Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2109700Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2109750Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2109753Z 2025-12-04T10:08:29.2109797Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2109843Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2109888Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2109933Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2109981Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2109983Z 2025-12-04T10:08:29.2109985Z 2025-12-04T10:08:29.2110030Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2110073Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2110133Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2110177Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2110225Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2110251Z 2025-12-04T10:08:29.2110297Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2110341Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2110396Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2110441Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2110504Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2110546Z dtype=torch.float64) 2025-12-04T10:08:29.2110548Z 2025-12-04T10:08:29.2110583Z Expected: 2025-12-04T10:08:29.2110636Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2110682Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2110729Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2110775Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2110826Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2110829Z 2025-12-04T10:08:29.2110874Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2110918Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2110964Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2111009Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2111058Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2111060Z 2025-12-04T10:08:29.2111062Z 2025-12-04T10:08:29.2111106Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2111150Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2111193Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2111238Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2111283Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2111286Z 2025-12-04T10:08:29.2111332Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2111376Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2111422Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2111467Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2111529Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2111570Z dtype=torch.float64) 2025-12-04T10:08:29.2111571Z 2025-12-04T10:08:29.2111654Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2111656Z 2025-12-04T10:08:29.2111701Z Traceback (most recent call last): 2025-12-04T10:08:29.2111857Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2111896Z method(*args, **kwargs) 2025-12-04T10:08:29.2112073Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2112120Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2112158Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2112318Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2112362Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2112400Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2112560Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2112602Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2112639Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2112805Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2112843Z fn(*args, **kwargs) 2025-12-04T10:08:29.2113080Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2113121Z raise e_tracked from e 2025-12-04T10:08:29.2113167Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2113185Z 2025-12-04T10:08:29.2113277Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2113359Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2113440Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2113442Z 2025-12-04T10:08:29.2113529Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2113632Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2113668Z If the test 2025-12-04T10:08:29.2113762Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2113827Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2113922Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2114004Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2114007Z 2025-12-04T10:08:29.2114097Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2114182Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2114219Z the following. 2025-12-04T10:08:29.2114221Z 2025-12-04T10:08:29.2114308Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2114397Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2114448Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2114511Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2114572Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2114575Z 2025-12-04T10:08:29.2114608Z Got: 2025-12-04T10:08:29.2114663Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2114711Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2114758Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2114803Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2114850Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2114852Z 2025-12-04T10:08:29.2114897Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2114942Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2114986Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2115031Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2115081Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2115084Z 2025-12-04T10:08:29.2115086Z 2025-12-04T10:08:29.2115131Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2115178Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2115221Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2115269Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2115316Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2115318Z 2025-12-04T10:08:29.2115364Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2115408Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2115453Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2115499Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2115578Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2115621Z dtype=torch.float64) 2025-12-04T10:08:29.2115636Z 2025-12-04T10:08:29.2115683Z Expected: 2025-12-04T10:08:29.2115737Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2115781Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2115828Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2115885Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2115933Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2115935Z 2025-12-04T10:08:29.2115979Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2116025Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2116069Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2116116Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2116164Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2116166Z 2025-12-04T10:08:29.2116168Z 2025-12-04T10:08:29.2116217Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2116260Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2116304Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2116349Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2116396Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2116397Z 2025-12-04T10:08:29.2116441Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2116486Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2116531Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2116577Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2116644Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2116688Z dtype=torch.float64) 2025-12-04T10:08:29.2116690Z 2025-12-04T10:08:29.2116979Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2116982Z 2025-12-04T10:08:29.2117056Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2117260Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2117263Z 2025-12-04T10:08:29.2117350Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2117444Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2117491Z Traceback (most recent call last): 2025-12-04T10:08:29.2117666Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2117709Z return test(*args, **kwargs) 2025-12-04T10:08:29.2117750Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2117854Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2117919Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2118089Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2118213Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2118266Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2118445Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2118505Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2118572Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2118727Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2118793Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2118849Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2118989Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2119035Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2119074Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2119225Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2119275Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2119430Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2119473Z raise GradcheckError( 2025-12-04T10:08:29.2119564Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2119566Z 2025-12-04T10:08:29.2119657Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2119740Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2119819Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2119821Z 2025-12-04T10:08:29.2119906Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2120009Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2120046Z If the test 2025-12-04T10:08:29.2120139Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2120201Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2120301Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2120383Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2120386Z 2025-12-04T10:08:29.2120477Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2120565Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2120606Z the following. 2025-12-04T10:08:29.2120608Z 2025-12-04T10:08:29.2120696Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2120789Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2120842Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2120907Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2120968Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2120970Z 2025-12-04T10:08:29.2121003Z Got: 2025-12-04T10:08:29.2121061Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2121109Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2121155Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2121200Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2121247Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2121248Z 2025-12-04T10:08:29.2121295Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2121339Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2121384Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2121429Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2121492Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2121494Z 2025-12-04T10:08:29.2121496Z 2025-12-04T10:08:29.2121542Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2121610Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2121655Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2121700Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2121760Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2121763Z 2025-12-04T10:08:29.2121808Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2121852Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2121898Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2121946Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2122009Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2122052Z dtype=torch.float64) 2025-12-04T10:08:29.2122054Z 2025-12-04T10:08:29.2122088Z Expected: 2025-12-04T10:08:29.2122142Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2122191Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2122239Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2122282Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2122331Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2122333Z 2025-12-04T10:08:29.2122378Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2122423Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2122466Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2122512Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2122561Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2122564Z 2025-12-04T10:08:29.2122565Z 2025-12-04T10:08:29.2122610Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2122655Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2122701Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2122745Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2122791Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2122794Z 2025-12-04T10:08:29.2122839Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2122883Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2122975Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2123021Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2123083Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2123124Z dtype=torch.float64) 2025-12-04T10:08:29.2123126Z 2025-12-04T10:08:29.2123209Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2123212Z 2025-12-04T10:08:29.2123258Z Traceback (most recent call last): 2025-12-04T10:08:29.2123416Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2123455Z method(*args, **kwargs) 2025-12-04T10:08:29.2123633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2123677Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2123717Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2123876Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2123919Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2123979Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2124139Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2124210Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2124248Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2124398Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2124451Z fn(*args, **kwargs) 2025-12-04T10:08:29.2124617Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2124657Z raise e_tracked from e 2025-12-04T10:08:29.2124702Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2124704Z 2025-12-04T10:08:29.2124798Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2124879Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2124961Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2124963Z 2025-12-04T10:08:29.2125047Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2125154Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2125188Z If the test 2025-12-04T10:08:29.2125281Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2125345Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2125440Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2125522Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2125524Z 2025-12-04T10:08:29.2125614Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2125701Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2125739Z the following. 2025-12-04T10:08:29.2125741Z 2025-12-04T10:08:29.2125831Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2125923Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2125975Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2126037Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2126099Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2126101Z 2025-12-04T10:08:29.2126133Z Got: 2025-12-04T10:08:29.2126189Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2126235Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2126283Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2126327Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2126376Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2126378Z 2025-12-04T10:08:29.2126422Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2126469Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2126513Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2126559Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2126608Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2126611Z 2025-12-04T10:08:29.2126612Z 2025-12-04T10:08:29.2126658Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2126702Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2126747Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2126792Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2126838Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2126841Z 2025-12-04T10:08:29.2126898Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2126943Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2127012Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2127057Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2127120Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2127177Z dtype=torch.float64) 2025-12-04T10:08:29.2127179Z 2025-12-04T10:08:29.2127213Z Expected: 2025-12-04T10:08:29.2127266Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2127311Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2127359Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2127403Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2127450Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2127452Z 2025-12-04T10:08:29.2127498Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2127543Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2127589Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2127633Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2127683Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2127686Z 2025-12-04T10:08:29.2127688Z 2025-12-04T10:08:29.2127732Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2127776Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2127820Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2127865Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2127911Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2127913Z 2025-12-04T10:08:29.2127960Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2128004Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2128049Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2128095Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2128158Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2128199Z dtype=torch.float64) 2025-12-04T10:08:29.2128202Z 2025-12-04T10:08:29.2128491Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2128494Z 2025-12-04T10:08:29.2128568Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2128770Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2128773Z 2025-12-04T10:08:29.2128861Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2128958Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2129004Z Traceback (most recent call last): 2025-12-04T10:08:29.2129176Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2129219Z return test(*args, **kwargs) 2025-12-04T10:08:29.2129256Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2129362Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2129426Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2129593Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2129729Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2129792Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2129964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2130033Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2130076Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2130230Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2130297Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2130340Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2130480Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2130526Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2130564Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2130717Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2130768Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2130920Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2130963Z raise GradcheckError( 2025-12-04T10:08:29.2131052Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2131054Z 2025-12-04T10:08:29.2131148Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2131231Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2131312Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2131314Z 2025-12-04T10:08:29.2131398Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2131503Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2131539Z If the test 2025-12-04T10:08:29.2131633Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2131695Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2131791Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2131873Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2131875Z 2025-12-04T10:08:29.2131965Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2132050Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2132086Z the following. 2025-12-04T10:08:29.2132088Z 2025-12-04T10:08:29.2132179Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2132268Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2132322Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2132385Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2132446Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2132449Z 2025-12-04T10:08:29.2132482Z Got: 2025-12-04T10:08:29.2132538Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2132584Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2132631Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2132675Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2132723Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2132725Z 2025-12-04T10:08:29.2132789Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2132837Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2132882Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2133004Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2133055Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2133057Z 2025-12-04T10:08:29.2133071Z 2025-12-04T10:08:29.2133117Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2133162Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2133205Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2133250Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2133296Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2133298Z 2025-12-04T10:08:29.2133343Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2133388Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2133433Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2133479Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2133545Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2133585Z dtype=torch.float64) 2025-12-04T10:08:29.2133587Z 2025-12-04T10:08:29.2133623Z Expected: 2025-12-04T10:08:29.2133675Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2133720Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2133765Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2133809Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2133855Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2133857Z 2025-12-04T10:08:29.2133902Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2133946Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2133991Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2134038Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2134088Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2134090Z 2025-12-04T10:08:29.2134092Z 2025-12-04T10:08:29.2134136Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2134182Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2134225Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2134269Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2134315Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2134317Z 2025-12-04T10:08:29.2134363Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2134406Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2134451Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2134496Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2134562Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2134604Z dtype=torch.float64) 2025-12-04T10:08:29.2134606Z 2025-12-04T10:08:29.2134689Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2134692Z 2025-12-04T10:08:29.2134738Z Traceback (most recent call last): 2025-12-04T10:08:29.2134895Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2134935Z method(*args, **kwargs) 2025-12-04T10:08:29.2135109Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2135155Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2135211Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2135373Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2135444Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2135484Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2135641Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2135693Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2135729Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2135881Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2135918Z fn(*args, **kwargs) 2025-12-04T10:08:29.2136086Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2136127Z raise e_tracked from e 2025-12-04T10:08:29.2136173Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2136175Z 2025-12-04T10:08:29.2136268Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2136351Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2136431Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2136435Z 2025-12-04T10:08:29.2136519Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2136622Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2136659Z If the test 2025-12-04T10:08:29.2136753Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2136814Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2136910Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2136991Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2136993Z 2025-12-04T10:08:29.2137085Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2137170Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2137206Z the following. 2025-12-04T10:08:29.2137208Z 2025-12-04T10:08:29.2137297Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2137387Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2137438Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2137502Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2137562Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2137564Z 2025-12-04T10:08:29.2137599Z Got: 2025-12-04T10:08:29.2137654Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2137702Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2137748Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2137794Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2137841Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2137843Z 2025-12-04T10:08:29.2137888Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2137934Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2137979Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2138023Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2138073Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2138075Z 2025-12-04T10:08:29.2138077Z 2025-12-04T10:08:29.2138121Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2138179Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2138224Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2138268Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2138346Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2138348Z 2025-12-04T10:08:29.2138393Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2138438Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2138494Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2138539Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2138602Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2138644Z dtype=torch.float64) 2025-12-04T10:08:29.2138646Z 2025-12-04T10:08:29.2138680Z Expected: 2025-12-04T10:08:29.2138733Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2138778Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2138823Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2138867Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2138916Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2138918Z 2025-12-04T10:08:29.2138962Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2139009Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2139052Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2139099Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2139148Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2139149Z 2025-12-04T10:08:29.2139151Z 2025-12-04T10:08:29.2139196Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2139239Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2139284Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2139328Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2139376Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2139378Z 2025-12-04T10:08:29.2139423Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2139467Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2139513Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2139558Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2139622Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2139662Z dtype=torch.float64) 2025-12-04T10:08:29.2139663Z 2025-12-04T10:08:29.2139952Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2139954Z 2025-12-04T10:08:29.2140028Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2140235Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2140237Z 2025-12-04T10:08:29.2140324Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2140419Z ________ TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 _________ 2025-12-04T10:08:29.2140464Z Traceback (most recent call last): 2025-12-04T10:08:29.2140635Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2140677Z return test(*args, **kwargs) 2025-12-04T10:08:29.2140715Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2140830Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 37, in test_fn_grad 2025-12-04T10:08:29.2140897Z self._grad_test_helper(device, dtype, op, op.get_op()) 2025-12-04T10:08:29.2141088Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5623, in _grad_test_helper 2025-12-04T10:08:29.2141209Z return self._check_helper(device, dtype, op, variant, 'gradcheck', check_forward_ad=check_forward_ad, 2025-12-04T10:08:29.2141272Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2141432Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5592, in _check_helper 2025-12-04T10:08:29.2141489Z self.assertTrue(gradcheck(fn, gradcheck_args, 2025-12-04T10:08:29.2141531Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2141687Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5182, in gradcheck 2025-12-04T10:08:29.2141751Z return torch.autograd.gradcheck(fn, inputs, **kwargs) 2025-12-04T10:08:29.2141796Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2141936Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2141983Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2142021Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2142173Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2140, in _gradcheck_helper 2025-12-04T10:08:29.2142222Z _test_batched_grad(tupled_inputs, o, i) 2025-12-04T10:08:29.2142377Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1192, in _test_batched_grad 2025-12-04T10:08:29.2142418Z raise GradcheckError( 2025-12-04T10:08:29.2142508Z torch.autograd.gradcheck.GradcheckError: For output 0 and input 0: 2025-12-04T10:08:29.2142511Z 2025-12-04T10:08:29.2142603Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2142687Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2142766Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2142769Z 2025-12-04T10:08:29.2142854Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2142991Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2143027Z If the test 2025-12-04T10:08:29.2143121Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2143182Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2143277Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2143358Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2143360Z 2025-12-04T10:08:29.2143452Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2143541Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2143577Z the following. 2025-12-04T10:08:29.2143579Z 2025-12-04T10:08:29.2143667Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2143760Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2143810Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2143875Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2143936Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2143938Z 2025-12-04T10:08:29.2143971Z Got: 2025-12-04T10:08:29.2144028Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2144075Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2144140Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2144187Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2144261Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2144263Z 2025-12-04T10:08:29.2146634Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2146689Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2146776Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2146821Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2146872Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2146875Z 2025-12-04T10:08:29.2146876Z 2025-12-04T10:08:29.2146922Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2146965Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2147010Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2147055Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2147102Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2147105Z 2025-12-04T10:08:29.2147151Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2147195Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2147239Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2147287Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2147350Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2147392Z dtype=torch.float64) 2025-12-04T10:08:29.2147395Z 2025-12-04T10:08:29.2147429Z Expected: 2025-12-04T10:08:29.2147483Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2147527Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2147574Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2147617Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2147664Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2147669Z 2025-12-04T10:08:29.2147713Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2147758Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2147802Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2147850Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2147899Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2147901Z 2025-12-04T10:08:29.2147903Z 2025-12-04T10:08:29.2147948Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2147991Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2148035Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2148082Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2148131Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2148133Z 2025-12-04T10:08:29.2148182Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2148226Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2148271Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2148318Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2148381Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2148422Z dtype=torch.float64) 2025-12-04T10:08:29.2148424Z 2025-12-04T10:08:29.2148507Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2148509Z 2025-12-04T10:08:29.2148554Z Traceback (most recent call last): 2025-12-04T10:08:29.2148725Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2148765Z method(*args, **kwargs) 2025-12-04T10:08:29.2148953Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2149010Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2149050Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2149210Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2149266Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2149304Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2149461Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2149502Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2149540Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2149690Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2149729Z fn(*args, **kwargs) 2025-12-04T10:08:29.2149899Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2149942Z raise e_tracked from e 2025-12-04T10:08:29.2149987Z Exception: For output 0 and input 0: 2025-12-04T10:08:29.2149990Z 2025-12-04T10:08:29.2150084Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2150167Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2150248Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2150251Z 2025-12-04T10:08:29.2150335Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2150436Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2150473Z If the test 2025-12-04T10:08:29.2150566Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2150629Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2150726Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2150807Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2150810Z 2025-12-04T10:08:29.2150899Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2150983Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2151019Z the following. 2025-12-04T10:08:29.2151021Z 2025-12-04T10:08:29.2151110Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2151199Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2151253Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2151316Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2151378Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2151382Z 2025-12-04T10:08:29.2151414Z Got: 2025-12-04T10:08:29.2151470Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2151517Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2151565Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2151610Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2151658Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2151660Z 2025-12-04T10:08:29.2151705Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2151751Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2151796Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2151854Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2151904Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2151906Z 2025-12-04T10:08:29.2151925Z 2025-12-04T10:08:29.2151980Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2152025Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2152068Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2152128Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2152174Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2152176Z 2025-12-04T10:08:29.2152221Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2152265Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2152309Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2152353Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2152417Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2152458Z dtype=torch.float64) 2025-12-04T10:08:29.2152460Z 2025-12-04T10:08:29.2152496Z Expected: 2025-12-04T10:08:29.2152550Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2152595Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2152640Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2152685Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2152731Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2152733Z 2025-12-04T10:08:29.2152778Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2152822Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2152867Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2152912Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2153017Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2153019Z 2025-12-04T10:08:29.2153021Z 2025-12-04T10:08:29.2153066Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2153112Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2153156Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2153201Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2153248Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2153251Z 2025-12-04T10:08:29.2153295Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2153340Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2153383Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2153428Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2153490Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2153532Z dtype=torch.float64) 2025-12-04T10:08:29.2153534Z 2025-12-04T10:08:29.2153830Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2153833Z 2025-12-04T10:08:29.2153909Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2154108Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2154111Z 2025-12-04T10:08:29.2154198Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2154295Z _____ TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 _____ 2025-12-04T10:08:29.2154341Z Traceback (most recent call last): 2025-12-04T10:08:29.2154527Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2154582Z return test(*args, **kwargs) 2025-12-04T10:08:29.2154633Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2154744Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 75, in test_fn_gradgrad 2025-12-04T10:08:29.2154826Z self._check_helper(device, dtype, op, op.get_op(), "bwgrad_bwgrad") 2025-12-04T10:08:29.2155002Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5617, in _check_helper 2025-12-04T10:08:29.2155075Z self.assertTrue(gradgradcheck(fn, gradcheck_args, **kwargs)) 2025-12-04T10:08:29.2155122Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2155283Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5202, in gradgradcheck 2025-12-04T10:08:29.2155375Z return torch.autograd.gradgradcheck(fn, inputs, grad_outputs, **kwargs) 2025-12-04T10:08:29.2155423Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2155572Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2291, in gradgradcheck 2025-12-04T10:08:29.2155612Z return gradcheck( 2025-12-04T10:08:29.2155646Z ^^^^^^^^^^ 2025-12-04T10:08:29.2155790Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2155835Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2155874Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2156025Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.2156067Z _gradcheck_real_imag( 2025-12-04T10:08:29.2156224Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1489, in _gradcheck_real_imag 2025-12-04T10:08:29.2156261Z gradcheck_fn( 2025-12-04T10:08:29.2156408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.2156456Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.2156627Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.2156669Z raise GradcheckError( 2025-12-04T10:08:29.2156888Z torch.autograd.gradcheck.GradcheckError: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2156945Z numerical:(-0.39084068924293136-1405.505986244369j) 2025-12-04T10:08:29.2157005Z analytical:(-0.3908406912063411-0.15149921416268441j) 2025-12-04T10:08:29.2157007Z 2025-12-04T10:08:29.2157109Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2157219Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2157319Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2157322Z 2025-12-04T10:08:29.2157358Z Numerical: 2025-12-04T10:08:29.2157422Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2157466Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2157520Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2157561Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2157613Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2157654Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2157702Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2157742Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2157795Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2157848Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2157898Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2157951Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2157994Z ..., 2025-12-04T10:08:29.2158045Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158083Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2158143Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158182Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2158230Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158268Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2158316Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158355Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2158404Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158442Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2158491Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158569Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2158609Z Analytical: 2025-12-04T10:08:29.2158667Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2158707Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2158754Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158794Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2158844Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2158884Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2158932Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2158971Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2159020Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2159060Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2159108Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159146Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2159180Z ..., 2025-12-04T10:08:29.2159231Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159269Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2159318Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159357Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2159407Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159445Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2159493Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159531Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2159579Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159617Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2159667Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2159741Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2159745Z 2025-12-04T10:08:29.2159829Z The max per-element difference (slow mode) is: 6.114718200210563e-09. 2025-12-04T10:08:29.2159927Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2159972Z test might've passed in slow_mode! 2025-12-04T10:08:29.2159975Z 2025-12-04T10:08:29.2160061Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2160166Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2160168Z 2025-12-04T10:08:29.2160202Z If the test 2025-12-04T10:08:29.2160296Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2160350Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2160458Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2160506Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2160583Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2160668Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2160670Z 2025-12-04T10:08:29.2160752Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2160764Z 2025-12-04T10:08:29.2160809Z Traceback (most recent call last): 2025-12-04T10:08:29.2160964Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2161004Z method(*args, **kwargs) 2025-12-04T10:08:29.2161179Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2161225Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2161262Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2161429Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2161473Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2161512Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2161672Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2161714Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2161751Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2161901Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2161939Z fn(*args, **kwargs) 2025-12-04T10:08:29.2162105Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2162146Z raise e_tracked from e 2025-12-04T10:08:29.2162309Z Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2162366Z numerical:(-0.39084068924293136-1405.505986244369j) 2025-12-04T10:08:29.2162425Z analytical:(-0.3908406912063411-0.15149921416268441j) 2025-12-04T10:08:29.2162427Z 2025-12-04T10:08:29.2162527Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2162632Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2162731Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2162733Z 2025-12-04T10:08:29.2162767Z Numerical: 2025-12-04T10:08:29.2162829Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2162869Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2162920Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2162991Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2163044Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2163082Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2163134Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163172Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2163223Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2163263Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2163312Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163350Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2163383Z ..., 2025-12-04T10:08:29.2163431Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163470Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2163517Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163556Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2163626Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163666Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2163743Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163783Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2163831Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2163870Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2163931Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164006Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2164041Z Analytical: 2025-12-04T10:08:29.2164100Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2164139Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2164187Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164225Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2164277Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2164315Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2164363Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164404Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2164455Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2164494Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2164542Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164581Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2164614Z ..., 2025-12-04T10:08:29.2164662Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164700Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2164749Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164787Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2164836Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164874Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2164922Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2164963Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2165012Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2165049Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2165098Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2165172Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2165175Z 2025-12-04T10:08:29.2165256Z The max per-element difference (slow mode) is: 6.114718200210563e-09. 2025-12-04T10:08:29.2165352Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2165397Z test might've passed in slow_mode! 2025-12-04T10:08:29.2165399Z 2025-12-04T10:08:29.2165485Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2165588Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2165590Z 2025-12-04T10:08:29.2165625Z If the test 2025-12-04T10:08:29.2165720Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2165773Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2165869Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2165916Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2165993Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2166055Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2166058Z 2025-12-04T10:08:29.2166368Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2166370Z 2025-12-04T10:08:29.2166445Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2166682Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2166685Z 2025-12-04T10:08:29.2166772Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2166880Z _____ TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 _____ 2025-12-04T10:08:29.2166925Z Traceback (most recent call last): 2025-12-04T10:08:29.2167096Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2167139Z return test(*args, **kwargs) 2025-12-04T10:08:29.2167176Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2167287Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 75, in test_fn_gradgrad 2025-12-04T10:08:29.2167368Z self._check_helper(device, dtype, op, op.get_op(), "bwgrad_bwgrad") 2025-12-04T10:08:29.2167531Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5617, in _check_helper 2025-12-04T10:08:29.2167606Z self.assertTrue(gradgradcheck(fn, gradcheck_args, **kwargs)) 2025-12-04T10:08:29.2167654Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2167815Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5202, in gradgradcheck 2025-12-04T10:08:29.2167905Z return torch.autograd.gradgradcheck(fn, inputs, grad_outputs, **kwargs) 2025-12-04T10:08:29.2167951Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2168099Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2291, in gradgradcheck 2025-12-04T10:08:29.2168139Z return gradcheck( 2025-12-04T10:08:29.2168174Z ^^^^^^^^^^ 2025-12-04T10:08:29.2168313Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2168359Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2168397Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2168547Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.2168589Z _gradcheck_real_imag( 2025-12-04T10:08:29.2168744Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1489, in _gradcheck_real_imag 2025-12-04T10:08:29.2168780Z gradcheck_fn( 2025-12-04T10:08:29.2168926Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.2168972Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.2169145Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.2169189Z raise GradcheckError( 2025-12-04T10:08:29.2169408Z torch.autograd.gradcheck.GradcheckError: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2169467Z numerical:(1696144.6004526883-0.013355989004183888j) 2025-12-04T10:08:29.2169528Z analytical:(-0.39008194078835945-0.013355988641472659j) 2025-12-04T10:08:29.2169530Z 2025-12-04T10:08:29.2169630Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2169733Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2169831Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2169833Z 2025-12-04T10:08:29.2169868Z Numerical: 2025-12-04T10:08:29.2169944Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2169985Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170037Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170101Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2170155Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170193Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170255Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170293Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2170344Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170382Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170432Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170470Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2170503Z ..., 2025-12-04T10:08:29.2170552Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170591Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170642Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2170683Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2170732Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170770Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170820Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2170859Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2170907Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2170945Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2170995Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2171070Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2171106Z Analytical: 2025-12-04T10:08:29.2171165Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171204Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2171253Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171292Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2171342Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171381Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2171428Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171467Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2171516Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171555Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2171602Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171640Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2171672Z ..., 2025-12-04T10:08:29.2171721Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171759Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2171809Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2171847Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2171898Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2171936Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2171986Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2172024Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2172073Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2172111Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2172161Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2172233Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2172235Z 2025-12-04T10:08:29.2172313Z The max per-element difference (slow mode) is: 10243.111340285763. 2025-12-04T10:08:29.2172315Z 2025-12-04T10:08:29.2172317Z 2025-12-04T10:08:29.2172410Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2172412Z 2025-12-04T10:08:29.2172457Z Traceback (most recent call last): 2025-12-04T10:08:29.2172633Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2172675Z method(*args, **kwargs) 2025-12-04T10:08:29.2172854Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2172915Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2173005Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2173167Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2173211Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2173247Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2173408Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2173449Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2173488Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2173640Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2173678Z fn(*args, **kwargs) 2025-12-04T10:08:29.2173846Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2173889Z raise e_tracked from e 2025-12-04T10:08:29.2174053Z Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2174110Z numerical:(1696144.6004526883-0.013355989004183888j) 2025-12-04T10:08:29.2174169Z analytical:(-0.39008194078835945-0.013355988641472659j) 2025-12-04T10:08:29.2174172Z 2025-12-04T10:08:29.2174272Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2174375Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2174474Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2174476Z 2025-12-04T10:08:29.2174511Z Numerical: 2025-12-04T10:08:29.2174574Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2174613Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2174663Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2174702Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2174753Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2174791Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2174839Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2174878Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2174929Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2174966Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2175018Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175056Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2175089Z ..., 2025-12-04T10:08:29.2175137Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175177Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2175226Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2175265Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2175313Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175351Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2175400Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2175438Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2175502Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175541Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2175591Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2175692Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2175728Z Analytical: 2025-12-04T10:08:29.2175787Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175842Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2175890Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2175929Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2175978Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176017Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2176064Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176102Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2176152Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176190Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2176238Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176278Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2176310Z ..., 2025-12-04T10:08:29.2176359Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176399Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2176453Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2176491Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2176539Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176577Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2176627Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2176665Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2176713Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2176751Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2176802Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2176874Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2176877Z 2025-12-04T10:08:29.2176954Z The max per-element difference (slow mode) is: 10243.111340285763. 2025-12-04T10:08:29.2176956Z 2025-12-04T10:08:29.2176958Z 2025-12-04T10:08:29.2177258Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2177261Z 2025-12-04T10:08:29.2177334Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2177546Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2177549Z 2025-12-04T10:08:29.2177635Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2177735Z _____ TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 _____ 2025-12-04T10:08:29.2177779Z Traceback (most recent call last): 2025-12-04T10:08:29.2177951Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2177995Z return test(*args, **kwargs) 2025-12-04T10:08:29.2178033Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2178143Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 75, in test_fn_gradgrad 2025-12-04T10:08:29.2178224Z self._check_helper(device, dtype, op, op.get_op(), "bwgrad_bwgrad") 2025-12-04T10:08:29.2178386Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5617, in _check_helper 2025-12-04T10:08:29.2178474Z self.assertTrue(gradgradcheck(fn, gradcheck_args, **kwargs)) 2025-12-04T10:08:29.2178521Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2178707Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5202, in gradgradcheck 2025-12-04T10:08:29.2178797Z return torch.autograd.gradgradcheck(fn, inputs, grad_outputs, **kwargs) 2025-12-04T10:08:29.2178858Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2179004Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2291, in gradgradcheck 2025-12-04T10:08:29.2179043Z return gradcheck( 2025-12-04T10:08:29.2179077Z ^^^^^^^^^^ 2025-12-04T10:08:29.2179217Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2179262Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2179302Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2179453Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.2179498Z _gradcheck_real_imag( 2025-12-04T10:08:29.2179654Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1505, in _gradcheck_real_imag 2025-12-04T10:08:29.2179690Z gradcheck_fn( 2025-12-04T10:08:29.2179838Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.2179883Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.2180056Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.2180096Z raise GradcheckError( 2025-12-04T10:08:29.2180304Z torch.autograd.gradcheck.GradcheckError: While considering the real part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2180357Z numerical:(-3.8928576251059264-2196.420621897911j) 2025-12-04T10:08:29.2180410Z analytical:(-3.892857622953266+2.269277869184171j) 2025-12-04T10:08:29.2180413Z 2025-12-04T10:08:29.2180513Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2180615Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2180714Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2180716Z 2025-12-04T10:08:29.2180751Z Numerical: 2025-12-04T10:08:29.2180824Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2180880Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2180942Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2180995Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2181058Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2181111Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2181146Z ..., 2025-12-04T10:08:29.2181205Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2181257Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2181315Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2181366Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2181422Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2181476Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2181528Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2181563Z Analytical: 2025-12-04T10:08:29.2181654Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2181706Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2181764Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2181838Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2181898Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2181950Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2181999Z ..., 2025-12-04T10:08:29.2182055Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2182106Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2182162Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2182212Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2182268Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2182323Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2182375Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2182380Z 2025-12-04T10:08:29.2182461Z The max per-element difference (slow mode) is: 6.6884309542415565e-09. 2025-12-04T10:08:29.2182559Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2182605Z test might've passed in slow_mode! 2025-12-04T10:08:29.2182608Z 2025-12-04T10:08:29.2182694Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2182798Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2182800Z 2025-12-04T10:08:29.2182835Z If the test 2025-12-04T10:08:29.2182978Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2183031Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2183128Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2183175Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2183253Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2183320Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2183322Z 2025-12-04T10:08:29.2183401Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2183405Z 2025-12-04T10:08:29.2183449Z Traceback (most recent call last): 2025-12-04T10:08:29.2183606Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2183647Z method(*args, **kwargs) 2025-12-04T10:08:29.2183824Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2183869Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2183909Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2184069Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2184114Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2184151Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2184310Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2184352Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2184390Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2184542Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2184580Z fn(*args, **kwargs) 2025-12-04T10:08:29.2184748Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2184814Z raise e_tracked from e 2025-12-04T10:08:29.2184970Z Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2185064Z numerical:(-3.8928576251059264-2196.420621897911j) 2025-12-04T10:08:29.2185117Z analytical:(-3.892857622953266+2.269277869184171j) 2025-12-04T10:08:29.2185119Z 2025-12-04T10:08:29.2185219Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2185340Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2185439Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2185441Z 2025-12-04T10:08:29.2185475Z Numerical: 2025-12-04T10:08:29.2185547Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2185601Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2185662Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2185715Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2185776Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2185830Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2185863Z ..., 2025-12-04T10:08:29.2185921Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2185973Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2186030Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2186082Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2186140Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2186192Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2186244Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2186280Z Analytical: 2025-12-04T10:08:29.2186355Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2186406Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2186465Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2186516Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2186576Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2186627Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2186661Z ..., 2025-12-04T10:08:29.2186716Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2186771Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2186825Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2186877Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2186934Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2186989Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2187043Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2187045Z 2025-12-04T10:08:29.2187128Z The max per-element difference (slow mode) is: 6.6884309542415565e-09. 2025-12-04T10:08:29.2187227Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2187276Z test might've passed in slow_mode! 2025-12-04T10:08:29.2187278Z 2025-12-04T10:08:29.2187363Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2187466Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2187468Z 2025-12-04T10:08:29.2187501Z If the test 2025-12-04T10:08:29.2187598Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2187668Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2187763Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2187830Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2187907Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2187972Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2187985Z 2025-12-04T10:08:29.2188283Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2188285Z 2025-12-04T10:08:29.2188360Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2188573Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2188575Z 2025-12-04T10:08:29.2188664Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2188763Z _____ TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 _____ 2025-12-04T10:08:29.2188809Z Traceback (most recent call last): 2025-12-04T10:08:29.2188982Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1151, in test_wrapper 2025-12-04T10:08:29.2189025Z return test(*args, **kwargs) 2025-12-04T10:08:29.2189063Z ^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2189173Z File "/var/lib/jenkins/pytorch/test/test_ops_gradients.py", line 75, in test_fn_gradgrad 2025-12-04T10:08:29.2189253Z self._check_helper(device, dtype, op, op.get_op(), "bwgrad_bwgrad") 2025-12-04T10:08:29.2189415Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5617, in _check_helper 2025-12-04T10:08:29.2189491Z self.assertTrue(gradgradcheck(fn, gradcheck_args, **kwargs)) 2025-12-04T10:08:29.2189537Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2189701Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 5202, in gradgradcheck 2025-12-04T10:08:29.2189790Z return torch.autograd.gradgradcheck(fn, inputs, grad_outputs, **kwargs) 2025-12-04T10:08:29.2189839Z ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2189985Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2291, in gradgradcheck 2025-12-04T10:08:29.2190024Z return gradcheck( 2025-12-04T10:08:29.2190058Z ^^^^^^^^^^ 2025-12-04T10:08:29.2190200Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2086, in gradcheck 2025-12-04T10:08:29.2190245Z return _gradcheck_helper(**args) 2025-12-04T10:08:29.2190285Z ^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2190437Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 2115, in _gradcheck_helper 2025-12-04T10:08:29.2190482Z _gradcheck_real_imag( 2025-12-04T10:08:29.2190644Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1489, in _gradcheck_real_imag 2025-12-04T10:08:29.2190682Z gradcheck_fn( 2025-12-04T10:08:29.2190828Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1956, in _fast_gradcheck 2025-12-04T10:08:29.2190875Z _check_analytical_numerical_equal( 2025-12-04T10:08:29.2191047Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/autograd/gradcheck.py", line 1884, in _check_analytical_numerical_equal 2025-12-04T10:08:29.2191088Z raise GradcheckError( 2025-12-04T10:08:29.2191319Z torch.autograd.gradcheck.GradcheckError: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2191374Z numerical:(-1.7224683846703075+5451.015769314017j) 2025-12-04T10:08:29.2191456Z analytical:(-1.7224683845910052+0.3176942206055258j) 2025-12-04T10:08:29.2191461Z 2025-12-04T10:08:29.2191560Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2191663Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2191772Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2191774Z 2025-12-04T10:08:29.2191809Z Numerical: 2025-12-04T10:08:29.2191872Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2191913Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2191967Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192007Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2192062Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192105Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2192154Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192195Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2192244Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192286Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2192335Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192373Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2192405Z ..., 2025-12-04T10:08:29.2192454Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192494Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2192546Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2192585Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2192634Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192673Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2192726Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2192767Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2192816Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2192854Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2192904Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2193027Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2193065Z Analytical: 2025-12-04T10:08:29.2193123Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193162Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2193209Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193248Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2193296Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193335Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2193382Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193422Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2193471Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193509Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2193556Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193598Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2193630Z ..., 2025-12-04T10:08:29.2193680Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193719Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2193772Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2193811Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2193860Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2193897Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2193967Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2194007Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2194085Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2194124Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2194175Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2194249Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2194266Z 2025-12-04T10:08:29.2194349Z The max per-element difference (slow mode) is: 9.890398048691805e-09. 2025-12-04T10:08:29.2194446Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2194493Z test might've passed in slow_mode! 2025-12-04T10:08:29.2194495Z 2025-12-04T10:08:29.2194583Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2194688Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2194690Z 2025-12-04T10:08:29.2194725Z If the test 2025-12-04T10:08:29.2194819Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2194879Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2194974Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2195020Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2195099Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2195164Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2195166Z 2025-12-04T10:08:29.2195246Z The above exception was the direct cause of the following exception: 2025-12-04T10:08:29.2195248Z 2025-12-04T10:08:29.2195293Z Traceback (most recent call last): 2025-12-04T10:08:29.2195450Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 3329, in wrapper 2025-12-04T10:08:29.2195493Z method(*args, **kwargs) 2025-12-04T10:08:29.2195669Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 428, in instantiated_test 2025-12-04T10:08:29.2195716Z result = test(self, **param_kwargs) 2025-12-04T10:08:29.2195753Z ^^^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2195913Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2195958Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2195996Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2196156Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1231, in dep_fn 2025-12-04T10:08:29.2196198Z return fn(slf, *args, **kwargs) 2025-12-04T10:08:29.2196236Z ^^^^^^^^^^^^^^^^^^^^^^^^ 2025-12-04T10:08:29.2196391Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_utils.py", line 1736, in wrapper 2025-12-04T10:08:29.2196431Z fn(*args, **kwargs) 2025-12-04T10:08:29.2196599Z File "/opt/conda/envs/py_3.12/lib/python3.12/site-packages/torch/testing/_internal/common_device_type.py", line 1163, in test_wrapper 2025-12-04T10:08:29.2196642Z raise e_tracked from e 2025-12-04T10:08:29.2196805Z Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2196860Z numerical:(-1.7224683846703075+5451.015769314017j) 2025-12-04T10:08:29.2196918Z analytical:(-1.7224683845910052+0.3176942206055258j) 2025-12-04T10:08:29.2196920Z 2025-12-04T10:08:29.2197019Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2197120Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2197230Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2197232Z 2025-12-04T10:08:29.2197267Z Numerical: 2025-12-04T10:08:29.2197329Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197395Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2197449Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197487Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2197538Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197588Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2197638Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197676Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2197725Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197763Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2197813Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197851Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2197884Z ..., 2025-12-04T10:08:29.2197933Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2197972Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198024Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2198064Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2198111Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198151Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198202Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2198240Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2198287Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198331Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198381Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2198455Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2198491Z Analytical: 2025-12-04T10:08:29.2198551Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198589Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198640Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198678Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2198730Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198770Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198820Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198859Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2198911Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2198950Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2198999Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2199037Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2199070Z ..., 2025-12-04T10:08:29.2199119Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2199157Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2199207Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2199251Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2199301Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2199342Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2199395Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2199435Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2199482Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2199521Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2199570Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2199645Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2199647Z 2025-12-04T10:08:29.2199743Z The max per-element difference (slow mode) is: 9.890398048691805e-09. 2025-12-04T10:08:29.2199841Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2199902Z test might've passed in slow_mode! 2025-12-04T10:08:29.2199915Z 2025-12-04T10:08:29.2200001Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2200106Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2200120Z 2025-12-04T10:08:29.2200156Z If the test 2025-12-04T10:08:29.2200250Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2200304Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2200400Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2200445Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2200522Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2200586Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2200588Z 2025-12-04T10:08:29.2200893Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2200896Z 2025-12-04T10:08:29.2200972Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2201185Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2201187Z 2025-12-04T10:08:29.2201275Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2201470Z - generated xml file: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/test_ops_gradients/test_ops_gradients-335fccee26ff9f5c.xml - 2025-12-04T10:08:29.2201533Z =========================== short test summary info ============================ 2025-12-04T10:08:29.2201864Z FAILED [0.8222s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.2201920Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.2201977Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.2201979Z 2025-12-04T10:08:29.2202078Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2202306Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2202404Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2202406Z 2025-12-04T10:08:29.2202440Z Numerical: 2025-12-04T10:08:29.2202519Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.2202573Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2202613Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2202676Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2202728Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2202767Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2202830Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2202879Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2202915Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2202989Z ..., 2025-12-04T10:08:29.2203050Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203098Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.2203135Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.2203215Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203261Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.2203328Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.2203388Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203436Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.2203522Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2203558Z Analytical: 2025-12-04T10:08:29.2203631Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.2203679Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2203717Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2203780Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203827Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203868Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2203928Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2203983Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2204019Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2204053Z ..., 2025-12-04T10:08:29.2204117Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2204165Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.2204201Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.2204266Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2204310Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.2204346Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.2204410Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2204461Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.2204531Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2204533Z 2025-12-04T10:08:29.2204615Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.2204711Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2204758Z test might've passed in slow_mode! 2025-12-04T10:08:29.2204761Z 2025-12-04T10:08:29.2204847Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2204954Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2204956Z 2025-12-04T10:08:29.2204990Z If the test 2025-12-04T10:08:29.2205086Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2205144Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2205241Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2205287Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2205364Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2205429Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2205431Z 2025-12-04T10:08:29.2205734Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2205738Z 2025-12-04T10:08:29.2205813Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2206020Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2206022Z 2025-12-04T10:08:29.2206120Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2206294Z FAILED [0.6882s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2206320Z 2025-12-04T10:08:29.2206412Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2206493Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2206583Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2206585Z 2025-12-04T10:08:29.2206670Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2206771Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2206807Z If the test 2025-12-04T10:08:29.2206900Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2206965Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2207059Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2207142Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2207145Z 2025-12-04T10:08:29.2207237Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2207323Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2207360Z the following. 2025-12-04T10:08:29.2207362Z 2025-12-04T10:08:29.2207451Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2207541Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2207593Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2207657Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2207720Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2207723Z 2025-12-04T10:08:29.2207755Z Got: 2025-12-04T10:08:29.2207815Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2207865Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2207915Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2207961Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2208011Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2208014Z 2025-12-04T10:08:29.2208060Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2208106Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2208152Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2208197Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2208247Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2208249Z 2025-12-04T10:08:29.2208251Z 2025-12-04T10:08:29.2208296Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2208340Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2208385Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2208430Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2208482Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2208484Z 2025-12-04T10:08:29.2208533Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2208577Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2208621Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2208666Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2208731Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2208774Z dtype=torch.float64) 2025-12-04T10:08:29.2208776Z 2025-12-04T10:08:29.2208812Z Expected: 2025-12-04T10:08:29.2208885Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2208931Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2209002Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2209048Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2209094Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2209108Z 2025-12-04T10:08:29.2209154Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2209199Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2209250Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2209294Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2209343Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2209345Z 2025-12-04T10:08:29.2209347Z 2025-12-04T10:08:29.2209393Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2209436Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2209481Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2209527Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2209574Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2209576Z 2025-12-04T10:08:29.2209620Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2209666Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2209711Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2209756Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2209818Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2209860Z dtype=torch.float64) 2025-12-04T10:08:29.2209862Z 2025-12-04T10:08:29.2210146Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2210149Z 2025-12-04T10:08:29.2210226Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2210428Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2210431Z 2025-12-04T10:08:29.2210517Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2210697Z FAILED [0.1038s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2210700Z 2025-12-04T10:08:29.2210791Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2210874Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2210954Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2210955Z 2025-12-04T10:08:29.2211041Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2211144Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2211179Z If the test 2025-12-04T10:08:29.2211271Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2211336Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2211428Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2211511Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2211514Z 2025-12-04T10:08:29.2211604Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2211702Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2211739Z the following. 2025-12-04T10:08:29.2211741Z 2025-12-04T10:08:29.2211830Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2211945Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2211997Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2212061Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2212134Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2212136Z 2025-12-04T10:08:29.2212168Z Got: 2025-12-04T10:08:29.2212243Z tensor([[[[-0.7501+7.9726e-02j, 0.4166+1.4770e+00j, 1.5250+5.0409e-01j, 2025-12-04T10:08:29.2212295Z 1.3125-5.3362e-01j, 0.4543-7.5771e-01j], 2025-12-04T10:08:29.2212361Z [-0.2393+5.2765e-02j, -0.0989-4.0902e-02j, -0.1885-5.7204e-02j, 2025-12-04T10:08:29.2212411Z -0.2942+1.7841e-01j, -0.0727+2.6102e-01j], 2025-12-04T10:08:29.2212474Z [-0.2867+5.4473e-02j, -0.2933+1.4645e-01j, 0.1696-1.0586e-01j, 2025-12-04T10:08:29.2212522Z 0.0314-4.4484e-01j, 0.1050+1.3559e-01j], 2025-12-04T10:08:29.2212585Z [-1.3958-8.1339e-01j, -0.5369-6.0813e-01j, -1.2260-1.7464e-01j, 2025-12-04T10:08:29.2212631Z 0.3117+5.7046e-01j, 0.3362-4.9936e-01j], 2025-12-04T10:08:29.2212693Z [ 4.7407+4.2793e+00j, 12.2699-9.5039e-01j, -8.6688+3.0407e+00j, 2025-12-04T10:08:29.2212743Z -1.7592+6.6302e+00j, -0.6919-8.5212e-01j]], 2025-12-04T10:08:29.2212745Z 2025-12-04T10:08:29.2212804Z [[-0.6800+7.0299e-01j, 1.4536+1.1274e+00j, -0.7016-2.3112e+00j, 2025-12-04T10:08:29.2212851Z 0.4316-2.2178e-01j, 0.7518-6.7808e-01j], 2025-12-04T10:08:29.2212915Z [ 0.8304+2.2318e+00j, -1.5760+1.3611e+00j, -0.2518+4.4128e-03j, 2025-12-04T10:08:29.2213003Z 0.6568-2.6649e-01j, -0.5120-6.2765e-01j], 2025-12-04T10:08:29.2213064Z [ 0.4447-6.1708e-01j, 0.4007-7.3907e-01j, 1.0581+4.5924e-02j, 2025-12-04T10:08:29.2213111Z -0.8412+5.8163e-02j, -0.3835-4.0253e-01j], 2025-12-04T10:08:29.2213171Z [ 0.1873+2.9768e-01j, -0.2781-5.8242e-01j, 0.5444-8.6504e-01j, 2025-12-04T10:08:29.2213221Z -0.1955+1.5327e-01j, 0.1963+3.9709e-01j], 2025-12-04T10:08:29.2213281Z [-2.8196-9.4837e-01j, -1.2308-1.3153e+00j, 5.3516-3.9024e-01j, 2025-12-04T10:08:29.2213333Z 0.6782-1.2914e+00j, -0.9552-2.9624e-01j]]], 2025-12-04T10:08:29.2213336Z 2025-12-04T10:08:29.2213338Z 2025-12-04T10:08:29.2213397Z [[[-0.1919-5.9893e-01j, -0.2037-4.1950e-01j, 0.6085+2.7197e-01j, 2025-12-04T10:08:29.2213444Z 1.4388-8.3350e-01j, -0.6628-1.1732e-01j], 2025-12-04T10:08:29.2213504Z [-0.6616-5.8389e-01j, -0.2443+9.6196e-01j, -0.2488+5.0987e-01j, 2025-12-04T10:08:29.2213550Z 0.1170-8.9906e-01j, 0.4268-3.0089e-01j], 2025-12-04T10:08:29.2213611Z [-0.1374+2.8444e-01j, -0.1955-1.4549e+00j, -0.5708-4.1567e-01j, 2025-12-04T10:08:29.2213663Z -0.0404+3.7118e-01j, 0.2557-1.8153e-01j], 2025-12-04T10:08:29.2213721Z [ 0.3232-1.1092e-01j, -0.4227-1.0964e+00j, 1.2298+9.0961e-01j, 2025-12-04T10:08:29.2213770Z -0.6143-2.3413e-01j, 0.1764-1.6442e+00j], 2025-12-04T10:08:29.2213830Z [ 1.0214+7.6772e-01j, 0.3184-3.5588e-01j, 0.3143+5.4397e-01j, 2025-12-04T10:08:29.2213878Z -0.8216-1.6840e-01j, -0.5994-8.6882e-01j]], 2025-12-04T10:08:29.2213881Z 2025-12-04T10:08:29.2213940Z [[ 1.0539-7.3211e-01j, 0.4599+5.2475e-01j, 1.1369-7.5329e-01j, 2025-12-04T10:08:29.2213987Z -0.7323+2.0070e+00j, -0.6316+1.7883e-01j], 2025-12-04T10:08:29.2214049Z [-1.0193-6.3350e-01j, -0.1444-9.0377e-01j, 0.8412+5.4601e-01j, 2025-12-04T10:08:29.2214095Z -0.4251+8.2113e-03j, -0.9993-3.5177e-01j], 2025-12-04T10:08:29.2214154Z [ 0.3320-4.2876e-01j, -0.8812-2.5672e-02j, 0.1053-7.5240e-01j, 2025-12-04T10:08:29.2214214Z 0.2988+3.5971e-01j, 0.6463+2.1691e-02j], 2025-12-04T10:08:29.2214275Z [-0.0153-3.8690e-01j, 0.8213-6.5318e-01j, 0.7421+1.2504e+00j, 2025-12-04T10:08:29.2214320Z 0.3329+7.9396e-01j, -1.0457-3.7436e-01j], 2025-12-04T10:08:29.2214408Z [-0.5649+1.4362e-01j, -0.1873-1.5054e+00j, -0.7475+3.7488e-01j, 2025-12-04T10:08:29.2214469Z 1.2359-2.0724e-01j, 1.0937+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2214517Z dtype=torch.complex128) 2025-12-04T10:08:29.2214532Z 2025-12-04T10:08:29.2214567Z Expected: 2025-12-04T10:08:29.2214642Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.2214682Z 0.3401-0.5676j], 2025-12-04T10:08:29.2214746Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.2214784Z 0.2064-0.7429j], 2025-12-04T10:08:29.2214851Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.2214888Z 0.4114+0.5306j], 2025-12-04T10:08:29.2214954Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.2214991Z -0.3622+0.5375j], 2025-12-04T10:08:29.2215059Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.2215098Z 0.0867+0.1067j]], 2025-12-04T10:08:29.2215100Z 2025-12-04T10:08:29.2215163Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.2215201Z 0.5321-0.4721j], 2025-12-04T10:08:29.2215268Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.2215305Z -0.6743-0.7686j], 2025-12-04T10:08:29.2215367Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.2215404Z -0.5254-0.5482j], 2025-12-04T10:08:29.2215468Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.2215507Z -0.3257-0.6610j], 2025-12-04T10:08:29.2215570Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.2215608Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.2215612Z 2025-12-04T10:08:29.2215614Z 2025-12-04T10:08:29.2215676Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2215713Z -0.6628-0.1173j], 2025-12-04T10:08:29.2215775Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2215812Z 0.4268-0.3009j], 2025-12-04T10:08:29.2215877Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2215913Z 0.2557-0.1815j], 2025-12-04T10:08:29.2215976Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2216012Z 0.1764-1.6442j], 2025-12-04T10:08:29.2216074Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2216115Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2216117Z 2025-12-04T10:08:29.2216180Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2216219Z -0.6316+0.1788j], 2025-12-04T10:08:29.2216281Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2216319Z -0.9993-0.3518j], 2025-12-04T10:08:29.2216381Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2216417Z 0.6463+0.0217j], 2025-12-04T10:08:29.2216478Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2216515Z -1.0457-0.3744j], 2025-12-04T10:08:29.2216577Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2216644Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2216646Z 2025-12-04T10:08:29.2216967Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2216981Z 2025-12-04T10:08:29.2217056Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2217262Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2217282Z 2025-12-04T10:08:29.2217367Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2217546Z FAILED [0.0511s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2217548Z 2025-12-04T10:08:29.2217640Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2217723Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2217802Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2217805Z 2025-12-04T10:08:29.2217890Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2217992Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2218029Z If the test 2025-12-04T10:08:29.2218122Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2218186Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2218279Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2218363Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2218365Z 2025-12-04T10:08:29.2218460Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2218545Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2218581Z the following. 2025-12-04T10:08:29.2218585Z 2025-12-04T10:08:29.2218675Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2218766Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2218816Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2218881Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2218941Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2218943Z 2025-12-04T10:08:29.2218975Z Got: 2025-12-04T10:08:29.2219026Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219073Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219112Z nan+nanj], 2025-12-04T10:08:29.2219156Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219200Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219239Z nan+nanj], 2025-12-04T10:08:29.2219282Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219326Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2219364Z nan+nanj], 2025-12-04T10:08:29.2219421Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2219476Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2219519Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2219569Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2219623Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2219666Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2219668Z 2025-12-04T10:08:29.2219718Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2219771Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2219823Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2219873Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2219945Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2219985Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2220037Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2220087Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2220138Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2220188Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2220238Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2220277Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2220326Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2220375Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2220418Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2220420Z 2025-12-04T10:08:29.2220422Z 2025-12-04T10:08:29.2220472Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2220525Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2220564Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2220615Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2220666Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2220706Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2220756Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2220809Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2220848Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2220899Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2220949Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2220989Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2221039Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2221088Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2221131Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2221133Z 2025-12-04T10:08:29.2221183Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2221233Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2221272Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2221324Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2221373Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2221413Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2221463Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2221514Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2221554Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2221605Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2221653Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2221694Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2221745Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2221797Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2221848Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2221893Z dtype=torch.complex128) 2025-12-04T10:08:29.2221895Z 2025-12-04T10:08:29.2221929Z Expected: 2025-12-04T10:08:29.2222007Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2222044Z 0.3401-0.5673j], 2025-12-04T10:08:29.2222110Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2222147Z 0.2078-0.7444j], 2025-12-04T10:08:29.2222227Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2222264Z 0.4109+0.5305j], 2025-12-04T10:08:29.2222350Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2222387Z -0.3607+0.5386j], 2025-12-04T10:08:29.2222450Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2222498Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2222500Z 2025-12-04T10:08:29.2222564Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2222599Z 0.5323-0.4729j], 2025-12-04T10:08:29.2222662Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2222699Z -0.6732-0.7677j], 2025-12-04T10:08:29.2222761Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2222796Z -0.5241-0.5479j], 2025-12-04T10:08:29.2222861Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2222897Z -0.3257-0.6597j], 2025-12-04T10:08:29.2223034Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2223073Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2223075Z 2025-12-04T10:08:29.2223078Z 2025-12-04T10:08:29.2223141Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2223178Z -0.6637-0.1175j], 2025-12-04T10:08:29.2223241Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2223277Z 0.4261-0.3012j], 2025-12-04T10:08:29.2223343Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2223379Z 0.2567-0.1808j], 2025-12-04T10:08:29.2223441Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2223478Z 0.1761-1.6446j], 2025-12-04T10:08:29.2223540Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2223579Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2223582Z 2025-12-04T10:08:29.2223644Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2223682Z -0.6307+0.1756j], 2025-12-04T10:08:29.2223744Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2223782Z -0.9972-0.3518j], 2025-12-04T10:08:29.2223847Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2223882Z 0.6467+0.0201j], 2025-12-04T10:08:29.2223943Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2223981Z -1.0443-0.3699j], 2025-12-04T10:08:29.2224045Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2224113Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2224115Z 2025-12-04T10:08:29.2224413Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2224417Z 2025-12-04T10:08:29.2224493Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2224700Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2224704Z 2025-12-04T10:08:29.2224791Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2224972Z FAILED [0.0506s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2224990Z 2025-12-04T10:08:29.2225084Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2225166Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2225271Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2225273Z 2025-12-04T10:08:29.2225358Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2225475Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2225511Z If the test 2025-12-04T10:08:29.2225604Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2225666Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2225761Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2225843Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2225846Z 2025-12-04T10:08:29.2225937Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2226026Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2226061Z the following. 2025-12-04T10:08:29.2226065Z 2025-12-04T10:08:29.2226154Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2226248Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2226299Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2226364Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2226424Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2226426Z 2025-12-04T10:08:29.2226459Z Got: 2025-12-04T10:08:29.2226508Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226554Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226595Z nan+nanj], 2025-12-04T10:08:29.2226639Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226682Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226722Z nan+nanj], 2025-12-04T10:08:29.2226765Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226809Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2226848Z nan+nanj], 2025-12-04T10:08:29.2226904Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2226958Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2226999Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2227051Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2227104Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2227145Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2227147Z 2025-12-04T10:08:29.2227200Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2227250Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2227292Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2227343Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2227393Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2227432Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2227485Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2227535Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2227575Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2227625Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2227676Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2227715Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2227764Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2227831Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2227873Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2227889Z 2025-12-04T10:08:29.2227891Z 2025-12-04T10:08:29.2227959Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2228010Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2228049Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2228112Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2228161Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2228200Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2228250Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2228303Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2228341Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2228392Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2228441Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2228480Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2228532Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2228583Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2228627Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2228631Z 2025-12-04T10:08:29.2228682Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2228732Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2228770Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2228821Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2228870Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2228909Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2228961Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2229012Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2229050Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2229103Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2229153Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2229192Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2229243Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2229293Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2229343Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2229388Z dtype=torch.complex128) 2025-12-04T10:08:29.2229390Z 2025-12-04T10:08:29.2229425Z Expected: 2025-12-04T10:08:29.2229503Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2229541Z 0.3401-0.5673j], 2025-12-04T10:08:29.2229607Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2229643Z 0.2078-0.7444j], 2025-12-04T10:08:29.2229708Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2229746Z 0.4109+0.5305j], 2025-12-04T10:08:29.2229809Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2229847Z -0.3607+0.5386j], 2025-12-04T10:08:29.2229912Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2229949Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2229951Z 2025-12-04T10:08:29.2230015Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2230052Z 0.5323-0.4729j], 2025-12-04T10:08:29.2230117Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2230153Z -0.6732-0.7677j], 2025-12-04T10:08:29.2230227Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2230264Z -0.5241-0.5479j], 2025-12-04T10:08:29.2230337Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2230386Z -0.3257-0.6597j], 2025-12-04T10:08:29.2230452Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2230489Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2230507Z 2025-12-04T10:08:29.2230510Z 2025-12-04T10:08:29.2230573Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2230611Z -0.6637-0.1175j], 2025-12-04T10:08:29.2230674Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2230710Z 0.4261-0.3012j], 2025-12-04T10:08:29.2230773Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2230814Z 0.2567-0.1808j], 2025-12-04T10:08:29.2230877Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2230915Z 0.1761-1.6446j], 2025-12-04T10:08:29.2230978Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2231018Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2231020Z 2025-12-04T10:08:29.2231081Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2231120Z -0.6307+0.1756j], 2025-12-04T10:08:29.2231183Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2231221Z -0.9972-0.3518j], 2025-12-04T10:08:29.2231283Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2231322Z 0.6467+0.0201j], 2025-12-04T10:08:29.2231383Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2231421Z -1.0443-0.3699j], 2025-12-04T10:08:29.2231484Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2231550Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2231553Z 2025-12-04T10:08:29.2231853Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2231856Z 2025-12-04T10:08:29.2231931Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2232137Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2232141Z 2025-12-04T10:08:29.2232228Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2232412Z FAILED [0.0513s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2232414Z 2025-12-04T10:08:29.2232509Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2232590Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2232671Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2232674Z 2025-12-04T10:08:29.2232763Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2232865Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2232901Z If the test 2025-12-04T10:08:29.2233040Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2233105Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2233218Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2233301Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2233320Z 2025-12-04T10:08:29.2233425Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2233511Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2233547Z the following. 2025-12-04T10:08:29.2233562Z 2025-12-04T10:08:29.2233652Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2233742Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2233796Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2233861Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2233922Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2233924Z 2025-12-04T10:08:29.2233958Z Got: 2025-12-04T10:08:29.2234033Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.2234072Z -0.0303+0.0508j], 2025-12-04T10:08:29.2234137Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.2234178Z -0.0087+0.0311j], 2025-12-04T10:08:29.2234242Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.2234278Z 0.0279+0.0361j], 2025-12-04T10:08:29.2234342Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.2234380Z -0.4873+0.7136j], 2025-12-04T10:08:29.2234442Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.2234483Z -0.0153-0.0191j]], 2025-12-04T10:08:29.2234485Z 2025-12-04T10:08:29.2234547Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.2234583Z 0.2857-0.2518j], 2025-12-04T10:08:29.2234646Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.2234682Z 0.0473+0.0540j], 2025-12-04T10:08:29.2234745Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.2234784Z -0.0383-0.0398j], 2025-12-04T10:08:29.2234847Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.2234883Z -0.0382-0.0777j], 2025-12-04T10:08:29.2234947Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.2234986Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.2234988Z 2025-12-04T10:08:29.2234989Z 2025-12-04T10:08:29.2235051Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2235088Z -0.6637-0.1175j], 2025-12-04T10:08:29.2235150Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2235186Z 0.4261-0.3012j], 2025-12-04T10:08:29.2235250Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2235287Z 0.2567-0.1808j], 2025-12-04T10:08:29.2235351Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2235387Z 0.1761-1.6446j], 2025-12-04T10:08:29.2237337Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2237381Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2237383Z 2025-12-04T10:08:29.2237447Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2237484Z -0.6307+0.1756j], 2025-12-04T10:08:29.2237548Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2237585Z -0.9972-0.3518j], 2025-12-04T10:08:29.2237646Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2237683Z 0.6467+0.0201j], 2025-12-04T10:08:29.2237768Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2237805Z -1.0443-0.3699j], 2025-12-04T10:08:29.2237898Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2237966Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2237968Z 2025-12-04T10:08:29.2238003Z Expected: 2025-12-04T10:08:29.2238088Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2238125Z 0.3401-0.5673j], 2025-12-04T10:08:29.2238186Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2238222Z 0.2078-0.7444j], 2025-12-04T10:08:29.2238285Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2238321Z 0.4109+0.5305j], 2025-12-04T10:08:29.2238383Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2238421Z -0.3607+0.5386j], 2025-12-04T10:08:29.2238482Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2238525Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2238527Z 2025-12-04T10:08:29.2238591Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2238628Z 0.5323-0.4729j], 2025-12-04T10:08:29.2238693Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2238730Z -0.6732-0.7677j], 2025-12-04T10:08:29.2238791Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2238828Z -0.5241-0.5479j], 2025-12-04T10:08:29.2238889Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2238925Z -0.3257-0.6597j], 2025-12-04T10:08:29.2238990Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2239028Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2239030Z 2025-12-04T10:08:29.2239032Z 2025-12-04T10:08:29.2239098Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2239135Z -0.6637-0.1175j], 2025-12-04T10:08:29.2239197Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2239236Z 0.4261-0.3012j], 2025-12-04T10:08:29.2239299Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2239336Z 0.2567-0.1808j], 2025-12-04T10:08:29.2239400Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2239436Z 0.1761-1.6446j], 2025-12-04T10:08:29.2239499Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2239537Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2239539Z 2025-12-04T10:08:29.2239601Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2239639Z -0.6307+0.1756j], 2025-12-04T10:08:29.2239706Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2239742Z -0.9972-0.3518j], 2025-12-04T10:08:29.2239804Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2239840Z 0.6467+0.0201j], 2025-12-04T10:08:29.2239902Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2239938Z -1.0443-0.3699j], 2025-12-04T10:08:29.2240001Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2240066Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2240068Z 2025-12-04T10:08:29.2240380Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2240412Z 2025-12-04T10:08:29.2240496Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2240703Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2240715Z 2025-12-04T10:08:29.2240801Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2240979Z FAILED [0.0520s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2240981Z 2025-12-04T10:08:29.2241073Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2241152Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2241233Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2241235Z 2025-12-04T10:08:29.2241319Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2241428Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2241463Z If the test 2025-12-04T10:08:29.2241557Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2241620Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2241714Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2241795Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2241797Z 2025-12-04T10:08:29.2241888Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2241972Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2242009Z the following. 2025-12-04T10:08:29.2242011Z 2025-12-04T10:08:29.2242101Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2242194Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2242247Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2242310Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2242371Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2242373Z 2025-12-04T10:08:29.2242405Z Got: 2025-12-04T10:08:29.2242477Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.2242517Z -0.0303+0.0508j], 2025-12-04T10:08:29.2242582Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.2242619Z -0.0087+0.0311j], 2025-12-04T10:08:29.2242683Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.2242720Z 0.0279+0.0361j], 2025-12-04T10:08:29.2242782Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.2242820Z -0.4873+0.7136j], 2025-12-04T10:08:29.2242884Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.2242922Z -0.0153-0.0191j]], 2025-12-04T10:08:29.2242925Z 2025-12-04T10:08:29.2243035Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.2243070Z 0.2857-0.2518j], 2025-12-04T10:08:29.2243133Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.2243168Z 0.0473+0.0540j], 2025-12-04T10:08:29.2243231Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.2243266Z -0.0383-0.0398j], 2025-12-04T10:08:29.2243347Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.2243384Z -0.0382-0.0777j], 2025-12-04T10:08:29.2243446Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.2243514Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.2243516Z 2025-12-04T10:08:29.2243518Z 2025-12-04T10:08:29.2243581Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2243634Z -0.6637-0.1175j], 2025-12-04T10:08:29.2243697Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2243732Z 0.4261-0.3012j], 2025-12-04T10:08:29.2243795Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2243830Z 0.2567-0.1808j], 2025-12-04T10:08:29.2243893Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2243928Z 0.1761-1.6446j], 2025-12-04T10:08:29.2243993Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2244031Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2244033Z 2025-12-04T10:08:29.2244100Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2244136Z -0.6307+0.1756j], 2025-12-04T10:08:29.2244199Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2244236Z -0.9972-0.3518j], 2025-12-04T10:08:29.2244298Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2244332Z 0.6467+0.0201j], 2025-12-04T10:08:29.2244394Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2244429Z -1.0443-0.3699j], 2025-12-04T10:08:29.2244493Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2244559Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2244561Z 2025-12-04T10:08:29.2244596Z Expected: 2025-12-04T10:08:29.2244669Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2244707Z 0.3401-0.5673j], 2025-12-04T10:08:29.2244769Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2244804Z 0.2078-0.7444j], 2025-12-04T10:08:29.2244868Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2244904Z 0.4109+0.5305j], 2025-12-04T10:08:29.2244967Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2245003Z -0.3607+0.5386j], 2025-12-04T10:08:29.2245065Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2245102Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2245103Z 2025-12-04T10:08:29.2245167Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2245202Z 0.5323-0.4729j], 2025-12-04T10:08:29.2245265Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2245303Z -0.6732-0.7677j], 2025-12-04T10:08:29.2245365Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2245400Z -0.5241-0.5479j], 2025-12-04T10:08:29.2245462Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2245499Z -0.3257-0.6597j], 2025-12-04T10:08:29.2245562Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2245599Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2245601Z 2025-12-04T10:08:29.2245603Z 2025-12-04T10:08:29.2245665Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2245701Z -0.6637-0.1175j], 2025-12-04T10:08:29.2245774Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2245810Z 0.4261-0.3012j], 2025-12-04T10:08:29.2245874Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2245933Z 0.2567-0.1808j], 2025-12-04T10:08:29.2245997Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2246032Z 0.1761-1.6446j], 2025-12-04T10:08:29.2246105Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2246143Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2246145Z 2025-12-04T10:08:29.2246207Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2246243Z -0.6307+0.1756j], 2025-12-04T10:08:29.2246306Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2246341Z -0.9972-0.3518j], 2025-12-04T10:08:29.2246405Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2246440Z 0.6467+0.0201j], 2025-12-04T10:08:29.2246504Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2246542Z -1.0443-0.3699j], 2025-12-04T10:08:29.2246607Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2246673Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2246676Z 2025-12-04T10:08:29.2246971Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2246974Z 2025-12-04T10:08:29.2247047Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2247251Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2247254Z 2025-12-04T10:08:29.2247340Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2247515Z FAILED [0.0663s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2247519Z 2025-12-04T10:08:29.2247612Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2247693Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2247772Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2247774Z 2025-12-04T10:08:29.2247858Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2247960Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2247998Z If the test 2025-12-04T10:08:29.2248091Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2248154Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2248250Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2248332Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2248334Z 2025-12-04T10:08:29.2248424Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2248511Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2248546Z the following. 2025-12-04T10:08:29.2248549Z 2025-12-04T10:08:29.2248639Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2248728Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2248794Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2248857Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2248918Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2248932Z 2025-12-04T10:08:29.2248975Z Got: 2025-12-04T10:08:29.2249039Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.2249094Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.2249148Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.2249200Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.2249256Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.2249296Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.2249346Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.2249396Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.2249438Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.2249489Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.2249540Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.2249579Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.2249630Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.2249680Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.2249723Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.2249728Z 2025-12-04T10:08:29.2249778Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.2249828Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.2249867Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.2249916Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.2249967Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.2250004Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.2250057Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.2250106Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.2250144Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.2250196Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.2250248Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.2250287Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.2250339Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.2250389Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.2250430Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.2250432Z 2025-12-04T10:08:29.2250434Z 2025-12-04T10:08:29.2250483Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.2250533Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.2250571Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.2250623Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.2250672Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.2250712Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.2250763Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.2250814Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.2250852Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.2250903Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.2250951Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.2250990Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.2251038Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.2251088Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.2251128Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.2251130Z 2025-12-04T10:08:29.2251199Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.2251248Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.2251299Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.2251361Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.2251411Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.2251450Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.2251512Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.2251562Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.2251601Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.2251651Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.2251701Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.2251739Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.2251792Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.2251842Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.2251895Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2251943Z dtype=torch.complex128) 2025-12-04T10:08:29.2251946Z 2025-12-04T10:08:29.2251981Z Expected: 2025-12-04T10:08:29.2252057Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2252096Z 0.3406-0.5682j], 2025-12-04T10:08:29.2252161Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2252197Z 0.2069-0.7450j], 2025-12-04T10:08:29.2252262Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2252297Z 0.4118+0.5311j], 2025-12-04T10:08:29.2252361Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2252397Z -0.3628+0.5383j], 2025-12-04T10:08:29.2252461Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2252499Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2252501Z 2025-12-04T10:08:29.2252566Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2252602Z 0.5325-0.4733j], 2025-12-04T10:08:29.2252668Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2252705Z -0.6729-0.7686j], 2025-12-04T10:08:29.2252767Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2252803Z -0.5258-0.5473j], 2025-12-04T10:08:29.2252865Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2252901Z -0.3244-0.6603j], 2025-12-04T10:08:29.2253001Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2253044Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2253046Z 2025-12-04T10:08:29.2253049Z 2025-12-04T10:08:29.2253112Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2253147Z -0.6623-0.1171j], 2025-12-04T10:08:29.2253216Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2253251Z 0.4266-0.2997j], 2025-12-04T10:08:29.2253315Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2253351Z 0.2556-0.1819j], 2025-12-04T10:08:29.2253416Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2253451Z 0.1768-1.6449j], 2025-12-04T10:08:29.2253514Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2253552Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2253554Z 2025-12-04T10:08:29.2253617Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2253674Z -0.6312+0.1775j], 2025-12-04T10:08:29.2253738Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2253774Z -0.9967-0.3519j], 2025-12-04T10:08:29.2253866Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2253902Z 0.6457+0.0238j], 2025-12-04T10:08:29.2253964Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2254017Z -1.0432-0.3734j], 2025-12-04T10:08:29.2254081Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2254146Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2254149Z 2025-12-04T10:08:29.2254441Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2254443Z 2025-12-04T10:08:29.2254517Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2254724Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2254727Z 2025-12-04T10:08:29.2254813Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2254989Z FAILED [0.0547s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2254991Z 2025-12-04T10:08:29.2255084Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2255164Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2255243Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2255245Z 2025-12-04T10:08:29.2255330Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2255432Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2255470Z If the test 2025-12-04T10:08:29.2255564Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2255626Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2255723Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2255805Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2255807Z 2025-12-04T10:08:29.2255898Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2255982Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2256018Z the following. 2025-12-04T10:08:29.2256020Z 2025-12-04T10:08:29.2256110Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2256199Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2256255Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2256318Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2256380Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2256383Z 2025-12-04T10:08:29.2256415Z Got: 2025-12-04T10:08:29.2256490Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2256526Z 0.3401-0.5673j], 2025-12-04T10:08:29.2256590Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2256626Z 0.2078-0.7444j], 2025-12-04T10:08:29.2256691Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2256727Z 0.4109+0.5305j], 2025-12-04T10:08:29.2256802Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2256839Z -0.3607+0.5386j], 2025-12-04T10:08:29.2256914Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2256962Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2256965Z 2025-12-04T10:08:29.2257028Z [[-0.0544+0.0551j, 0.1142+0.0904j, -0.0538-0.1835j, 0.0343-0.0172j, 2025-12-04T10:08:29.2257076Z 0.0600-0.0531j], 2025-12-04T10:08:29.2257138Z [ 0.0741+0.0886j, -0.0645+0.0327j, 0.0494+0.0031j, -0.0136-0.0117j, 2025-12-04T10:08:29.2257174Z -0.0521-0.0595j], 2025-12-04T10:08:29.2257236Z [ 0.0363-0.0508j, 0.0327-0.0608j, 0.0869+0.0035j, -0.0690+0.0050j, 2025-12-04T10:08:29.2257272Z -0.0316-0.0329j], 2025-12-04T10:08:29.2257337Z [-0.0712-0.1140j, 0.1059+0.2229j, -0.2099+0.3292j, 0.0750-0.0582j, 2025-12-04T10:08:29.2257374Z -0.0746-0.1521j], 2025-12-04T10:08:29.2257437Z [-0.0238-0.0080j, -0.0105-0.0112j, 0.0452-0.0034j, 0.0057-0.0109j, 2025-12-04T10:08:29.2257476Z -0.0081-0.0025j]]], 2025-12-04T10:08:29.2257478Z 2025-12-04T10:08:29.2257481Z 2025-12-04T10:08:29.2257543Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2257581Z -0.6637-0.1175j], 2025-12-04T10:08:29.2257642Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2257680Z 0.4261-0.3012j], 2025-12-04T10:08:29.2257743Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2257779Z 0.2567-0.1808j], 2025-12-04T10:08:29.2257841Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2257876Z 0.1761-1.6446j], 2025-12-04T10:08:29.2257939Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2257979Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2257981Z 2025-12-04T10:08:29.2258042Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2258080Z -0.6307+0.1756j], 2025-12-04T10:08:29.2258142Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2258179Z -0.9972-0.3518j], 2025-12-04T10:08:29.2258240Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2258277Z 0.6467+0.0201j], 2025-12-04T10:08:29.2258340Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2258377Z -1.0443-0.3699j], 2025-12-04T10:08:29.2258440Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2258506Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2258508Z 2025-12-04T10:08:29.2258542Z Expected: 2025-12-04T10:08:29.2258615Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2258650Z 0.3401-0.5673j], 2025-12-04T10:08:29.2258714Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2258752Z 0.2078-0.7444j], 2025-12-04T10:08:29.2258815Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2258852Z 0.4109+0.5305j], 2025-12-04T10:08:29.2258916Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2258953Z -0.3607+0.5386j], 2025-12-04T10:08:29.2259016Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2259053Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2259056Z 2025-12-04T10:08:29.2259118Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2259154Z 0.5323-0.4729j], 2025-12-04T10:08:29.2259228Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2259267Z -0.6732-0.7677j], 2025-12-04T10:08:29.2259339Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2259390Z -0.5241-0.5479j], 2025-12-04T10:08:29.2259453Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2259491Z -0.3257-0.6597j], 2025-12-04T10:08:29.2259571Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2259609Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2259611Z 2025-12-04T10:08:29.2259613Z 2025-12-04T10:08:29.2259675Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2259711Z -0.6637-0.1175j], 2025-12-04T10:08:29.2259774Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2259810Z 0.4261-0.3012j], 2025-12-04T10:08:29.2259873Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2259909Z 0.2567-0.1808j], 2025-12-04T10:08:29.2259973Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2260010Z 0.1761-1.6446j], 2025-12-04T10:08:29.2260072Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2260112Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2260114Z 2025-12-04T10:08:29.2260177Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2260214Z -0.6307+0.1756j], 2025-12-04T10:08:29.2260276Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2260313Z -0.9972-0.3518j], 2025-12-04T10:08:29.2260375Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2260412Z 0.6467+0.0201j], 2025-12-04T10:08:29.2260476Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2260515Z -1.0443-0.3699j], 2025-12-04T10:08:29.2260579Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2260646Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2260648Z 2025-12-04T10:08:29.2260946Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2260950Z 2025-12-04T10:08:29.2261023Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2261227Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2261230Z 2025-12-04T10:08:29.2261316Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2261492Z FAILED [0.0531s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2261495Z 2025-12-04T10:08:29.2261587Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2261670Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2261748Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2261750Z 2025-12-04T10:08:29.2261834Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2261938Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2261972Z If the test 2025-12-04T10:08:29.2262066Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2262138Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2262234Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2262336Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2262338Z 2025-12-04T10:08:29.2262431Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2262526Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2262564Z the following. 2025-12-04T10:08:29.2262566Z 2025-12-04T10:08:29.2262653Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2262745Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2262795Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2262858Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2262919Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2262921Z 2025-12-04T10:08:29.2263002Z Got: 2025-12-04T10:08:29.2263065Z tensor([[[[-5.6119e-01+5.7406e-02j, 3.1233e-01+1.1033e+00j, 2025-12-04T10:08:29.2263122Z 1.1405e+00+3.7729e-01j, 9.8358e-01-3.9860e-01j, 2025-12-04T10:08:29.2263162Z 3.4014e-01-5.6728e-01j], 2025-12-04T10:08:29.2263214Z [ 6.8236e-01-1.5236e-01j, 2.8253e-01+1.1557e-01j, 2025-12-04T10:08:29.2263265Z 5.3698e-01+1.6411e-01j, 8.3948e-01-5.0656e-01j, 2025-12-04T10:08:29.2263305Z 2.0776e-01-7.4444e-01j], 2025-12-04T10:08:29.2263358Z [-1.1234e+00+2.1468e-01j, -1.1468e+00+5.7362e-01j, 2025-12-04T10:08:29.2263408Z 6.6358e-01-4.1426e-01j, 1.2341e-01-1.7417e+00j, 2025-12-04T10:08:29.2263447Z 4.1088e-01+5.3045e-01j], 2025-12-04T10:08:29.2263496Z [ 1.5025e+00+8.7788e-01j, 5.7751e-01+6.5749e-01j, 2025-12-04T10:08:29.2263546Z 1.3189e+00+1.8928e-01j, -3.3668e-01-6.1260e-01j, 2025-12-04T10:08:29.2263586Z -3.6075e-01+5.3857e-01j], 2025-12-04T10:08:29.2263636Z [-5.9510e-01-5.3655e-01j, -1.5396e+00+1.1822e-01j, 2025-12-04T10:08:29.2263689Z 1.0860e+00-3.8168e-01j, 2.1929e-01-8.3159e-01j, 2025-12-04T10:08:29.2263730Z 8.5424e-02+1.0631e-01j]], 2025-12-04T10:08:29.2263732Z 2025-12-04T10:08:29.2263782Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2263834Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2263874Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2263923Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2263973Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2264011Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2264064Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2264113Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2264154Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2264205Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2264255Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2264295Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2264343Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2264394Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2264436Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2264438Z 2025-12-04T10:08:29.2264439Z 2025-12-04T10:08:29.2264490Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2264540Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2264580Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2264631Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2264699Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2264738Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2264788Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2264870Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2264909Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2264958Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2265022Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2265059Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2265110Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2265159Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2265203Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2265205Z 2025-12-04T10:08:29.2265253Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2265305Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2265345Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2265395Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2265446Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2265486Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2265535Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2265591Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2265628Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2265679Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2265727Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2265766Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2265815Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2265866Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2265917Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2265962Z dtype=torch.complex128) 2025-12-04T10:08:29.2265964Z 2025-12-04T10:08:29.2265999Z Expected: 2025-12-04T10:08:29.2266075Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2266111Z 0.3401-0.5673j], 2025-12-04T10:08:29.2266175Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2266213Z 0.2078-0.7444j], 2025-12-04T10:08:29.2266278Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2266314Z 0.4109+0.5305j], 2025-12-04T10:08:29.2266379Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2266416Z -0.3607+0.5386j], 2025-12-04T10:08:29.2266478Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2266517Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2266519Z 2025-12-04T10:08:29.2266581Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2266618Z 0.5323-0.4729j], 2025-12-04T10:08:29.2266681Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2266718Z -0.6732-0.7677j], 2025-12-04T10:08:29.2266780Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2266818Z -0.5241-0.5479j], 2025-12-04T10:08:29.2266879Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2266916Z -0.3257-0.6597j], 2025-12-04T10:08:29.2266979Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2267018Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2267020Z 2025-12-04T10:08:29.2267022Z 2025-12-04T10:08:29.2267093Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2267132Z -0.6637-0.1175j], 2025-12-04T10:08:29.2267194Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2267255Z 0.4261-0.3012j], 2025-12-04T10:08:29.2267320Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2267356Z 0.2567-0.1808j], 2025-12-04T10:08:29.2267418Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2267470Z 0.1761-1.6446j], 2025-12-04T10:08:29.2267532Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2267573Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2267575Z 2025-12-04T10:08:29.2267636Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2267675Z -0.6307+0.1756j], 2025-12-04T10:08:29.2267737Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2267774Z -0.9972-0.3518j], 2025-12-04T10:08:29.2267835Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2267876Z 0.6467+0.0201j], 2025-12-04T10:08:29.2267939Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2267981Z -1.0443-0.3699j], 2025-12-04T10:08:29.2268045Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2268112Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2268114Z 2025-12-04T10:08:29.2268415Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2268417Z 2025-12-04T10:08:29.2268495Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2268702Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2268705Z 2025-12-04T10:08:29.2268791Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2268970Z FAILED [0.0526s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2268973Z 2025-12-04T10:08:29.2269064Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2269147Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2269225Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2269227Z 2025-12-04T10:08:29.2269311Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2269418Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2269453Z If the test 2025-12-04T10:08:29.2269547Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2269611Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2269705Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2269789Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2269791Z 2025-12-04T10:08:29.2269883Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2269967Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2270004Z the following. 2025-12-04T10:08:29.2270006Z 2025-12-04T10:08:29.2270093Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2270194Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2270246Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2270322Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2270399Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2270401Z 2025-12-04T10:08:29.2270434Z Got: 2025-12-04T10:08:29.2270485Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270541Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270580Z nan+nanj], 2025-12-04T10:08:29.2270626Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270668Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270707Z nan+nanj], 2025-12-04T10:08:29.2270748Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270790Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2270827Z nan+nanj], 2025-12-04T10:08:29.2270884Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2270938Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2270980Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2271035Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2271089Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2271130Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2271133Z 2025-12-04T10:08:29.2271184Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2271234Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2271278Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2271327Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2271379Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2271419Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2271470Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2271519Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2271560Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2271609Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2271659Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2271699Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2271749Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2271799Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2271839Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2271842Z 2025-12-04T10:08:29.2271843Z 2025-12-04T10:08:29.2271894Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2271943Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2271983Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2272036Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2272088Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2272128Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2272178Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2272229Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2272269Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2272319Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2272368Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2272406Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2272455Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2272503Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2272544Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2272546Z 2025-12-04T10:08:29.2272616Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2272667Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2272730Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2272781Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2272830Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2272869Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2272965Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2273015Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2273052Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2273103Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2273151Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2273191Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2273240Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2273292Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2273343Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2273394Z dtype=torch.complex128) 2025-12-04T10:08:29.2273396Z 2025-12-04T10:08:29.2273431Z Expected: 2025-12-04T10:08:29.2273508Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2273546Z 0.3401-0.5673j], 2025-12-04T10:08:29.2273611Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2273647Z 0.2078-0.7444j], 2025-12-04T10:08:29.2273712Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2273749Z 0.4109+0.5305j], 2025-12-04T10:08:29.2273812Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2273849Z -0.3607+0.5386j], 2025-12-04T10:08:29.2273912Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2273950Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2273954Z 2025-12-04T10:08:29.2274018Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2274054Z 0.5323-0.4729j], 2025-12-04T10:08:29.2274117Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2274155Z -0.6732-0.7677j], 2025-12-04T10:08:29.2274216Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2274253Z -0.5241-0.5479j], 2025-12-04T10:08:29.2274314Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2274350Z -0.3257-0.6597j], 2025-12-04T10:08:29.2274412Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2274449Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2274452Z 2025-12-04T10:08:29.2274454Z 2025-12-04T10:08:29.2274515Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2274553Z -0.6637-0.1175j], 2025-12-04T10:08:29.2274617Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2274653Z 0.4261-0.3012j], 2025-12-04T10:08:29.2274716Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2274753Z 0.2567-0.1808j], 2025-12-04T10:08:29.2274814Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2274850Z 0.1761-1.6446j], 2025-12-04T10:08:29.2274911Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2274952Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2274954Z 2025-12-04T10:08:29.2275019Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2275091Z -0.6307+0.1756j], 2025-12-04T10:08:29.2275154Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2275206Z -0.9972-0.3518j], 2025-12-04T10:08:29.2275284Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2275322Z 0.6467+0.0201j], 2025-12-04T10:08:29.2275383Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2275434Z -1.0443-0.3699j], 2025-12-04T10:08:29.2275497Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2275564Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2275565Z 2025-12-04T10:08:29.2275863Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2275865Z 2025-12-04T10:08:29.2275938Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2276145Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2276148Z 2025-12-04T10:08:29.2276235Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2276413Z FAILED [0.0594s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2276416Z 2025-12-04T10:08:29.2276507Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2276589Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2276668Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2276670Z 2025-12-04T10:08:29.2276753Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2276856Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2276892Z If the test 2025-12-04T10:08:29.2276985Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2277047Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2277144Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2277227Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2277229Z 2025-12-04T10:08:29.2277320Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2277404Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2277441Z the following. 2025-12-04T10:08:29.2277443Z 2025-12-04T10:08:29.2277531Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2277622Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2277674Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2277738Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2277798Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2277801Z 2025-12-04T10:08:29.2277834Z Got: 2025-12-04T10:08:29.2277883Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2277927Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2277965Z nan+nanj], 2025-12-04T10:08:29.2278009Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2278051Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2278090Z nan+nanj], 2025-12-04T10:08:29.2278131Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2278190Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2278228Z nan+nanj], 2025-12-04T10:08:29.2278283Z [-6.8713e-02+4.1696e-01j, 4.9646e-02+4.3508e-01j, 2025-12-04T10:08:29.2278359Z -3.1639e-02-7.7189e-03j, -1.2184e-01-1.0718e-01j, 2025-12-04T10:08:29.2278401Z -8.5515e-02-2.2762e-02j], 2025-12-04T10:08:29.2278452Z [ 1.0284e-01-5.4252e-02j, 6.0851e-02-2.1565e-01j, 2025-12-04T10:08:29.2278516Z -2.2839e-03+1.6702e-01j, 1.0233e-01+7.1440e-02j, 2025-12-04T10:08:29.2278557Z -1.8752e-02+6.3237e-03j]], 2025-12-04T10:08:29.2278559Z 2025-12-04T10:08:29.2278609Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2278660Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2278699Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2278748Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2278799Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2278838Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2278889Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2278940Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2278980Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2279029Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2279080Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2279119Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2279167Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2279216Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2279257Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2279259Z 2025-12-04T10:08:29.2279261Z 2025-12-04T10:08:29.2279312Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2279362Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2279401Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2279451Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2279504Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2279541Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2279591Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2279642Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2279681Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2279730Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2279780Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2279818Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2279867Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2279916Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2279957Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2279959Z 2025-12-04T10:08:29.2280008Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2280060Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2280098Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2280149Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2280199Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2280238Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2280287Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2280337Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2280374Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2280424Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2280485Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2280525Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2280575Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2280655Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2280706Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2280753Z dtype=torch.complex128) 2025-12-04T10:08:29.2280754Z 2025-12-04T10:08:29.2280799Z Expected: 2025-12-04T10:08:29.2280875Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2280912Z 0.3401-0.5673j], 2025-12-04T10:08:29.2280977Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2281013Z 0.2078-0.7444j], 2025-12-04T10:08:29.2281079Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2281114Z 0.4109+0.5305j], 2025-12-04T10:08:29.2281178Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2281215Z -0.3607+0.5386j], 2025-12-04T10:08:29.2281278Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2281320Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2281323Z 2025-12-04T10:08:29.2281385Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2281423Z 0.5323-0.4729j], 2025-12-04T10:08:29.2281485Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2281522Z -0.6732-0.7677j], 2025-12-04T10:08:29.2281583Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2281620Z -0.5241-0.5479j], 2025-12-04T10:08:29.2281682Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2281718Z -0.3257-0.6597j], 2025-12-04T10:08:29.2281781Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2281820Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2281822Z 2025-12-04T10:08:29.2281824Z 2025-12-04T10:08:29.2281887Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2281925Z -0.6637-0.1175j], 2025-12-04T10:08:29.2281987Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2282024Z 0.4261-0.3012j], 2025-12-04T10:08:29.2282086Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2282123Z 0.2567-0.1808j], 2025-12-04T10:08:29.2282189Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2282225Z 0.1761-1.6446j], 2025-12-04T10:08:29.2282287Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2282326Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2282329Z 2025-12-04T10:08:29.2282389Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2282426Z -0.6307+0.1756j], 2025-12-04T10:08:29.2282490Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2282527Z -0.9972-0.3518j], 2025-12-04T10:08:29.2282587Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2282625Z 0.6467+0.0201j], 2025-12-04T10:08:29.2282686Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2282723Z -1.0443-0.3699j], 2025-12-04T10:08:29.2282786Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2282852Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2282854Z 2025-12-04T10:08:29.2283239Z Caused by sample input at index 10: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={'upper': 'False'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2283269Z 2025-12-04T10:08:29.2283343Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2283546Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=10 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2283563Z 2025-12-04T10:08:29.2283648Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2283823Z FAILED [0.0556s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2283825Z 2025-12-04T10:08:29.2283916Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2283999Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2284077Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2284080Z 2025-12-04T10:08:29.2284165Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2284267Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2284302Z If the test 2025-12-04T10:08:29.2284397Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2284460Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2284554Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2284635Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2284637Z 2025-12-04T10:08:29.2284729Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2284813Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2284850Z the following. 2025-12-04T10:08:29.2284852Z 2025-12-04T10:08:29.2284941Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2285033Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2285085Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2285149Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2285210Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2285212Z 2025-12-04T10:08:29.2285245Z Got: 2025-12-04T10:08:29.2285295Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285341Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285379Z nan+nanj], 2025-12-04T10:08:29.2285423Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285467Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285504Z nan+nanj], 2025-12-04T10:08:29.2285546Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285590Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2285628Z nan+nanj], 2025-12-04T10:08:29.2285684Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2285738Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2285779Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2285829Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2285881Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2285922Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2285924Z 2025-12-04T10:08:29.2285975Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2286025Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2286077Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2286127Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2286178Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2286238Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2286293Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2286342Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2286394Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2286443Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2286492Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2286531Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2286580Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2286630Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2286671Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2286674Z 2025-12-04T10:08:29.2286676Z 2025-12-04T10:08:29.2286727Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2286775Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2286817Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2286867Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2286917Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2286957Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2287007Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2287057Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2287095Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2287145Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2287194Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2287233Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2287283Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2287331Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2287374Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2287376Z 2025-12-04T10:08:29.2287425Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2287474Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2287514Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2287564Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2287613Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2287652Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2287701Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2287751Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2287789Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2287840Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2287888Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2287929Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2287978Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2288029Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2288081Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2288125Z dtype=torch.complex128) 2025-12-04T10:08:29.2288127Z 2025-12-04T10:08:29.2288160Z Expected: 2025-12-04T10:08:29.2288237Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2288274Z 0.3401-0.5673j], 2025-12-04T10:08:29.2288339Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2288375Z 0.2078-0.7444j], 2025-12-04T10:08:29.2288452Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2288488Z 0.4109+0.5305j], 2025-12-04T10:08:29.2288553Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2288611Z -0.3607+0.5386j], 2025-12-04T10:08:29.2288675Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2288714Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2288729Z 2025-12-04T10:08:29.2288793Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2288828Z 0.5323-0.4729j], 2025-12-04T10:08:29.2288892Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2288929Z -0.6732-0.7677j], 2025-12-04T10:08:29.2288991Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2289028Z -0.5241-0.5479j], 2025-12-04T10:08:29.2289091Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2289127Z -0.3257-0.6597j], 2025-12-04T10:08:29.2289189Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2289231Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2289233Z 2025-12-04T10:08:29.2289235Z 2025-12-04T10:08:29.2289297Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2289337Z -0.6637-0.1175j], 2025-12-04T10:08:29.2289398Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2289435Z 0.4261-0.3012j], 2025-12-04T10:08:29.2289497Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2289533Z 0.2567-0.1808j], 2025-12-04T10:08:29.2289595Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2289632Z 0.1761-1.6446j], 2025-12-04T10:08:29.2289694Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2289733Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2289736Z 2025-12-04T10:08:29.2289798Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2289836Z -0.6307+0.1756j], 2025-12-04T10:08:29.2289897Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2289936Z -0.9972-0.3518j], 2025-12-04T10:08:29.2289997Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2290033Z 0.6467+0.0201j], 2025-12-04T10:08:29.2290094Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2290131Z -1.0443-0.3699j], 2025-12-04T10:08:29.2290194Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2290260Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2290262Z 2025-12-04T10:08:29.2290559Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2290563Z 2025-12-04T10:08:29.2290636Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2290839Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2290842Z 2025-12-04T10:08:29.2290927Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2291105Z FAILED [0.0542s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2291107Z 2025-12-04T10:08:29.2291219Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2291302Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2291406Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2291408Z 2025-12-04T10:08:29.2291492Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2291610Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2291646Z If the test 2025-12-04T10:08:29.2291739Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2291802Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2291895Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2291977Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2291979Z 2025-12-04T10:08:29.2292073Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2292156Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2292196Z the following. 2025-12-04T10:08:29.2292198Z 2025-12-04T10:08:29.2292286Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2292377Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2292430Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2292493Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2292554Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2292556Z 2025-12-04T10:08:29.2292588Z Got: 2025-12-04T10:08:29.2292638Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2292682Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2292721Z nan+nanj], 2025-12-04T10:08:29.2292767Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2292811Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2292850Z nan+nanj], 2025-12-04T10:08:29.2292894Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2292977Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2293015Z nan+nanj], 2025-12-04T10:08:29.2293073Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2293128Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2293168Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2293218Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2293270Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2293311Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2293313Z 2025-12-04T10:08:29.2293364Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2293415Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2293456Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2293508Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2293561Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2293600Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2293650Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2293700Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2293741Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2293791Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2293843Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2293881Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2293932Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2293998Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2294041Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2294043Z 2025-12-04T10:08:29.2294057Z 2025-12-04T10:08:29.2294125Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2294175Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2294214Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2294297Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2294348Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2294385Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2294436Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2294486Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2294524Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2294574Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2294627Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2294665Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2294716Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2294765Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2294809Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2294811Z 2025-12-04T10:08:29.2294861Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2294912Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2294952Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2295003Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2295051Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2295090Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2295141Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2295192Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2295230Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2295281Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2295332Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2295372Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2295421Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2295475Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2295527Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2295572Z dtype=torch.complex128) 2025-12-04T10:08:29.2295574Z 2025-12-04T10:08:29.2295608Z Expected: 2025-12-04T10:08:29.2295684Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2295721Z 0.3401-0.5673j], 2025-12-04T10:08:29.2295786Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2295825Z 0.2078-0.7444j], 2025-12-04T10:08:29.2295890Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2295927Z 0.4109+0.5305j], 2025-12-04T10:08:29.2295992Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2296030Z -0.3607+0.5386j], 2025-12-04T10:08:29.2296095Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2296132Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2296134Z 2025-12-04T10:08:29.2296197Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2296233Z 0.5323-0.4729j], 2025-12-04T10:08:29.2296297Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2296333Z -0.6732-0.7677j], 2025-12-04T10:08:29.2296410Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2296447Z -0.5241-0.5479j], 2025-12-04T10:08:29.2296509Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2296568Z -0.3257-0.6597j], 2025-12-04T10:08:29.2296632Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2296673Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2296685Z 2025-12-04T10:08:29.2296687Z 2025-12-04T10:08:29.2296749Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2296786Z -0.6637-0.1175j], 2025-12-04T10:08:29.2296848Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2296885Z 0.4261-0.3012j], 2025-12-04T10:08:29.2296947Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2296985Z 0.2567-0.1808j], 2025-12-04T10:08:29.2297047Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2297083Z 0.1761-1.6446j], 2025-12-04T10:08:29.2297145Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2297187Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2297189Z 2025-12-04T10:08:29.2297251Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2297288Z -0.6307+0.1756j], 2025-12-04T10:08:29.2297351Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2297388Z -0.9972-0.3518j], 2025-12-04T10:08:29.2297450Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2297486Z 0.6467+0.0201j], 2025-12-04T10:08:29.2297546Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2297583Z -1.0443-0.3699j], 2025-12-04T10:08:29.2297646Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2297712Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2297715Z 2025-12-04T10:08:29.2298018Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2298022Z 2025-12-04T10:08:29.2298096Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2298302Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2298304Z 2025-12-04T10:08:29.2298390Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2298568Z FAILED [0.0549s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2298569Z 2025-12-04T10:08:29.2298662Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2298744Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2298824Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2298827Z 2025-12-04T10:08:29.2298911Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2299013Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2299048Z If the test 2025-12-04T10:08:29.2299141Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2299203Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2299297Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2299389Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2299391Z 2025-12-04T10:08:29.2299493Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2299587Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2299624Z the following. 2025-12-04T10:08:29.2299626Z 2025-12-04T10:08:29.2299730Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2299820Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2299871Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2299934Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2299995Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2299997Z 2025-12-04T10:08:29.2300029Z Got: 2025-12-04T10:08:29.2300106Z tensor([[[[-10.9555+1.1443e+01j, -10.7610+9.3674e+00j, 4.0176+4.5979e+00j, 2025-12-04T10:08:29.2300159Z 6.2494-9.6514e+00j, -7.6518-2.9573e+00j], 2025-12-04T10:08:29.2300224Z [ 1.6973-1.0608e+01j, 3.8142-1.0573e+01j, -6.6223-2.5443e+00j, 2025-12-04T10:08:29.2300276Z -1.1524+8.9229e+00j, 4.8668-1.4703e+00j], 2025-12-04T10:08:29.2300341Z [ -1.4156-5.1293e+00j, -0.1388-5.3173e+00j, -3.7781-2.4617e-01j, 2025-12-04T10:08:29.2300390Z 0.4484+4.2408e+00j, 1.5391-1.9971e+00j], 2025-12-04T10:08:29.2300452Z [ -1.3952-2.9971e+00j, -1.4045-2.8774e+00j, -0.7956+1.0268e-02j, 2025-12-04T10:08:29.2300499Z 1.1773+8.6251e-01j, 0.7337-4.2551e-01j], 2025-12-04T10:08:29.2300560Z [ -0.0984+7.5107e-01j, 0.9180+1.1351e+00j, -0.8797-6.4058e-01j, 2025-12-04T10:08:29.2300611Z -0.7650+2.7541e-01j, 0.0369-1.2352e-01j]], 2025-12-04T10:08:29.2300613Z 2025-12-04T10:08:29.2300674Z [[ -4.9773+1.6248e+00j, 2.9623+9.3284e-01j, 4.8539-3.5427e-03j, 2025-12-04T10:08:29.2300722Z 0.6497-4.7870e+00j, -0.9892+1.2625e-01j], 2025-12-04T10:08:29.2300782Z [ -1.7052-2.8590e+00j, -0.0110+1.1556e+00j, 1.9902+2.9968e+00j, 2025-12-04T10:08:29.2300831Z 2.8546-8.5227e-01j, -0.8828+2.1961e-01j], 2025-12-04T10:08:29.2300893Z [ 3.1874-2.3475e+00j, -1.6718-2.0495e-01j, -6.3047-8.6525e-01j, 2025-12-04T10:08:29.2300938Z 0.5177+3.8594e+00j, 1.7619-8.4486e-02j], 2025-12-04T10:08:29.2301001Z [ 0.9590-1.5771e+00j, -0.2202+5.4104e-01j, -2.1598+1.7769e+00j, 2025-12-04T10:08:29.2301046Z 0.8666+5.8784e-01j, 0.7389-9.9069e-01j], 2025-12-04T10:08:29.2301105Z [ 0.5992+5.4884e-01j, 0.1630+4.6679e-01j, -1.3796-4.8927e-01j, 2025-12-04T10:08:29.2301158Z -0.3115+2.4686e-01j, 0.2055+1.7864e-01j]]], 2025-12-04T10:08:29.2301161Z 2025-12-04T10:08:29.2301162Z 2025-12-04T10:08:29.2301224Z [[[ -0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.2301270Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.2301332Z [ -0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.2301379Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.2301441Z [ -0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.2301489Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.2301551Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.2301596Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.2301657Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.2301707Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.2301709Z 2025-12-04T10:08:29.2301769Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.2301828Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.2301890Z [ -1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.2301948Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.2302019Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.2302065Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.2302136Z [ -0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.2302181Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.2302243Z [ -0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.2302306Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2302351Z dtype=torch.complex128) 2025-12-04T10:08:29.2302353Z 2025-12-04T10:08:29.2302387Z Expected: 2025-12-04T10:08:29.2302461Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2302498Z 0.3401-0.5673j], 2025-12-04T10:08:29.2302564Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2302603Z 0.2078-0.7444j], 2025-12-04T10:08:29.2302668Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2302704Z 0.4109+0.5305j], 2025-12-04T10:08:29.2302769Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2302807Z -0.3607+0.5386j], 2025-12-04T10:08:29.2302870Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2302908Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2302911Z 2025-12-04T10:08:29.2303013Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2303049Z 0.5323-0.4729j], 2025-12-04T10:08:29.2303113Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2303150Z -0.6732-0.7677j], 2025-12-04T10:08:29.2303212Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2303250Z -0.5241-0.5479j], 2025-12-04T10:08:29.2303312Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2303349Z -0.3257-0.6597j], 2025-12-04T10:08:29.2303413Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2303452Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2303454Z 2025-12-04T10:08:29.2303455Z 2025-12-04T10:08:29.2303517Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2303554Z -0.6637-0.1175j], 2025-12-04T10:08:29.2303616Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2303652Z 0.4261-0.3012j], 2025-12-04T10:08:29.2303717Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2303753Z 0.2567-0.1808j], 2025-12-04T10:08:29.2303816Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2303853Z 0.1761-1.6446j], 2025-12-04T10:08:29.2303915Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2303954Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2303958Z 2025-12-04T10:08:29.2304020Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2304057Z -0.6307+0.1756j], 2025-12-04T10:08:29.2304119Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2304156Z -0.9972-0.3518j], 2025-12-04T10:08:29.2304217Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2304253Z 0.6467+0.0201j], 2025-12-04T10:08:29.2304334Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2304372Z -1.0443-0.3699j], 2025-12-04T10:08:29.2304448Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2304530Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2304532Z 2025-12-04T10:08:29.2304832Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2304849Z 2025-12-04T10:08:29.2304923Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2305128Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2305130Z 2025-12-04T10:08:29.2305217Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2305398Z FAILED [0.0540s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2305401Z 2025-12-04T10:08:29.2305492Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2305573Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2305655Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2305658Z 2025-12-04T10:08:29.2305740Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2305843Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2305878Z If the test 2025-12-04T10:08:29.2305971Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2306034Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2306128Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2306210Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2306212Z 2025-12-04T10:08:29.2306303Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2306387Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2306424Z the following. 2025-12-04T10:08:29.2306426Z 2025-12-04T10:08:29.2306513Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2306603Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2306654Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2306718Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2306779Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2306781Z 2025-12-04T10:08:29.2306813Z Got: 2025-12-04T10:08:29.2306887Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1047j, 1.1406+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.2306926Z 0.3399-0.5667j], 2025-12-04T10:08:29.2306989Z [ 0.6809-0.1507j, 0.2812+0.1175j, 0.5375+0.1638j, 0.8389-0.5080j, 2025-12-04T10:08:29.2307026Z 0.2074-0.7436j], 2025-12-04T10:08:29.2307092Z [-1.1227+0.2137j, -1.1472+0.5734j, 0.6646-0.4148j, 0.1232-1.7416j, 2025-12-04T10:08:29.2307128Z 0.4108+0.5305j], 2025-12-04T10:08:29.2307191Z [ 1.5016+0.8767j, 0.5762+0.6562j, 1.3188+0.1896j, -0.3358-0.6125j, 2025-12-04T10:08:29.2307228Z -0.3605+0.5383j], 2025-12-04T10:08:29.2307290Z [-0.5945-0.5360j, -1.5380+0.1181j, 1.0848-0.3813j, 0.2191-0.8307j, 2025-12-04T10:08:29.2307329Z 0.0853+0.1062j]], 2025-12-04T10:08:29.2307330Z 2025-12-04T10:08:29.2307404Z [[-0.4814+0.4918j, 1.0181+0.7994j, -0.4840-1.6292j, 0.3046-0.1542j, 2025-12-04T10:08:29.2307442Z 0.5318-0.4740j], 2025-12-04T10:08:29.2307504Z [ 0.9584+1.1453j, -0.8334+0.4231j, 0.6382+0.0402j, -0.1755-0.1514j, 2025-12-04T10:08:29.2307562Z -0.6735-0.7687j], 2025-12-04T10:08:29.2307624Z [ 0.6042-0.8441j, 0.5444-1.0102j, 1.4445+0.0590j, -1.1478+0.0824j, 2025-12-04T10:08:29.2307661Z -0.5243-0.5478j], 2025-12-04T10:08:29.2307733Z [-0.3103-0.4949j, 0.4622+0.9676j, -0.9095+1.4325j, 0.3254-0.2537j, 2025-12-04T10:08:29.2307770Z -0.3255-0.6602j], 2025-12-04T10:08:29.2307833Z [ 0.9170+0.3097j, 0.4022+0.4302j, -1.7385+0.1306j, -0.2206+0.4188j, 2025-12-04T10:08:29.2307871Z 0.3098+0.0958j]]], 2025-12-04T10:08:29.2307873Z 2025-12-04T10:08:29.2307874Z 2025-12-04T10:08:29.2307937Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2307972Z -0.6637-0.1175j], 2025-12-04T10:08:29.2308036Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2308072Z 0.4261-0.3012j], 2025-12-04T10:08:29.2308137Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2308175Z 0.2567-0.1808j], 2025-12-04T10:08:29.2308238Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2308274Z 0.1761-1.6446j], 2025-12-04T10:08:29.2308340Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2308380Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2308382Z 2025-12-04T10:08:29.2308444Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2308480Z -0.6307+0.1756j], 2025-12-04T10:08:29.2308548Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2308583Z -0.9972-0.3518j], 2025-12-04T10:08:29.2308646Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2308681Z 0.6467+0.0201j], 2025-12-04T10:08:29.2308745Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2308781Z -1.0443-0.3699j], 2025-12-04T10:08:29.2308845Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2308910Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2308913Z 2025-12-04T10:08:29.2308948Z Expected: 2025-12-04T10:08:29.2309019Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2309056Z 0.3401-0.5673j], 2025-12-04T10:08:29.2309116Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2309153Z 0.2078-0.7444j], 2025-12-04T10:08:29.2309215Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2309252Z 0.4109+0.5305j], 2025-12-04T10:08:29.2309313Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2309352Z -0.3607+0.5386j], 2025-12-04T10:08:29.2309414Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2309453Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2309455Z 2025-12-04T10:08:29.2309518Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2309555Z 0.5323-0.4729j], 2025-12-04T10:08:29.2309619Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2309654Z -0.6732-0.7677j], 2025-12-04T10:08:29.2309716Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2309752Z -0.5241-0.5479j], 2025-12-04T10:08:29.2309814Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2309862Z -0.3257-0.6597j], 2025-12-04T10:08:29.2309925Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2309973Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2309993Z 2025-12-04T10:08:29.2309995Z 2025-12-04T10:08:29.2310059Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2310095Z -0.6637-0.1175j], 2025-12-04T10:08:29.2310169Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2310205Z 0.4261-0.3012j], 2025-12-04T10:08:29.2310269Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2310304Z 0.2567-0.1808j], 2025-12-04T10:08:29.2310367Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2310402Z 0.1761-1.6446j], 2025-12-04T10:08:29.2310466Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2310505Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2310506Z 2025-12-04T10:08:29.2310570Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2310608Z -0.6307+0.1756j], 2025-12-04T10:08:29.2310670Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2310706Z -0.9972-0.3518j], 2025-12-04T10:08:29.2310769Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2310804Z 0.6467+0.0201j], 2025-12-04T10:08:29.2310866Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2310901Z -1.0443-0.3699j], 2025-12-04T10:08:29.2310966Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2311029Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2311032Z 2025-12-04T10:08:29.2311328Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2311331Z 2025-12-04T10:08:29.2311406Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2311610Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2311612Z 2025-12-04T10:08:29.2311699Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2312010Z FAILED [0.0784s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.2312067Z numerical:(-3.789329528702977-1498.8805873207555j) 2025-12-04T10:08:29.2312126Z analytical:(-3.7893295284827486-1.6896308095602504j) 2025-12-04T10:08:29.2312129Z 2025-12-04T10:08:29.2312232Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2312336Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2312435Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2312438Z 2025-12-04T10:08:29.2312472Z Numerical: 2025-12-04T10:08:29.2312548Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.2312597Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2312637Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2312701Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2312760Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2312800Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2312861Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2312984Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313022Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2313056Z ..., 2025-12-04T10:08:29.2313117Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313181Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.2313219Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.2313280Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313325Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.2313362Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.2313421Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313470Z ..., 1.8450+0.0000e+00j, -4.5147+2.2204e-10j, 2025-12-04T10:08:29.2313542Z -17.2724+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2313580Z Analytical: 2025-12-04T10:08:29.2313651Z tensor([[ -6.8962+8.5367e-03j, 4.4422+4.6947e-03j, -17.1751-2.9084e-03j, 2025-12-04T10:08:29.2313699Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2313736Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2313799Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313844Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313880Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2313939Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2313984Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2314020Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2314053Z ..., 2025-12-04T10:08:29.2314115Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2314162Z ..., -2.0647+1.3880e+00j, 2.2690+4.8761e+00j, 2025-12-04T10:08:29.2314199Z -3.5478-3.0187e+00j], 2025-12-04T10:08:29.2314263Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2314307Z ..., 5.4702+3.5206e+00j, 5.8333+4.9154e+00j, 2025-12-04T10:08:29.2314344Z 7.9937+8.5387e+00j], 2025-12-04T10:08:29.2314405Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2314452Z ..., 1.8450+1.1347e-17j, -4.5147-2.7766e-17j, 2025-12-04T10:08:29.2314522Z -17.2724-1.0623e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2314524Z 2025-12-04T10:08:29.2314605Z The max per-element difference (slow mode) is: 2.85017036937797e-09. 2025-12-04T10:08:29.2314701Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2314749Z test might've passed in slow_mode! 2025-12-04T10:08:29.2314751Z 2025-12-04T10:08:29.2314836Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2314942Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2314944Z 2025-12-04T10:08:29.2314979Z If the test 2025-12-04T10:08:29.2315072Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2315128Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2315223Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2315270Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2315347Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2315411Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2315413Z 2025-12-04T10:08:29.2315734Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2315767Z 2025-12-04T10:08:29.2315841Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2316045Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2316057Z 2025-12-04T10:08:29.2316144Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2316321Z FAILED [0.0545s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2316324Z 2025-12-04T10:08:29.2316415Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2316497Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2316576Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2316579Z 2025-12-04T10:08:29.2316663Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2316763Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2316798Z If the test 2025-12-04T10:08:29.2316891Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2316954Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2317046Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2317127Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2317129Z 2025-12-04T10:08:29.2317219Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2317304Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2317340Z the following. 2025-12-04T10:08:29.2317342Z 2025-12-04T10:08:29.2317432Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2317522Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2317574Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2317637Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2317699Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2317701Z 2025-12-04T10:08:29.2317733Z Got: 2025-12-04T10:08:29.2317804Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2317843Z nan+nanj], 2025-12-04T10:08:29.2317905Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2317941Z nan+nanj], 2025-12-04T10:08:29.2317999Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2318036Z nan+nanj], 2025-12-04T10:08:29.2318105Z [-0.4501-0.4557j, -0.4128-0.1096j, -0.0924-0.3252j, 0.0246-0.0093j, 2025-12-04T10:08:29.2318144Z 0.1692-0.0800j], 2025-12-04T10:08:29.2318211Z [ 0.0270+0.0775j, 0.1441+0.0653j, -0.1164-0.0193j, -0.0607+0.0639j, 2025-12-04T10:08:29.2318250Z -0.0024-0.0138j]], 2025-12-04T10:08:29.2318254Z 2025-12-04T10:08:29.2318318Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2318355Z 0.5323-0.4729j], 2025-12-04T10:08:29.2318418Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2318455Z -0.6732-0.7677j], 2025-12-04T10:08:29.2318517Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2318554Z -0.5241-0.5479j], 2025-12-04T10:08:29.2318627Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2318664Z -0.3257-0.6597j], 2025-12-04T10:08:29.2318727Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2318785Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2318787Z 2025-12-04T10:08:29.2318789Z 2025-12-04T10:08:29.2318851Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2318900Z -0.6637-0.1175j], 2025-12-04T10:08:29.2318963Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2318999Z 0.4261-0.3012j], 2025-12-04T10:08:29.2319061Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2319097Z 0.2567-0.1808j], 2025-12-04T10:08:29.2319159Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2319195Z 0.1761-1.6446j], 2025-12-04T10:08:29.2319257Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2321082Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2321086Z 2025-12-04T10:08:29.2321152Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2321190Z -0.6307+0.1756j], 2025-12-04T10:08:29.2321253Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2321292Z -0.9972-0.3518j], 2025-12-04T10:08:29.2321354Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2321390Z 0.6467+0.0201j], 2025-12-04T10:08:29.2321451Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2321488Z -1.0443-0.3699j], 2025-12-04T10:08:29.2321551Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2321620Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2321622Z 2025-12-04T10:08:29.2321657Z Expected: 2025-12-04T10:08:29.2321730Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2321768Z 0.3401-0.5673j], 2025-12-04T10:08:29.2321831Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2321867Z 0.2078-0.7444j], 2025-12-04T10:08:29.2321932Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2321967Z 0.4109+0.5305j], 2025-12-04T10:08:29.2322029Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2322066Z -0.3607+0.5386j], 2025-12-04T10:08:29.2322128Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2322166Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2322168Z 2025-12-04T10:08:29.2322230Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2322267Z 0.5323-0.4729j], 2025-12-04T10:08:29.2322329Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2322370Z -0.6732-0.7677j], 2025-12-04T10:08:29.2322431Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2322468Z -0.5241-0.5479j], 2025-12-04T10:08:29.2322531Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2322567Z -0.3257-0.6597j], 2025-12-04T10:08:29.2322629Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2322667Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2322669Z 2025-12-04T10:08:29.2322671Z 2025-12-04T10:08:29.2322732Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2322768Z -0.6637-0.1175j], 2025-12-04T10:08:29.2322851Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2322890Z 0.4261-0.3012j], 2025-12-04T10:08:29.2323015Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2323067Z 0.2567-0.1808j], 2025-12-04T10:08:29.2323129Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2323166Z 0.1761-1.6446j], 2025-12-04T10:08:29.2323245Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2323284Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2323286Z 2025-12-04T10:08:29.2323347Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2323385Z -0.6307+0.1756j], 2025-12-04T10:08:29.2323447Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2323484Z -0.9972-0.3518j], 2025-12-04T10:08:29.2323548Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2323584Z 0.6467+0.0201j], 2025-12-04T10:08:29.2323647Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2323686Z -1.0443-0.3699j], 2025-12-04T10:08:29.2323750Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2323816Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2323819Z 2025-12-04T10:08:29.2324114Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2324117Z 2025-12-04T10:08:29.2324192Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2324397Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2324399Z 2025-12-04T10:08:29.2324486Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2324665Z FAILED [0.0546s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2324668Z 2025-12-04T10:08:29.2324760Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2324841Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2324920Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2324922Z 2025-12-04T10:08:29.2325005Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2325107Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2325143Z If the test 2025-12-04T10:08:29.2325236Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2325298Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2325394Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2325474Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2325477Z 2025-12-04T10:08:29.2325568Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2325651Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2325688Z the following. 2025-12-04T10:08:29.2325690Z 2025-12-04T10:08:29.2325777Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2325867Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2325934Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2325999Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2326059Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2326083Z 2025-12-04T10:08:29.2326116Z Got: 2025-12-04T10:08:29.2326166Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326212Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326269Z nan+nanj], 2025-12-04T10:08:29.2326314Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326357Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326395Z nan+nanj], 2025-12-04T10:08:29.2326437Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326480Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2326517Z nan+nanj], 2025-12-04T10:08:29.2326575Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2326630Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2326674Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2326727Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2326782Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2326825Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2326827Z 2025-12-04T10:08:29.2326878Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2326930Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2326971Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2327021Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2327072Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2327111Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2327161Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2327211Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2327250Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2327299Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2327350Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2327390Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2327439Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2327490Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2327531Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2327532Z 2025-12-04T10:08:29.2327534Z 2025-12-04T10:08:29.2327585Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2327633Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2327673Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2327722Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2327774Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2327812Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2327862Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2327915Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2327954Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2328004Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2328055Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2328093Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2328144Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2328192Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2328234Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2328236Z 2025-12-04T10:08:29.2328285Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2328349Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2328388Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2328439Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2328509Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2328549Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2328598Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2328664Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2328703Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2328756Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2328804Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2328844Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2328892Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2328944Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2328996Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2329041Z dtype=torch.complex128) 2025-12-04T10:08:29.2329043Z 2025-12-04T10:08:29.2329079Z Expected: 2025-12-04T10:08:29.2329156Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2329193Z 0.3401-0.5673j], 2025-12-04T10:08:29.2329258Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2329296Z 0.2078-0.7444j], 2025-12-04T10:08:29.2329362Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2329397Z 0.4109+0.5305j], 2025-12-04T10:08:29.2329460Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2329496Z -0.3607+0.5386j], 2025-12-04T10:08:29.2329559Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2329598Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2329601Z 2025-12-04T10:08:29.2329664Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2329702Z 0.5323-0.4729j], 2025-12-04T10:08:29.2329765Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2329802Z -0.6732-0.7677j], 2025-12-04T10:08:29.2329863Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2329900Z -0.5241-0.5479j], 2025-12-04T10:08:29.2329962Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2329998Z -0.3257-0.6597j], 2025-12-04T10:08:29.2330060Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2330099Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2330101Z 2025-12-04T10:08:29.2330102Z 2025-12-04T10:08:29.2330165Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2330201Z -0.6637-0.1175j], 2025-12-04T10:08:29.2330263Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2330301Z 0.4261-0.3012j], 2025-12-04T10:08:29.2330364Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2330400Z 0.2567-0.1808j], 2025-12-04T10:08:29.2330464Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2330500Z 0.1761-1.6446j], 2025-12-04T10:08:29.2330561Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2330600Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2330601Z 2025-12-04T10:08:29.2330662Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2330699Z -0.6307+0.1756j], 2025-12-04T10:08:29.2330774Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2330812Z -0.9972-0.3518j], 2025-12-04T10:08:29.2330873Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2330931Z 0.6467+0.0201j], 2025-12-04T10:08:29.2330993Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2331030Z -1.0443-0.3699j], 2025-12-04T10:08:29.2331103Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2331167Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2331170Z 2025-12-04T10:08:29.2331468Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2331470Z 2025-12-04T10:08:29.2331544Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2331750Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2331754Z 2025-12-04T10:08:29.2331841Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2332019Z FAILED [0.0550s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2332022Z 2025-12-04T10:08:29.2332114Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2332197Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2332276Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2332277Z 2025-12-04T10:08:29.2332362Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2332464Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2332499Z If the test 2025-12-04T10:08:29.2332593Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2332656Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2332750Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2332832Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2332834Z 2025-12-04T10:08:29.2332925Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2333039Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2333076Z the following. 2025-12-04T10:08:29.2333078Z 2025-12-04T10:08:29.2333166Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2333258Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2333309Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2333377Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2333437Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2333439Z 2025-12-04T10:08:29.2333472Z Got: 2025-12-04T10:08:29.2333532Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.2333587Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.2333626Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.2333679Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.2333729Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.2333769Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.2333818Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.2333890Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.2333929Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.2333979Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.2334055Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.2334096Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.2334145Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.2334210Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.2334250Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.2334252Z 2025-12-04T10:08:29.2334301Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.2334351Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.2334390Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.2334441Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.2334495Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.2334534Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.2334582Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.2334635Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.2334673Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.2334723Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.2334773Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.2334813Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.2334861Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.2334911Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.2334950Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.2334953Z 2025-12-04T10:08:29.2334955Z 2025-12-04T10:08:29.2335005Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2335055Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2335094Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2335147Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2335201Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2335239Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2335289Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2335341Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2335379Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2335428Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2335478Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2335515Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2335564Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2335614Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2335655Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2335657Z 2025-12-04T10:08:29.2335706Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2335758Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2335796Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2335847Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2335897Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2335936Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2335985Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2336035Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2336072Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2336123Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2336183Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2336223Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2336272Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2336342Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2336393Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2336437Z dtype=torch.complex128) 2025-12-04T10:08:29.2336439Z 2025-12-04T10:08:29.2336485Z Expected: 2025-12-04T10:08:29.2336561Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2336598Z 0.3401-0.5673j], 2025-12-04T10:08:29.2336663Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2336699Z 0.2078-0.7444j], 2025-12-04T10:08:29.2336764Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2336799Z 0.4109+0.5305j], 2025-12-04T10:08:29.2336863Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2336900Z -0.3607+0.5386j], 2025-12-04T10:08:29.2336964Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2337003Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2337006Z 2025-12-04T10:08:29.2337068Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2337106Z 0.5323-0.4729j], 2025-12-04T10:08:29.2337168Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2337205Z -0.6732-0.7677j], 2025-12-04T10:08:29.2337265Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2337303Z -0.5241-0.5479j], 2025-12-04T10:08:29.2337364Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2337400Z -0.3257-0.6597j], 2025-12-04T10:08:29.2337462Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2337501Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2337503Z 2025-12-04T10:08:29.2337506Z 2025-12-04T10:08:29.2337568Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2337605Z -0.6637-0.1175j], 2025-12-04T10:08:29.2337667Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2337704Z 0.4261-0.3012j], 2025-12-04T10:08:29.2337766Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2337801Z 0.2567-0.1808j], 2025-12-04T10:08:29.2337863Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2337899Z 0.1761-1.6446j], 2025-12-04T10:08:29.2337960Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2337999Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2338002Z 2025-12-04T10:08:29.2338064Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2338101Z -0.6307+0.1756j], 2025-12-04T10:08:29.2338165Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2338203Z -0.9972-0.3518j], 2025-12-04T10:08:29.2338264Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2338301Z 0.6467+0.0201j], 2025-12-04T10:08:29.2338362Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2338398Z -1.0443-0.3699j], 2025-12-04T10:08:29.2338460Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2338526Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2338528Z 2025-12-04T10:08:29.2338833Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2338847Z 2025-12-04T10:08:29.2338932Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2339136Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2339150Z 2025-12-04T10:08:29.2339235Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2339411Z FAILED [0.0548s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2339413Z 2025-12-04T10:08:29.2339504Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2339587Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2339665Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2339667Z 2025-12-04T10:08:29.2339752Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2339854Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2339889Z If the test 2025-12-04T10:08:29.2339983Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2340045Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2340140Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2340222Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2340224Z 2025-12-04T10:08:29.2340316Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2340406Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2340443Z the following. 2025-12-04T10:08:29.2340445Z 2025-12-04T10:08:29.2340532Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2340624Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2340675Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2340739Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2340799Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2340801Z 2025-12-04T10:08:29.2340833Z Got: 2025-12-04T10:08:29.2340895Z tensor([[[[-2.3518e+01-5.6232e+01j, -1.2445e+02-7.6613e+01j, 2025-12-04T10:08:29.2340947Z 9.3101e+01+5.3124e+01j, 7.8771e+01-5.1318e+01j, 2025-12-04T10:08:29.2340987Z -4.7595e+00+9.2052e+00j], 2025-12-04T10:08:29.2341039Z [-5.8362e+01-2.6163e+01j, -1.5184e+02+2.2944e+01j, 2025-12-04T10:08:29.2341090Z 1.1262e+02-1.7163e+01j, 3.2374e+01-9.3903e+01j, 2025-12-04T10:08:29.2341129Z 1.7040e+00+1.0627e+01j], 2025-12-04T10:08:29.2341177Z [-9.1504e+00+1.0782e+01j, -5.3149e+00+2.6978e+01j, 2025-12-04T10:08:29.2341229Z 2.4708e+00-1.7297e+01j, -1.2730e+01-1.0703e+01j, 2025-12-04T10:08:29.2341268Z 1.4913e+00+4.0749e-01j], 2025-12-04T10:08:29.2341317Z [ 4.7359e+00+3.0196e+00j, 1.4319e+01-3.8324e-01j, 2025-12-04T10:08:29.2341368Z -1.0828e+01+3.2204e-01j, -3.4928e+00+8.0073e+00j, 2025-12-04T10:08:29.2341406Z 2.8789e-01-9.7090e-01j], 2025-12-04T10:08:29.2341455Z [ 3.3319e-01-5.8596e+00j, -7.7389e+00-8.2484e+00j, 2025-12-04T10:08:29.2341504Z 7.1618e+00+4.4494e+00j, 5.7542e+00-2.5633e+00j, 2025-12-04T10:08:29.2341545Z -2.1506e-01+9.7549e-01j]], 2025-12-04T10:08:29.2341547Z 2025-12-04T10:08:29.2341596Z [[ 6.1179e+00+8.1178e-01j, -1.1040e+00+9.5730e+00j, 2025-12-04T10:08:29.2341657Z -2.1417e+01+4.3606e+00j, -2.4228e+00+4.2418e+00j, 2025-12-04T10:08:29.2341697Z 1.2144e+00-5.4223e+00j], 2025-12-04T10:08:29.2341745Z [ 1.0554e+00+2.0025e+00j, 6.0366e-01+1.3909e+00j, 2025-12-04T10:08:29.2341821Z -5.3986e+00-3.7971e+00j, -1.9855e+00+1.4202e-01j, 2025-12-04T10:08:29.2341859Z 1.8767e+00+4.8361e-01j], 2025-12-04T10:08:29.2341908Z [ 7.9709e-01+3.7062e+00j, -7.5262e-01+5.7069e+00j, 2025-12-04T10:08:29.2341975Z -8.1417e+00-6.4404e+00j, -2.5707e+00-4.4328e-01j, 2025-12-04T10:08:29.2342017Z -2.3716e-01-5.0440e-01j], 2025-12-04T10:08:29.2342070Z [ 3.7944e-01+2.4863e+00j, 2.3908e+00+3.2409e+00j, 2025-12-04T10:08:29.2342121Z -4.5207e+00+3.7503e-01j, -1.3235e+00-3.7416e-01j, 2025-12-04T10:08:29.2342160Z -1.0091e+00+2.0470e-01j], 2025-12-04T10:08:29.2342209Z [ 2.4189e+00+1.7475e+00j, 7.9292e-01+1.6335e+00j, 2025-12-04T10:08:29.2342261Z -5.2401e+00-1.1988e+00j, -1.0313e+00+1.0328e+00j, 2025-12-04T10:08:29.2342301Z 8.2539e-01+5.6439e-01j]]], 2025-12-04T10:08:29.2342303Z 2025-12-04T10:08:29.2342305Z 2025-12-04T10:08:29.2342356Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2342408Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2342447Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2342497Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2342549Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2342586Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2342636Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2342686Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2342724Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2342773Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2342824Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2342862Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2342911Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2343006Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2343047Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2343049Z 2025-12-04T10:08:29.2343098Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2343149Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2343187Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2343237Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2343285Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2343324Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2343373Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2343424Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2343462Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2343512Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2343562Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2343601Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2343650Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2343702Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2343753Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2343797Z dtype=torch.complex128) 2025-12-04T10:08:29.2343799Z 2025-12-04T10:08:29.2343833Z Expected: 2025-12-04T10:08:29.2343908Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2343945Z 0.3401-0.5673j], 2025-12-04T10:08:29.2344010Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2344062Z 0.2078-0.7444j], 2025-12-04T10:08:29.2344128Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2344178Z 0.4109+0.5305j], 2025-12-04T10:08:29.2344254Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2344291Z -0.3607+0.5386j], 2025-12-04T10:08:29.2344355Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2344408Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2344410Z 2025-12-04T10:08:29.2344472Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2344508Z 0.5323-0.4729j], 2025-12-04T10:08:29.2344571Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2344608Z -0.6732-0.7677j], 2025-12-04T10:08:29.2344671Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2344712Z -0.5241-0.5479j], 2025-12-04T10:08:29.2344773Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2344813Z -0.3257-0.6597j], 2025-12-04T10:08:29.2344877Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2344915Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2344917Z 2025-12-04T10:08:29.2344919Z 2025-12-04T10:08:29.2344981Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2345017Z -0.6637-0.1175j], 2025-12-04T10:08:29.2345079Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2345115Z 0.4261-0.3012j], 2025-12-04T10:08:29.2345179Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2345217Z 0.2567-0.1808j], 2025-12-04T10:08:29.2345281Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2345317Z 0.1761-1.6446j], 2025-12-04T10:08:29.2345378Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2345419Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2345421Z 2025-12-04T10:08:29.2345482Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2345519Z -0.6307+0.1756j], 2025-12-04T10:08:29.2345582Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2345618Z -0.9972-0.3518j], 2025-12-04T10:08:29.2345679Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2345715Z 0.6467+0.0201j], 2025-12-04T10:08:29.2345775Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2345812Z -1.0443-0.3699j], 2025-12-04T10:08:29.2345875Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2345940Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2345942Z 2025-12-04T10:08:29.2346241Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2346244Z 2025-12-04T10:08:29.2346317Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2346518Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2346520Z 2025-12-04T10:08:29.2346606Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2346795Z FAILED [0.0515s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2346797Z 2025-12-04T10:08:29.2346890Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2346998Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2347077Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2347079Z 2025-12-04T10:08:29.2347162Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2347275Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2347309Z If the test 2025-12-04T10:08:29.2347403Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2347465Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2347559Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2347641Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2347643Z 2025-12-04T10:08:29.2347733Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2347819Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2347856Z the following. 2025-12-04T10:08:29.2347858Z 2025-12-04T10:08:29.2347946Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2348039Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2348090Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2348153Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2348214Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2348216Z 2025-12-04T10:08:29.2348249Z Got: 2025-12-04T10:08:29.2348322Z tensor([[[[ 0.0502-0.0054j, -0.0280-0.0988j, -0.1021-0.0336j, -0.0878+0.0359j, 2025-12-04T10:08:29.2348362Z -0.0303+0.0508j], 2025-12-04T10:08:29.2348426Z [-0.0285+0.0063j, -0.0118-0.0049j, -0.0225-0.0069j, -0.0351+0.0213j, 2025-12-04T10:08:29.2348465Z -0.0087+0.0311j], 2025-12-04T10:08:29.2348529Z [-0.0763+0.0145j, -0.0780+0.0389j, 0.0452-0.0282j, 0.0084-0.1184j, 2025-12-04T10:08:29.2348565Z 0.0279+0.0361j], 2025-12-04T10:08:29.2348627Z [ 1.9920+1.1873j, 0.7606+0.8821j, 1.7565+0.2688j, -0.4405-0.8209j, 2025-12-04T10:08:29.2348665Z -0.4873+0.7136j], 2025-12-04T10:08:29.2348727Z [ 0.1068+0.0963j, 0.2763-0.0212j, -0.1949+0.0685j, -0.0394+0.1492j, 2025-12-04T10:08:29.2348767Z -0.0153-0.0191j]], 2025-12-04T10:08:29.2348769Z 2025-12-04T10:08:29.2348831Z [[-0.2588+0.2615j, 0.5418+0.4303j, -0.2539-0.8722j, 0.1633-0.0816j, 2025-12-04T10:08:29.2348867Z 0.2857-0.2518j], 2025-12-04T10:08:29.2348931Z [-0.0673-0.0805j, 0.0585-0.0297j, -0.0448-0.0028j, 0.0123+0.0106j, 2025-12-04T10:08:29.2348968Z 0.0473+0.0540j], 2025-12-04T10:08:29.2349032Z [ 0.0439-0.0616j, 0.0395-0.0737j, 0.1053+0.0040j, -0.0836+0.0062j, 2025-12-04T10:08:29.2349070Z -0.0383-0.0398j], 2025-12-04T10:08:29.2349133Z [-0.0364-0.0583j, 0.0542+0.1139j, -0.1072+0.1683j, 0.0383-0.0298j, 2025-12-04T10:08:29.2349170Z -0.0382-0.0777j], 2025-12-04T10:08:29.2349232Z [-0.0670-0.0226j, -0.0294-0.0314j, 0.1271-0.0095j, 0.0161-0.0306j, 2025-12-04T10:08:29.2349272Z -0.0226-0.0070j]]], 2025-12-04T10:08:29.2349274Z 2025-12-04T10:08:29.2349276Z 2025-12-04T10:08:29.2349338Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2349374Z -0.6637-0.1175j], 2025-12-04T10:08:29.2349436Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2349471Z 0.4261-0.3012j], 2025-12-04T10:08:29.2349550Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2349586Z 0.2567-0.1808j], 2025-12-04T10:08:29.2349649Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2349710Z 0.1761-1.6446j], 2025-12-04T10:08:29.2349774Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2349813Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2349815Z 2025-12-04T10:08:29.2349889Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2349925Z -0.6307+0.1756j], 2025-12-04T10:08:29.2349988Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2350023Z -0.9972-0.3518j], 2025-12-04T10:08:29.2350085Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2350121Z 0.6467+0.0201j], 2025-12-04T10:08:29.2350183Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2350219Z -1.0443-0.3699j], 2025-12-04T10:08:29.2350282Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2350350Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2350352Z 2025-12-04T10:08:29.2350388Z Expected: 2025-12-04T10:08:29.2350459Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2350499Z 0.3401-0.5673j], 2025-12-04T10:08:29.2350560Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2350595Z 0.2078-0.7444j], 2025-12-04T10:08:29.2350658Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2350694Z 0.4109+0.5305j], 2025-12-04T10:08:29.2350755Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2350791Z -0.3607+0.5386j], 2025-12-04T10:08:29.2350853Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2350891Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2350893Z 2025-12-04T10:08:29.2350957Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2350993Z 0.5323-0.4729j], 2025-12-04T10:08:29.2351056Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2351094Z -0.6732-0.7677j], 2025-12-04T10:08:29.2351155Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2351191Z -0.5241-0.5479j], 2025-12-04T10:08:29.2351253Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2351289Z -0.3257-0.6597j], 2025-12-04T10:08:29.2351352Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2351390Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2351391Z 2025-12-04T10:08:29.2351393Z 2025-12-04T10:08:29.2351456Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2351493Z -0.6637-0.1175j], 2025-12-04T10:08:29.2351556Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2351591Z 0.4261-0.3012j], 2025-12-04T10:08:29.2351655Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2351691Z 0.2567-0.1808j], 2025-12-04T10:08:29.2351754Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2351789Z 0.1761-1.6446j], 2025-12-04T10:08:29.2351851Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2351888Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2351890Z 2025-12-04T10:08:29.2351964Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2352002Z -0.6307+0.1756j], 2025-12-04T10:08:29.2352064Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2352129Z -0.9972-0.3518j], 2025-12-04T10:08:29.2352192Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2352228Z 0.6467+0.0201j], 2025-12-04T10:08:29.2352291Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2352339Z -1.0443-0.3699j], 2025-12-04T10:08:29.2352402Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2352467Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2352469Z 2025-12-04T10:08:29.2352765Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2352767Z 2025-12-04T10:08:29.2352840Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2353092Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2353094Z 2025-12-04T10:08:29.2353182Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2353359Z FAILED [0.1019s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2353361Z 2025-12-04T10:08:29.2353454Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2353534Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2353615Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2353617Z 2025-12-04T10:08:29.2353700Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2353804Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2353838Z If the test 2025-12-04T10:08:29.2353931Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2353992Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2354088Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2354168Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2354171Z 2025-12-04T10:08:29.2354261Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2354345Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2354382Z the following. 2025-12-04T10:08:29.2354385Z 2025-12-04T10:08:29.2354473Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2354562Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2354616Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2354679Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2354739Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2354742Z 2025-12-04T10:08:29.2354774Z Got: 2025-12-04T10:08:29.2354843Z tensor([[[[ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2354882Z nan+nanj], 2025-12-04T10:08:29.2354942Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2354980Z nan+nanj], 2025-12-04T10:08:29.2355037Z [ nan+nanj, nan+nanj, nan+nanj, nan+nanj, 2025-12-04T10:08:29.2355073Z nan+nanj], 2025-12-04T10:08:29.2355165Z [-0.1128+0.0345j, 0.1313-0.0704j, -0.3074+0.0842j, 0.0296+0.1745j, 2025-12-04T10:08:29.2355203Z 0.0075-0.0879j], 2025-12-04T10:08:29.2355281Z [-0.2084+0.0790j, -0.1661+0.3962j, 0.0437-0.3177j, -0.1778-0.1603j, 2025-12-04T10:08:29.2355334Z 0.0375-0.0079j]], 2025-12-04T10:08:29.2355335Z 2025-12-04T10:08:29.2355399Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.2355449Z 0.5321-0.4721j], 2025-12-04T10:08:29.2355512Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.2355549Z -0.6743-0.7686j], 2025-12-04T10:08:29.2355611Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.2355647Z -0.5254-0.5482j], 2025-12-04T10:08:29.2355709Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.2355745Z -0.3257-0.6610j], 2025-12-04T10:08:29.2355808Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.2355847Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.2355848Z 2025-12-04T10:08:29.2355851Z 2025-12-04T10:08:29.2355916Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2355952Z -0.6628-0.1173j], 2025-12-04T10:08:29.2356017Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2356054Z 0.4268-0.3009j], 2025-12-04T10:08:29.2356117Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2356154Z 0.2557-0.1815j], 2025-12-04T10:08:29.2356216Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2356252Z 0.1764-1.6442j], 2025-12-04T10:08:29.2356314Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2356354Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2356357Z 2025-12-04T10:08:29.2356420Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2356458Z -0.6316+0.1788j], 2025-12-04T10:08:29.2356521Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2356558Z -0.9993-0.3518j], 2025-12-04T10:08:29.2356620Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2356658Z 0.6463+0.0217j], 2025-12-04T10:08:29.2356718Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2356756Z -1.0457-0.3744j], 2025-12-04T10:08:29.2356819Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2356885Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2356887Z 2025-12-04T10:08:29.2356921Z Expected: 2025-12-04T10:08:29.2356995Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.2357031Z 0.3401-0.5676j], 2025-12-04T10:08:29.2357093Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.2357130Z 0.2064-0.7429j], 2025-12-04T10:08:29.2357196Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.2357231Z 0.4114+0.5306j], 2025-12-04T10:08:29.2357293Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.2357329Z -0.3622+0.5375j], 2025-12-04T10:08:29.2357392Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.2357429Z 0.0867+0.1067j]], 2025-12-04T10:08:29.2357431Z 2025-12-04T10:08:29.2357494Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.2357529Z 0.5321-0.4721j], 2025-12-04T10:08:29.2357604Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.2357641Z -0.6743-0.7686j], 2025-12-04T10:08:29.2357704Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.2357762Z -0.5254-0.5482j], 2025-12-04T10:08:29.2357824Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.2357860Z -0.3257-0.6610j], 2025-12-04T10:08:29.2357937Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.2357974Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.2357976Z 2025-12-04T10:08:29.2357979Z 2025-12-04T10:08:29.2358040Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2358076Z -0.6628-0.1173j], 2025-12-04T10:08:29.2358140Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2358176Z 0.4268-0.3009j], 2025-12-04T10:08:29.2358239Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2358275Z 0.2557-0.1815j], 2025-12-04T10:08:29.2358339Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2358375Z 0.1764-1.6442j], 2025-12-04T10:08:29.2358437Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2358476Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2358478Z 2025-12-04T10:08:29.2358539Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2358576Z -0.6316+0.1788j], 2025-12-04T10:08:29.2358637Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2358674Z -0.9993-0.3518j], 2025-12-04T10:08:29.2358735Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2358771Z 0.6463+0.0217j], 2025-12-04T10:08:29.2358832Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2358869Z -1.0457-0.3744j], 2025-12-04T10:08:29.2358935Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2358999Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2359001Z 2025-12-04T10:08:29.2359302Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2359305Z 2025-12-04T10:08:29.2359379Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2359582Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2359587Z 2025-12-04T10:08:29.2359672Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2359966Z FAILED [0.0961s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.2360020Z numerical:(-5.755417309607989+580.8226412522022j) 2025-12-04T10:08:29.2360074Z analytical:(-5.75541730976393+4.180765823773575j) 2025-12-04T10:08:29.2360076Z 2025-12-04T10:08:29.2360174Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2360278Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2360376Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2360378Z 2025-12-04T10:08:29.2360413Z Numerical: 2025-12-04T10:08:29.2360502Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.2360554Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2360605Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2360681Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.2360730Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2360769Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2360843Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.2360890Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2360927Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2360961Z ..., 2025-12-04T10:08:29.2361022Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2361069Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2361105Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2361167Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2361212Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2361250Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2361310Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2361360Z ..., -10.5935+0.0000e+00j, -16.7554+8.8818e-10j, 2025-12-04T10:08:29.2361434Z -13.8938+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2361469Z Analytical: 2025-12-04T10:08:29.2361541Z tensor([[-10.5125-3.6212e-03j, -8.4762-6.8073e-03j, -7.9646-4.9548e-03j, 2025-12-04T10:08:29.2361592Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2361630Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2361691Z [ -1.2557-7.5718e-01j, 2.3487+2.3915e-01j, -5.3650+3.0117e+00j, 2025-12-04T10:08:29.2361738Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2361775Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2361839Z [ -2.0477-6.2949e+00j, -3.5290+1.3344e+00j, -3.7635-1.5151e+00j, 2025-12-04T10:08:29.2361889Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2361927Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2361960Z ..., 2025-12-04T10:08:29.2362020Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2362066Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2362103Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2362162Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2362208Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2362243Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2362305Z [ -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2362356Z ..., -10.5935-6.5151e-17j, -16.7554-1.0305e-16j, 2025-12-04T10:08:29.2362426Z -13.8938-8.5447e-17j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2362428Z 2025-12-04T10:08:29.2362511Z The max per-element difference (slow mode) is: 2.644327920579172e-09. 2025-12-04T10:08:29.2362611Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2362658Z test might've passed in slow_mode! 2025-12-04T10:08:29.2362661Z 2025-12-04T10:08:29.2362747Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2362850Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2362852Z 2025-12-04T10:08:29.2362887Z If the test 2025-12-04T10:08:29.2363040Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2363097Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2363213Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2363261Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2363337Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2363439Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2363441Z 2025-12-04T10:08:29.2363736Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2363754Z 2025-12-04T10:08:29.2363828Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2364034Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2364036Z 2025-12-04T10:08:29.2364122Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2364302Z FAILED [0.1053s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2364306Z 2025-12-04T10:08:29.2364397Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2364479Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2364558Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2364560Z 2025-12-04T10:08:29.2364643Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2364744Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2364781Z If the test 2025-12-04T10:08:29.2364874Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2364935Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2365029Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2365110Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2365114Z 2025-12-04T10:08:29.2365206Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2365290Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2365332Z the following. 2025-12-04T10:08:29.2365334Z 2025-12-04T10:08:29.2365423Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2365513Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2365564Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2365626Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2365688Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2365691Z 2025-12-04T10:08:29.2365724Z Got: 2025-12-04T10:08:29.2365797Z tensor([[[[-0.5610+0.0596j, 0.3115+1.1046j, 1.1405+0.3771j, 0.9817-0.3990j, 2025-12-04T10:08:29.2365836Z 0.3398-0.5666j], 2025-12-04T10:08:29.2365900Z [ 0.6809-0.1503j, 0.2815+0.1163j, 0.5365+0.1627j, 0.8373-0.5079j, 2025-12-04T10:08:29.2365938Z 0.2066-0.7429j], 2025-12-04T10:08:29.2366002Z [-1.1219+0.2129j, -1.1479+0.5728j, 0.6637-0.4141j, 0.1232-1.7406j, 2025-12-04T10:08:29.2366040Z 0.4109+0.5306j], 2025-12-04T10:08:29.2366102Z [ 1.5018+0.8758j, 0.5776+0.6546j, 1.3193+0.1883j, -0.3353-0.6140j, 2025-12-04T10:08:29.2366141Z -0.3620+0.5373j], 2025-12-04T10:08:29.2366203Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.2366242Z 0.0867+0.1067j]], 2025-12-04T10:08:29.2366244Z 2025-12-04T10:08:29.2366306Z [[-0.4817+0.4921j, 1.0186+0.7998j, -0.4843-1.6301j, 0.3048-0.1543j, 2025-12-04T10:08:29.2366353Z 0.5321-0.4742j], 2025-12-04T10:08:29.2366416Z [ 0.9586+1.1457j, -0.8337+0.4236j, 0.6387+0.0398j, -0.1755-0.1514j, 2025-12-04T10:08:29.2366468Z -0.6735-0.7690j], 2025-12-04T10:08:29.2366539Z [ 0.6050-0.8440j, 0.5445-1.0105j, 1.4448+0.0590j, -1.1483+0.0823j, 2025-12-04T10:08:29.2366577Z -0.5249-0.5482j], 2025-12-04T10:08:29.2366639Z [-0.3104-0.4952j, 0.4605+0.9686j, -0.9071+1.4359j, 0.3253-0.2541j, 2025-12-04T10:08:29.2366687Z -0.3251-0.6604j], 2025-12-04T10:08:29.2366750Z [ 0.9182+0.3088j, 0.4008+0.4283j, -1.7427+0.1271j, -0.2208+0.4205j, 2025-12-04T10:08:29.2366787Z 0.3111+0.0965j]]], 2025-12-04T10:08:29.2366789Z 2025-12-04T10:08:29.2366791Z 2025-12-04T10:08:29.2366854Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2366890Z -0.6628-0.1173j], 2025-12-04T10:08:29.2366955Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2366990Z 0.4268-0.3009j], 2025-12-04T10:08:29.2367056Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2367093Z 0.2557-0.1815j], 2025-12-04T10:08:29.2367156Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2367191Z 0.1764-1.6442j], 2025-12-04T10:08:29.2367253Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2367292Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2367294Z 2025-12-04T10:08:29.2367356Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2367392Z -0.6316+0.1788j], 2025-12-04T10:08:29.2367454Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2367490Z -0.9993-0.3518j], 2025-12-04T10:08:29.2367553Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2367589Z 0.6463+0.0217j], 2025-12-04T10:08:29.2367651Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2367690Z -1.0457-0.3744j], 2025-12-04T10:08:29.2367754Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2367818Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2367821Z 2025-12-04T10:08:29.2367858Z Expected: 2025-12-04T10:08:29.2367930Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.2367966Z 0.3401-0.5676j], 2025-12-04T10:08:29.2368027Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.2368065Z 0.2064-0.7429j], 2025-12-04T10:08:29.2368129Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.2368165Z 0.4114+0.5306j], 2025-12-04T10:08:29.2368227Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.2368265Z -0.3622+0.5375j], 2025-12-04T10:08:29.2368328Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.2368366Z 0.0867+0.1067j]], 2025-12-04T10:08:29.2368368Z 2025-12-04T10:08:29.2368430Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.2368468Z 0.5321-0.4721j], 2025-12-04T10:08:29.2368531Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.2368566Z -0.6743-0.7686j], 2025-12-04T10:08:29.2368631Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.2368668Z -0.5254-0.5482j], 2025-12-04T10:08:29.2368731Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.2368767Z -0.3257-0.6610j], 2025-12-04T10:08:29.2368841Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.2368879Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.2368894Z 2025-12-04T10:08:29.2368907Z 2025-12-04T10:08:29.2368970Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2369006Z -0.6628-0.1173j], 2025-12-04T10:08:29.2369069Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2369117Z 0.4268-0.3009j], 2025-12-04T10:08:29.2369182Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2369217Z 0.2557-0.1815j], 2025-12-04T10:08:29.2369281Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2369316Z 0.1764-1.6442j], 2025-12-04T10:08:29.2369379Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2369419Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2369421Z 2025-12-04T10:08:29.2369483Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2369520Z -0.6316+0.1788j], 2025-12-04T10:08:29.2369583Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2369619Z -0.9993-0.3518j], 2025-12-04T10:08:29.2369681Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2369717Z 0.6463+0.0217j], 2025-12-04T10:08:29.2369779Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2369816Z -1.0457-0.3744j], 2025-12-04T10:08:29.2369879Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2369943Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2369945Z 2025-12-04T10:08:29.2370269Z Caused by sample input at index 22: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={'upper': 'False'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2370272Z 2025-12-04T10:08:29.2370347Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2370550Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=22 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2370553Z 2025-12-04T10:08:29.2370639Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2370814Z FAILED [0.1007s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2370816Z 2025-12-04T10:08:29.2370909Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2370990Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2371069Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2371072Z 2025-12-04T10:08:29.2371157Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2371259Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2371296Z If the test 2025-12-04T10:08:29.2371389Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2371450Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2371544Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2371625Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2371627Z 2025-12-04T10:08:29.2371727Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2371812Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2371848Z the following. 2025-12-04T10:08:29.2371861Z 2025-12-04T10:08:29.2371964Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2372054Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2372106Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2372181Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2372243Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2372245Z 2025-12-04T10:08:29.2372277Z Got: 2025-12-04T10:08:29.2372342Z tensor([[[[-1.0977e+01+1.1337e+01j, -1.0756e+01+9.2380e+00j, 2025-12-04T10:08:29.2372394Z 3.9925e+00+4.6300e+00j, 6.3377e+00-9.6003e+00j, 2025-12-04T10:08:29.2372437Z -7.6218e+00-3.0058e+00j], 2025-12-04T10:08:29.2372489Z [ 1.7222e+00-1.0554e+01j, 3.8398e+00-1.0499e+01j, 2025-12-04T10:08:29.2372543Z -6.6268e+00-2.5683e+00j, -1.2097e+00+8.9256e+00j, 2025-12-04T10:08:29.2372583Z 4.8629e+00-1.4466e+00j], 2025-12-04T10:08:29.2372637Z [-1.3885e+00-5.1036e+00j, -1.0999e-01-5.2818e+00j, 2025-12-04T10:08:29.2372687Z -3.7775e+00-2.5616e-01j, 4.2126e-01+4.2466e+00j, 2025-12-04T10:08:29.2372726Z 1.5395e+00-1.9816e+00j], 2025-12-04T10:08:29.2372779Z [-1.3818e+00-2.9840e+00j, -1.3907e+00-2.8604e+00j, 2025-12-04T10:08:29.2372830Z -7.9615e-01+6.6249e-03j, 1.1648e+00+8.6583e-01j, 2025-12-04T10:08:29.2372869Z 7.3385e-01-4.1776e-01j], 2025-12-04T10:08:29.2372919Z [-9.8467e-02+7.5125e-01j, 9.1949e-01+1.1341e+00j, 2025-12-04T10:08:29.2373011Z -8.8098e-01-6.4165e-01j, -7.6596e-01+2.7492e-01j, 2025-12-04T10:08:29.2373055Z 3.6590e-02-1.2498e-01j]], 2025-12-04T10:08:29.2373057Z 2025-12-04T10:08:29.2373107Z [[-5.0049e+00+1.6417e+00j, 2.9798e+00+9.4143e-01j, 2025-12-04T10:08:29.2373159Z 4.9091e+00-3.7872e-03j, 6.3788e-01-4.8041e+00j, 2025-12-04T10:08:29.2373198Z -1.0136e+00+1.2785e-01j], 2025-12-04T10:08:29.2373254Z [-1.7261e+00-2.8658e+00j, -8.7846e-03+1.1695e+00j, 2025-12-04T10:08:29.2373303Z 2.0116e+00+3.0260e+00j, 2.8595e+00-8.6768e-01j, 2025-12-04T10:08:29.2373343Z -8.9377e-01+2.0670e-01j], 2025-12-04T10:08:29.2373395Z [ 3.2179e+00-2.3623e+00j, -1.6873e+00-2.1378e-01j, 2025-12-04T10:08:29.2373445Z -6.3615e+00-8.6185e-01j, 5.2496e-01+3.8774e+00j, 2025-12-04T10:08:29.2373484Z 1.7859e+00-8.7532e-02j], 2025-12-04T10:08:29.2373534Z [ 9.6471e-01-1.5865e+00j, -2.2860e-01+5.4319e-01j, 2025-12-04T10:08:29.2373583Z -2.1799e+00+1.7894e+00j, 8.7317e-01+5.9223e-01j, 2025-12-04T10:08:29.2373622Z 7.4597e-01-9.9616e-01j], 2025-12-04T10:08:29.2373671Z [ 5.9963e-01+5.4587e-01j, 1.6291e-01+4.6320e-01j, 2025-12-04T10:08:29.2373724Z -1.3783e+00-4.8949e-01j, -3.1085e-01+2.4789e-01j, 2025-12-04T10:08:29.2373765Z 2.0589e-01+1.7868e-01j]]], 2025-12-04T10:08:29.2373769Z 2025-12-04T10:08:29.2373771Z 2025-12-04T10:08:29.2373823Z [[[-1.9189e-01-5.9893e-01j, -2.0372e-01-4.1950e-01j, 2025-12-04T10:08:29.2373873Z 6.0848e-01+2.7197e-01j, 1.4388e+00-8.3350e-01j, 2025-12-04T10:08:29.2373913Z -6.6285e-01-1.1732e-01j], 2025-12-04T10:08:29.2373967Z [-6.6164e-01-5.8389e-01j, -2.4430e-01+9.6196e-01j, 2025-12-04T10:08:29.2374018Z -2.4885e-01+5.0987e-01j, 1.1702e-01-8.9906e-01j, 2025-12-04T10:08:29.2374056Z 4.2679e-01-3.0089e-01j], 2025-12-04T10:08:29.2374106Z [-1.3736e-01+2.8444e-01j, -1.9547e-01-1.4549e+00j, 2025-12-04T10:08:29.2374158Z -5.7081e-01-4.1567e-01j, -4.0360e-02+3.7118e-01j, 2025-12-04T10:08:29.2374195Z 2.5569e-01-1.8153e-01j], 2025-12-04T10:08:29.2374245Z [ 3.2317e-01-1.1092e-01j, -4.2273e-01-1.0964e+00j, 2025-12-04T10:08:29.2374319Z 1.2298e+00+9.0961e-01j, -6.1429e-01-2.3413e-01j, 2025-12-04T10:08:29.2374359Z 1.7642e-01-1.6442e+00j], 2025-12-04T10:08:29.2374439Z [ 1.0214e+00+7.6772e-01j, 3.1844e-01-3.5588e-01j, 2025-12-04T10:08:29.2374489Z 3.1428e-01+5.4397e-01j, -8.2156e-01-1.6840e-01j, 2025-12-04T10:08:29.2374530Z -5.9945e-01-8.6882e-01j]], 2025-12-04T10:08:29.2374532Z 2025-12-04T10:08:29.2374595Z [[ 1.0539e+00-7.3211e-01j, 4.5990e-01+5.2475e-01j, 2025-12-04T10:08:29.2374644Z 1.1369e+00-7.5329e-01j, -7.3226e-01+2.0070e+00j, 2025-12-04T10:08:29.2374683Z -6.3165e-01+1.7883e-01j], 2025-12-04T10:08:29.2374732Z [-1.0193e+00-6.3350e-01j, -1.4438e-01-9.0377e-01j, 2025-12-04T10:08:29.2374783Z 8.4124e-01+5.4601e-01j, -4.2510e-01+8.2113e-03j, 2025-12-04T10:08:29.2374821Z -9.9926e-01-3.5177e-01j], 2025-12-04T10:08:29.2374873Z [ 3.3203e-01-4.2876e-01j, -8.8123e-01-2.5672e-02j, 2025-12-04T10:08:29.2374925Z 1.0533e-01-7.5240e-01j, 2.9878e-01+3.5971e-01j, 2025-12-04T10:08:29.2374963Z 6.4627e-01+2.1691e-02j], 2025-12-04T10:08:29.2375018Z [-1.5263e-02-3.8690e-01j, 8.2130e-01-6.5318e-01j, 2025-12-04T10:08:29.2375068Z 7.4210e-01+1.2504e+00j, 3.3293e-01+7.9396e-01j, 2025-12-04T10:08:29.2375106Z -1.0457e+00-3.7436e-01j], 2025-12-04T10:08:29.2375156Z [-5.6491e-01+1.4362e-01j, -1.8726e-01-1.5054e+00j, 2025-12-04T10:08:29.2375207Z -7.4748e-01+3.7488e-01j, 1.2359e+00-2.0724e-01j, 2025-12-04T10:08:29.2375259Z 1.0937e+00+4.8063e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2375302Z dtype=torch.complex128) 2025-12-04T10:08:29.2375303Z 2025-12-04T10:08:29.2375339Z Expected: 2025-12-04T10:08:29.2375413Z tensor([[[[-0.5625+0.0601j, 0.3111+1.1049j, 1.1395+0.3781j, 0.9824-0.3977j, 2025-12-04T10:08:29.2375451Z 0.3401-0.5676j], 2025-12-04T10:08:29.2375517Z [ 0.6811-0.1497j, 0.2817+0.1166j, 0.5365+0.1631j, 0.8374-0.5080j, 2025-12-04T10:08:29.2375556Z 0.2064-0.7429j], 2025-12-04T10:08:29.2375621Z [-1.1228+0.2127j, -1.1480+0.5731j, 0.6629-0.4148j, 0.1230-1.7407j, 2025-12-04T10:08:29.2375660Z 0.4114+0.5306j], 2025-12-04T10:08:29.2375722Z [ 1.5026+0.8762j, 0.5781+0.6547j, 1.3198+0.1886j, -0.3354-0.6141j, 2025-12-04T10:08:29.2375759Z -0.3622+0.5375j], 2025-12-04T10:08:29.2375822Z [-0.5937-0.5359j, -1.5365+0.1190j, 1.0856-0.3808j, 0.2203-0.8303j, 2025-12-04T10:08:29.2375861Z 0.0867+0.1067j]], 2025-12-04T10:08:29.2375863Z 2025-12-04T10:08:29.2375925Z [[-0.4830+0.4934j, 1.0183+0.7993j, -0.4825-1.6342j, 0.3049-0.1543j, 2025-12-04T10:08:29.2375961Z 0.5321-0.4721j], 2025-12-04T10:08:29.2376024Z [ 0.9575+1.1469j, -0.8345+0.4233j, 0.6410+0.0386j, -0.1754-0.1518j, 2025-12-04T10:08:29.2376060Z -0.6743-0.7686j], 2025-12-04T10:08:29.2376123Z [ 0.6044-0.8444j, 0.5445-1.0116j, 1.4474+0.0589j, -1.1485+0.0820j, 2025-12-04T10:08:29.2376159Z -0.5254-0.5482j], 2025-12-04T10:08:29.2376222Z [-0.3118-0.4963j, 0.4603+0.9683j, -0.9049+1.4371j, 0.3260-0.2548j, 2025-12-04T10:08:29.2376260Z -0.3257-0.6610j], 2025-12-04T10:08:29.2376322Z [ 0.9188+0.3090j, 0.4011+0.4286j, -1.7438+0.1272j, -0.2210+0.4208j, 2025-12-04T10:08:29.2376361Z 0.3113+0.0965j]]], 2025-12-04T10:08:29.2376364Z 2025-12-04T10:08:29.2376366Z 2025-12-04T10:08:29.2376428Z [[[-0.1919-0.5989j, -0.2037-0.4195j, 0.6085+0.2720j, 1.4388-0.8335j, 2025-12-04T10:08:29.2376463Z -0.6628-0.1173j], 2025-12-04T10:08:29.2376526Z [-0.6616-0.5839j, -0.2443+0.9620j, -0.2488+0.5099j, 0.1170-0.8991j, 2025-12-04T10:08:29.2376561Z 0.4268-0.3009j], 2025-12-04T10:08:29.2376624Z [-0.1374+0.2844j, -0.1955-1.4549j, -0.5708-0.4157j, -0.0404+0.3712j, 2025-12-04T10:08:29.2376659Z 0.2557-0.1815j], 2025-12-04T10:08:29.2376734Z [ 0.3232-0.1109j, -0.4227-1.0964j, 1.2298+0.9096j, -0.6143-0.2341j, 2025-12-04T10:08:29.2376770Z 0.1764-1.6442j], 2025-12-04T10:08:29.2376843Z [ 1.0214+0.7677j, 0.3184-0.3559j, 0.3143+0.5440j, -0.8216-0.1684j, 2025-12-04T10:08:29.2376893Z -0.5994-0.8688j]], 2025-12-04T10:08:29.2376895Z 2025-12-04T10:08:29.2376959Z [[ 1.0539-0.7321j, 0.4599+0.5248j, 1.1369-0.7533j, -0.7323+2.0070j, 2025-12-04T10:08:29.2377009Z -0.6316+0.1788j], 2025-12-04T10:08:29.2377073Z [-1.0193-0.6335j, -0.1444-0.9038j, 0.8412+0.5460j, -0.4251+0.0082j, 2025-12-04T10:08:29.2377108Z -0.9993-0.3518j], 2025-12-04T10:08:29.2377171Z [ 0.3320-0.4288j, -0.8812-0.0257j, 0.1053-0.7524j, 0.2988+0.3597j, 2025-12-04T10:08:29.2377206Z 0.6463+0.0217j], 2025-12-04T10:08:29.2377267Z [-0.0153-0.3869j, 0.8213-0.6532j, 0.7421+1.2504j, 0.3329+0.7940j, 2025-12-04T10:08:29.2377303Z -1.0457-0.3744j], 2025-12-04T10:08:29.2377368Z [-0.5649+0.1436j, -0.1873-1.5054j, -0.7475+0.3749j, 1.2359-0.2072j, 2025-12-04T10:08:29.2377432Z 1.0937+0.4806j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2377436Z 2025-12-04T10:08:29.2377736Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2377739Z 2025-12-04T10:08:29.2377813Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2378018Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2378020Z 2025-12-04T10:08:29.2378109Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2378286Z FAILED [0.0557s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2378288Z 2025-12-04T10:08:29.2378381Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2378462Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2378541Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2378544Z 2025-12-04T10:08:29.2378626Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2378729Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2378764Z If the test 2025-12-04T10:08:29.2378857Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2378918Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2379014Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2379096Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2379098Z 2025-12-04T10:08:29.2379189Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2379275Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2379312Z the following. 2025-12-04T10:08:29.2379314Z 2025-12-04T10:08:29.2379403Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2379491Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2379544Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2379606Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2379667Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2379669Z 2025-12-04T10:08:29.2379701Z Got: 2025-12-04T10:08:29.2379785Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.2379823Z -0.1875+0.3131j], 2025-12-04T10:08:29.2379889Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.2379947Z -0.0786+0.2827j], 2025-12-04T10:08:29.2380012Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.2380048Z 0.3077+0.3986j], 2025-12-04T10:08:29.2380122Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.2380158Z -0.1509+0.2260j], 2025-12-04T10:08:29.2380221Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.2380259Z 0.0273+0.0340j]], 2025-12-04T10:08:29.2380261Z 2025-12-04T10:08:29.2380324Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.2380359Z 0.3021-0.2693j], 2025-12-04T10:08:29.2380423Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.2380459Z -4.3263-4.7783j], 2025-12-04T10:08:29.2380524Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.2380561Z 0.1501+0.1573j], 2025-12-04T10:08:29.2380624Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.2380660Z -0.0529-0.1077j], 2025-12-04T10:08:29.2380724Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.2380762Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.2380764Z 2025-12-04T10:08:29.2380768Z 2025-12-04T10:08:29.2380831Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2380869Z -0.6637-0.1175j], 2025-12-04T10:08:29.2380931Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2380970Z 0.4261-0.3012j], 2025-12-04T10:08:29.2381033Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2381069Z 0.2567-0.1808j], 2025-12-04T10:08:29.2381133Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2381171Z 0.1761-1.6446j], 2025-12-04T10:08:29.2381232Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2381272Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2381274Z 2025-12-04T10:08:29.2381335Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2381372Z -0.6307+0.1756j], 2025-12-04T10:08:29.2381434Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2381472Z -0.9972-0.3518j], 2025-12-04T10:08:29.2381534Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2381570Z 0.6467+0.0201j], 2025-12-04T10:08:29.2381632Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2381668Z -1.0443-0.3699j], 2025-12-04T10:08:29.2381732Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2381798Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2381800Z 2025-12-04T10:08:29.2381833Z Expected: 2025-12-04T10:08:29.2381907Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2381942Z 0.3401-0.5673j], 2025-12-04T10:08:29.2382004Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2382039Z 0.2078-0.7444j], 2025-12-04T10:08:29.2382102Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2382138Z 0.4109+0.5305j], 2025-12-04T10:08:29.2382212Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2382249Z -0.3607+0.5386j], 2025-12-04T10:08:29.2382312Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2382372Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2382374Z 2025-12-04T10:08:29.2382440Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2382475Z 0.5323-0.4729j], 2025-12-04T10:08:29.2382556Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2382592Z -0.6732-0.7677j], 2025-12-04T10:08:29.2382656Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2382693Z -0.5241-0.5479j], 2025-12-04T10:08:29.2382755Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2382792Z -0.3257-0.6597j], 2025-12-04T10:08:29.2382856Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2382894Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2382896Z 2025-12-04T10:08:29.2382898Z 2025-12-04T10:08:29.2383003Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2383041Z -0.6637-0.1175j], 2025-12-04T10:08:29.2383103Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2383138Z 0.4261-0.3012j], 2025-12-04T10:08:29.2383202Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2383238Z 0.2567-0.1808j], 2025-12-04T10:08:29.2383300Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2383337Z 0.1761-1.6446j], 2025-12-04T10:08:29.2383399Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2383438Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2383440Z 2025-12-04T10:08:29.2383502Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2383539Z -0.6307+0.1756j], 2025-12-04T10:08:29.2383601Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2383639Z -0.9972-0.3518j], 2025-12-04T10:08:29.2383700Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2383736Z 0.6467+0.0201j], 2025-12-04T10:08:29.2383798Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2383835Z -1.0443-0.3699j], 2025-12-04T10:08:29.2383897Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2383961Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2383963Z 2025-12-04T10:08:29.2384262Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2384265Z 2025-12-04T10:08:29.2384340Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2384648Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2384652Z 2025-12-04T10:08:29.2384738Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2384915Z FAILED [0.0560s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2384916Z 2025-12-04T10:08:29.2385007Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2385088Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2385186Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2385188Z 2025-12-04T10:08:29.2385272Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2385402Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2385439Z If the test 2025-12-04T10:08:29.2385530Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2385606Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2385699Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2385781Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2385784Z 2025-12-04T10:08:29.2385874Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2385958Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2385995Z the following. 2025-12-04T10:08:29.2385997Z 2025-12-04T10:08:29.2386085Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2386178Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2386228Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2386291Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2386353Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2386354Z 2025-12-04T10:08:29.2386387Z Got: 2025-12-04T10:08:29.2386460Z tensor([[[[-0.5612+5.7406e-02j, 0.3123+1.1033e+00j, 1.1405+3.7729e-01j, 2025-12-04T10:08:29.2386511Z 0.9836-3.9860e-01j, 0.3401-5.6728e-01j], 2025-12-04T10:08:29.2386573Z [ 0.6824-1.5236e-01j, 0.2825+1.1557e-01j, 0.5370+1.6411e-01j, 2025-12-04T10:08:29.2386622Z 0.8395-5.0656e-01j, 0.2078-7.4444e-01j], 2025-12-04T10:08:29.2386685Z [-1.1234+2.1468e-01j, -1.1468+5.7362e-01j, 0.6636-4.1426e-01j, 2025-12-04T10:08:29.2386732Z 0.1234-1.7417e+00j, 0.4109+5.3045e-01j], 2025-12-04T10:08:29.2386792Z [ 1.5025+8.7788e-01j, 0.5775+6.5749e-01j, 1.3189+1.8928e-01j, 2025-12-04T10:08:29.2386841Z -0.3367-6.1260e-01j, -0.3607+5.3857e-01j], 2025-12-04T10:08:29.2386902Z [-0.5951-5.3655e-01j, -1.5396+1.1822e-01j, 1.0860-3.8168e-01j, 2025-12-04T10:08:29.2386951Z 0.2193-8.3159e-01j, 0.0854+1.0631e-01j]], 2025-12-04T10:08:29.2386953Z 2025-12-04T10:08:29.2387012Z [[ 0.3521-3.8438e-01j, -0.5150-5.0442e-02j, 0.0599-1.7112e-01j, 2025-12-04T10:08:29.2387059Z -0.1132+3.4576e-03j, 0.2537-4.1136e-01j], 2025-12-04T10:08:29.2387118Z [-0.0427-3.2344e-01j, 0.0572-1.6179e-01j, -0.0989+7.1356e-02j, 2025-12-04T10:08:29.2387165Z -0.0587-9.6529e-05j, 0.2071-1.6101e-01j], 2025-12-04T10:08:29.2387225Z [ 0.5809+1.3868e+00j, 0.2300-6.2183e-02j, -0.1172-7.3543e-02j, 2025-12-04T10:08:29.2387272Z 0.2678-4.1000e-01j, 0.8742+7.4068e-01j], 2025-12-04T10:08:29.2387331Z [ 0.0101-3.1495e-01j, -0.3015+3.3319e-01j, -0.5334+3.8510e-02j, 2025-12-04T10:08:29.2387379Z 0.2210+1.9992e-02j, 0.1421-3.0661e-01j], 2025-12-04T10:08:29.2387437Z [ 0.2046-8.5916e-02j, 0.1344+1.2888e-02j, -0.2789+2.8624e-01j, 2025-12-04T10:08:29.2387490Z 0.0256+1.0544e-01j, 0.0678-3.0551e-02j]]], 2025-12-04T10:08:29.2387493Z 2025-12-04T10:08:29.2387495Z 2025-12-04T10:08:29.2387555Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.2387601Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.2387661Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.2387705Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.2387768Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.2387824Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.2387886Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.2387934Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.2388015Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.2388065Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.2388067Z 2025-12-04T10:08:29.2388136Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.2388182Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.2388244Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.2388291Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.2388351Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.2388396Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.2388459Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.2388506Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.2388569Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.2388629Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2388674Z dtype=torch.complex128) 2025-12-04T10:08:29.2388677Z 2025-12-04T10:08:29.2388712Z Expected: 2025-12-04T10:08:29.2388786Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2388823Z 0.3401-0.5673j], 2025-12-04T10:08:29.2388887Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2388924Z 0.2078-0.7444j], 2025-12-04T10:08:29.2388989Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2389026Z 0.4109+0.5305j], 2025-12-04T10:08:29.2389090Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2389126Z -0.3607+0.5386j], 2025-12-04T10:08:29.2389190Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2389230Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2389232Z 2025-12-04T10:08:29.2389294Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2389332Z 0.5323-0.4729j], 2025-12-04T10:08:29.2389394Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2389431Z -0.6732-0.7677j], 2025-12-04T10:08:29.2389493Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2389530Z -0.5241-0.5479j], 2025-12-04T10:08:29.2389591Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2389627Z -0.3257-0.6597j], 2025-12-04T10:08:29.2389689Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2389728Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2389731Z 2025-12-04T10:08:29.2389733Z 2025-12-04T10:08:29.2389797Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2389834Z -0.6637-0.1175j], 2025-12-04T10:08:29.2389896Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2389933Z 0.4261-0.3012j], 2025-12-04T10:08:29.2389995Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2390031Z 0.2567-0.1808j], 2025-12-04T10:08:29.2390095Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2390131Z 0.1761-1.6446j], 2025-12-04T10:08:29.2390193Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2390244Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2390246Z 2025-12-04T10:08:29.2390308Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2390357Z -0.6307+0.1756j], 2025-12-04T10:08:29.2390429Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2390467Z -0.9972-0.3518j], 2025-12-04T10:08:29.2390528Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2390577Z 0.6467+0.0201j], 2025-12-04T10:08:29.2390637Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2390675Z -1.0443-0.3699j], 2025-12-04T10:08:29.2390737Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2390802Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2390804Z 2025-12-04T10:08:29.2391101Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2391105Z 2025-12-04T10:08:29.2391179Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2391383Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2391386Z 2025-12-04T10:08:29.2391473Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2391651Z FAILED [0.0558s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2391653Z 2025-12-04T10:08:29.2391747Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2391835Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2391914Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2391916Z 2025-12-04T10:08:29.2392000Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2392102Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2392138Z If the test 2025-12-04T10:08:29.2392232Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2392293Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2392387Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2392466Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2392468Z 2025-12-04T10:08:29.2392559Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2392643Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2392680Z the following. 2025-12-04T10:08:29.2392682Z 2025-12-04T10:08:29.2392773Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2392864Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2392916Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2393035Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2393096Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2393098Z 2025-12-04T10:08:29.2393130Z Got: 2025-12-04T10:08:29.2393181Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393227Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393265Z nan+nanj], 2025-12-04T10:08:29.2393310Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393375Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393415Z nan+nanj], 2025-12-04T10:08:29.2393457Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393501Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2393571Z nan+nanj], 2025-12-04T10:08:29.2393629Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2393682Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2393737Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2393788Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2393841Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2393883Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2393885Z 2025-12-04T10:08:29.2393936Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2393988Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2394030Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2394080Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2394130Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2394172Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2394222Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2394271Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2394313Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2394361Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2394411Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2394450Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2394499Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2394548Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2394590Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2394593Z 2025-12-04T10:08:29.2394594Z 2025-12-04T10:08:29.2394648Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2394697Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2394738Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2394788Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2394839Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2394878Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2394928Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2394979Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2395017Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2395067Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2395117Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2395154Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2395205Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2395255Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2395299Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2395301Z 2025-12-04T10:08:29.2395350Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2395401Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2395440Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2395491Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2395539Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2395578Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2395628Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2395678Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2395717Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2395780Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2395829Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2395890Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2395940Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2395990Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2396052Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2396097Z dtype=torch.complex128) 2025-12-04T10:08:29.2396100Z 2025-12-04T10:08:29.2396134Z Expected: 2025-12-04T10:08:29.2396211Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2396247Z 0.3401-0.5673j], 2025-12-04T10:08:29.2396311Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2396347Z 0.2078-0.7444j], 2025-12-04T10:08:29.2396414Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2396450Z 0.4109+0.5305j], 2025-12-04T10:08:29.2396513Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2396552Z -0.3607+0.5386j], 2025-12-04T10:08:29.2396614Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2396653Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2396656Z 2025-12-04T10:08:29.2396719Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2396757Z 0.5323-0.4729j], 2025-12-04T10:08:29.2396820Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2396858Z -0.6732-0.7677j], 2025-12-04T10:08:29.2396919Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2396957Z -0.5241-0.5479j], 2025-12-04T10:08:29.2397019Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2397056Z -0.3257-0.6597j], 2025-12-04T10:08:29.2397117Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2397158Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2397159Z 2025-12-04T10:08:29.2397161Z 2025-12-04T10:08:29.2397224Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2397265Z -0.6637-0.1175j], 2025-12-04T10:08:29.2397328Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2397364Z 0.4261-0.3012j], 2025-12-04T10:08:29.2397427Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2397463Z 0.2567-0.1808j], 2025-12-04T10:08:29.2397525Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2397563Z 0.1761-1.6446j], 2025-12-04T10:08:29.2397625Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2397664Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2397667Z 2025-12-04T10:08:29.2397731Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2397768Z -0.6307+0.1756j], 2025-12-04T10:08:29.2397830Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2397870Z -0.9972-0.3518j], 2025-12-04T10:08:29.2397931Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2397968Z 0.6467+0.0201j], 2025-12-04T10:08:29.2398029Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2398067Z -1.0443-0.3699j], 2025-12-04T10:08:29.2398130Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2398208Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2398210Z 2025-12-04T10:08:29.2398522Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2398539Z 2025-12-04T10:08:29.2398612Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2398824Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2398827Z 2025-12-04T10:08:29.2398912Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2399091Z FAILED [0.0659s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2399093Z 2025-12-04T10:08:29.2399185Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2399267Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2399347Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2399349Z 2025-12-04T10:08:29.2399433Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2399535Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2399571Z If the test 2025-12-04T10:08:29.2399663Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2399726Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2399824Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2399908Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2399910Z 2025-12-04T10:08:29.2400002Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2400085Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2400123Z the following. 2025-12-04T10:08:29.2400126Z 2025-12-04T10:08:29.2400216Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2400306Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2400359Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2400422Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2400482Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2400484Z 2025-12-04T10:08:29.2400518Z Got: 2025-12-04T10:08:29.2400579Z tensor([[[[-3.8784e+01-4.3703e+01j, -1.2755e+02+2.7931e+01j, 2025-12-04T10:08:29.2400632Z 1.2988e+02-2.4578e+01j, 1.3154e+01-5.0382e+01j, 2025-12-04T10:08:29.2400674Z -5.2772e+00+1.4070e+01j], 2025-12-04T10:08:29.2400727Z [ 1.5611e+01-1.4438e+01j, 1.1850e+00-9.3043e+00j, 2025-12-04T10:08:29.2400776Z 4.7216e+00+3.2779e+00j, 8.0461e+00+1.8300e+01j, 2025-12-04T10:08:29.2400818Z -4.2700e+00-1.5494e+01j], 2025-12-04T10:08:29.2400868Z [-2.3610e+01+6.0120e+00j, -4.8936e+00+5.2923e+00j, 2025-12-04T10:08:29.2400919Z -1.0649e+01-3.9485e+00j, 1.6111e+00-1.8797e+01j, 2025-12-04T10:08:29.2400959Z 9.2718e+00+5.5048e+00j], 2025-12-04T10:08:29.2401009Z [ 2.7147e+01+2.2377e+01j, 5.5576e+01-1.2430e+00j, 2025-12-04T10:08:29.2401058Z -3.1506e+01+1.4050e+01j, -9.0041e+00+2.5841e+01j, 2025-12-04T10:08:29.2401099Z -4.6332e+00-1.2998e+00j], 2025-12-04T10:08:29.2401148Z [-2.6703e+01-2.4088e+01j, -6.9110e+01+5.4290e+00j, 2025-12-04T10:08:29.2401197Z 4.8713e+01-1.7231e+01j, 9.7890e+00-3.7251e+01j, 2025-12-04T10:08:29.2401237Z 3.9395e+00+4.8082e+00j]], 2025-12-04T10:08:29.2401250Z 2025-12-04T10:08:29.2401301Z [[ 2.8142e+02-2.3259e+02j, 3.1869e+02-2.0779e+02j, 2025-12-04T10:08:29.2401351Z -1.4454e+02-1.5237e+01j, -3.2275e+02+1.5163e+02j, 2025-12-04T10:08:29.2401413Z 4.3416e+01-1.3512e+00j], 2025-12-04T10:08:29.2401463Z [-3.0455e+03+2.3761e+03j, -3.2312e+03+2.1228e+03j, 2025-12-04T10:08:29.2401514Z 1.6578e+03+3.1713e+00j, 3.3541e+03-1.6316e+03j, 2025-12-04T10:08:29.2401563Z -4.2058e+02+1.9751e+01j], 2025-12-04T10:08:29.2401613Z [ 2.1673e+01-8.2674e+00j, 1.1414e+01-1.6387e+01j, 2025-12-04T10:08:29.2401663Z 8.7072e+00-4.1742e+00j, -2.3038e+01+7.1607e+00j, 2025-12-04T10:08:29.2401702Z -3.7922e+00-5.0427e+00j], 2025-12-04T10:08:29.2401751Z [-2.6068e+01-1.1216e+01j, -7.5027e+00-4.9602e+00j, 2025-12-04T10:08:29.2401801Z 3.9834e+01+5.7592e+00j, 7.8271e+00-1.2708e+01j, 2025-12-04T10:08:29.2401840Z -1.0269e+01-6.7246e+00j], 2025-12-04T10:08:29.2401891Z [ 3.3309e+01+1.1031e+01j, 1.4523e+01+1.5508e+01j, 2025-12-04T10:08:29.2401943Z -6.3225e+01+4.9375e+00j, -7.8893e+00+1.5323e+01j, 2025-12-04T10:08:29.2401983Z 1.1316e+01+3.3800e+00j]]], 2025-12-04T10:08:29.2401986Z 2025-12-04T10:08:29.2401988Z 2025-12-04T10:08:29.2402039Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.2402089Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.2402129Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.2402179Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.2402230Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.2402267Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.2402319Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.2402369Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.2402407Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.2402457Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.2402507Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.2402547Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.2402596Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.2402645Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.2402688Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.2402690Z 2025-12-04T10:08:29.2402739Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.2402793Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.2402831Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.2402881Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.2402973Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.2404738Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.2404794Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.2404844Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.2404885Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.2404938Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.2404986Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.2405027Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.2405077Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.2405127Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.2405179Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2405224Z dtype=torch.complex128) 2025-12-04T10:08:29.2405226Z 2025-12-04T10:08:29.2405261Z Expected: 2025-12-04T10:08:29.2405336Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2405397Z 0.3406-0.5682j], 2025-12-04T10:08:29.2405464Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2405500Z 0.2069-0.7450j], 2025-12-04T10:08:29.2405606Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2405644Z 0.4118+0.5311j], 2025-12-04T10:08:29.2405707Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2405759Z -0.3628+0.5383j], 2025-12-04T10:08:29.2405822Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2405861Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2405864Z 2025-12-04T10:08:29.2405926Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2405963Z 0.5325-0.4733j], 2025-12-04T10:08:29.2406025Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2406064Z -0.6729-0.7686j], 2025-12-04T10:08:29.2406129Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2406166Z -0.5258-0.5473j], 2025-12-04T10:08:29.2406233Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2406270Z -0.3244-0.6603j], 2025-12-04T10:08:29.2406332Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2406371Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2406373Z 2025-12-04T10:08:29.2406375Z 2025-12-04T10:08:29.2406436Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2406473Z -0.6623-0.1171j], 2025-12-04T10:08:29.2406535Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2406571Z 0.4266-0.2997j], 2025-12-04T10:08:29.2406634Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2406671Z 0.2556-0.1819j], 2025-12-04T10:08:29.2406734Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2406773Z 0.1768-1.6449j], 2025-12-04T10:08:29.2406837Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2406877Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2406879Z 2025-12-04T10:08:29.2406943Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2406980Z -0.6312+0.1775j], 2025-12-04T10:08:29.2407041Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2407079Z -0.9967-0.3519j], 2025-12-04T10:08:29.2407140Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2407176Z 0.6457+0.0238j], 2025-12-04T10:08:29.2407237Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2407275Z -1.0432-0.3734j], 2025-12-04T10:08:29.2407337Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2407406Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2407408Z 2025-12-04T10:08:29.2407700Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2407705Z 2025-12-04T10:08:29.2407778Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2407984Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2407986Z 2025-12-04T10:08:29.2408083Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2408261Z FAILED [0.1166s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2408273Z 2025-12-04T10:08:29.2408376Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2408459Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2408549Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2408551Z 2025-12-04T10:08:29.2408635Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2408736Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2408772Z If the test 2025-12-04T10:08:29.2408866Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2408929Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2409023Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2409105Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2409109Z 2025-12-04T10:08:29.2409199Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2409283Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2409321Z the following. 2025-12-04T10:08:29.2409323Z 2025-12-04T10:08:29.2409410Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2409500Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2409551Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2409615Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2409675Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2409677Z 2025-12-04T10:08:29.2409711Z Got: 2025-12-04T10:08:29.2409772Z tensor([[[[-7.5011e-01+7.9726e-02j, 4.1661e-01+1.4770e+00j, 2025-12-04T10:08:29.2409825Z 1.5250e+00+5.0409e-01j, 1.3125e+00-5.3362e-01j, 2025-12-04T10:08:29.2409867Z 4.5431e-01-7.5771e-01j], 2025-12-04T10:08:29.2409919Z [ 2.4769e-01-5.4787e-02j, 1.0208e-01+4.2423e-02j, 2025-12-04T10:08:29.2409970Z 1.9503e-01+5.9522e-02j, 3.0470e-01-1.8443e-01j, 2025-12-04T10:08:29.2410010Z 7.5363e-02-2.7012e-01j], 2025-12-04T10:08:29.2410060Z [ 3.2563e-01-6.1781e-02j, 3.3314e-01-1.6612e-01j, 2025-12-04T10:08:29.2410111Z -1.9273e-01+1.2022e-01j, -3.5932e-02+5.0528e-01j, 2025-12-04T10:08:29.2410149Z -1.1919e-01-1.5403e-01j], 2025-12-04T10:08:29.2410199Z [-1.7381e-01-1.0136e-01j, -6.6712e-02-7.5859e-02j, 2025-12-04T10:08:29.2410250Z -1.5261e-01-2.1954e-02j, 3.8784e-02+7.0886e-02j, 2025-12-04T10:08:29.2410288Z 4.1758e-02-6.2216e-02j], 2025-12-04T10:08:29.2410339Z [-2.5580e-01-2.3046e-01j, -6.6189e-01+5.1646e-02j, 2025-12-04T10:08:29.2410390Z 4.6751e-01-1.6405e-01j, 9.4475e-02-3.5775e-01j, 2025-12-04T10:08:29.2410433Z 3.7398e-02+4.5822e-02j]], 2025-12-04T10:08:29.2410435Z 2025-12-04T10:08:29.2410485Z [[ 1.4246e+00-1.5105e+00j, -3.1159e+00-2.3543e+00j, 2025-12-04T10:08:29.2410536Z 1.5514e+00+4.8875e+00j, -9.1034e-01+4.8238e-01j, 2025-12-04T10:08:29.2410576Z -1.5778e+00+1.4596e+00j], 2025-12-04T10:08:29.2410626Z [ 1.5992e-01+1.9116e-01j, -1.3893e-01+7.0489e-02j, 2025-12-04T10:08:29.2410676Z 1.0628e-01+6.7161e-03j, -2.9284e-02-2.5291e-02j, 2025-12-04T10:08:29.2410714Z -1.1238e-01-1.2833e-01j], 2025-12-04T10:08:29.2410764Z [-1.8926e+01+4.0012e+01j, -1.5112e+01+4.6534e+01j, 2025-12-04T10:08:29.2410813Z -6.0961e+01+8.5739e+00j, 4.7501e+01-1.2235e+01j, 2025-12-04T10:08:29.2410852Z 2.6221e+01+1.8958e+01j], 2025-12-04T10:08:29.2410915Z [ 5.9566e-02+9.5667e-02j, -8.9025e-02-1.8668e-01j, 2025-12-04T10:08:29.2410966Z 1.7547e-01-2.7680e-01j, -6.2695e-02+4.8940e-02j, 2025-12-04T10:08:29.2411016Z 6.3067e-02+1.2735e-01j], 2025-12-04T10:08:29.2411075Z [ 4.3970e-01+1.4849e-01j, 1.9197e-01+2.0574e-01j, 2025-12-04T10:08:29.2411126Z -8.3511e-01+6.1209e-02j, -1.0595e-01+2.0204e-01j, 2025-12-04T10:08:29.2411168Z 1.4976e-01+4.6547e-02j]]], 2025-12-04T10:08:29.2411182Z 2025-12-04T10:08:29.2411184Z 2025-12-04T10:08:29.2411235Z [[[-1.9247e-01-5.9898e-01j, -2.0373e-01-4.1895e-01j, 2025-12-04T10:08:29.2411284Z 6.1013e-01+2.7049e-01j, 1.4377e+00-8.3280e-01j, 2025-12-04T10:08:29.2411323Z -6.6499e-01-1.1766e-01j], 2025-12-04T10:08:29.2411373Z [-6.6132e-01-5.8401e-01j, -2.4468e-01+9.6209e-01j, 2025-12-04T10:08:29.2411423Z -2.4876e-01+5.0988e-01j, 1.1762e-01-8.9780e-01j, 2025-12-04T10:08:29.2411461Z 4.2619e-01-3.0161e-01j], 2025-12-04T10:08:29.2411511Z [-1.3795e-01+2.8517e-01j, -1.9518e-01-1.4548e+00j, 2025-12-04T10:08:29.2411562Z -5.7144e-01-4.1533e-01j, -4.0360e-02+3.6991e-01j, 2025-12-04T10:08:29.2411602Z 2.5680e-01-1.8153e-01j], 2025-12-04T10:08:29.2411652Z [ 3.2443e-01-1.1166e-01j, -4.2329e-01-1.0968e+00j, 2025-12-04T10:08:29.2411703Z 1.2292e+00+9.1030e-01j, -6.1282e-01-2.3221e-01j, 2025-12-04T10:08:29.2411742Z 1.7643e-01-1.6447e+00j], 2025-12-04T10:08:29.2411791Z [ 1.0216e+00+7.6797e-01j, 3.1799e-01-3.5585e-01j, 2025-12-04T10:08:29.2411840Z 3.1383e-01+5.4475e-01j, -8.2130e-01-1.6836e-01j, 2025-12-04T10:08:29.2411882Z -5.9919e-01-8.6910e-01j]], 2025-12-04T10:08:29.2411883Z 2025-12-04T10:08:29.2411932Z [[ 1.0555e+00-7.3195e-01j, 4.5944e-01+5.2560e-01j, 2025-12-04T10:08:29.2411982Z 1.1356e+00-7.5032e-01j, -7.3399e-01+2.0055e+00j, 2025-12-04T10:08:29.2412021Z -6.3011e-01+1.7524e-01j], 2025-12-04T10:08:29.2412075Z [-1.0192e+00-6.3369e-01j, -1.4472e-01-9.0334e-01j, 2025-12-04T10:08:29.2412124Z 8.3985e-01+5.4672e-01j, -4.2470e-01+8.0460e-03j, 2025-12-04T10:08:29.2412166Z -9.9820e-01-3.5334e-01j], 2025-12-04T10:08:29.2412215Z [ 3.3154e-01-4.2917e-01j, -8.8055e-01-2.5479e-02j, 2025-12-04T10:08:29.2412265Z 1.0429e-01-7.5315e-01j, 2.9962e-01+3.6077e-01j, 2025-12-04T10:08:29.2412304Z 6.4636e-01+2.2084e-02j], 2025-12-04T10:08:29.2412355Z [-1.7452e-02-3.8796e-01j, 8.2227e-01-6.5336e-01j, 2025-12-04T10:08:29.2412404Z 7.4086e-01+1.2470e+00j, 3.3632e-01+7.9639e-01j, 2025-12-04T10:08:29.2412443Z -1.0463e+00-3.7173e-01j], 2025-12-04T10:08:29.2412492Z [-5.6360e-01+1.4406e-01j, -1.8765e-01-1.5054e+00j, 2025-12-04T10:08:29.2412543Z -7.4607e-01+3.7677e-01j, 1.2337e+00-2.0909e-01j, 2025-12-04T10:08:29.2412594Z 1.0935e+00+4.7941e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2412639Z dtype=torch.complex128) 2025-12-04T10:08:29.2412641Z 2025-12-04T10:08:29.2412675Z Expected: 2025-12-04T10:08:29.2412751Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.2412789Z 0.3399-0.5672j], 2025-12-04T10:08:29.2412854Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.2412890Z 0.2071-0.7425j], 2025-12-04T10:08:29.2412997Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.2413033Z 0.4110+0.5304j], 2025-12-04T10:08:29.2413096Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.2413132Z -0.3610+0.5378j], 2025-12-04T10:08:29.2413196Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.2413234Z 0.0868+0.1064j]], 2025-12-04T10:08:29.2413237Z 2025-12-04T10:08:29.2413319Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.2413356Z 0.5342-0.4740j], 2025-12-04T10:08:29.2413418Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.2413496Z -0.6736-0.7699j], 2025-12-04T10:08:29.2413558Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.2413595Z -0.5256-0.5484j], 2025-12-04T10:08:29.2413671Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.2413708Z -0.3277-0.6605j], 2025-12-04T10:08:29.2413771Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.2413809Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.2413811Z 2025-12-04T10:08:29.2413813Z 2025-12-04T10:08:29.2413875Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.2413913Z -0.6650-0.1177j], 2025-12-04T10:08:29.2413978Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.2414014Z 0.4262-0.3016j], 2025-12-04T10:08:29.2414077Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.2414116Z 0.2568-0.1815j], 2025-12-04T10:08:29.2414178Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.2414213Z 0.1764-1.6447j], 2025-12-04T10:08:29.2414276Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.2414316Z -0.5992-0.8691j]], 2025-12-04T10:08:29.2414317Z 2025-12-04T10:08:29.2414380Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.2414417Z -0.6301+0.1752j], 2025-12-04T10:08:29.2414478Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.2414515Z -0.9982-0.3533j], 2025-12-04T10:08:29.2414578Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.2414614Z 0.6464+0.0221j], 2025-12-04T10:08:29.2414677Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.2414715Z -1.0463-0.3717j], 2025-12-04T10:08:29.2414777Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.2414843Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2414846Z 2025-12-04T10:08:29.2415139Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2415142Z 2025-12-04T10:08:29.2415216Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2415422Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2415424Z 2025-12-04T10:08:29.2415512Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2415691Z FAILED [0.0558s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2415694Z 2025-12-04T10:08:29.2415786Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2415867Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2415945Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2415948Z 2025-12-04T10:08:29.2416033Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2416135Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2416192Z If the test 2025-12-04T10:08:29.2416285Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2416362Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2416467Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2416549Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2416563Z 2025-12-04T10:08:29.2416654Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2416738Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2416774Z the following. 2025-12-04T10:08:29.2416776Z 2025-12-04T10:08:29.2416864Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2416954Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2417005Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2417070Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2417130Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2417136Z 2025-12-04T10:08:29.2417169Z Got: 2025-12-04T10:08:29.2417229Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.2417282Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.2417322Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.2417374Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.2417424Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.2417464Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.2417514Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.2417565Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.2417603Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.2417653Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.2417702Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.2417742Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.2417793Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.2417842Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.2417882Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.2417887Z 2025-12-04T10:08:29.2417936Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.2417985Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.2418024Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.2418072Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.2418121Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.2418159Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.2418209Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.2418259Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.2418298Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.2418348Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.2418396Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.2418434Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.2418484Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.2418533Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.2418574Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.2418576Z 2025-12-04T10:08:29.2418578Z 2025-12-04T10:08:29.2418628Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2418677Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2418716Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2418778Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2418829Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2418889Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2418940Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2418990Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2419040Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2419091Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2419144Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2419182Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2419232Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2419281Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2419322Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2419324Z 2025-12-04T10:08:29.2419374Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2419424Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2419464Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2419514Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2419563Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2419601Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2419653Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2419703Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2419740Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2419791Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2419839Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2419880Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2419929Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2419979Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2420029Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2420076Z dtype=torch.complex128) 2025-12-04T10:08:29.2420078Z 2025-12-04T10:08:29.2420112Z Expected: 2025-12-04T10:08:29.2420187Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2420226Z 0.3401-0.5673j], 2025-12-04T10:08:29.2420291Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2420326Z 0.2078-0.7444j], 2025-12-04T10:08:29.2420391Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2420426Z 0.4109+0.5305j], 2025-12-04T10:08:29.2420490Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2420526Z -0.3607+0.5386j], 2025-12-04T10:08:29.2420589Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2420627Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2420633Z 2025-12-04T10:08:29.2420696Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2420733Z 0.5323-0.4729j], 2025-12-04T10:08:29.2420795Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2420834Z -0.6732-0.7677j], 2025-12-04T10:08:29.2420896Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2420932Z -0.5241-0.5479j], 2025-12-04T10:08:29.2420993Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2421030Z -0.3257-0.6597j], 2025-12-04T10:08:29.2421092Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2421130Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2421144Z 2025-12-04T10:08:29.2421146Z 2025-12-04T10:08:29.2421208Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2421256Z -0.6637-0.1175j], 2025-12-04T10:08:29.2421331Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2421368Z 0.4261-0.3012j], 2025-12-04T10:08:29.2421430Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2421480Z 0.2567-0.1808j], 2025-12-04T10:08:29.2421543Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2421579Z 0.1761-1.6446j], 2025-12-04T10:08:29.2421641Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2421680Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2421682Z 2025-12-04T10:08:29.2421743Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2421781Z -0.6307+0.1756j], 2025-12-04T10:08:29.2421843Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2421881Z -0.9972-0.3518j], 2025-12-04T10:08:29.2421945Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2421982Z 0.6467+0.0201j], 2025-12-04T10:08:29.2422043Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2422082Z -1.0443-0.3699j], 2025-12-04T10:08:29.2422145Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2422210Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2422212Z 2025-12-04T10:08:29.2422514Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2422517Z 2025-12-04T10:08:29.2422590Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2422798Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2422800Z 2025-12-04T10:08:29.2422885Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2423102Z FAILED [0.1104s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2423104Z 2025-12-04T10:08:29.2423196Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2423278Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2423357Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2423360Z 2025-12-04T10:08:29.2423446Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2423548Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2423585Z If the test 2025-12-04T10:08:29.2423677Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2423739Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2423834Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2423916Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2423918Z 2025-12-04T10:08:29.2424009Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2424093Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2424130Z the following. 2025-12-04T10:08:29.2424132Z 2025-12-04T10:08:29.2424235Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2424328Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2424406Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2424470Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2424616Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2424640Z 2025-12-04T10:08:29.2424673Z Got: 2025-12-04T10:08:29.2424746Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.2424783Z 0.3399-0.5672j], 2025-12-04T10:08:29.2424845Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.2424882Z 0.2071-0.7425j], 2025-12-04T10:08:29.2424945Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.2424982Z 0.4110+0.5304j], 2025-12-04T10:08:29.2425044Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.2425081Z -0.3610+0.5378j], 2025-12-04T10:08:29.2425145Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.2425185Z 0.0868+0.1064j]], 2025-12-04T10:08:29.2425187Z 2025-12-04T10:08:29.2425250Z [[-1.0988+0.1570j, -0.8103-0.1739j, 0.7776-3.3622j, -0.4721+2.4823j, 2025-12-04T10:08:29.2425288Z -1.3900+0.9553j], 2025-12-04T10:08:29.2425351Z [-1.1652+0.8914j, 0.1777-2.1221j, 3.5317-0.1484j, -1.4368-1.5654j, 2025-12-04T10:08:29.2425387Z 0.4591-1.3401j], 2025-12-04T10:08:29.2425447Z [ 0.7359-0.3223j, 2.1508-0.8276j, 2.7059+4.0560j, 0.0778-1.6340j, 2025-12-04T10:08:29.2425484Z 0.1961-0.8144j], 2025-12-04T10:08:29.2425545Z [-0.0354-0.7195j, 1.8138-0.3152j, 0.6474+3.4303j, 0.2280-0.0901j, 2025-12-04T10:08:29.2425581Z -0.6439-0.2327j], 2025-12-04T10:08:29.2425644Z [ 0.8064-0.0707j, 0.4507+0.1942j, -1.2912+0.6826j, -0.0278+0.3969j, 2025-12-04T10:08:29.2425682Z 0.2718-0.0305j]]], 2025-12-04T10:08:29.2425685Z 2025-12-04T10:08:29.2425687Z 2025-12-04T10:08:29.2425750Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.2425785Z -0.6650-0.1177j], 2025-12-04T10:08:29.2425848Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.2425886Z 0.4262-0.3016j], 2025-12-04T10:08:29.2425949Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.2425985Z 0.2568-0.1815j], 2025-12-04T10:08:29.2426047Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.2426083Z 0.1764-1.6447j], 2025-12-04T10:08:29.2426147Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.2426186Z -0.5992-0.8691j]], 2025-12-04T10:08:29.2426188Z 2025-12-04T10:08:29.2426250Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.2426288Z -0.6301+0.1752j], 2025-12-04T10:08:29.2426351Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.2426387Z -0.9982-0.3533j], 2025-12-04T10:08:29.2426451Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.2426487Z 0.6464+0.0221j], 2025-12-04T10:08:29.2426549Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.2426585Z -1.0463-0.3717j], 2025-12-04T10:08:29.2426648Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.2426712Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2426715Z 2025-12-04T10:08:29.2426749Z Expected: 2025-12-04T10:08:29.2426831Z tensor([[[[-0.5618+0.0575j, 0.3117+1.1038j, 1.1399+0.3763j, 0.9819-0.3979j, 2025-12-04T10:08:29.2426868Z 0.3399-0.5672j], 2025-12-04T10:08:29.2426952Z [ 0.6816-0.1508j, 0.2813+0.1165j, 0.5363+0.1634j, 0.8372-0.5071j, 2025-12-04T10:08:29.2426989Z 0.2071-0.7425j], 2025-12-04T10:08:29.2427051Z [-1.1227+0.2131j, -1.1479+0.5722j, 0.6632-0.4140j, 0.1237-1.7409j, 2025-12-04T10:08:29.2427099Z 0.4110+0.5304j], 2025-12-04T10:08:29.2427161Z [ 1.5026+0.8764j, 0.5770+0.6559j, 1.3190+0.1897j, -0.3354-0.6127j, 2025-12-04T10:08:29.2427199Z -0.3610+0.5378j], 2025-12-04T10:08:29.2427262Z [-0.5938-0.5350j, -1.5365+0.1199j, 1.0852-0.3808j, 0.2193-0.8305j, 2025-12-04T10:08:29.2427304Z 0.0868+0.1064j]], 2025-12-04T10:08:29.2427306Z 2025-12-04T10:08:29.2427368Z [[-0.4822+0.4927j, 1.0178+0.7991j, -0.4845-1.6315j, 0.3060-0.1543j, 2025-12-04T10:08:29.2427404Z 0.5342-0.4740j], 2025-12-04T10:08:29.2427467Z [ 0.9591+1.1462j, -0.8341+0.4227j, 0.6381+0.0403j, -0.1749-0.1519j, 2025-12-04T10:08:29.2427505Z -0.6736-0.7699j], 2025-12-04T10:08:29.2427568Z [ 0.6053-0.8444j, 0.5445-1.0116j, 1.4456+0.0580j, -1.1486+0.0820j, 2025-12-04T10:08:29.2427607Z -0.5256-0.5484j], 2025-12-04T10:08:29.2427669Z [-0.3105-0.4962j, 0.4611+0.9677j, -0.9074+1.4349j, 0.3253-0.2546j, 2025-12-04T10:08:29.2427708Z -0.3277-0.6605j], 2025-12-04T10:08:29.2427770Z [ 0.9163+0.3094j, 0.4000+0.4287j, -1.7403+0.1276j, -0.2208+0.4210j, 2025-12-04T10:08:29.2427809Z 0.3121+0.0970j]]], 2025-12-04T10:08:29.2427810Z 2025-12-04T10:08:29.2427812Z 2025-12-04T10:08:29.2427876Z [[[-0.1925-0.5990j, -0.2037-0.4189j, 0.6101+0.2705j, 1.4377-0.8328j, 2025-12-04T10:08:29.2427912Z -0.6650-0.1177j], 2025-12-04T10:08:29.2427974Z [-0.6613-0.5840j, -0.2447+0.9621j, -0.2488+0.5099j, 0.1176-0.8978j, 2025-12-04T10:08:29.2428010Z 0.4262-0.3016j], 2025-12-04T10:08:29.2428074Z [-0.1380+0.2852j, -0.1952-1.4548j, -0.5714-0.4153j, -0.0404+0.3699j, 2025-12-04T10:08:29.2428109Z 0.2568-0.1815j], 2025-12-04T10:08:29.2428173Z [ 0.3244-0.1117j, -0.4233-1.0968j, 1.2292+0.9103j, -0.6128-0.2322j, 2025-12-04T10:08:29.2428209Z 0.1764-1.6447j], 2025-12-04T10:08:29.2428272Z [ 1.0216+0.7680j, 0.3180-0.3559j, 0.3138+0.5448j, -0.8213-0.1684j, 2025-12-04T10:08:29.2428311Z -0.5992-0.8691j]], 2025-12-04T10:08:29.2428313Z 2025-12-04T10:08:29.2428375Z [[ 1.0555-0.7319j, 0.4594+0.5256j, 1.1356-0.7503j, -0.7340+2.0055j, 2025-12-04T10:08:29.2428411Z -0.6301+0.1752j], 2025-12-04T10:08:29.2428474Z [-1.0192-0.6337j, -0.1447-0.9033j, 0.8398+0.5467j, -0.4247+0.0080j, 2025-12-04T10:08:29.2428510Z -0.9982-0.3533j], 2025-12-04T10:08:29.2428572Z [ 0.3315-0.4292j, -0.8805-0.0255j, 0.1043-0.7531j, 0.2996+0.3608j, 2025-12-04T10:08:29.2428608Z 0.6464+0.0221j], 2025-12-04T10:08:29.2428669Z [-0.0175-0.3880j, 0.8223-0.6534j, 0.7409+1.2470j, 0.3363+0.7964j, 2025-12-04T10:08:29.2428705Z -1.0463-0.3717j], 2025-12-04T10:08:29.2428771Z [-0.5636+0.1441j, -0.1876-1.5054j, -0.7461+0.3768j, 1.2337-0.2091j, 2025-12-04T10:08:29.2428836Z 1.0935+0.4794j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2428838Z 2025-12-04T10:08:29.2429132Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2429134Z 2025-12-04T10:08:29.2429208Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2429411Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2429427Z 2025-12-04T10:08:29.2429515Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2429704Z FAILED [0.0589s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2429721Z 2025-12-04T10:08:29.2429814Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2429906Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2429985Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2429987Z 2025-12-04T10:08:29.2430070Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2430172Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2430207Z If the test 2025-12-04T10:08:29.2430302Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2430363Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2430458Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2430542Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2430544Z 2025-12-04T10:08:29.2430636Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2430721Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2430757Z the following. 2025-12-04T10:08:29.2430759Z 2025-12-04T10:08:29.2430847Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2430937Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2430988Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2431050Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2431112Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2431114Z 2025-12-04T10:08:29.2431146Z Got: 2025-12-04T10:08:29.2431221Z tensor([[[[ 0.3099-0.0331j, -0.1725-0.6100j, -0.6301-0.2079j, -0.5421+0.2208j, 2025-12-04T10:08:29.2431260Z -0.1875+0.3131j], 2025-12-04T10:08:29.2431325Z [-0.2588+0.0575j, -0.1069-0.0446j, -0.2044-0.0621j, -0.3187+0.1933j, 2025-12-04T10:08:29.2431362Z -0.0786+0.2827j], 2025-12-04T10:08:29.2431426Z [-0.8428+0.1590j, -0.8617+0.4289j, 0.4993-0.3105j, 0.0946-1.3069j, 2025-12-04T10:08:29.2431462Z 0.3077+0.3986j], 2025-12-04T10:08:29.2431525Z [ 0.6304+0.3668j, 0.2421+0.2749j, 0.5533+0.0787j, -0.1413-0.2567j, 2025-12-04T10:08:29.2431560Z -0.1509+0.2260j], 2025-12-04T10:08:29.2431623Z [-0.1904-0.1717j, -0.4927+0.0378j, 0.3475-0.1221j, 0.0702-0.2661j, 2025-12-04T10:08:29.2431659Z 0.0273+0.0340j]], 2025-12-04T10:08:29.2431661Z 2025-12-04T10:08:29.2431725Z [[-0.2735+0.2795j, 0.5785+0.4541j, -0.2751-0.9256j, 0.1731-0.0877j, 2025-12-04T10:08:29.2431760Z 0.3021-0.2693j], 2025-12-04T10:08:29.2431825Z [ 6.1624+7.1237j, -5.2119+2.7542j, 4.0289+0.1875j, -1.1224-0.9364j, 2025-12-04T10:08:29.2431862Z -4.3263-4.7783j], 2025-12-04T10:08:29.2431926Z [-0.1736+0.2418j, -0.1565+0.2895j, -0.4142-0.0175j, 0.3292-0.0232j, 2025-12-04T10:08:29.2431962Z 0.1501+0.1573j], 2025-12-04T10:08:29.2432026Z [-0.0505-0.0808j, 0.0752+0.1579j, -0.1486+0.2334j, 0.0531-0.0413j, 2025-12-04T10:08:29.2432062Z -0.0529-0.1077j], 2025-12-04T10:08:29.2432124Z [ 0.8451+0.2855j, 0.3707+0.3965j, -1.6023+0.1204j, -0.2033+0.3860j, 2025-12-04T10:08:29.2432162Z 0.2856+0.0883j]]], 2025-12-04T10:08:29.2432163Z 2025-12-04T10:08:29.2432165Z 2025-12-04T10:08:29.2432228Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2432275Z -0.6637-0.1175j], 2025-12-04T10:08:29.2432339Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2432374Z 0.4261-0.3012j], 2025-12-04T10:08:29.2432461Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2432497Z 0.2567-0.1808j], 2025-12-04T10:08:29.2432561Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2432608Z 0.1761-1.6446j], 2025-12-04T10:08:29.2432670Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2432708Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2432710Z 2025-12-04T10:08:29.2432771Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2432808Z -0.6307+0.1756j], 2025-12-04T10:08:29.2432869Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2432907Z -0.9972-0.3518j], 2025-12-04T10:08:29.2433016Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2433052Z 0.6467+0.0201j], 2025-12-04T10:08:29.2433121Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2433157Z -1.0443-0.3699j], 2025-12-04T10:08:29.2433220Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2433287Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2433289Z 2025-12-04T10:08:29.2433322Z Expected: 2025-12-04T10:08:29.2433395Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2433430Z 0.3401-0.5673j], 2025-12-04T10:08:29.2433491Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2433526Z 0.2078-0.7444j], 2025-12-04T10:08:29.2433590Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2433625Z 0.4109+0.5305j], 2025-12-04T10:08:29.2433687Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2433725Z -0.3607+0.5386j], 2025-12-04T10:08:29.2433787Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2433823Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2433826Z 2025-12-04T10:08:29.2433889Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2433925Z 0.5323-0.4729j], 2025-12-04T10:08:29.2433989Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2434024Z -0.6732-0.7677j], 2025-12-04T10:08:29.2434086Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2434122Z -0.5241-0.5479j], 2025-12-04T10:08:29.2434185Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2434221Z -0.3257-0.6597j], 2025-12-04T10:08:29.2434284Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2434322Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2434324Z 2025-12-04T10:08:29.2434327Z 2025-12-04T10:08:29.2434388Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2434426Z -0.6637-0.1175j], 2025-12-04T10:08:29.2434489Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2434525Z 0.4261-0.3012j], 2025-12-04T10:08:29.2434588Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2434623Z 0.2567-0.1808j], 2025-12-04T10:08:29.2434687Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2434728Z 0.1761-1.6446j], 2025-12-04T10:08:29.2434807Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2434846Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2434863Z 2025-12-04T10:08:29.2434948Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2434986Z -0.6307+0.1756j], 2025-12-04T10:08:29.2435048Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2435102Z -0.9972-0.3518j], 2025-12-04T10:08:29.2435165Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2435203Z 0.6467+0.0201j], 2025-12-04T10:08:29.2435263Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2435300Z -1.0443-0.3699j], 2025-12-04T10:08:29.2435363Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2435431Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2435433Z 2025-12-04T10:08:29.2435730Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2435735Z 2025-12-04T10:08:29.2435808Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2436012Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2436015Z 2025-12-04T10:08:29.2436101Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2436278Z FAILED [0.0571s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2436280Z 2025-12-04T10:08:29.2436372Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2436453Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2436533Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2436535Z 2025-12-04T10:08:29.2436617Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2436719Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2436756Z If the test 2025-12-04T10:08:29.2436850Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2436914Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2437007Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2437091Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2437093Z 2025-12-04T10:08:29.2437183Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2437268Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2437305Z the following. 2025-12-04T10:08:29.2437307Z 2025-12-04T10:08:29.2437396Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2437487Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2437538Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2437602Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2437662Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2437664Z 2025-12-04T10:08:29.2437696Z Got: 2025-12-04T10:08:29.2437758Z tensor([[[[-9.3499e+00+3.6972e+01j, 8.2352e+01+1.3224e+01j, 2025-12-04T10:08:29.2437813Z -6.0533e+01+2.2437e+01j, -1.3159e+01+4.3248e+01j, 2025-12-04T10:08:29.2437864Z 1.9644e+00+4.0053e+00j], 2025-12-04T10:08:29.2437918Z [-7.2752e+00-3.9206e+01j, -9.3996e+01+6.7313e+00j, 2025-12-04T10:08:29.2437968Z 9.1405e+01-2.0061e+01j, 1.8515e+01-4.4790e+01j, 2025-12-04T10:08:29.2438033Z -2.4192e+00-1.8976e+00j], 2025-12-04T10:08:29.2438083Z [-1.5130e+01+1.9311e+01j, 5.7027e+01-8.1820e+00j, 2025-12-04T10:08:29.2438134Z -7.5208e+01+1.0948e+01j, -4.0119e+00+2.5884e+01j, 2025-12-04T10:08:29.2438183Z 9.8160e+00-5.7790e+00j], 2025-12-04T10:08:29.2438232Z [ 1.8519e+01+1.4580e+01j, 3.3212e+01+5.5708e-01j, 2025-12-04T10:08:29.2438281Z -1.5762e+01+8.4504e+00j, -5.8529e+00+1.3836e+01j, 2025-12-04T10:08:29.2438321Z -3.3047e+00+2.7431e-01j], 2025-12-04T10:08:29.2438370Z [-2.6761e+01-2.4040e+01j, -6.9111e+01+5.4335e+00j, 2025-12-04T10:08:29.2438419Z 4.8723e+01-1.7224e+01j, 9.7768e+00-3.7352e+01j, 2025-12-04T10:08:29.2438460Z 3.8438e+00+4.7656e+00j]], 2025-12-04T10:08:29.2438462Z 2025-12-04T10:08:29.2438512Z [[ 5.1464e+04+1.2801e+04j, 2.0299e+04+3.9971e+03j, 2025-12-04T10:08:29.2438562Z -6.8766e+04-7.2739e+03j, -2.1429e+04+2.4389e+04j, 2025-12-04T10:08:29.2438605Z 1.6461e+04+9.0546e+03j], 2025-12-04T10:08:29.2438654Z [-3.6871e+04-9.2001e+03j, -1.4534e+04-2.8657e+03j, 2025-12-04T10:08:29.2438703Z 4.9250e+04+5.2481e+03j, 1.5372e+04-1.7463e+04j, 2025-12-04T10:08:29.2438742Z -1.1784e+04-6.4973e+03j], 2025-12-04T10:08:29.2438791Z [ 1.2016e+02+3.3809e+01j, 4.0815e+01+3.5966e+00j, 2025-12-04T10:08:29.2438841Z -1.4265e+02-2.4002e+01j, -5.2457e+01+5.4774e+01j, 2025-12-04T10:08:29.2438882Z 3.4631e+01+1.9852e+01j], 2025-12-04T10:08:29.2438931Z [-4.0314e+01-1.6009e+01j, -1.3863e+01-1.1645e+01j, 2025-12-04T10:08:29.2438980Z 6.6657e+01+3.5756e+00j, 1.1259e+01-1.9147e+01j, 2025-12-04T10:08:29.2439018Z -1.5043e+01-8.2280e+00j], 2025-12-04T10:08:29.2439068Z [ 3.3331e+01+1.1058e+01j, 1.4677e+01+1.5529e+01j, 2025-12-04T10:08:29.2439117Z -6.3054e+01+5.0790e+00j, -7.9226e+00+1.5240e+01j, 2025-12-04T10:08:29.2439159Z 1.1260e+01+3.4151e+00j]]], 2025-12-04T10:08:29.2439163Z 2025-12-04T10:08:29.2439164Z 2025-12-04T10:08:29.2439214Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2439264Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2439304Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2439355Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2439406Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2439447Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2439496Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2439548Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2439586Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2439638Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2439686Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2439727Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2439776Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2439825Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2439867Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2439869Z 2025-12-04T10:08:29.2439918Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2439969Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2440007Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2440057Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2440107Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2440146Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2440212Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2440262Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2440325Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2440377Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2440425Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2440475Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2440525Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2440576Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2440626Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2440670Z dtype=torch.complex128) 2025-12-04T10:08:29.2440672Z 2025-12-04T10:08:29.2440707Z Expected: 2025-12-04T10:08:29.2440785Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2440822Z 0.3401-0.5673j], 2025-12-04T10:08:29.2440886Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2440922Z 0.2078-0.7444j], 2025-12-04T10:08:29.2440989Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2441024Z 0.4109+0.5305j], 2025-12-04T10:08:29.2441088Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2441125Z -0.3607+0.5386j], 2025-12-04T10:08:29.2441188Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2441226Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2441227Z 2025-12-04T10:08:29.2441290Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2441325Z 0.5323-0.4729j], 2025-12-04T10:08:29.2441388Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2441426Z -0.6732-0.7677j], 2025-12-04T10:08:29.2441488Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2441525Z -0.5241-0.5479j], 2025-12-04T10:08:29.2441590Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2441627Z -0.3257-0.6597j], 2025-12-04T10:08:29.2441691Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2441729Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2441731Z 2025-12-04T10:08:29.2441733Z 2025-12-04T10:08:29.2441795Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2441833Z -0.6637-0.1175j], 2025-12-04T10:08:29.2441895Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2441933Z 0.4261-0.3012j], 2025-12-04T10:08:29.2441997Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2442034Z 0.2567-0.1808j], 2025-12-04T10:08:29.2442096Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2442132Z 0.1761-1.6446j], 2025-12-04T10:08:29.2442194Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2442233Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2442235Z 2025-12-04T10:08:29.2442298Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2442336Z -0.6307+0.1756j], 2025-12-04T10:08:29.2442397Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2442435Z -0.9972-0.3518j], 2025-12-04T10:08:29.2442497Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2442534Z 0.6467+0.0201j], 2025-12-04T10:08:29.2442594Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2442641Z -1.0443-0.3699j], 2025-12-04T10:08:29.2442705Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2442792Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2442794Z 2025-12-04T10:08:29.2443145Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2443162Z 2025-12-04T10:08:29.2443238Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2443439Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2443443Z 2025-12-04T10:08:29.2443529Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2443706Z FAILED [0.0563s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2443709Z 2025-12-04T10:08:29.2443802Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2443883Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2443961Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2443963Z 2025-12-04T10:08:29.2444046Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2444147Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2444182Z If the test 2025-12-04T10:08:29.2444275Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2444337Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2444433Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2444516Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2444519Z 2025-12-04T10:08:29.2444609Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2444693Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2444730Z the following. 2025-12-04T10:08:29.2444731Z 2025-12-04T10:08:29.2444821Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2444911Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2444962Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2445026Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2445086Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2445088Z 2025-12-04T10:08:29.2445121Z Got: 2025-12-04T10:08:29.2445194Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.2445245Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.2445311Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.2445360Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.2445421Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.2445469Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.2445529Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.2445576Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.2445636Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.2445687Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.2445690Z 2025-12-04T10:08:29.2445764Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.2445810Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.2445905Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.2445952Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.2446011Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.2446068Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.2446128Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.2446174Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.2446234Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.2446285Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.2446287Z 2025-12-04T10:08:29.2446289Z 2025-12-04T10:08:29.2446350Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.2446396Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.2446456Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.2446505Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.2446565Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.2446611Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.2446673Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.2446719Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.2446778Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.2446826Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.2446828Z 2025-12-04T10:08:29.2446887Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.2446935Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.2446994Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.2447042Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.2447102Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.2447147Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.2447206Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.2447251Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.2447313Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.2447373Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2447417Z dtype=torch.complex128) 2025-12-04T10:08:29.2447419Z 2025-12-04T10:08:29.2447452Z Expected: 2025-12-04T10:08:29.2447527Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2447563Z 0.3401-0.5673j], 2025-12-04T10:08:29.2447627Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2447665Z 0.2078-0.7444j], 2025-12-04T10:08:29.2447730Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2447766Z 0.4109+0.5305j], 2025-12-04T10:08:29.2447830Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2447866Z -0.3607+0.5386j], 2025-12-04T10:08:29.2447929Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2447967Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2447969Z 2025-12-04T10:08:29.2448033Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2448069Z 0.5323-0.4729j], 2025-12-04T10:08:29.2448151Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2448189Z -0.6732-0.7677j], 2025-12-04T10:08:29.2448250Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2448311Z -0.5241-0.5479j], 2025-12-04T10:08:29.2448373Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2448411Z -0.3257-0.6597j], 2025-12-04T10:08:29.2448483Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2448521Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2448523Z 2025-12-04T10:08:29.2448525Z 2025-12-04T10:08:29.2448587Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2448624Z -0.6637-0.1175j], 2025-12-04T10:08:29.2448686Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2448722Z 0.4261-0.3012j], 2025-12-04T10:08:29.2448787Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2448823Z 0.2567-0.1808j], 2025-12-04T10:08:29.2448886Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2448923Z 0.1761-1.6446j], 2025-12-04T10:08:29.2448985Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2449024Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2449027Z 2025-12-04T10:08:29.2449089Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2449126Z -0.6307+0.1756j], 2025-12-04T10:08:29.2449187Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2449224Z -0.9972-0.3518j], 2025-12-04T10:08:29.2449285Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2449322Z 0.6467+0.0201j], 2025-12-04T10:08:29.2449384Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2449420Z -1.0443-0.3699j], 2025-12-04T10:08:29.2449484Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2449551Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2449553Z 2025-12-04T10:08:29.2449851Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2449855Z 2025-12-04T10:08:29.2449930Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2450138Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2450140Z 2025-12-04T10:08:29.2450227Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2450406Z FAILED [0.0555s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2450410Z 2025-12-04T10:08:29.2450502Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2450584Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2450664Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2450666Z 2025-12-04T10:08:29.2450748Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2450849Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2450885Z If the test 2025-12-04T10:08:29.2450978Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2451051Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2451145Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2451247Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2451249Z 2025-12-04T10:08:29.2451340Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2451423Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2451470Z the following. 2025-12-04T10:08:29.2451472Z 2025-12-04T10:08:29.2451559Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2451649Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2451701Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2451764Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2451825Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2451827Z 2025-12-04T10:08:29.2451860Z Got: 2025-12-04T10:08:29.2451910Z tensor([[[[ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2451959Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2451997Z nan+nanj], 2025-12-04T10:08:29.2452042Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2452084Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2452124Z nan+nanj], 2025-12-04T10:08:29.2452166Z [ nan+nanj, nan+nanj, 2025-12-04T10:08:29.2452208Z nan+nanj, nan+nanj, 2025-12-04T10:08:29.2452245Z nan+nanj], 2025-12-04T10:08:29.2452301Z [-4.5011e-01-4.5568e-01j, -4.1276e-01-1.0965e-01j, 2025-12-04T10:08:29.2452355Z -9.2388e-02-3.2525e-01j, 2.4579e-02-9.2569e-03j, 2025-12-04T10:08:29.2452395Z 1.6921e-01-7.9961e-02j], 2025-12-04T10:08:29.2452447Z [ 2.7000e-02+7.7535e-02j, 1.4412e-01+6.5290e-02j, 2025-12-04T10:08:29.2452501Z -1.1636e-01-1.9258e-02j, -6.0697e-02+6.3884e-02j, 2025-12-04T10:08:29.2452542Z -2.4316e-03-1.3760e-02j]], 2025-12-04T10:08:29.2452545Z 2025-12-04T10:08:29.2452597Z [[-4.8218e-01+4.8525e-01j, 1.0069e+00+8.0732e-01j, 2025-12-04T10:08:29.2452648Z -5.0535e-01-1.6324e+00j, 3.1426e-01-1.4760e-01j, 2025-12-04T10:08:29.2452688Z 5.3752e-01-4.7521e-01j], 2025-12-04T10:08:29.2452739Z [ 6.6873e-01+1.7935e+00j, -1.6660e+00-4.3039e-01j, 2025-12-04T10:08:29.2452790Z 1.8748e+00-1.5115e+00j, -3.6565e-02-1.0518e-01j, 2025-12-04T10:08:29.2452829Z -3.0701e-01+4.6337e-02j], 2025-12-04T10:08:29.2452879Z [ 1.0700e+00-3.7001e+00j, -1.7124e+00-1.5058e+01j, 2025-12-04T10:08:29.2452969Z 2.4293e+01-9.7962e+00j, -8.2821e+00+3.9956e-03j, 2025-12-04T10:08:29.2453010Z -2.8052e+00+3.9072e-01j], 2025-12-04T10:08:29.2453060Z [-7.8162e+00-5.9073e+00j, 1.5687e+00+5.6304e+00j, 2025-12-04T10:08:29.2453110Z 2.3086e+00+1.1232e+01j, 3.9797e+00-4.5049e+00j, 2025-12-04T10:08:29.2453149Z -4.4829e+00-6.0651e+00j], 2025-12-04T10:08:29.2453200Z [ 1.2388e+01+4.1833e+00j, 5.4338e+00+5.8111e+00j, 2025-12-04T10:08:29.2453250Z -2.3486e+01+1.7657e+00j, -2.9800e+00+5.6582e+00j, 2025-12-04T10:08:29.2453291Z 4.1856e+00+1.2939e+00j]]], 2025-12-04T10:08:29.2453295Z 2025-12-04T10:08:29.2453297Z 2025-12-04T10:08:29.2453348Z [[[-1.9422e-01-5.9982e-01j, -2.0379e-01-4.1896e-01j, 2025-12-04T10:08:29.2453397Z 6.0950e-01+2.7013e-01j, 1.4386e+00-8.3353e-01j, 2025-12-04T10:08:29.2453437Z -6.6369e-01-1.1754e-01j], 2025-12-04T10:08:29.2453487Z [-6.6325e-01-5.8476e-01j, -2.4510e-01+9.6496e-01j, 2025-12-04T10:08:29.2453538Z -2.4927e-01+5.1005e-01j, 1.1940e-01-9.0023e-01j, 2025-12-04T10:08:29.2453575Z 4.2607e-01-3.0121e-01j], 2025-12-04T10:08:29.2453642Z [-1.3833e-01+2.8447e-01j, -1.9572e-01-1.4563e+00j, 2025-12-04T10:08:29.2453694Z -5.7101e-01-4.1585e-01j, -3.9484e-02+3.6956e-01j, 2025-12-04T10:08:29.2453747Z 2.5674e-01-1.8083e-01j], 2025-12-04T10:08:29.2453811Z [ 3.2525e-01-1.1231e-01j, -4.2430e-01-1.0985e+00j, 2025-12-04T10:08:29.2453862Z 1.2298e+00+9.1000e-01j, -6.1240e-01-2.3117e-01j, 2025-12-04T10:08:29.2453900Z 1.7606e-01-1.6446e+00j], 2025-12-04T10:08:29.2453963Z [ 1.0234e+00+7.7070e-01j, 3.2070e-01-3.5507e-01j, 2025-12-04T10:08:29.2454012Z 3.1408e-01+5.4598e-01j, -8.2496e-01-1.6896e-01j, 2025-12-04T10:08:29.2454055Z -5.9960e-01-8.7005e-01j]], 2025-12-04T10:08:29.2454057Z 2025-12-04T10:08:29.2454105Z [[ 1.0535e+00-7.3133e-01j, 4.5991e-01+5.2485e-01j, 2025-12-04T10:08:29.2454156Z 1.1345e+00-7.4928e-01j, -7.3199e-01+2.0047e+00j, 2025-12-04T10:08:29.2454194Z -6.3071e-01+1.7559e-01j], 2025-12-04T10:08:29.2454247Z [-1.0193e+00-6.3274e-01j, -1.4410e-01-9.0354e-01j, 2025-12-04T10:08:29.2454296Z 8.3861e-01+5.4619e-01j, -4.2400e-01+7.4738e-03j, 2025-12-04T10:08:29.2454336Z -9.9720e-01-3.5180e-01j], 2025-12-04T10:08:29.2454389Z [ 3.3287e-01-4.2785e-01j, -8.8116e-01-2.4360e-02j, 2025-12-04T10:08:29.2454439Z 1.0457e-01-7.5094e-01j, 2.9743e-01+3.5862e-01j, 2025-12-04T10:08:29.2454477Z 6.4668e-01+2.0119e-02j], 2025-12-04T10:08:29.2454531Z [-1.6339e-02-3.8884e-01j, 8.2351e-01-6.5351e-01j, 2025-12-04T10:08:29.2454579Z 7.3937e-01+1.2447e+00j, 3.3652e-01+7.9813e-01j, 2025-12-04T10:08:29.2454618Z -1.0443e+00-3.6995e-01j], 2025-12-04T10:08:29.2454667Z [-5.6468e-01+1.4363e-01j, -1.8762e-01-1.5068e+00j, 2025-12-04T10:08:29.2454718Z -7.4164e-01+3.7617e-01j, 1.2339e+00-2.0699e-01j, 2025-12-04T10:08:29.2454770Z 1.0896e+00+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2454813Z dtype=torch.complex128) 2025-12-04T10:08:29.2454816Z 2025-12-04T10:08:29.2454850Z Expected: 2025-12-04T10:08:29.2454926Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2454964Z 0.3401-0.5673j], 2025-12-04T10:08:29.2455030Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2455066Z 0.2078-0.7444j], 2025-12-04T10:08:29.2455131Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2455170Z 0.4109+0.5305j], 2025-12-04T10:08:29.2455233Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2455269Z -0.3607+0.5386j], 2025-12-04T10:08:29.2455333Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2455370Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2455372Z 2025-12-04T10:08:29.2455436Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2455473Z 0.5323-0.4729j], 2025-12-04T10:08:29.2455536Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2455574Z -0.6732-0.7677j], 2025-12-04T10:08:29.2455637Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2455673Z -0.5241-0.5479j], 2025-12-04T10:08:29.2455735Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2455774Z -0.3257-0.6597j], 2025-12-04T10:08:29.2455836Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2455874Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2455876Z 2025-12-04T10:08:29.2455878Z 2025-12-04T10:08:29.2455939Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2455976Z -0.6637-0.1175j], 2025-12-04T10:08:29.2456055Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2456092Z 0.4261-0.3012j], 2025-12-04T10:08:29.2456155Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2456218Z 0.2567-0.1808j], 2025-12-04T10:08:29.2456281Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2456317Z 0.1761-1.6446j], 2025-12-04T10:08:29.2456390Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2456430Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2456432Z 2025-12-04T10:08:29.2456493Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2456530Z -0.6307+0.1756j], 2025-12-04T10:08:29.2456594Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2456631Z -0.9972-0.3518j], 2025-12-04T10:08:29.2456693Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2456730Z 0.6467+0.0201j], 2025-12-04T10:08:29.2456792Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2456832Z -1.0443-0.3699j], 2025-12-04T10:08:29.2456895Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2456962Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2456964Z 2025-12-04T10:08:29.2457260Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2457263Z 2025-12-04T10:08:29.2457336Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2457540Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2457542Z 2025-12-04T10:08:29.2457628Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2457805Z FAILED [0.0584s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2457808Z 2025-12-04T10:08:29.2457902Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2457984Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2458062Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2458064Z 2025-12-04T10:08:29.2458148Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2458251Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2458286Z If the test 2025-12-04T10:08:29.2458380Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2458442Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2458538Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2458620Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2458622Z 2025-12-04T10:08:29.2458714Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2458798Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2458834Z the following. 2025-12-04T10:08:29.2458837Z 2025-12-04T10:08:29.2458926Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2459017Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2459069Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2459148Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2459210Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2459222Z 2025-12-04T10:08:29.2459267Z Got: 2025-12-04T10:08:29.2459341Z tensor([[[[-0.7499+7.9689e-02j, 0.4165+1.4766e+00j, 1.5247+5.0402e-01j, 2025-12-04T10:08:29.2459392Z 1.3123-5.3347e-01j, 0.4542-7.5753e-01j], 2025-12-04T10:08:29.2459466Z [-0.2588+5.7469e-02j, -0.1069-4.4588e-02j, -0.2044-6.2121e-02j, 2025-12-04T10:08:29.2459515Z -0.3187+1.9331e-01j, -0.0786+2.8273e-01j], 2025-12-04T10:08:29.2459577Z [-0.8428+1.5904e-01j, -0.8617+4.2893e-01j, 0.4993-3.1053e-01j, 2025-12-04T10:08:29.2459624Z 0.0946-1.3069e+00j, 0.3077+3.9864e-01j], 2025-12-04T10:08:29.2459683Z [ 0.6304+3.6678e-01j, 0.2421+2.7488e-01j, 0.5533+7.8709e-02j, 2025-12-04T10:08:29.2459731Z -0.1413-2.5671e-01j, -0.1509+2.2603e-01j], 2025-12-04T10:08:29.2459791Z [-0.1904-1.7169e-01j, -0.4927+3.7829e-02j, 0.3475-1.2213e-01j, 2025-12-04T10:08:29.2459840Z 0.0702-2.6610e-01j, 0.0273+3.4017e-02j]], 2025-12-04T10:08:29.2459842Z 2025-12-04T10:08:29.2459903Z [[-0.2735+2.7945e-01j, 0.5785+4.5411e-01j, -0.2751-9.2563e-01j, 2025-12-04T10:08:29.2459950Z 0.1731-8.7656e-02j, 0.3021-2.6932e-01j], 2025-12-04T10:08:29.2460011Z [10.2294+1.2576e+00j, -1.5731-4.2476e+00j, 13.9668+4.4408e-01j, 2025-12-04T10:08:29.2460060Z -9.0056-2.5138e-01j, -7.9876-8.4908e+00j], 2025-12-04T10:08:29.2460120Z [-0.1736+2.4183e-01j, -0.1565+2.8948e-01j, -0.4142-1.7474e-02j, 2025-12-04T10:08:29.2460167Z 0.3292-2.3187e-02j, 0.1501+1.5730e-01j], 2025-12-04T10:08:29.2460227Z [-0.0505-8.0762e-02j, 0.0752+1.5787e-01j, -0.1486+2.3338e-01j, 2025-12-04T10:08:29.2460272Z 0.0531-4.1295e-02j, -0.0529-1.0772e-01j], 2025-12-04T10:08:29.2460331Z [ 0.8451+2.8546e-01j, 0.3707+3.9648e-01j, -1.6023+1.2035e-01j, 2025-12-04T10:08:29.2460386Z -0.2033+3.8601e-01j, 0.2856+8.8294e-02j]]], 2025-12-04T10:08:29.2460388Z 2025-12-04T10:08:29.2460390Z 2025-12-04T10:08:29.2460451Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.2460497Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.2460560Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.2460608Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.2460669Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.2460716Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.2460776Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.2460822Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.2460881Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.2460930Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.2460932Z 2025-12-04T10:08:29.2460993Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.2461041Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.2461101Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.2461146Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.2461206Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.2461251Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.2461310Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.2461355Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.2461416Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.2461476Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2461535Z dtype=torch.complex128) 2025-12-04T10:08:29.2461537Z 2025-12-04T10:08:29.2461572Z Expected: 2025-12-04T10:08:29.2461656Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2461704Z 0.3401-0.5673j], 2025-12-04T10:08:29.2461770Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2461808Z 0.2078-0.7444j], 2025-12-04T10:08:29.2461883Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2461919Z 0.4109+0.5305j], 2025-12-04T10:08:29.2461982Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2462019Z -0.3607+0.5386j], 2025-12-04T10:08:29.2462081Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2462121Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2462122Z 2025-12-04T10:08:29.2462186Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2462223Z 0.5323-0.4729j], 2025-12-04T10:08:29.2462286Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2462326Z -0.6732-0.7677j], 2025-12-04T10:08:29.2462387Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2462423Z -0.5241-0.5479j], 2025-12-04T10:08:29.2462488Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2462525Z -0.3257-0.6597j], 2025-12-04T10:08:29.2462587Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2462625Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2462627Z 2025-12-04T10:08:29.2462628Z 2025-12-04T10:08:29.2462689Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2462726Z -0.6637-0.1175j], 2025-12-04T10:08:29.2462788Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2462824Z 0.4261-0.3012j], 2025-12-04T10:08:29.2462889Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2462925Z 0.2567-0.1808j], 2025-12-04T10:08:29.2463037Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2463075Z 0.1761-1.6446j], 2025-12-04T10:08:29.2463136Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2463176Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2463179Z 2025-12-04T10:08:29.2463241Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2463278Z -0.6307+0.1756j], 2025-12-04T10:08:29.2463339Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2463377Z -0.9972-0.3518j], 2025-12-04T10:08:29.2463439Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2463476Z 0.6467+0.0201j], 2025-12-04T10:08:29.2463539Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2463576Z -1.0443-0.3699j], 2025-12-04T10:08:29.2463639Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2463706Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2463709Z 2025-12-04T10:08:29.2464007Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2464009Z 2025-12-04T10:08:29.2464083Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2464303Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2464320Z 2025-12-04T10:08:29.2464420Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2464598Z FAILED [0.0664s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2464620Z 2025-12-04T10:08:29.2464712Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2464793Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2464871Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2464873Z 2025-12-04T10:08:29.2464958Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2465061Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2465097Z If the test 2025-12-04T10:08:29.2465190Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2465255Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2465349Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2465431Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2465435Z 2025-12-04T10:08:29.2465528Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2465611Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2465648Z the following. 2025-12-04T10:08:29.2465650Z 2025-12-04T10:08:29.2465738Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2465829Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2465881Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2465946Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2466009Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2466011Z 2025-12-04T10:08:29.2466044Z Got: 2025-12-04T10:08:29.2466105Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.2466160Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.2466203Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.2466255Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.2466306Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.2466347Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.2466397Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.2466450Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.2466490Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.2466541Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.2466591Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.2466632Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.2466681Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.2466732Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.2466773Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.2466775Z 2025-12-04T10:08:29.2466826Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.2466877Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.2466915Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.2466964Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.2467015Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.2467067Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.2467118Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.2467169Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.2467233Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.2467285Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.2467333Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.2467388Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.2467436Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.2467486Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.2467526Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.2467528Z 2025-12-04T10:08:29.2467530Z 2025-12-04T10:08:29.2467582Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.2467630Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.2467672Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.2467722Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.2467774Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.2467814Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.2467864Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.2467914Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.2467953Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.2468003Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.2468052Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.2468090Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.2468139Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.2468188Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.2468229Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.2468232Z 2025-12-04T10:08:29.2468282Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.2468332Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.2468373Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.2468423Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.2468473Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.2468514Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.2468563Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.2468613Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.2468651Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.2468701Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.2468749Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.2468788Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.2468838Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.2468889Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.2468941Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2468985Z dtype=torch.complex128) 2025-12-04T10:08:29.2468987Z 2025-12-04T10:08:29.2469022Z Expected: 2025-12-04T10:08:29.2469098Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2469136Z 0.3406-0.5682j], 2025-12-04T10:08:29.2469202Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2469239Z 0.2069-0.7450j], 2025-12-04T10:08:29.2469304Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2469341Z 0.4118+0.5311j], 2025-12-04T10:08:29.2469403Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2469453Z -0.3628+0.5383j], 2025-12-04T10:08:29.2469516Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2469555Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2469568Z 2025-12-04T10:08:29.2469641Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2469679Z 0.5325-0.4733j], 2025-12-04T10:08:29.2469742Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2469794Z -0.6729-0.7686j], 2025-12-04T10:08:29.2469855Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2469892Z -0.5258-0.5473j], 2025-12-04T10:08:29.2469954Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2469992Z -0.3244-0.6603j], 2025-12-04T10:08:29.2470055Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2470095Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2470096Z 2025-12-04T10:08:29.2470098Z 2025-12-04T10:08:29.2470160Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2470200Z -0.6623-0.1171j], 2025-12-04T10:08:29.2470262Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2470299Z 0.4266-0.2997j], 2025-12-04T10:08:29.2470361Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2470398Z 0.2556-0.1819j], 2025-12-04T10:08:29.2470460Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2470496Z 0.1768-1.6449j], 2025-12-04T10:08:29.2470558Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2470598Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2470599Z 2025-12-04T10:08:29.2470662Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2470699Z -0.6312+0.1775j], 2025-12-04T10:08:29.2470761Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2470800Z -0.9967-0.3519j], 2025-12-04T10:08:29.2470861Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2470897Z 0.6457+0.0238j], 2025-12-04T10:08:29.2470960Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2470997Z -1.0432-0.3734j], 2025-12-04T10:08:29.2471060Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2471125Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2471127Z 2025-12-04T10:08:29.2471418Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2471420Z 2025-12-04T10:08:29.2471493Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2471699Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2471702Z 2025-12-04T10:08:29.2471790Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2472087Z FAILED [0.1407s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 0 with respect to input 1, 2025-12-04T10:08:29.2472141Z numerical:(2.2877583977282128+2512.0369106069234j) 2025-12-04T10:08:29.2472195Z analytical:(2.2877583962149695+0.5241653412004752j) 2025-12-04T10:08:29.2472198Z 2025-12-04T10:08:29.2472308Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2472413Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2472533Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2472535Z 2025-12-04T10:08:29.2472570Z Numerical: 2025-12-04T10:08:29.2472643Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.2472705Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2472744Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2472808Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.2472856Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2472893Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2473005Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.2473053Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473090Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2473124Z ..., 2025-12-04T10:08:29.2473186Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473232Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473271Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2473330Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473377Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473413Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2473473Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2473520Z ..., 10.0033-4.4409e-10j, -8.3182+0.0000e+00j, 2025-12-04T10:08:29.2473590Z 12.6339+0.0000e+00j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2473625Z Analytical: 2025-12-04T10:08:29.2473696Z tensor([[16.2288-1.1079e-02j, -6.7991-2.3325e-03j, 11.6812-3.6840e-03j, 2025-12-04T10:08:29.2473743Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2473782Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2473844Z [-5.3649+8.5613e+00j, -5.5256-8.0846e+00j, 3.9120+7.2376e+00j, 2025-12-04T10:08:29.2473891Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2473928Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2473990Z [-7.3766+4.8006e+00j, -8.5249+4.4795e+00j, -5.6217+8.4488e+00j, 2025-12-04T10:08:29.2474036Z ..., -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2474074Z -0.0000-0.0000e+00j], 2025-12-04T10:08:29.2474107Z ..., 2025-12-04T10:08:29.2474167Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2474211Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2474249Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2474308Z [ 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2474355Z ..., 0.0000+0.0000e+00j, 0.0000+0.0000e+00j, 2025-12-04T10:08:29.2474391Z 0.0000+0.0000e+00j], 2025-12-04T10:08:29.2474456Z [-0.0000-0.0000e+00j, -0.0000-0.0000e+00j, -0.0000-0.0000e+00j, 2025-12-04T10:08:29.2474503Z ..., 10.0033+1.0039e-16j, -8.3182-8.3477e-17j, 2025-12-04T10:08:29.2474574Z 12.6339+1.2679e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2474577Z 2025-12-04T10:08:29.2474653Z The max per-element difference (slow mode) is: 9724.518089195833. 2025-12-04T10:08:29.2474655Z 2025-12-04T10:08:29.2474656Z 2025-12-04T10:08:29.2474949Z Caused by sample input at index 23: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2474951Z 2025-12-04T10:08:29.2475045Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2475262Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=23 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2475287Z 2025-12-04T10:08:29.2475374Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2475549Z FAILED [0.0659s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2475565Z 2025-12-04T10:08:29.2475658Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2475738Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2475817Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2475820Z 2025-12-04T10:08:29.2475904Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2476008Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2476044Z If the test 2025-12-04T10:08:29.2476141Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2476203Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2476297Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2476379Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2476382Z 2025-12-04T10:08:29.2476474Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2476561Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2476597Z the following. 2025-12-04T10:08:29.2476599Z 2025-12-04T10:08:29.2476689Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2476779Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2476831Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2476897Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2476958Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2476960Z 2025-12-04T10:08:29.2476992Z Got: 2025-12-04T10:08:29.2477057Z tensor([[[[-5.3226e-01+2.2833e-01j, 1.2172e-01+4.0753e-01j, 2025-12-04T10:08:29.2477111Z 5.9300e-02-3.5389e-01j, -3.2253e-01-2.7500e-01j, 2025-12-04T10:08:29.2477152Z -1.6007e-01+8.9793e-02j], 2025-12-04T10:08:29.2477204Z [ 3.5471e-01+2.0459e-01j, 3.0466e-01+4.3355e-02j, 2025-12-04T10:08:29.2477256Z -8.9097e-02+2.1981e-01j, 2.0589e-01+3.0278e-01j, 2025-12-04T10:08:29.2477294Z 2.3286e-01-1.2799e-01j], 2025-12-04T10:08:29.2477345Z [ 8.6003e-02-3.5272e-01j, 5.6611e-02+6.6132e-03j, 2025-12-04T10:08:29.2477396Z -1.1115e-01-3.1866e-01j, -1.1853e-01+4.1526e-01j, 2025-12-04T10:08:29.2477436Z -3.2613e-02-1.3832e-01j], 2025-12-04T10:08:29.2477485Z [-1.9229e-02+3.2211e-01j, -8.4788e-02+6.7719e-02j, 2025-12-04T10:08:29.2477536Z 8.5277e-02+3.3589e-01j, 1.4248e-01-9.6270e-02j, 2025-12-04T10:08:29.2477575Z -1.3831e-01-2.3542e-02j], 2025-12-04T10:08:29.2477626Z [-8.1906e-02+4.6588e-03j, -1.0208e-01+1.2079e-01j, 2025-12-04T10:08:29.2477675Z 5.0211e-02-1.0664e-01j, -4.4704e-02-7.5640e-02j, 2025-12-04T10:08:29.2477717Z 1.4118e-02+1.3256e-03j]], 2025-12-04T10:08:29.2477719Z 2025-12-04T10:08:29.2477767Z [[-2.9921e+00+7.8395e-01j, -1.0095e-02+2.2262e+00j, 2025-12-04T10:08:29.2477818Z -3.7508e-01-8.3313e-01j, 2.4656e+00-1.1248e+00j, 2025-12-04T10:08:29.2477856Z 5.1439e-01-3.7111e-01j], 2025-12-04T10:08:29.2477907Z [-1.4577e+00+4.7797e-01j, -1.7842e+00-8.0146e-02j, 2025-12-04T10:08:29.2477969Z 4.1783e+00+1.2688e-01j, 7.2015e-01-1.2453e+00j, 2025-12-04T10:08:29.2478009Z -1.3770e+00-1.0458e+00j], 2025-12-04T10:08:29.2478056Z [ 2.4354e+01+6.0588e+00j, 5.5061e+00-9.6130e+00j, 2025-12-04T10:08:29.2478135Z -1.2647e+01-1.3780e+01j, -1.5097e+01+1.1234e+01j, 2025-12-04T10:08:29.2478173Z 6.1530e+00+5.8727e+00j], 2025-12-04T10:08:29.2478225Z [-2.5925e+01-1.2015e+01j, -6.2741e+00-2.8452e+00j, 2025-12-04T10:08:29.2478286Z 3.6809e+01+8.7609e+00j, 8.3202e+00-1.2845e+01j, 2025-12-04T10:08:29.2478325Z -1.0638e+01-7.9331e+00j], 2025-12-04T10:08:29.2478374Z [ 1.2380e+01+4.1734e+00j, 5.3764e+00+5.8027e+00j, 2025-12-04T10:08:29.2478423Z -2.3550e+01+1.7126e+00j, -2.9678e+00+5.6894e+00j, 2025-12-04T10:08:29.2478465Z 4.2064e+00+1.2809e+00j]]], 2025-12-04T10:08:29.2478466Z 2025-12-04T10:08:29.2478468Z 2025-12-04T10:08:29.2478517Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.2478568Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.2478606Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.2478658Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.2478710Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.2478748Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.2478798Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.2478849Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.2478887Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.2478937Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.2478985Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.2479024Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.2479072Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.2479124Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.2479164Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.2479166Z 2025-12-04T10:08:29.2479216Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.2479267Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.2479306Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.2479357Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.2479407Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.2479445Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.2479495Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.2479544Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.2479582Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.2479632Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.2479681Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.2479722Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.2479773Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.2479824Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.2479877Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2479920Z dtype=torch.complex128) 2025-12-04T10:08:29.2479922Z 2025-12-04T10:08:29.2479958Z Expected: 2025-12-04T10:08:29.2480034Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2480072Z 0.3406-0.5682j], 2025-12-04T10:08:29.2480137Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2480174Z 0.2069-0.7450j], 2025-12-04T10:08:29.2480239Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2480276Z 0.4118+0.5311j], 2025-12-04T10:08:29.2480356Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2480395Z -0.3628+0.5383j], 2025-12-04T10:08:29.2480458Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2480521Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2480523Z 2025-12-04T10:08:29.2480586Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2480622Z 0.5325-0.4733j], 2025-12-04T10:08:29.2480702Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2480738Z -0.6729-0.7686j], 2025-12-04T10:08:29.2480800Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2480836Z -0.5258-0.5473j], 2025-12-04T10:08:29.2480900Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2480936Z -0.3244-0.6603j], 2025-12-04T10:08:29.2481000Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2481038Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2481040Z 2025-12-04T10:08:29.2481041Z 2025-12-04T10:08:29.2481107Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2481143Z -0.6623-0.1171j], 2025-12-04T10:08:29.2481206Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2481243Z 0.4266-0.2997j], 2025-12-04T10:08:29.2481306Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2481342Z 0.2556-0.1819j], 2025-12-04T10:08:29.2481405Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2481441Z 0.1768-1.6449j], 2025-12-04T10:08:29.2481505Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2481543Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2481549Z 2025-12-04T10:08:29.2481613Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2481649Z -0.6312+0.1775j], 2025-12-04T10:08:29.2481714Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2481751Z -0.9967-0.3519j], 2025-12-04T10:08:29.2481814Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2481850Z 0.6457+0.0238j], 2025-12-04T10:08:29.2481913Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2481950Z -1.0432-0.3734j], 2025-12-04T10:08:29.2482015Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2482080Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2482083Z 2025-12-04T10:08:29.2482374Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2482378Z 2025-12-04T10:08:29.2482453Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2482653Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2482656Z 2025-12-04T10:08:29.2482743Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2482918Z FAILED [0.0563s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2482920Z 2025-12-04T10:08:29.2483050Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2483153Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2483234Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2483236Z 2025-12-04T10:08:29.2483334Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2483452Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2483488Z If the test 2025-12-04T10:08:29.2483581Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2483658Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2483752Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2483834Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2483836Z 2025-12-04T10:08:29.2483928Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2484014Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2484050Z the following. 2025-12-04T10:08:29.2484052Z 2025-12-04T10:08:29.2484141Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2484235Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2484287Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2484350Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2484413Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2484415Z 2025-12-04T10:08:29.2484446Z Got: 2025-12-04T10:08:29.2484520Z tensor([[[[ 0.1522-3.0454e-01j, 0.0432-2.8285e-02j, 0.2757-2.5142e-01j, 2025-12-04T10:08:29.2484571Z -0.0707-9.0180e-02j, 0.0837+8.3120e-02j], 2025-12-04T10:08:29.2484635Z [-0.0307+5.8181e-01j, -0.2089+2.1095e-02j, 0.1939+7.2422e-01j, 2025-12-04T10:08:29.2484683Z 0.3169-1.5300e-01j, -0.3015+2.0354e-03j], 2025-12-04T10:08:29.2484745Z [ 0.0171+4.4518e-02j, 0.0036+2.0798e-02j, 0.0073+3.7086e-02j, 2025-12-04T10:08:29.2484792Z 0.0056+1.5149e-02j, -0.0280-1.4131e-02j], 2025-12-04T10:08:29.2484855Z [ 0.3470+1.1164e-01j, -0.1160+1.0611e-01j, 0.5798+5.3320e-02j, 2025-12-04T10:08:29.2484902Z -0.0032-3.0137e-01j, -0.0916+1.7354e-01j], 2025-12-04T10:08:29.2484963Z [ 0.0457+4.1189e-02j, 0.1182-9.0754e-03j, -0.0834+2.9300e-02j, 2025-12-04T10:08:29.2485013Z -0.0168+6.3838e-02j, -0.0066-8.1608e-03j]], 2025-12-04T10:08:29.2485015Z 2025-12-04T10:08:29.2485075Z [[ 0.6532+2.0614e-01j, -1.7082+8.1363e-01j, -2.1005-2.2277e+00j, 2025-12-04T10:08:29.2485120Z 0.2647+4.0664e-01j, 1.0407-5.0749e-01j], 2025-12-04T10:08:29.2485181Z [ 0.1777-1.5236e-01j, -0.3372+8.5955e-01j, -1.3093+1.3646e-01j, 2025-12-04T10:08:29.2485227Z 0.2815+1.5150e-02j, 0.1596-4.8515e-01j], 2025-12-04T10:08:29.2485287Z [-0.0606+3.6598e-02j, 0.2659-2.6692e-01j, 0.5345+1.9307e-01j, 2025-12-04T10:08:29.2485334Z -0.1456-5.4323e-02j, -0.1774+9.0880e-02j], 2025-12-04T10:08:29.2485394Z [-0.0373-1.2024e-01j, 0.1259+2.2929e-01j, -0.2618+3.6338e-01j, 2025-12-04T10:08:29.2485443Z 0.0754-4.1391e-02j, -0.0633-1.5445e-01j], 2025-12-04T10:08:29.2485503Z [-0.0238-8.0491e-03j, -0.0105-1.1179e-02j, 0.0452-3.3936e-03j, 2025-12-04T10:08:29.2485554Z 0.0057-1.0884e-02j, -0.0081-2.4896e-03j]]], 2025-12-04T10:08:29.2485557Z 2025-12-04T10:08:29.2485559Z 2025-12-04T10:08:29.2485618Z [[[-0.1942-5.9982e-01j, -0.2038-4.1896e-01j, 0.6095+2.7013e-01j, 2025-12-04T10:08:29.2485664Z 1.4386-8.3353e-01j, -0.6637-1.1754e-01j], 2025-12-04T10:08:29.2485724Z [-0.6633-5.8476e-01j, -0.2451+9.6496e-01j, -0.2493+5.1005e-01j, 2025-12-04T10:08:29.2485769Z 0.1194-9.0023e-01j, 0.4261-3.0121e-01j], 2025-12-04T10:08:29.2485829Z [-0.1383+2.8447e-01j, -0.1957-1.4563e+00j, -0.5710-4.1585e-01j, 2025-12-04T10:08:29.2485887Z -0.0395+3.6956e-01j, 0.2567-1.8083e-01j], 2025-12-04T10:08:29.2485947Z [ 0.3252-1.1231e-01j, -0.4243-1.0985e+00j, 1.2298+9.1000e-01j, 2025-12-04T10:08:29.2486023Z -0.6124-2.3117e-01j, 0.1761-1.6446e+00j], 2025-12-04T10:08:29.2486082Z [ 1.0234+7.7070e-01j, 0.3207-3.5507e-01j, 0.3141+5.4598e-01j, 2025-12-04T10:08:29.2486131Z -0.8250-1.6896e-01j, -0.5996-8.7005e-01j]], 2025-12-04T10:08:29.2486144Z 2025-12-04T10:08:29.2486203Z [[ 1.0535-7.3133e-01j, 0.4599+5.2485e-01j, 1.1345-7.4928e-01j, 2025-12-04T10:08:29.2486250Z -0.7320+2.0047e+00j, -0.6307+1.7559e-01j], 2025-12-04T10:08:29.2486309Z [-1.0193-6.3274e-01j, -0.1441-9.0354e-01j, 0.8386+5.4619e-01j, 2025-12-04T10:08:29.2486355Z -0.4240+7.4738e-03j, -0.9972-3.5180e-01j], 2025-12-04T10:08:29.2486414Z [ 0.3329-4.2785e-01j, -0.8812-2.4360e-02j, 0.1046-7.5094e-01j, 2025-12-04T10:08:29.2486461Z 0.2974+3.5862e-01j, 0.6467+2.0119e-02j], 2025-12-04T10:08:29.2486519Z [-0.0163-3.8884e-01j, 0.8235-6.5351e-01j, 0.7394+1.2447e+00j, 2025-12-04T10:08:29.2486566Z 0.3365+7.9813e-01j, -1.0443-3.6995e-01j], 2025-12-04T10:08:29.2486629Z [-0.5647+1.4363e-01j, -0.1876-1.5068e+00j, -0.7416+3.7617e-01j, 2025-12-04T10:08:29.2486691Z 1.2339-2.0699e-01j, 1.0896+4.8109e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2488727Z dtype=torch.complex128) 2025-12-04T10:08:29.2488733Z 2025-12-04T10:08:29.2488770Z Expected: 2025-12-04T10:08:29.2488847Z tensor([[[[-0.5612+0.0574j, 0.3123+1.1033j, 1.1405+0.3773j, 0.9836-0.3986j, 2025-12-04T10:08:29.2488884Z 0.3401-0.5673j], 2025-12-04T10:08:29.2488952Z [ 0.6824-0.1524j, 0.2825+0.1156j, 0.5370+0.1641j, 0.8395-0.5066j, 2025-12-04T10:08:29.2488989Z 0.2078-0.7444j], 2025-12-04T10:08:29.2489053Z [-1.1234+0.2147j, -1.1468+0.5736j, 0.6636-0.4143j, 0.1234-1.7417j, 2025-12-04T10:08:29.2489091Z 0.4109+0.5305j], 2025-12-04T10:08:29.2489156Z [ 1.5025+0.8779j, 0.5775+0.6575j, 1.3189+0.1893j, -0.3367-0.6126j, 2025-12-04T10:08:29.2489192Z -0.3607+0.5386j], 2025-12-04T10:08:29.2489259Z [-0.5951-0.5366j, -1.5396+0.1182j, 1.0860-0.3817j, 0.2193-0.8316j, 2025-12-04T10:08:29.2489298Z 0.0854+0.1063j]], 2025-12-04T10:08:29.2489299Z 2025-12-04T10:08:29.2489362Z [[-0.4823+0.4909j, 1.0167+0.7995j, -0.4851-1.6306j, 0.3057-0.1534j, 2025-12-04T10:08:29.2489400Z 0.5323-0.4729j], 2025-12-04T10:08:29.2489463Z [ 0.9577+1.1464j, -0.8347+0.4231j, 0.6380+0.0379j, -0.1751-0.1510j, 2025-12-04T10:08:29.2489499Z -0.6732-0.7677j], 2025-12-04T10:08:29.2489561Z [ 0.6037-0.8449j, 0.5437-1.0111j, 1.4462+0.0592j, -1.1472+0.0823j, 2025-12-04T10:08:29.2489597Z -0.5241-0.5479j], 2025-12-04T10:08:29.2489659Z [-0.3109-0.4936j, 0.4614+0.9678j, -0.9090+1.4297j, 0.3248-0.2541j, 2025-12-04T10:08:29.2489696Z -0.3257-0.6597j], 2025-12-04T10:08:29.2489758Z [ 0.9170+0.3098j, 0.4022+0.4302j, -1.7387+0.1306j, -0.2206+0.4189j, 2025-12-04T10:08:29.2489796Z 0.3099+0.0958j]]], 2025-12-04T10:08:29.2489799Z 2025-12-04T10:08:29.2489801Z 2025-12-04T10:08:29.2489864Z [[[-0.1942-0.5998j, -0.2038-0.4190j, 0.6095+0.2701j, 1.4386-0.8335j, 2025-12-04T10:08:29.2489901Z -0.6637-0.1175j], 2025-12-04T10:08:29.2489965Z [-0.6633-0.5848j, -0.2451+0.9650j, -0.2493+0.5101j, 0.1194-0.9002j, 2025-12-04T10:08:29.2490001Z 0.4261-0.3012j], 2025-12-04T10:08:29.2490065Z [-0.1383+0.2845j, -0.1957-1.4563j, -0.5710-0.4159j, -0.0395+0.3696j, 2025-12-04T10:08:29.2490100Z 0.2567-0.1808j], 2025-12-04T10:08:29.2490163Z [ 0.3252-0.1123j, -0.4243-1.0985j, 1.2298+0.9100j, -0.6124-0.2312j, 2025-12-04T10:08:29.2490198Z 0.1761-1.6446j], 2025-12-04T10:08:29.2490261Z [ 1.0234+0.7707j, 0.3207-0.3551j, 0.3141+0.5460j, -0.8250-0.1690j, 2025-12-04T10:08:29.2490319Z -0.5996-0.8700j]], 2025-12-04T10:08:29.2490321Z 2025-12-04T10:08:29.2490385Z [[ 1.0535-0.7313j, 0.4599+0.5249j, 1.1345-0.7493j, -0.7320+2.0047j, 2025-12-04T10:08:29.2490446Z -0.6307+0.1756j], 2025-12-04T10:08:29.2490510Z [-1.0193-0.6327j, -0.1441-0.9035j, 0.8386+0.5462j, -0.4240+0.0075j, 2025-12-04T10:08:29.2490547Z -0.9972-0.3518j], 2025-12-04T10:08:29.2490610Z [ 0.3329-0.4278j, -0.8812-0.0244j, 0.1046-0.7509j, 0.2974+0.3586j, 2025-12-04T10:08:29.2490660Z 0.6467+0.0201j], 2025-12-04T10:08:29.2490723Z [-0.0163-0.3888j, 0.8235-0.6535j, 0.7394+1.2447j, 0.3365+0.7981j, 2025-12-04T10:08:29.2490759Z -1.0443-0.3699j], 2025-12-04T10:08:29.2490822Z [-0.5647+0.1436j, -0.1876-1.5068j, -0.7416+0.3762j, 1.2339-0.2070j, 2025-12-04T10:08:29.2490888Z 1.0896+0.4811j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2490890Z 2025-12-04T10:08:29.2491189Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2491194Z 2025-12-04T10:08:29.2491268Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2491471Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2491474Z 2025-12-04T10:08:29.2491561Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2491738Z FAILED [0.0658s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2491740Z 2025-12-04T10:08:29.2491833Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2491915Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2491994Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2491997Z 2025-12-04T10:08:29.2492082Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2492184Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2492221Z If the test 2025-12-04T10:08:29.2492314Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2492376Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2492471Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2492552Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2492554Z 2025-12-04T10:08:29.2492645Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2492730Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2492765Z the following. 2025-12-04T10:08:29.2492769Z 2025-12-04T10:08:29.2492858Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2492994Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2493047Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2493110Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2493171Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2493173Z 2025-12-04T10:08:29.2493205Z Got: 2025-12-04T10:08:29.2493268Z tensor([[[[-2.3072e+00+6.1691e+00j, -3.3182e+00+9.8112e+00j, 2025-12-04T10:08:29.2493323Z -8.8058e-02+4.9936e-01j, -9.8754e-04-6.1498e-01j, 2025-12-04T10:08:29.2493365Z -1.3902e+00+7.5762e-01j], 2025-12-04T10:08:29.2493434Z [-4.4496e+00-6.8832e-02j, -4.1612e+00+1.1284e+00j, 2025-12-04T10:08:29.2493486Z 5.1452e-01-8.8250e-01j, -1.8040e-01-3.1300e+00j, 2025-12-04T10:08:29.2493526Z -3.2290e-01-4.9278e-01j], 2025-12-04T10:08:29.2493604Z [ 1.1768e+00-3.6793e+00j, -1.1017e-01-4.6846e+00j, 2025-12-04T10:08:29.2493654Z -2.8641e-02+1.7685e+00j, 2.6189e+00+2.6016e+00j, 2025-12-04T10:08:29.2493695Z -5.4152e-01-2.2839e-01j], 2025-12-04T10:08:29.2493758Z [-3.4989e+00-2.1141e+00j, -4.7105e+00-1.6009e+00j, 2025-12-04T10:08:29.2493808Z 7.5787e-01+4.7321e-01j, 1.9719e+00-9.8352e-01j, 2025-12-04T10:08:29.2493845Z 3.3267e-01-6.5017e-01j], 2025-12-04T10:08:29.2493896Z [ 7.3673e-01-1.7283e-01j, 7.3497e-01-1.2600e+00j, 2025-12-04T10:08:29.2493945Z -2.8628e-01+1.0489e+00j, 5.2667e-01+6.1600e-01j, 2025-12-04T10:08:29.2493988Z -1.3038e-01+1.0450e-02j]], 2025-12-04T10:08:29.2493990Z 2025-12-04T10:08:29.2494042Z [[-1.0965e+00+1.5674e-01j, -8.0557e-01-1.7475e-01j, 2025-12-04T10:08:29.2494091Z 7.7523e-01-3.3573e+00j, -4.6952e-01+2.4802e+00j, 2025-12-04T10:08:29.2494131Z -1.3881e+00+9.5408e-01j], 2025-12-04T10:08:29.2494182Z [-1.1672e+00+8.9033e-01j, 1.7277e-01-2.1244e+00j, 2025-12-04T10:08:29.2494233Z 3.5321e+00-1.5647e-01j, -1.4319e+00-1.5610e+00j, 2025-12-04T10:08:29.2494271Z 4.6176e-01-1.3325e+00j], 2025-12-04T10:08:29.2494321Z [ 7.3709e-01-3.2540e-01j, 2.1550e+00-8.3235e-01j, 2025-12-04T10:08:29.2494371Z 2.7092e+00+4.0626e+00j, 7.8157e-02-1.6310e+00j, 2025-12-04T10:08:29.2494409Z 1.9234e-01-8.1117e-01j], 2025-12-04T10:08:29.2494459Z [-3.3284e-02-7.1936e-01j, 1.8239e+00-3.1586e-01j, 2025-12-04T10:08:29.2494509Z 6.4664e-01+3.4432e+00j, 2.2814e-01-9.0876e-02j, 2025-12-04T10:08:29.2494547Z -6.4673e-01-2.3442e-01j], 2025-12-04T10:08:29.2494597Z [ 8.0919e-01-7.0268e-02j, 4.5072e-01+1.9683e-01j, 2025-12-04T10:08:29.2494646Z -1.2991e+00+6.8358e-01j, -2.7518e-02+3.9801e-01j, 2025-12-04T10:08:29.2494688Z 2.7154e-01-3.1690e-02j]]], 2025-12-04T10:08:29.2494690Z 2025-12-04T10:08:29.2494692Z 2025-12-04T10:08:29.2494742Z [[[-1.9304e-01-6.0012e-01j, -2.0497e-01-4.1951e-01j, 2025-12-04T10:08:29.2494792Z 6.0793e-01+2.7202e-01j, 1.4397e+00-8.3372e-01j, 2025-12-04T10:08:29.2494830Z -6.6227e-01-1.1712e-01j], 2025-12-04T10:08:29.2494881Z [-6.6229e-01-5.8593e-01j, -2.4415e-01+9.6400e-01j, 2025-12-04T10:08:29.2494930Z -2.4922e-01+5.1053e-01j, 1.1889e-01-9.0036e-01j, 2025-12-04T10:08:29.2494968Z 4.2662e-01-2.9966e-01j], 2025-12-04T10:08:29.2495018Z [-1.3783e-01+2.8418e-01j, -1.9572e-01-1.4562e+00j, 2025-12-04T10:08:29.2495069Z -5.7053e-01-4.1592e-01j, -3.8874e-02+3.7179e-01j, 2025-12-04T10:08:29.2495107Z 2.5558e-01-1.8192e-01j], 2025-12-04T10:08:29.2495157Z [ 3.2270e-01-1.1015e-01j, -4.2216e-01-1.0977e+00j, 2025-12-04T10:08:29.2495207Z 1.2303e+00+9.0953e-01j, -6.1451e-01-2.3406e-01j, 2025-12-04T10:08:29.2495246Z 1.7677e-01-1.6449e+00j], 2025-12-04T10:08:29.2495296Z [ 1.0245e+00+7.6916e-01j, 3.1807e-01-3.5505e-01j, 2025-12-04T10:08:29.2495346Z 3.1425e-01+5.4441e-01j, -8.2339e-01-1.6726e-01j, 2025-12-04T10:08:29.2495387Z -6.0108e-01-8.6995e-01j]], 2025-12-04T10:08:29.2495389Z 2025-12-04T10:08:29.2495440Z [[ 1.0538e+00-7.3166e-01j, 4.6020e-01+5.2275e-01j, 2025-12-04T10:08:29.2495489Z 1.1365e+00-7.4999e-01j, -7.3134e-01+2.0050e+00j, 2025-12-04T10:08:29.2495529Z -6.3122e-01+1.7755e-01j], 2025-12-04T10:08:29.2495579Z [-1.0192e+00-6.3251e-01j, -1.4514e-01-9.0427e-01j, 2025-12-04T10:08:29.2495628Z 8.3918e-01+5.4634e-01j, -4.2347e-01+6.9664e-03j, 2025-12-04T10:08:29.2495666Z -9.9674e-01-3.5193e-01j], 2025-12-04T10:08:29.2495717Z [ 3.3115e-01-4.2907e-01j, -8.7948e-01-2.5566e-02j, 2025-12-04T10:08:29.2495783Z 1.0442e-01-7.5436e-01j, 3.0045e-01+3.6130e-01j, 2025-12-04T10:08:29.2495823Z 6.4568e-01+2.3801e-02j], 2025-12-04T10:08:29.2495872Z [-1.4742e-02-3.8578e-01j, 8.1866e-01-6.5300e-01j, 2025-12-04T10:08:29.2495946Z 7.4182e-01+1.2483e+00j, 3.3326e-01+7.9392e-01j, 2025-12-04T10:08:29.2495985Z -1.0432e+00-3.7342e-01j], 2025-12-04T10:08:29.2496037Z [-5.6397e-01+1.4179e-01j, -1.8481e-01-1.5035e+00j, 2025-12-04T10:08:29.2496098Z -7.4705e-01+3.7837e-01j, 1.2330e+00-2.0653e-01j, 2025-12-04T10:08:29.2496150Z 1.0911e+00+4.7660e-01j]]]], device='cuda:0', 2025-12-04T10:08:29.2496194Z dtype=torch.complex128) 2025-12-04T10:08:29.2496195Z 2025-12-04T10:08:29.2496230Z Expected: 2025-12-04T10:08:29.2496305Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2496342Z 0.3406-0.5682j], 2025-12-04T10:08:29.2496408Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2496444Z 0.2069-0.7450j], 2025-12-04T10:08:29.2496509Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2496546Z 0.4118+0.5311j], 2025-12-04T10:08:29.2496609Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2496646Z -0.3628+0.5383j], 2025-12-04T10:08:29.2496709Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2496747Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2496749Z 2025-12-04T10:08:29.2496813Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2496848Z 0.5325-0.4733j], 2025-12-04T10:08:29.2496912Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2496948Z -0.6729-0.7686j], 2025-12-04T10:08:29.2497011Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2497047Z -0.5258-0.5473j], 2025-12-04T10:08:29.2497109Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2497148Z -0.3244-0.6603j], 2025-12-04T10:08:29.2497210Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2497247Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2497250Z 2025-12-04T10:08:29.2497252Z 2025-12-04T10:08:29.2497316Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2497351Z -0.6623-0.1171j], 2025-12-04T10:08:29.2497415Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2497450Z 0.4266-0.2997j], 2025-12-04T10:08:29.2497513Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2497548Z 0.2556-0.1819j], 2025-12-04T10:08:29.2497611Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2497647Z 0.1768-1.6449j], 2025-12-04T10:08:29.2497710Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2497750Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2497752Z 2025-12-04T10:08:29.2497814Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2497851Z -0.6312+0.1775j], 2025-12-04T10:08:29.2497914Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2497949Z -0.9967-0.3519j], 2025-12-04T10:08:29.2498011Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2498049Z 0.6457+0.0238j], 2025-12-04T10:08:29.2498109Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2498146Z -1.0432-0.3734j], 2025-12-04T10:08:29.2498234Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2498301Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2498317Z 2025-12-04T10:08:29.2498621Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2498639Z 2025-12-04T10:08:29.2498712Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2498913Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2498916Z 2025-12-04T10:08:29.2499002Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2499178Z FAILED [0.0700s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_complex128 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2499181Z 2025-12-04T10:08:29.2499273Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2499357Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2499435Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2499439Z 2025-12-04T10:08:29.2499522Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2499624Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2499660Z If the test 2025-12-04T10:08:29.2499752Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2499815Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2499908Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2499990Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2499992Z 2025-12-04T10:08:29.2500083Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2500168Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2500203Z the following. 2025-12-04T10:08:29.2500205Z 2025-12-04T10:08:29.2500295Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2500384Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2500436Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2500499Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2500561Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2500563Z 2025-12-04T10:08:29.2500595Z Got: 2025-12-04T10:08:29.2500675Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2500711Z 0.3406-0.5682j], 2025-12-04T10:08:29.2500774Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2500812Z 0.2069-0.7450j], 2025-12-04T10:08:29.2500877Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2500912Z 0.4118+0.5311j], 2025-12-04T10:08:29.2500976Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2501012Z -0.3628+0.5383j], 2025-12-04T10:08:29.2501075Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2501115Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2501118Z 2025-12-04T10:08:29.2501181Z [[ 0.1674-0.1713j, -0.3545-0.2779j, 0.1689+0.5668j, -0.1060+0.0538j, 2025-12-04T10:08:29.2501218Z -0.1849+0.1651j], 2025-12-04T10:08:29.2501298Z [-0.9004-1.0602j, 0.7728-0.3992j, -0.5939-0.0333j, 0.1645+0.1399j, 2025-12-04T10:08:29.2501335Z 0.6325+0.7115j], 2025-12-04T10:08:29.2501396Z [ 0.1296-0.1809j, 0.1168-0.2165j, 0.3090+0.0125j, -0.2459+0.0177j, 2025-12-04T10:08:29.2501457Z -0.1126-0.1173j], 2025-12-04T10:08:29.2501520Z [ 0.5659+0.8880j, -0.8454-1.7403j, 1.6164-2.5944j, -0.5832+0.4623j, 2025-12-04T10:08:29.2501557Z 0.5937+1.1849j], 2025-12-04T10:08:29.2501632Z [-0.4574-0.1542j, -0.1986-0.2144j, 0.8701-0.0632j, 0.1097-0.2102j, 2025-12-04T10:08:29.2501672Z -0.1554-0.0473j]]], 2025-12-04T10:08:29.2501673Z 2025-12-04T10:08:29.2501675Z 2025-12-04T10:08:29.2501736Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2501773Z -0.6623-0.1171j], 2025-12-04T10:08:29.2501834Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2501870Z 0.4266-0.2997j], 2025-12-04T10:08:29.2501934Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2501970Z 0.2556-0.1819j], 2025-12-04T10:08:29.2502032Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2502069Z 0.1768-1.6449j], 2025-12-04T10:08:29.2502131Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2502170Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2502172Z 2025-12-04T10:08:29.2502234Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2502271Z -0.6312+0.1775j], 2025-12-04T10:08:29.2502332Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2502369Z -0.9967-0.3519j], 2025-12-04T10:08:29.2502430Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2502467Z 0.6457+0.0238j], 2025-12-04T10:08:29.2502529Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2502565Z -1.0432-0.3734j], 2025-12-04T10:08:29.2502629Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2502695Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2502697Z 2025-12-04T10:08:29.2502732Z Expected: 2025-12-04T10:08:29.2502804Z tensor([[[[-0.5622+0.0613j, 0.3123+1.1064j, 1.1394+0.3777j, 0.9819-0.3989j, 2025-12-04T10:08:29.2502841Z 0.3406-0.5682j], 2025-12-04T10:08:29.2502904Z [ 0.6805-0.1497j, 0.2823+0.1182j, 0.5365+0.1636j, 0.8392-0.5077j, 2025-12-04T10:08:29.2503081Z 0.2069-0.7450j], 2025-12-04T10:08:29.2503145Z [-1.1229+0.2127j, -1.1477+0.5735j, 0.6633-0.4140j, 0.1233-1.7405j, 2025-12-04T10:08:29.2503180Z 0.4118+0.5311j], 2025-12-04T10:08:29.2503243Z [ 1.5029+0.8762j, 0.5784+0.6541j, 1.3203+0.1891j, -0.3354-0.6144j, 2025-12-04T10:08:29.2503281Z -0.3628+0.5383j], 2025-12-04T10:08:29.2503344Z [-0.5938-0.5376j, -1.5396+0.1181j, 1.0857-0.3818j, 0.2196-0.8293j, 2025-12-04T10:08:29.2503383Z 0.0876+0.1073j]], 2025-12-04T10:08:29.2503386Z 2025-12-04T10:08:29.2503448Z [[-0.4826+0.4927j, 1.0186+0.7993j, -0.4835-1.6283j, 0.3052-0.1552j, 2025-12-04T10:08:29.2503484Z 0.5325-0.4733j], 2025-12-04T10:08:29.2503546Z [ 0.9588+1.1463j, -0.8332+0.4227j, 0.6374+0.0407j, -0.1748-0.1518j, 2025-12-04T10:08:29.2503583Z -0.6729-0.7686j], 2025-12-04T10:08:29.2503644Z [ 0.6043-0.8435j, 0.5449-1.0113j, 1.4452+0.0573j, -1.1483+0.0816j, 2025-12-04T10:08:29.2503680Z -0.5258-0.5473j], 2025-12-04T10:08:29.2503742Z [-0.3101-0.4963j, 0.4623+0.9682j, -0.9067+1.4350j, 0.3261-0.2539j, 2025-12-04T10:08:29.2503779Z -0.3244-0.6603j], 2025-12-04T10:08:29.2503840Z [ 0.9165+0.3090j, 0.3980+0.4296j, -1.7434+0.1267j, -0.2197+0.4212j, 2025-12-04T10:08:29.2503904Z 0.3114+0.0948j]]], 2025-12-04T10:08:29.2503906Z 2025-12-04T10:08:29.2503908Z 2025-12-04T10:08:29.2503970Z [[[-0.1930-0.6001j, -0.2050-0.4195j, 0.6079+0.2720j, 1.4397-0.8337j, 2025-12-04T10:08:29.2504039Z -0.6623-0.1171j], 2025-12-04T10:08:29.2504102Z [-0.6623-0.5859j, -0.2441+0.9640j, -0.2492+0.5105j, 0.1189-0.9004j, 2025-12-04T10:08:29.2504138Z 0.4266-0.2997j], 2025-12-04T10:08:29.2504216Z [-0.1378+0.2842j, -0.1957-1.4562j, -0.5705-0.4159j, -0.0389+0.3718j, 2025-12-04T10:08:29.2504252Z 0.2556-0.1819j], 2025-12-04T10:08:29.2504314Z [ 0.3227-0.1102j, -0.4222-1.0977j, 1.2303+0.9095j, -0.6145-0.2341j, 2025-12-04T10:08:29.2504349Z 0.1768-1.6449j], 2025-12-04T10:08:29.2504411Z [ 1.0245+0.7692j, 0.3181-0.3550j, 0.3142+0.5444j, -0.8234-0.1673j, 2025-12-04T10:08:29.2504449Z -0.6011-0.8699j]], 2025-12-04T10:08:29.2504451Z 2025-12-04T10:08:29.2504514Z [[ 1.0538-0.7317j, 0.4602+0.5227j, 1.1365-0.7500j, -0.7313+2.0050j, 2025-12-04T10:08:29.2504552Z -0.6312+0.1775j], 2025-12-04T10:08:29.2504613Z [-1.0192-0.6325j, -0.1451-0.9043j, 0.8392+0.5463j, -0.4235+0.0070j, 2025-12-04T10:08:29.2504656Z -0.9967-0.3519j], 2025-12-04T10:08:29.2504718Z [ 0.3311-0.4291j, -0.8795-0.0256j, 0.1044-0.7544j, 0.3004+0.3613j, 2025-12-04T10:08:29.2504754Z 0.6457+0.0238j], 2025-12-04T10:08:29.2504816Z [-0.0147-0.3858j, 0.8187-0.6530j, 0.7418+1.2483j, 0.3333+0.7939j, 2025-12-04T10:08:29.2504853Z -1.0432-0.3734j], 2025-12-04T10:08:29.2504915Z [-0.5640+0.1418j, -0.1848-1.5035j, -0.7471+0.3784j, 1.2330-0.2065j, 2025-12-04T10:08:29.2504981Z 1.0911+0.4766j]]]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2504983Z 2025-12-04T10:08:29.2505273Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2505275Z 2025-12-04T10:08:29.2505349Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2505553Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2505556Z 2025-12-04T10:08:29.2505642Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2505816Z FAILED [0.0282s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2505819Z 2025-12-04T10:08:29.2505911Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2505992Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2506071Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2506073Z 2025-12-04T10:08:29.2506157Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2506261Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2506297Z If the test 2025-12-04T10:08:29.2506390Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2506453Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2506549Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2506630Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2506632Z 2025-12-04T10:08:29.2506723Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2506806Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2506856Z the following. 2025-12-04T10:08:29.2506859Z 2025-12-04T10:08:29.2506946Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2507061Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2507113Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2507176Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2507257Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2507259Z 2025-12-04T10:08:29.2507292Z Got: 2025-12-04T10:08:29.2507348Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2507397Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2507445Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2507490Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2507538Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2507541Z 2025-12-04T10:08:29.2507587Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2507632Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2507681Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2507726Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2507777Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2507780Z 2025-12-04T10:08:29.2507781Z 2025-12-04T10:08:29.2507826Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2507870Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2507914Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2507958Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2508006Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2508008Z 2025-12-04T10:08:29.2508053Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2508098Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2508142Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2508189Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2508253Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2508297Z dtype=torch.float64) 2025-12-04T10:08:29.2508300Z 2025-12-04T10:08:29.2508334Z Expected: 2025-12-04T10:08:29.2508388Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2508432Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2508477Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2508521Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2508568Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2508570Z 2025-12-04T10:08:29.2508614Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2508660Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2508704Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2508751Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2508800Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2508802Z 2025-12-04T10:08:29.2508805Z 2025-12-04T10:08:29.2508850Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2508894Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2508938Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2508982Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2509030Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2509031Z 2025-12-04T10:08:29.2509077Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2509133Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2509180Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2509236Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2509309Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2509352Z dtype=torch.float64) 2025-12-04T10:08:29.2509354Z 2025-12-04T10:08:29.2509659Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2509662Z 2025-12-04T10:08:29.2509735Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2509938Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2509942Z 2025-12-04T10:08:29.2510028Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2510203Z FAILED [0.0267s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2510207Z 2025-12-04T10:08:29.2510299Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2510381Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2510460Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2510462Z 2025-12-04T10:08:29.2510545Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2510646Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2510681Z If the test 2025-12-04T10:08:29.2510774Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2510834Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2510929Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2511012Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2511014Z 2025-12-04T10:08:29.2511106Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2511190Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2511226Z the following. 2025-12-04T10:08:29.2511228Z 2025-12-04T10:08:29.2511315Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2511405Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2511455Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2511519Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2511579Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2511581Z 2025-12-04T10:08:29.2511615Z Got: 2025-12-04T10:08:29.2511670Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2511719Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2511765Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2511810Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2511858Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2511860Z 2025-12-04T10:08:29.2511905Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2511950Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2511995Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2512041Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2512101Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2512103Z 2025-12-04T10:08:29.2512105Z 2025-12-04T10:08:29.2512150Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2512216Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2512262Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2512306Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2512353Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2512367Z 2025-12-04T10:08:29.2512412Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2512456Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2512500Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2512544Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2512606Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2512649Z dtype=torch.float64) 2025-12-04T10:08:29.2512651Z 2025-12-04T10:08:29.2512685Z Expected: 2025-12-04T10:08:29.2512738Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2512785Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2512831Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2512875Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2512923Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2512925Z 2025-12-04T10:08:29.2513008Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2513054Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2513097Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2513143Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2513191Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2513193Z 2025-12-04T10:08:29.2513197Z 2025-12-04T10:08:29.2513241Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2513286Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2513331Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2513376Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2513422Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2513426Z 2025-12-04T10:08:29.2513471Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2513515Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2513560Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2513604Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2513666Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2513707Z dtype=torch.float64) 2025-12-04T10:08:29.2513709Z 2025-12-04T10:08:29.2513999Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2514002Z 2025-12-04T10:08:29.2514075Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2514274Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2514278Z 2025-12-04T10:08:29.2514364Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2514537Z FAILED [0.0270s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2514539Z 2025-12-04T10:08:29.2514633Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2514734Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2514814Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2514831Z 2025-12-04T10:08:29.2514928Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2515030Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2515078Z If the test 2025-12-04T10:08:29.2515171Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2515231Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2515325Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2515409Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2515411Z 2025-12-04T10:08:29.2515504Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2515588Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2515625Z the following. 2025-12-04T10:08:29.2515628Z 2025-12-04T10:08:29.2515717Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2515808Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2515859Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2515923Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2515983Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2515985Z 2025-12-04T10:08:29.2516017Z Got: 2025-12-04T10:08:29.2516072Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2516119Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2516166Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2516212Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2516260Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2516262Z 2025-12-04T10:08:29.2516308Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2516353Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2516397Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2516444Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2516493Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2516496Z 2025-12-04T10:08:29.2516498Z 2025-12-04T10:08:29.2516543Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2516586Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2516630Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2516674Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2516721Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2516723Z 2025-12-04T10:08:29.2516768Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2516815Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2516858Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2516903Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2516966Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2517008Z dtype=torch.float64) 2025-12-04T10:08:29.2517010Z 2025-12-04T10:08:29.2517043Z Expected: 2025-12-04T10:08:29.2517097Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2517140Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2517186Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2517230Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2517289Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2517291Z 2025-12-04T10:08:29.2517336Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2517409Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2517454Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2517500Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2517559Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2517562Z 2025-12-04T10:08:29.2517564Z 2025-12-04T10:08:29.2517608Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2517652Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2517695Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2517740Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2517786Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2517789Z 2025-12-04T10:08:29.2517834Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2517878Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2517924Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2517968Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2518030Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2518071Z dtype=torch.float64) 2025-12-04T10:08:29.2518073Z 2025-12-04T10:08:29.2518359Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2518361Z 2025-12-04T10:08:29.2518433Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2518634Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2518637Z 2025-12-04T10:08:29.2518725Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2518895Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2518898Z 2025-12-04T10:08:29.2518990Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2519070Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2519149Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2519151Z 2025-12-04T10:08:29.2519234Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2519335Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2519371Z If the test 2025-12-04T10:08:29.2519463Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2519525Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2519620Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2519701Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2519704Z 2025-12-04T10:08:29.2519796Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2519879Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2519915Z the following. 2025-12-04T10:08:29.2519917Z 2025-12-04T10:08:29.2520004Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2520094Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2520158Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2520221Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2520282Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2520309Z 2025-12-04T10:08:29.2520341Z Got: 2025-12-04T10:08:29.2520397Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2520443Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2520502Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2520546Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2520594Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2520597Z 2025-12-04T10:08:29.2520641Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2520687Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2520731Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2520780Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2520828Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2520831Z 2025-12-04T10:08:29.2520833Z 2025-12-04T10:08:29.2520879Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2520923Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2520967Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2521013Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2521061Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2521063Z 2025-12-04T10:08:29.2521108Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2521153Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2521197Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2521242Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2521305Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2521346Z dtype=torch.float64) 2025-12-04T10:08:29.2521349Z 2025-12-04T10:08:29.2521383Z Expected: 2025-12-04T10:08:29.2521438Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2521482Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2521527Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2521572Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2521620Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2521622Z 2025-12-04T10:08:29.2521667Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2521711Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2521756Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2521800Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2521852Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2521854Z 2025-12-04T10:08:29.2521856Z 2025-12-04T10:08:29.2521901Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2521946Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2521989Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2522033Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2522080Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2522083Z 2025-12-04T10:08:29.2522128Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2522173Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2522220Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2522264Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2522339Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2522380Z dtype=torch.float64) 2025-12-04T10:08:29.2522382Z 2025-12-04T10:08:29.2522683Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2522696Z 2025-12-04T10:08:29.2522781Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2523019Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2523022Z 2025-12-04T10:08:29.2523107Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2523277Z FAILED [0.0270s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2523282Z 2025-12-04T10:08:29.2523373Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2523454Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2523534Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2523536Z 2025-12-04T10:08:29.2523619Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2523722Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2523757Z If the test 2025-12-04T10:08:29.2523850Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2523911Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2524006Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2524088Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2524091Z 2025-12-04T10:08:29.2524181Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2524270Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2524305Z the following. 2025-12-04T10:08:29.2524307Z 2025-12-04T10:08:29.2524395Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2524486Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2524537Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2524599Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2524660Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2524662Z 2025-12-04T10:08:29.2524694Z Got: 2025-12-04T10:08:29.2524749Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2524797Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2524844Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2524888Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2524938Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2524940Z 2025-12-04T10:08:29.2524984Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2525029Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2525074Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2525119Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2525168Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2525170Z 2025-12-04T10:08:29.2525172Z 2025-12-04T10:08:29.2525217Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2525260Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2525329Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2525374Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2525422Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2525437Z 2025-12-04T10:08:29.2525498Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2525544Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2525587Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2525646Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2525708Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2525749Z dtype=torch.float64) 2025-12-04T10:08:29.2525751Z 2025-12-04T10:08:29.2525786Z Expected: 2025-12-04T10:08:29.2525838Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2525884Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2525930Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2525974Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2526021Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2526024Z 2025-12-04T10:08:29.2526070Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2526115Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2526160Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2526206Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2526255Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2526257Z 2025-12-04T10:08:29.2526259Z 2025-12-04T10:08:29.2526303Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2526348Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2526392Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2526440Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2526485Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2526487Z 2025-12-04T10:08:29.2526536Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2526580Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2526626Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2526673Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2526736Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2526776Z dtype=torch.float64) 2025-12-04T10:08:29.2526777Z 2025-12-04T10:08:29.2527062Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2527064Z 2025-12-04T10:08:29.2527140Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2527339Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2527343Z 2025-12-04T10:08:29.2527430Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2527600Z FAILED [0.0293s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2527604Z 2025-12-04T10:08:29.2527696Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2527777Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2527856Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2527858Z 2025-12-04T10:08:29.2527951Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2528053Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2528104Z If the test 2025-12-04T10:08:29.2528208Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2528271Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2528366Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2528459Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2528461Z 2025-12-04T10:08:29.2528552Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2528636Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2528672Z the following. 2025-12-04T10:08:29.2528674Z 2025-12-04T10:08:29.2528763Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2528854Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2528907Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2528970Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2529032Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2529034Z 2025-12-04T10:08:29.2529066Z Got: 2025-12-04T10:08:29.2529122Z tensor([[[[-0.2718, 0.4023, -0.2886, -2.0572, 0.8617], 2025-12-04T10:08:29.2529168Z [-0.8466, 0.4577, -0.5941, -0.5979, 0.3840], 2025-12-04T10:08:29.2529214Z [-0.9354, -0.1574, -0.3456, -1.5513, -0.3520], 2025-12-04T10:08:29.2529258Z [-0.8259, 1.4445, 1.3606, 0.4498, 0.7210], 2025-12-04T10:08:29.2529306Z [-0.1940, 1.0860, -0.2763, -0.5038, -0.8057]], 2025-12-04T10:08:29.2529309Z 2025-12-04T10:08:29.2529353Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2529401Z [ 1.7377, -1.1775, -0.8656, -0.1678, 0.2485], 2025-12-04T10:08:29.2529445Z [ 1.2858, 0.1665, -0.3299, 0.6027, -2.3239], 2025-12-04T10:08:29.2529490Z [ 0.4440, -1.2709, -1.1622, -0.4258, -0.8472], 2025-12-04T10:08:29.2529540Z [ 0.7699, -0.0568, -0.2380, 0.3615, -1.2294]]], 2025-12-04T10:08:29.2529542Z 2025-12-04T10:08:29.2529544Z 2025-12-04T10:08:29.2529590Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2529635Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2529679Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2529724Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2529770Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2529772Z 2025-12-04T10:08:29.2529819Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2529863Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2529908Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2529953Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2530016Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2530057Z dtype=torch.float64) 2025-12-04T10:08:29.2530059Z 2025-12-04T10:08:29.2530094Z Expected: 2025-12-04T10:08:29.2530146Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2530193Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2530238Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2530283Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2530330Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2530332Z 2025-12-04T10:08:29.2530378Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2530423Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2530478Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2530524Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2530595Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2530597Z 2025-12-04T10:08:29.2530599Z 2025-12-04T10:08:29.2530644Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2530688Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2530746Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2530791Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2530836Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2530838Z 2025-12-04T10:08:29.2530883Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2530927Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2530973Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2531019Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2531081Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2531125Z dtype=torch.float64) 2025-12-04T10:08:29.2531129Z 2025-12-04T10:08:29.2531413Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2531416Z 2025-12-04T10:08:29.2531490Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2531688Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2531690Z 2025-12-04T10:08:29.2531777Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2531947Z FAILED [0.0268s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2531950Z 2025-12-04T10:08:29.2532044Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2532124Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2532202Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2532205Z 2025-12-04T10:08:29.2532291Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2532391Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2532427Z If the test 2025-12-04T10:08:29.2532518Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2532580Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2532674Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2532757Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2532759Z 2025-12-04T10:08:29.2532851Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2532971Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2533007Z the following. 2025-12-04T10:08:29.2533010Z 2025-12-04T10:08:29.2533099Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2533191Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2533243Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2533306Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2533367Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2533369Z 2025-12-04T10:08:29.2533401Z Got: 2025-12-04T10:08:29.2533476Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2533523Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2533599Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2533644Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2533692Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2533694Z 2025-12-04T10:08:29.2533751Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2533797Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2533840Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2533885Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2533934Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2533936Z 2025-12-04T10:08:29.2533939Z 2025-12-04T10:08:29.2533983Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2534031Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2534075Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2534123Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2534170Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2534172Z 2025-12-04T10:08:29.2534218Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2534264Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2534308Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2534351Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2534415Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2534456Z dtype=torch.float64) 2025-12-04T10:08:29.2534457Z 2025-12-04T10:08:29.2534492Z Expected: 2025-12-04T10:08:29.2534546Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2534592Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2534636Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2534683Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2534729Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2534731Z 2025-12-04T10:08:29.2534777Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2534824Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2534869Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2534915Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2534965Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2534967Z 2025-12-04T10:08:29.2534969Z 2025-12-04T10:08:29.2535013Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2535058Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2535102Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2535147Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2535194Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2535197Z 2025-12-04T10:08:29.2535242Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2535287Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2535332Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2535378Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2535439Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2535482Z dtype=torch.float64) 2025-12-04T10:08:29.2535484Z 2025-12-04T10:08:29.2535782Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2535784Z 2025-12-04T10:08:29.2535870Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2536082Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2536095Z 2025-12-04T10:08:29.2536182Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2536355Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2536357Z 2025-12-04T10:08:29.2536450Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2536531Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2536611Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2536613Z 2025-12-04T10:08:29.2536698Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2536801Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2536836Z If the test 2025-12-04T10:08:29.2536928Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2536990Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2537084Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2537167Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2537169Z 2025-12-04T10:08:29.2537260Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2537346Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2537382Z the following. 2025-12-04T10:08:29.2537384Z 2025-12-04T10:08:29.2537472Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2537563Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2537615Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2537678Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2537739Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2537742Z 2025-12-04T10:08:29.2537774Z Got: 2025-12-04T10:08:29.2537829Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2537875Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2537923Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2537966Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2538015Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2538018Z 2025-12-04T10:08:29.2538063Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2538108Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2538163Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2538207Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2538257Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2538259Z 2025-12-04T10:08:29.2538261Z 2025-12-04T10:08:29.2538305Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2538349Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2538393Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2538438Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2538485Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2538487Z 2025-12-04T10:08:29.2538549Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2538594Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2538640Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2538704Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2538768Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2538808Z dtype=torch.float64) 2025-12-04T10:08:29.2538823Z 2025-12-04T10:08:29.2538858Z Expected: 2025-12-04T10:08:29.2538910Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2538955Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2538999Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2539045Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2539090Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2539092Z 2025-12-04T10:08:29.2539138Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2539184Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2539228Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2539276Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2539326Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2539328Z 2025-12-04T10:08:29.2539330Z 2025-12-04T10:08:29.2539377Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2539421Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2539465Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2539508Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2539555Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2539557Z 2025-12-04T10:08:29.2539601Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2539647Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2539690Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2539735Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2539798Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2539839Z dtype=torch.float64) 2025-12-04T10:08:29.2539841Z 2025-12-04T10:08:29.2540135Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2540138Z 2025-12-04T10:08:29.2540212Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2540410Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2540413Z 2025-12-04T10:08:29.2540499Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2540671Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2540674Z 2025-12-04T10:08:29.2540765Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2540847Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2540924Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2540927Z 2025-12-04T10:08:29.2541010Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2541110Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2541145Z If the test 2025-12-04T10:08:29.2541237Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2541309Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2541402Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2541509Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2541511Z 2025-12-04T10:08:29.2541602Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2541701Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2541736Z the following. 2025-12-04T10:08:29.2541738Z 2025-12-04T10:08:29.2541826Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2541916Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2541970Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2542033Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2542095Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2542097Z 2025-12-04T10:08:29.2542129Z Got: 2025-12-04T10:08:29.2542186Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2542234Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2542282Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2542327Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2542374Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2542376Z 2025-12-04T10:08:29.2542421Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2542466Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2542512Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2542556Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2542607Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2542610Z 2025-12-04T10:08:29.2542612Z 2025-12-04T10:08:29.2542656Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2542701Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2542746Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2542790Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2542836Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2542839Z 2025-12-04T10:08:29.2542884Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2542964Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2543009Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2543053Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2543116Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2543157Z dtype=torch.float64) 2025-12-04T10:08:29.2543160Z 2025-12-04T10:08:29.2543195Z Expected: 2025-12-04T10:08:29.2543248Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2543294Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2543340Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2543386Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2543432Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2543436Z 2025-12-04T10:08:29.2543481Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2543526Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2543571Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2543615Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2543665Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2543667Z 2025-12-04T10:08:29.2543669Z 2025-12-04T10:08:29.2543731Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2543776Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2543849Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2543893Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2543941Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2543964Z 2025-12-04T10:08:29.2544009Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2544054Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2544098Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2544142Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2544204Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2544245Z dtype=torch.float64) 2025-12-04T10:08:29.2544247Z 2025-12-04T10:08:29.2544534Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2544537Z 2025-12-04T10:08:29.2544610Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2544808Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2544812Z 2025-12-04T10:08:29.2544897Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2545068Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2545070Z 2025-12-04T10:08:29.2545162Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2545243Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2545320Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2545324Z 2025-12-04T10:08:29.2545411Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2545513Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2545551Z If the test 2025-12-04T10:08:29.2545643Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2545704Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2545798Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2545879Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2545881Z 2025-12-04T10:08:29.2545970Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2546054Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2546089Z the following. 2025-12-04T10:08:29.2546093Z 2025-12-04T10:08:29.2546183Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2546274Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2546325Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2546388Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2546448Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2546450Z 2025-12-04T10:08:29.2546483Z Got: 2025-12-04T10:08:29.2546538Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2546584Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2546630Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2546686Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2546734Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2546736Z 2025-12-04T10:08:29.2546795Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2546849Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2546894Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2546939Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2547009Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2547011Z 2025-12-04T10:08:29.2547013Z 2025-12-04T10:08:29.2547057Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2547101Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2547144Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2547189Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2547236Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2547237Z 2025-12-04T10:08:29.2547283Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2547331Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2547377Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2547421Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2547484Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2547525Z dtype=torch.float64) 2025-12-04T10:08:29.2547527Z 2025-12-04T10:08:29.2547562Z Expected: 2025-12-04T10:08:29.2547615Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2547659Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2547704Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2547748Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2547796Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2547799Z 2025-12-04T10:08:29.2547843Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2547889Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2547933Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2547978Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2548028Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2548030Z 2025-12-04T10:08:29.2548032Z 2025-12-04T10:08:29.2548078Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2548122Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2548166Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2548210Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2548257Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2548260Z 2025-12-04T10:08:29.2548304Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2548349Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2548395Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2548440Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2548501Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2548544Z dtype=torch.float64) 2025-12-04T10:08:29.2548546Z 2025-12-04T10:08:29.2548835Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2548838Z 2025-12-04T10:08:29.2548911Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2549121Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2549124Z 2025-12-04T10:08:29.2549231Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2549402Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2549417Z 2025-12-04T10:08:29.2549509Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2549590Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2549668Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2549670Z 2025-12-04T10:08:29.2549755Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2549856Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2549893Z If the test 2025-12-04T10:08:29.2549985Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2550046Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2550143Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2550225Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2550228Z 2025-12-04T10:08:29.2550318Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2550403Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2550440Z the following. 2025-12-04T10:08:29.2550442Z 2025-12-04T10:08:29.2550531Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2550621Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2550673Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2550735Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2550795Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2550798Z 2025-12-04T10:08:29.2550831Z Got: 2025-12-04T10:08:29.2550886Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2550936Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2550983Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2551029Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2551076Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2551077Z 2025-12-04T10:08:29.2551122Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2551167Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2551212Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2551257Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2551307Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2551309Z 2025-12-04T10:08:29.2551312Z 2025-12-04T10:08:29.2551356Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2551401Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2551444Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2551490Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2551535Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2551537Z 2025-12-04T10:08:29.2551582Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2551626Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2551670Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2551714Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2551790Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2551833Z dtype=torch.float64) 2025-12-04T10:08:29.2551835Z 2025-12-04T10:08:29.2551880Z Expected: 2025-12-04T10:08:29.2551944Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2551989Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2552034Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2552088Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2552136Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2552138Z 2025-12-04T10:08:29.2552182Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2552227Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2552271Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2552316Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2552365Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2552367Z 2025-12-04T10:08:29.2552369Z 2025-12-04T10:08:29.2552415Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2552462Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2552506Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2552549Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2552597Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2552599Z 2025-12-04T10:08:29.2552643Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2552689Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2552732Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2552777Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2552839Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2552882Z dtype=torch.float64) 2025-12-04T10:08:29.2552884Z 2025-12-04T10:08:29.2553234Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2553237Z 2025-12-04T10:08:29.2553311Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2553510Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2553514Z 2025-12-04T10:08:29.2553598Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2553769Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2553772Z 2025-12-04T10:08:29.2553863Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2553945Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2554024Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2554026Z 2025-12-04T10:08:29.2554110Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2554212Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2554247Z If the test 2025-12-04T10:08:29.2554340Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2554403Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2554495Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2554576Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2554604Z 2025-12-04T10:08:29.2554696Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2554805Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2554844Z the following. 2025-12-04T10:08:29.2554846Z 2025-12-04T10:08:29.2554934Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2555039Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2555090Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2555152Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2555212Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2555214Z 2025-12-04T10:08:29.2555247Z Got: 2025-12-04T10:08:29.2555300Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2555346Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2555393Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2555438Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2555487Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2555489Z 2025-12-04T10:08:29.2555534Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2555579Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2555625Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2555669Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2555718Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2555721Z 2025-12-04T10:08:29.2555722Z 2025-12-04T10:08:29.2555766Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2555810Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2555856Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2555901Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2555946Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2555950Z 2025-12-04T10:08:29.2555996Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2556041Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2556085Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2556130Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2556193Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2556234Z dtype=torch.float64) 2025-12-04T10:08:29.2556236Z 2025-12-04T10:08:29.2556270Z Expected: 2025-12-04T10:08:29.2556323Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2556367Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2556414Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2556457Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2556504Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2556506Z 2025-12-04T10:08:29.2556551Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2556596Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2556639Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2556686Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2556733Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2556735Z 2025-12-04T10:08:29.2556737Z 2025-12-04T10:08:29.2556782Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2556826Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2556871Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2556933Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2556980Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2556982Z 2025-12-04T10:08:29.2557055Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2557101Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2557145Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2557190Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2557263Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2557304Z dtype=torch.float64) 2025-12-04T10:08:29.2557306Z 2025-12-04T10:08:29.2557590Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2557592Z 2025-12-04T10:08:29.2557665Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2557866Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2557870Z 2025-12-04T10:08:29.2557955Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2558124Z FAILED [0.0267s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2558128Z 2025-12-04T10:08:29.2558218Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2558300Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2558378Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2558381Z 2025-12-04T10:08:29.2558464Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2558566Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2558601Z If the test 2025-12-04T10:08:29.2558695Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2558756Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2558849Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2558931Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2558933Z 2025-12-04T10:08:29.2559023Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2559106Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2559143Z the following. 2025-12-04T10:08:29.2559145Z 2025-12-04T10:08:29.2559232Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2559322Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2559373Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2559437Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2559497Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2559499Z 2025-12-04T10:08:29.2559532Z Got: 2025-12-04T10:08:29.2559586Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2559636Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2559681Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2559726Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2559773Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2559776Z 2025-12-04T10:08:29.2559820Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2559875Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2559920Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2559965Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2560035Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2560038Z 2025-12-04T10:08:29.2560039Z 2025-12-04T10:08:29.2560085Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2560139Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2560183Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2560227Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2560273Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2560275Z 2025-12-04T10:08:29.2560319Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2560364Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2560408Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2560454Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2560516Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2560559Z dtype=torch.float64) 2025-12-04T10:08:29.2560560Z 2025-12-04T10:08:29.2560594Z Expected: 2025-12-04T10:08:29.2560648Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2560693Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2560738Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2560782Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2560829Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2560830Z 2025-12-04T10:08:29.2560875Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2560920Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2560964Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2561010Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2561058Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2561062Z 2025-12-04T10:08:29.2561063Z 2025-12-04T10:08:29.2561108Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2561155Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2561203Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2561247Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2561293Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2561295Z 2025-12-04T10:08:29.2561342Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2561385Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2561429Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2561474Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2561537Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2561577Z dtype=torch.float64) 2025-12-04T10:08:29.2561580Z 2025-12-04T10:08:29.2561868Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2561872Z 2025-12-04T10:08:29.2561944Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2562144Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2562146Z 2025-12-04T10:08:29.2562231Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2562415Z FAILED [0.0264s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2562418Z 2025-12-04T10:08:29.2562530Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2562610Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2562689Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2562701Z 2025-12-04T10:08:29.2562784Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2562886Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2562920Z If the test 2025-12-04T10:08:29.2563058Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2563118Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2563215Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2563296Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2563300Z 2025-12-04T10:08:29.2563391Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2563476Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2563512Z the following. 2025-12-04T10:08:29.2563515Z 2025-12-04T10:08:29.2563602Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2563692Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2563742Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2563807Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2563866Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2563868Z 2025-12-04T10:08:29.2563901Z Got: 2025-12-04T10:08:29.2563957Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2564004Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2564049Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2564095Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2564142Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2564144Z 2025-12-04T10:08:29.2564190Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2564236Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2564280Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2564325Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2564373Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2564375Z 2025-12-04T10:08:29.2564377Z 2025-12-04T10:08:29.2564422Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2564466Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2564513Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2564559Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2564606Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2564608Z 2025-12-04T10:08:29.2564653Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2564699Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2564742Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2564787Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2564849Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2564890Z dtype=torch.float64) 2025-12-04T10:08:29.2564892Z 2025-12-04T10:08:29.2564926Z Expected: 2025-12-04T10:08:29.2564980Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2565046Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2565093Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2565163Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2565214Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2565215Z 2025-12-04T10:08:29.2565261Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2565320Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2565365Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2565411Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2565459Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2565461Z 2025-12-04T10:08:29.2565464Z 2025-12-04T10:08:29.2565508Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2565553Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2565597Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2565643Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2565692Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2565694Z 2025-12-04T10:08:29.2565739Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2565783Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2565830Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2565874Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2565936Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2565977Z dtype=torch.float64) 2025-12-04T10:08:29.2565978Z 2025-12-04T10:08:29.2566265Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2566267Z 2025-12-04T10:08:29.2566339Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2566540Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2566542Z 2025-12-04T10:08:29.2566630Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2566807Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2566809Z 2025-12-04T10:08:29.2566903Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2566984Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2567064Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2567066Z 2025-12-04T10:08:29.2567149Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2567253Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2567288Z If the test 2025-12-04T10:08:29.2567381Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2567442Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2567535Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2567616Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2567618Z 2025-12-04T10:08:29.2567708Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2567791Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2567828Z the following. 2025-12-04T10:08:29.2567841Z 2025-12-04T10:08:29.2567929Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2568035Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2568099Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2568162Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2568224Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2568238Z 2025-12-04T10:08:29.2568270Z Got: 2025-12-04T10:08:29.2568324Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2568371Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2568419Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2568464Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2568512Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2568513Z 2025-12-04T10:08:29.2568559Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2568608Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2568656Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2568703Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2568752Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2568755Z 2025-12-04T10:08:29.2568757Z 2025-12-04T10:08:29.2568802Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2568846Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2568890Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2568935Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2568982Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2568983Z 2025-12-04T10:08:29.2569028Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2569073Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2569117Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2569164Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2569225Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2569266Z dtype=torch.float64) 2025-12-04T10:08:29.2569270Z 2025-12-04T10:08:29.2569304Z Expected: 2025-12-04T10:08:29.2569358Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2569402Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2569449Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2569493Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2569540Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2569542Z 2025-12-04T10:08:29.2569586Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2569632Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2569675Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2569723Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2569773Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2569775Z 2025-12-04T10:08:29.2569777Z 2025-12-04T10:08:29.2569822Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2569868Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2569911Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2569956Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2570002Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2570003Z 2025-12-04T10:08:29.2570049Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2570106Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2570153Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2570197Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2570280Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2570320Z dtype=torch.float64) 2025-12-04T10:08:29.2570322Z 2025-12-04T10:08:29.2570609Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2570627Z 2025-12-04T10:08:29.2570699Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2570900Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2570901Z 2025-12-04T10:08:29.2570988Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2571158Z FAILED [0.0261s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2571161Z 2025-12-04T10:08:29.2571253Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2571333Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2571413Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2571415Z 2025-12-04T10:08:29.2571499Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2571600Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2571635Z If the test 2025-12-04T10:08:29.2571728Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2571790Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2571884Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2571967Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2571969Z 2025-12-04T10:08:29.2572065Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2572150Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2572186Z the following. 2025-12-04T10:08:29.2572188Z 2025-12-04T10:08:29.2572275Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2572365Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2572417Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2572480Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2572543Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2572545Z 2025-12-04T10:08:29.2572578Z Got: 2025-12-04T10:08:29.2572633Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2572681Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2572727Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2572771Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2572820Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2572823Z 2025-12-04T10:08:29.2572867Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2572913Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2572994Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2573040Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2573089Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2573113Z 2025-12-04T10:08:29.2573115Z 2025-12-04T10:08:29.2573162Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2573205Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2573278Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2573323Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2573370Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2573385Z 2025-12-04T10:08:29.2573430Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2573474Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2573519Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2573564Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2573626Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2573667Z dtype=torch.float64) 2025-12-04T10:08:29.2573670Z 2025-12-04T10:08:29.2573704Z Expected: 2025-12-04T10:08:29.2573758Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2573801Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2573852Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2573896Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2573943Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2573946Z 2025-12-04T10:08:29.2573991Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2574035Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2574080Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2574124Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2574174Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2574176Z 2025-12-04T10:08:29.2574178Z 2025-12-04T10:08:29.2574222Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2574266Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2574311Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2574356Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2574401Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2574404Z 2025-12-04T10:08:29.2574450Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2576224Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2576272Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2576317Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2576380Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2576421Z dtype=torch.float64) 2025-12-04T10:08:29.2576423Z 2025-12-04T10:08:29.2576712Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2576715Z 2025-12-04T10:08:29.2576788Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2576988Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2576992Z 2025-12-04T10:08:29.2577078Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2577249Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2577251Z 2025-12-04T10:08:29.2577345Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2577443Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2577522Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2577537Z 2025-12-04T10:08:29.2577632Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2577735Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2577770Z If the test 2025-12-04T10:08:29.2577879Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2577939Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2578033Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2578113Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2578115Z 2025-12-04T10:08:29.2578207Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2578291Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2578328Z the following. 2025-12-04T10:08:29.2578330Z 2025-12-04T10:08:29.2578423Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2578512Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2578564Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2578627Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2578688Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2578690Z 2025-12-04T10:08:29.2578722Z Got: 2025-12-04T10:08:29.2578777Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2578823Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2578870Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2578914Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2578962Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2578964Z 2025-12-04T10:08:29.2579008Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2579056Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2579100Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2579147Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2579198Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2579200Z 2025-12-04T10:08:29.2579201Z 2025-12-04T10:08:29.2579246Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2579290Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2579334Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2579378Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2579425Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2579427Z 2025-12-04T10:08:29.2579473Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2579519Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2579563Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2579609Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2579671Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2579715Z dtype=torch.float64) 2025-12-04T10:08:29.2579717Z 2025-12-04T10:08:29.2579751Z Expected: 2025-12-04T10:08:29.2579804Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2579849Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2579894Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2579939Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2580007Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2580009Z 2025-12-04T10:08:29.2580055Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2580121Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2580166Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2580211Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2580261Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2580273Z 2025-12-04T10:08:29.2580275Z 2025-12-04T10:08:29.2580320Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2580365Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2580408Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2580453Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2580498Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2580500Z 2025-12-04T10:08:29.2580547Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2580593Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2580643Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2580686Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2580749Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2580791Z dtype=torch.float64) 2025-12-04T10:08:29.2580792Z 2025-12-04T10:08:29.2581080Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2581082Z 2025-12-04T10:08:29.2581156Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2581358Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2581360Z 2025-12-04T10:08:29.2581447Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2581618Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2581621Z 2025-12-04T10:08:29.2581716Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2581796Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2581875Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2581877Z 2025-12-04T10:08:29.2581963Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2582066Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2582102Z If the test 2025-12-04T10:08:29.2582197Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2582257Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2582353Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2582434Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2582439Z 2025-12-04T10:08:29.2582530Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2582615Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2582651Z the following. 2025-12-04T10:08:29.2582652Z 2025-12-04T10:08:29.2582741Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2582831Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2582895Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2582995Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2583058Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2583078Z 2025-12-04T10:08:29.2583125Z Got: 2025-12-04T10:08:29.2583181Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2583227Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2583292Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2583336Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2583384Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2583386Z 2025-12-04T10:08:29.2583430Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2583479Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2583524Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2583573Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2583622Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2583624Z 2025-12-04T10:08:29.2583626Z 2025-12-04T10:08:29.2583676Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2583722Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2583769Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2583815Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2583863Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2583864Z 2025-12-04T10:08:29.2583912Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2583958Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2584005Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2584049Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2584113Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2584154Z dtype=torch.float64) 2025-12-04T10:08:29.2584155Z 2025-12-04T10:08:29.2584191Z Expected: 2025-12-04T10:08:29.2584245Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2584290Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2584337Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2584385Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2584431Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2584433Z 2025-12-04T10:08:29.2584478Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2584522Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2584567Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2584611Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2584662Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2584664Z 2025-12-04T10:08:29.2584666Z 2025-12-04T10:08:29.2584710Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2584755Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2584799Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2584843Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2584890Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2584892Z 2025-12-04T10:08:29.2584937Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2584980Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2585025Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2585068Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2585144Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2585186Z dtype=torch.float64) 2025-12-04T10:08:29.2585188Z 2025-12-04T10:08:29.2585490Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2585504Z 2025-12-04T10:08:29.2585578Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2585789Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2585791Z 2025-12-04T10:08:29.2585878Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2586049Z FAILED [0.0264s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2586051Z 2025-12-04T10:08:29.2586145Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2586225Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2586305Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2586308Z 2025-12-04T10:08:29.2586391Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2586494Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2586530Z If the test 2025-12-04T10:08:29.2586622Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2586682Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2586775Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2586857Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2586860Z 2025-12-04T10:08:29.2586950Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2587037Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2587073Z the following. 2025-12-04T10:08:29.2587075Z 2025-12-04T10:08:29.2587165Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2587255Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2587308Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2587370Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2587430Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2587432Z 2025-12-04T10:08:29.2587464Z Got: 2025-12-04T10:08:29.2587519Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2587565Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2587612Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2587656Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2587706Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2587708Z 2025-12-04T10:08:29.2587752Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2587798Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2587843Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2587890Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2587939Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2587941Z 2025-12-04T10:08:29.2587944Z 2025-12-04T10:08:29.2587988Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2588032Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2588076Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2588133Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2588180Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2588193Z 2025-12-04T10:08:29.2588250Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2588294Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2588339Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2588399Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2588462Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2588503Z dtype=torch.float64) 2025-12-04T10:08:29.2588506Z 2025-12-04T10:08:29.2588540Z Expected: 2025-12-04T10:08:29.2588593Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2588638Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2588683Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2588727Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2588774Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2588778Z 2025-12-04T10:08:29.2588825Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2588869Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2588914Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2588960Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2589009Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2589011Z 2025-12-04T10:08:29.2589013Z 2025-12-04T10:08:29.2589057Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2589102Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2589145Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2589191Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2589237Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2589240Z 2025-12-04T10:08:29.2589284Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2589331Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2589375Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2589421Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2589484Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2589525Z dtype=torch.float64) 2025-12-04T10:08:29.2589527Z 2025-12-04T10:08:29.2589814Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2589817Z 2025-12-04T10:08:29.2589891Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2590093Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2590096Z 2025-12-04T10:08:29.2590183Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2590355Z FAILED [0.0264s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2590358Z 2025-12-04T10:08:29.2590449Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2590529Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2590608Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2590610Z 2025-12-04T10:08:29.2590694Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2590806Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2590843Z If the test 2025-12-04T10:08:29.2590957Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2591019Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2591112Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2591205Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2591207Z 2025-12-04T10:08:29.2591297Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2591381Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2591417Z the following. 2025-12-04T10:08:29.2591419Z 2025-12-04T10:08:29.2591507Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2591598Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2591650Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2591715Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2591776Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2591777Z 2025-12-04T10:08:29.2591809Z Got: 2025-12-04T10:08:29.2591864Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2591911Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2591959Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2592004Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2592051Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2592054Z 2025-12-04T10:08:29.2592099Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2592145Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2592190Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2592236Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2592286Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2592288Z 2025-12-04T10:08:29.2592290Z 2025-12-04T10:08:29.2592335Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2592381Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2592426Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2592471Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2592517Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2592519Z 2025-12-04T10:08:29.2592565Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2592609Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2592654Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2592698Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2592760Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2592803Z dtype=torch.float64) 2025-12-04T10:08:29.2592805Z 2025-12-04T10:08:29.2592840Z Expected: 2025-12-04T10:08:29.2592893Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2592980Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2593025Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2593071Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2593117Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2593119Z 2025-12-04T10:08:29.2593164Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2593211Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2593273Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2593319Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2593370Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2593400Z 2025-12-04T10:08:29.2593403Z 2025-12-04T10:08:29.2593447Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2593494Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2593555Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2593598Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2593644Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2593646Z 2025-12-04T10:08:29.2593691Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2593735Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2593779Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2593825Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2593887Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2593929Z dtype=torch.float64) 2025-12-04T10:08:29.2593932Z 2025-12-04T10:08:29.2594221Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2594224Z 2025-12-04T10:08:29.2594298Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2594500Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2594502Z 2025-12-04T10:08:29.2594588Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2594763Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2594766Z 2025-12-04T10:08:29.2594859Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2594941Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2595021Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2595024Z 2025-12-04T10:08:29.2595109Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2595210Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2595246Z If the test 2025-12-04T10:08:29.2595339Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2595401Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2595495Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2595577Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2595579Z 2025-12-04T10:08:29.2595673Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2595759Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2595794Z the following. 2025-12-04T10:08:29.2595797Z 2025-12-04T10:08:29.2595887Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2595977Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2596029Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2596092Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2596153Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2596155Z 2025-12-04T10:08:29.2596188Z Got: 2025-12-04T10:08:29.2596257Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2596304Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2596351Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2596416Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2596464Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2596466Z 2025-12-04T10:08:29.2596511Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2596568Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2596613Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2596657Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2596708Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2596710Z 2025-12-04T10:08:29.2596712Z 2025-12-04T10:08:29.2596756Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2596801Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2596845Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2596890Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2596938Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2596939Z 2025-12-04T10:08:29.2596985Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2597029Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2597074Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2597117Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2597181Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2597221Z dtype=torch.float64) 2025-12-04T10:08:29.2597223Z 2025-12-04T10:08:29.2597258Z Expected: 2025-12-04T10:08:29.2597310Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2597363Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2597409Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2597455Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2597501Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2597503Z 2025-12-04T10:08:29.2597554Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2597599Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2597644Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2597688Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2597737Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2597739Z 2025-12-04T10:08:29.2597741Z 2025-12-04T10:08:29.2597786Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2597830Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2597875Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2597919Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2597967Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2597969Z 2025-12-04T10:08:29.2598016Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2598062Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2598106Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2598152Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2598213Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2598254Z dtype=torch.float64) 2025-12-04T10:08:29.2598256Z 2025-12-04T10:08:29.2598561Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2598563Z 2025-12-04T10:08:29.2598638Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2598863Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2598867Z 2025-12-04T10:08:29.2598964Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2599135Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2599137Z 2025-12-04T10:08:29.2599228Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2599309Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2599388Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2599390Z 2025-12-04T10:08:29.2599475Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2599577Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2599614Z If the test 2025-12-04T10:08:29.2599707Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2599779Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2599873Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2599956Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2599958Z 2025-12-04T10:08:29.2600047Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2600131Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2600166Z the following. 2025-12-04T10:08:29.2600169Z 2025-12-04T10:08:29.2600257Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2600347Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2600401Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2600464Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2600525Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2600528Z 2025-12-04T10:08:29.2600562Z Got: 2025-12-04T10:08:29.2600617Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2600664Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2600709Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2600754Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2600806Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2600808Z 2025-12-04T10:08:29.2600858Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2600902Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2600951Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2600996Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2601045Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2601047Z 2025-12-04T10:08:29.2601049Z 2025-12-04T10:08:29.2601094Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2601139Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2601183Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2601228Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2601275Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2601277Z 2025-12-04T10:08:29.2601323Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2601378Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2601425Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2601493Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2601557Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2601597Z dtype=torch.float64) 2025-12-04T10:08:29.2601599Z 2025-12-04T10:08:29.2601645Z Expected: 2025-12-04T10:08:29.2601698Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2601743Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2601789Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2601833Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2601880Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2601883Z 2025-12-04T10:08:29.2601927Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2601972Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2602016Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2602066Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2602115Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2602116Z 2025-12-04T10:08:29.2602118Z 2025-12-04T10:08:29.2602163Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2602208Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2602252Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2602296Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2602342Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2602347Z 2025-12-04T10:08:29.2602391Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2602436Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2602479Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2602524Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2602587Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2602629Z dtype=torch.float64) 2025-12-04T10:08:29.2602631Z 2025-12-04T10:08:29.2602916Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2602921Z 2025-12-04T10:08:29.2603030Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2603235Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2603237Z 2025-12-04T10:08:29.2603323Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2603496Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2603499Z 2025-12-04T10:08:29.2603590Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2603671Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2603750Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2603752Z 2025-12-04T10:08:29.2603836Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2603938Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2603974Z If the test 2025-12-04T10:08:29.2604068Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2604147Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2604243Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2604352Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2604354Z 2025-12-04T10:08:29.2604445Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2604531Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2604583Z the following. 2025-12-04T10:08:29.2604585Z 2025-12-04T10:08:29.2604673Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2604764Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2604815Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2604877Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2604937Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2604939Z 2025-12-04T10:08:29.2604974Z Got: 2025-12-04T10:08:29.2605028Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2605077Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2605124Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2605169Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2605216Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2605218Z 2025-12-04T10:08:29.2605264Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2605308Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2605358Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2605405Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2605457Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2605459Z 2025-12-04T10:08:29.2605462Z 2025-12-04T10:08:29.2605506Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2605550Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2605595Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2605642Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2605690Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2605693Z 2025-12-04T10:08:29.2605744Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2605790Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2605834Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2605878Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2605941Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2605981Z dtype=torch.float64) 2025-12-04T10:08:29.2605984Z 2025-12-04T10:08:29.2606018Z Expected: 2025-12-04T10:08:29.2606071Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2606115Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2606164Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2606207Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2606256Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2606259Z 2025-12-04T10:08:29.2606305Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2606349Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2606394Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2606439Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2606487Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2606489Z 2025-12-04T10:08:29.2606491Z 2025-12-04T10:08:29.2606546Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2606591Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2606635Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2606702Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2606749Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2606752Z 2025-12-04T10:08:29.2606817Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2606862Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2606905Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2606950Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2607011Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2607052Z dtype=torch.float64) 2025-12-04T10:08:29.2607054Z 2025-12-04T10:08:29.2607342Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2607350Z 2025-12-04T10:08:29.2607423Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2607621Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2607625Z 2025-12-04T10:08:29.2607709Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2607879Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2607882Z 2025-12-04T10:08:29.2607982Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2608063Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2608141Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2608144Z 2025-12-04T10:08:29.2608230Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2608332Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2608367Z If the test 2025-12-04T10:08:29.2608462Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2608523Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2608616Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2608699Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2608701Z 2025-12-04T10:08:29.2608793Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2608878Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2608915Z the following. 2025-12-04T10:08:29.2608917Z 2025-12-04T10:08:29.2609006Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2609098Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2609149Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2609213Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2609272Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2609274Z 2025-12-04T10:08:29.2609307Z Got: 2025-12-04T10:08:29.2609361Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2609407Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2609455Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2609500Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2609560Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2609563Z 2025-12-04T10:08:29.2609610Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2609680Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2609727Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2609772Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2609835Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2609838Z 2025-12-04T10:08:29.2609839Z 2025-12-04T10:08:29.2609884Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2609928Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2609971Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2610016Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2610062Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2610065Z 2025-12-04T10:08:29.2610109Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2610154Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2610200Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2610245Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2610307Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2610351Z dtype=torch.float64) 2025-12-04T10:08:29.2610353Z 2025-12-04T10:08:29.2610388Z Expected: 2025-12-04T10:08:29.2610441Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2610485Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2610530Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2610574Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2610621Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2610623Z 2025-12-04T10:08:29.2610669Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2610713Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2610759Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2610805Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2610856Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2610859Z 2025-12-04T10:08:29.2610860Z 2025-12-04T10:08:29.2610907Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2610951Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2610995Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2611039Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2611085Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2611088Z 2025-12-04T10:08:29.2611134Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2611179Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2611224Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2611269Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2611330Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2611372Z dtype=torch.float64) 2025-12-04T10:08:29.2611374Z 2025-12-04T10:08:29.2611661Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2611663Z 2025-12-04T10:08:29.2611736Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2611950Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2611952Z 2025-12-04T10:08:29.2612037Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2612232Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2612234Z 2025-12-04T10:08:29.2612336Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2612417Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2612495Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2612497Z 2025-12-04T10:08:29.2612582Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2612684Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2612718Z If the test 2025-12-04T10:08:29.2612813Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2612875Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2613009Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2613090Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2613092Z 2025-12-04T10:08:29.2613184Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2613268Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2613304Z the following. 2025-12-04T10:08:29.2613306Z 2025-12-04T10:08:29.2613395Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2613485Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2613536Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2613600Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2613660Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2613663Z 2025-12-04T10:08:29.2613696Z Got: 2025-12-04T10:08:29.2613751Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2613798Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2613843Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2613890Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2613936Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2613938Z 2025-12-04T10:08:29.2613984Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2614028Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2614073Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2614119Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2614170Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2614172Z 2025-12-04T10:08:29.2614174Z 2025-12-04T10:08:29.2614221Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2614264Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2614308Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2614353Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2614402Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2614404Z 2025-12-04T10:08:29.2614448Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2614493Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2614539Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2614584Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2614663Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2614706Z dtype=torch.float64) 2025-12-04T10:08:29.2614707Z 2025-12-04T10:08:29.2614741Z Expected: 2025-12-04T10:08:29.2614823Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2614867Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2614913Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2614971Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2615018Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2615020Z 2025-12-04T10:08:29.2615064Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2615109Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2615153Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2615198Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2615247Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2615249Z 2025-12-04T10:08:29.2615251Z 2025-12-04T10:08:29.2615298Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2615345Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2615389Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2615433Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2615481Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2615482Z 2025-12-04T10:08:29.2615528Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2615572Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2615617Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2615660Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2615723Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2615764Z dtype=torch.float64) 2025-12-04T10:08:29.2615766Z 2025-12-04T10:08:29.2616052Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2616055Z 2025-12-04T10:08:29.2616128Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2616333Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2616337Z 2025-12-04T10:08:29.2616422Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2616594Z FAILED [0.0264s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2616596Z 2025-12-04T10:08:29.2616688Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2616768Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2616849Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2616851Z 2025-12-04T10:08:29.2616935Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2617038Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2617073Z If the test 2025-12-04T10:08:29.2617168Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2617228Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2617322Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2617403Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2617405Z 2025-12-04T10:08:29.2617508Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2617593Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2617649Z the following. 2025-12-04T10:08:29.2617651Z 2025-12-04T10:08:29.2617740Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2617831Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2617893Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2617956Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2618016Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2618018Z 2025-12-04T10:08:29.2618050Z Got: 2025-12-04T10:08:29.2618106Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2618153Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2618200Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2618245Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2618292Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2618297Z 2025-12-04T10:08:29.2618344Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2618388Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2618434Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2618480Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2618529Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2618530Z 2025-12-04T10:08:29.2618532Z 2025-12-04T10:08:29.2618577Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2618620Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2618666Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2618710Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2618757Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2618760Z 2025-12-04T10:08:29.2618805Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2618849Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2618894Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2618939Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2619003Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2619043Z dtype=torch.float64) 2025-12-04T10:08:29.2619045Z 2025-12-04T10:08:29.2619079Z Expected: 2025-12-04T10:08:29.2619131Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2619175Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2619222Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2619266Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2619313Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2619316Z 2025-12-04T10:08:29.2619361Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2619406Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2619450Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2619496Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2619544Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2619546Z 2025-12-04T10:08:29.2619549Z 2025-12-04T10:08:29.2619593Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2619638Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2619681Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2619746Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2619792Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2619795Z 2025-12-04T10:08:29.2619842Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2619909Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2619955Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2619999Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2620073Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2620113Z dtype=torch.float64) 2025-12-04T10:08:29.2620115Z 2025-12-04T10:08:29.2620402Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2620404Z 2025-12-04T10:08:29.2620478Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2620680Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2620684Z 2025-12-04T10:08:29.2620769Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2620941Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2620945Z 2025-12-04T10:08:29.2621038Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2621118Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2621197Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2621199Z 2025-12-04T10:08:29.2621282Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2621386Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2621421Z If the test 2025-12-04T10:08:29.2621517Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2621578Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2621673Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2621757Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2621759Z 2025-12-04T10:08:29.2621849Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2621933Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2621969Z the following. 2025-12-04T10:08:29.2621971Z 2025-12-04T10:08:29.2622059Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2622149Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2622200Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2622266Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2622327Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2622329Z 2025-12-04T10:08:29.2622362Z Got: 2025-12-04T10:08:29.2622418Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2622465Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2622511Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2622556Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2622603Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2622605Z 2025-12-04T10:08:29.2622649Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2622694Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2622761Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2622808Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2622896Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2622898Z 2025-12-04T10:08:29.2622900Z 2025-12-04T10:08:29.2622980Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2623024Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2623088Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2623132Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2623179Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2623181Z 2025-12-04T10:08:29.2623225Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2623269Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2623313Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2623358Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2623421Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2623465Z dtype=torch.float64) 2025-12-04T10:08:29.2623468Z 2025-12-04T10:08:29.2623502Z Expected: 2025-12-04T10:08:29.2623556Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2623600Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2623652Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2623695Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2623743Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2623744Z 2025-12-04T10:08:29.2623788Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2623834Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2623878Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2623924Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2623972Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2623976Z 2025-12-04T10:08:29.2623979Z 2025-12-04T10:08:29.2624023Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2624068Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2624113Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2624157Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2624203Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2624204Z 2025-12-04T10:08:29.2624249Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2624293Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2624337Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2624383Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2624445Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2624486Z dtype=torch.float64) 2025-12-04T10:08:29.2624489Z 2025-12-04T10:08:29.2624777Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2624780Z 2025-12-04T10:08:29.2624853Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2625053Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2625055Z 2025-12-04T10:08:29.2625142Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2625331Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2625333Z 2025-12-04T10:08:29.2625439Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2625533Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2625611Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2625624Z 2025-12-04T10:08:29.2625708Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2625809Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2625844Z If the test 2025-12-04T10:08:29.2625939Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2625999Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2626094Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2626175Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2626177Z 2025-12-04T10:08:29.2626270Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2626354Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2626390Z the following. 2025-12-04T10:08:29.2626392Z 2025-12-04T10:08:29.2626481Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2626572Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2626623Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2626685Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2626746Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2626748Z 2025-12-04T10:08:29.2626780Z Got: 2025-12-04T10:08:29.2626836Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2626882Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2626929Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2626974Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2627022Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2627025Z 2025-12-04T10:08:29.2627069Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2627116Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2627160Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2627205Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2627254Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2627256Z 2025-12-04T10:08:29.2627258Z 2025-12-04T10:08:29.2627302Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2627347Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2627391Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2627435Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2627483Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2627485Z 2025-12-04T10:08:29.2627530Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2627575Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2627620Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2627666Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2627728Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2627769Z dtype=torch.float64) 2025-12-04T10:08:29.2627771Z 2025-12-04T10:08:29.2627805Z Expected: 2025-12-04T10:08:29.2627859Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2627914Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2627962Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2628005Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2628074Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2628076Z 2025-12-04T10:08:29.2628122Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2628183Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2628228Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2628273Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2628321Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2628323Z 2025-12-04T10:08:29.2628325Z 2025-12-04T10:08:29.2628370Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2628414Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2628458Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2628503Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2628554Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2628557Z 2025-12-04T10:08:29.2628604Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2628648Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2628694Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2628737Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2628800Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2628840Z dtype=torch.float64) 2025-12-04T10:08:29.2628842Z 2025-12-04T10:08:29.2629128Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2629130Z 2025-12-04T10:08:29.2629204Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2629405Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2629407Z 2025-12-04T10:08:29.2629494Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2629666Z FAILED [0.0286s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2629668Z 2025-12-04T10:08:29.2629761Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2629841Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2629920Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2629923Z 2025-12-04T10:08:29.2630007Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2630110Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2630146Z If the test 2025-12-04T10:08:29.2630239Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2630299Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2630395Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2630476Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2630478Z 2025-12-04T10:08:29.2630568Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2630657Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2630692Z the following. 2025-12-04T10:08:29.2630694Z 2025-12-04T10:08:29.2630795Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2630886Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2630961Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2631024Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2631085Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2631098Z 2025-12-04T10:08:29.2631131Z Got: 2025-12-04T10:08:29.2631186Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2631231Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2631278Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2631322Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2631370Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2631371Z 2025-12-04T10:08:29.2631417Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2631462Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2631507Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2631556Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2631605Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2631607Z 2025-12-04T10:08:29.2631611Z 2025-12-04T10:08:29.2631657Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2631700Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2631745Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2631789Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2631836Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2631838Z 2025-12-04T10:08:29.2631883Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2631928Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2631972Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2632018Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2632081Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2632123Z dtype=torch.float64) 2025-12-04T10:08:29.2632126Z 2025-12-04T10:08:29.2632162Z Expected: 2025-12-04T10:08:29.2632215Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2632260Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2632305Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2632350Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2632396Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2632398Z 2025-12-04T10:08:29.2632443Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2632488Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2632534Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2632580Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2632630Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2632631Z 2025-12-04T10:08:29.2632633Z 2025-12-04T10:08:29.2632677Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2632723Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2632766Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2632810Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2632856Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2632858Z 2025-12-04T10:08:29.2632903Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2632987Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2633049Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2633094Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2633188Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2633229Z dtype=torch.float64) 2025-12-04T10:08:29.2633230Z 2025-12-04T10:08:29.2633516Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2633532Z 2025-12-04T10:08:29.2633606Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2633804Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2633806Z 2025-12-04T10:08:29.2633893Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2634066Z FAILED [0.0269s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2634069Z 2025-12-04T10:08:29.2634161Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2634241Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2634321Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2634323Z 2025-12-04T10:08:29.2634408Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2634509Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2634544Z If the test 2025-12-04T10:08:29.2634637Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2634698Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2634793Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2634876Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2634878Z 2025-12-04T10:08:29.2634967Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2635051Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2635089Z the following. 2025-12-04T10:08:29.2635091Z 2025-12-04T10:08:29.2635180Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2635271Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2635323Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2635384Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2635448Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2635450Z 2025-12-04T10:08:29.2635482Z Got: 2025-12-04T10:08:29.2635537Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2635584Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2635631Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2635675Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2635724Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2635726Z 2025-12-04T10:08:29.2635770Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2635816Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2635860Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2635908Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2635957Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2635959Z 2025-12-04T10:08:29.2635973Z 2025-12-04T10:08:29.2636021Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2636064Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2636128Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2636173Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2636220Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2636232Z 2025-12-04T10:08:29.2636278Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2636322Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2636369Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2636413Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2636476Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2636516Z dtype=torch.float64) 2025-12-04T10:08:29.2636518Z 2025-12-04T10:08:29.2636556Z Expected: 2025-12-04T10:08:29.2636608Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2636653Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2636702Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2636747Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2636793Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2636795Z 2025-12-04T10:08:29.2636840Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2636884Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2636930Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2636974Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2637024Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2637026Z 2025-12-04T10:08:29.2637028Z 2025-12-04T10:08:29.2637073Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2637117Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2637160Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2637207Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2637254Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2637257Z 2025-12-04T10:08:29.2637303Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2637350Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2637397Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2637443Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2637505Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2637545Z dtype=torch.float64) 2025-12-04T10:08:29.2637548Z 2025-12-04T10:08:29.2637833Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2637836Z 2025-12-04T10:08:29.2637910Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2638107Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2638110Z 2025-12-04T10:08:29.2638197Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2638367Z FAILED [0.0270s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2638370Z 2025-12-04T10:08:29.2638463Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2638554Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2638633Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2638635Z 2025-12-04T10:08:29.2638748Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2638849Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2638885Z If the test 2025-12-04T10:08:29.2638989Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2639051Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2639145Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2639227Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2639229Z 2025-12-04T10:08:29.2639320Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2639407Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2639445Z the following. 2025-12-04T10:08:29.2639447Z 2025-12-04T10:08:29.2639537Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2639628Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2639681Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2639745Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2639806Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2639808Z 2025-12-04T10:08:29.2639840Z Got: 2025-12-04T10:08:29.2639895Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2639940Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2639987Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2640031Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2640079Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2640081Z 2025-12-04T10:08:29.2640125Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2640172Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2640216Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2640262Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2640312Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2640313Z 2025-12-04T10:08:29.2640316Z 2025-12-04T10:08:29.2640360Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2640405Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2640448Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2640492Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2640539Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2640542Z 2025-12-04T10:08:29.2640588Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2640631Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2640678Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2640722Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2640785Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2640827Z dtype=torch.float64) 2025-12-04T10:08:29.2640829Z 2025-12-04T10:08:29.2640863Z Expected: 2025-12-04T10:08:29.2640916Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2640961Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2641006Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2641050Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2641110Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2641112Z 2025-12-04T10:08:29.2641159Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2641203Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2641277Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2641322Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2641371Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2641385Z 2025-12-04T10:08:29.2641387Z 2025-12-04T10:08:29.2641432Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2641478Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2641521Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2641566Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2641612Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2641614Z 2025-12-04T10:08:29.2641661Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2641706Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2641750Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2641799Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2641860Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2641902Z dtype=torch.float64) 2025-12-04T10:08:29.2641904Z 2025-12-04T10:08:29.2642187Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2642189Z 2025-12-04T10:08:29.2642263Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2642462Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2642465Z 2025-12-04T10:08:29.2642551Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2642723Z FAILED [0.0268s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2642725Z 2025-12-04T10:08:29.2642817Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2642902Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2643027Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2643029Z 2025-12-04T10:08:29.2643115Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2643215Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2643251Z If the test 2025-12-04T10:08:29.2643345Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2643406Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2643501Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2643583Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2643585Z 2025-12-04T10:08:29.2643677Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2643761Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2643796Z the following. 2025-12-04T10:08:29.2643798Z 2025-12-04T10:08:29.2643886Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2643975Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2644026Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2644103Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2644164Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2644180Z 2025-12-04T10:08:29.2644212Z Got: 2025-12-04T10:08:29.2644282Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2644328Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2644375Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2644432Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2644480Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2644483Z 2025-12-04T10:08:29.2644527Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2644573Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2644618Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2644662Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2644713Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2644715Z 2025-12-04T10:08:29.2644716Z 2025-12-04T10:08:29.2644764Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2644809Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2644856Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2644901Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2644947Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2644949Z 2025-12-04T10:08:29.2644994Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2645038Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2645083Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2645126Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2645190Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2645231Z dtype=torch.float64) 2025-12-04T10:08:29.2645233Z 2025-12-04T10:08:29.2645267Z Expected: 2025-12-04T10:08:29.2645322Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2645367Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2645413Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2645458Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2645504Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2645506Z 2025-12-04T10:08:29.2645551Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2645596Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2645641Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2645686Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2645736Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2645738Z 2025-12-04T10:08:29.2645740Z 2025-12-04T10:08:29.2645785Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2645830Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2645874Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2645917Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2645964Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2645966Z 2025-12-04T10:08:29.2646011Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2646055Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2646099Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2646144Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2646205Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2646257Z dtype=torch.float64) 2025-12-04T10:08:29.2646259Z 2025-12-04T10:08:29.2646558Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2646571Z 2025-12-04T10:08:29.2646645Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2646858Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2646860Z 2025-12-04T10:08:29.2646946Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2647117Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2647121Z 2025-12-04T10:08:29.2647216Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2647296Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2647375Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2647377Z 2025-12-04T10:08:29.2647462Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2647563Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2647600Z If the test 2025-12-04T10:08:29.2647693Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2647755Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2647848Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2647929Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2647931Z 2025-12-04T10:08:29.2648021Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2648106Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2648143Z the following. 2025-12-04T10:08:29.2648145Z 2025-12-04T10:08:29.2648233Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2648322Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2648375Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2648438Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2648501Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2648503Z 2025-12-04T10:08:29.2648535Z Got: 2025-12-04T10:08:29.2648590Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2648637Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2648684Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2648729Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2648775Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2648779Z 2025-12-04T10:08:29.2648824Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2648868Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2648913Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2648959Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2649009Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2649011Z 2025-12-04T10:08:29.2649013Z 2025-12-04T10:08:29.2649057Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2649101Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2649145Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2649200Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2649248Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2649250Z 2025-12-04T10:08:29.2649323Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2649368Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2649412Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2649471Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2649535Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2649575Z dtype=torch.float64) 2025-12-04T10:08:29.2649577Z 2025-12-04T10:08:29.2649612Z Expected: 2025-12-04T10:08:29.2649665Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2649710Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2649754Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2649800Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2649846Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2649849Z 2025-12-04T10:08:29.2649897Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2649944Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2649993Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2650040Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2650089Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2650091Z 2025-12-04T10:08:29.2650093Z 2025-12-04T10:08:29.2650138Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2650181Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2650226Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2650269Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2650316Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2650318Z 2025-12-04T10:08:29.2650362Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2650408Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2650452Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2650498Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2650560Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2650601Z dtype=torch.float64) 2025-12-04T10:08:29.2650603Z 2025-12-04T10:08:29.2650889Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2650891Z 2025-12-04T10:08:29.2650965Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2651164Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2651170Z 2025-12-04T10:08:29.2651255Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2651427Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2651430Z 2025-12-04T10:08:29.2651522Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2651603Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2651681Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2651683Z 2025-12-04T10:08:29.2651769Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2651883Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2651919Z If the test 2025-12-04T10:08:29.2652021Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2652095Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2652188Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2652280Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2652281Z 2025-12-04T10:08:29.2652374Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2652458Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2652493Z the following. 2025-12-04T10:08:29.2652495Z 2025-12-04T10:08:29.2652584Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2652674Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2652726Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2652789Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2652852Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2652854Z 2025-12-04T10:08:29.2652887Z Got: 2025-12-04T10:08:29.2652978Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2653025Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2653071Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2653117Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2653163Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2653167Z 2025-12-04T10:08:29.2653212Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2653256Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2653302Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2653346Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2653397Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2653399Z 2025-12-04T10:08:29.2653401Z 2025-12-04T10:08:29.2653445Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2653489Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2653533Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2653578Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2653624Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2653625Z 2025-12-04T10:08:29.2653671Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2653714Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2653760Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2653804Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2653867Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2653909Z dtype=torch.float64) 2025-12-04T10:08:29.2653911Z 2025-12-04T10:08:29.2653946Z Expected: 2025-12-04T10:08:29.2653999Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2654044Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2654090Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2654135Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2654183Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2654186Z 2025-12-04T10:08:29.2654230Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2654275Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2654319Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2654383Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2654433Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2654448Z 2025-12-04T10:08:29.2654463Z 2025-12-04T10:08:29.2654509Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2654552Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2654596Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2654654Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2654700Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2654704Z 2025-12-04T10:08:29.2654748Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2654793Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2654837Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2654883Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2654945Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2654986Z dtype=torch.float64) 2025-12-04T10:08:29.2654989Z 2025-12-04T10:08:29.2655286Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2655290Z 2025-12-04T10:08:29.2655363Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2655565Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2655567Z 2025-12-04T10:08:29.2655653Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2655827Z FAILED [0.0267s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2655829Z 2025-12-04T10:08:29.2655922Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2656006Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2656083Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2656087Z 2025-12-04T10:08:29.2656171Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2656272Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2656307Z If the test 2025-12-04T10:08:29.2656400Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2656461Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2656554Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2656637Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2656639Z 2025-12-04T10:08:29.2656730Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2656815Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2656851Z the following. 2025-12-04T10:08:29.2656853Z 2025-12-04T10:08:29.2656943Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2657033Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2657084Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2657148Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2657209Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2657210Z 2025-12-04T10:08:29.2657243Z Got: 2025-12-04T10:08:29.2657307Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2657355Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2657400Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2657466Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2657514Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2657516Z 2025-12-04T10:08:29.2657561Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2657616Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2657661Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2657706Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2657756Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2657758Z 2025-12-04T10:08:29.2657759Z 2025-12-04T10:08:29.2657803Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2657848Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2657892Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2657937Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2657984Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2657986Z 2025-12-04T10:08:29.2658031Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2658075Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2658121Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2658165Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2658227Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2658268Z dtype=torch.float64) 2025-12-04T10:08:29.2658271Z 2025-12-04T10:08:29.2658305Z Expected: 2025-12-04T10:08:29.2658358Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2658403Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2658449Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2658493Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2658541Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2658544Z 2025-12-04T10:08:29.2658587Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2658633Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2658677Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2658726Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2658774Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2658775Z 2025-12-04T10:08:29.2658777Z 2025-12-04T10:08:29.2658822Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2658866Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2658911Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2658955Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2659002Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2659005Z 2025-12-04T10:08:29.2659049Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2659094Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2659140Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2659186Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2659247Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2659288Z dtype=torch.float64) 2025-12-04T10:08:29.2659289Z 2025-12-04T10:08:29.2659596Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2659600Z 2025-12-04T10:08:29.2659673Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2659893Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2659895Z 2025-12-04T10:08:29.2659981Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2660164Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2660166Z 2025-12-04T10:08:29.2660258Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2660339Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2660418Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2660421Z 2025-12-04T10:08:29.2660505Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2660607Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2660644Z If the test 2025-12-04T10:08:29.2660737Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2660799Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2660893Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2660975Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2660977Z 2025-12-04T10:08:29.2661069Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2661154Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2661190Z the following. 2025-12-04T10:08:29.2661192Z 2025-12-04T10:08:29.2661281Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2661371Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2661424Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2661488Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2661547Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2661550Z 2025-12-04T10:08:29.2661583Z Got: 2025-12-04T10:08:29.2661637Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2661683Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2661729Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2661773Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2661819Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2661822Z 2025-12-04T10:08:29.2661869Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2661913Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2661958Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2662004Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2662055Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2662057Z 2025-12-04T10:08:29.2662059Z 2025-12-04T10:08:29.2662106Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2662150Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2662194Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2662239Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2662284Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2662287Z 2025-12-04T10:08:29.2662331Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2662390Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2662435Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2662480Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2662569Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2662611Z dtype=torch.float64) 2025-12-04T10:08:29.2662613Z 2025-12-04T10:08:29.2662647Z Expected: 2025-12-04T10:08:29.2662711Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2662755Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2662800Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2662844Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2662891Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2662893Z 2025-12-04T10:08:29.2662989Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2663035Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2663079Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2663124Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2663176Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2663178Z 2025-12-04T10:08:29.2663180Z 2025-12-04T10:08:29.2663225Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2663269Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2663313Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2663357Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2663403Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2663405Z 2025-12-04T10:08:29.2665172Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2665223Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2665269Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2665318Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2665390Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2665431Z dtype=torch.float64) 2025-12-04T10:08:29.2665433Z 2025-12-04T10:08:29.2665723Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2665728Z 2025-12-04T10:08:29.2665801Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2666003Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2666005Z 2025-12-04T10:08:29.2666090Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2666261Z FAILED [0.0269s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2666265Z 2025-12-04T10:08:29.2666356Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2666438Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2666516Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2666518Z 2025-12-04T10:08:29.2666604Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2666705Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2666741Z If the test 2025-12-04T10:08:29.2666835Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2666919Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2667015Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2667113Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2667128Z 2025-12-04T10:08:29.2667221Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2667304Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2667357Z the following. 2025-12-04T10:08:29.2667359Z 2025-12-04T10:08:29.2667447Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2667538Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2667589Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2667653Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2667712Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2667715Z 2025-12-04T10:08:29.2667748Z Got: 2025-12-04T10:08:29.2667802Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2667852Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2667900Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2667944Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2667993Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2667999Z 2025-12-04T10:08:29.2668044Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2668089Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2668134Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2668178Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2668229Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2668230Z 2025-12-04T10:08:29.2668232Z 2025-12-04T10:08:29.2668278Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2668322Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2668368Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2668412Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2668460Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2668463Z 2025-12-04T10:08:29.2668508Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2668552Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2668595Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2668640Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2668702Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2668744Z dtype=torch.float64) 2025-12-04T10:08:29.2668746Z 2025-12-04T10:08:29.2668780Z Expected: 2025-12-04T10:08:29.2668834Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2668878Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2668926Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2668969Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2669016Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2669019Z 2025-12-04T10:08:29.2669064Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2669109Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2669152Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2669198Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2669246Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2669248Z 2025-12-04T10:08:29.2669250Z 2025-12-04T10:08:29.2669307Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2669354Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2669400Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2669467Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2669514Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2669516Z 2025-12-04T10:08:29.2669560Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2669632Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2669676Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2669720Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2669783Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2669824Z dtype=torch.float64) 2025-12-04T10:08:29.2669826Z 2025-12-04T10:08:29.2670115Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2670118Z 2025-12-04T10:08:29.2670191Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2670389Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2670395Z 2025-12-04T10:08:29.2670481Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2670652Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2670654Z 2025-12-04T10:08:29.2670746Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2670828Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2670906Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2670908Z 2025-12-04T10:08:29.2670993Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2671096Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2671132Z If the test 2025-12-04T10:08:29.2671225Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2671286Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2671383Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2671464Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2671466Z 2025-12-04T10:08:29.2671558Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2671643Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2671679Z the following. 2025-12-04T10:08:29.2671681Z 2025-12-04T10:08:29.2671770Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2671860Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2671912Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2671975Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2672036Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2672038Z 2025-12-04T10:08:29.2672071Z Got: 2025-12-04T10:08:29.2672124Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2672171Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2672216Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2672262Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2672320Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2672325Z 2025-12-04T10:08:29.2672371Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2672442Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2672488Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2672533Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2672596Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2672598Z 2025-12-04T10:08:29.2672600Z 2025-12-04T10:08:29.2672645Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2672688Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2672732Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2672776Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2672823Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2672826Z 2025-12-04T10:08:29.2672870Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2672915Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2672999Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2673045Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2673109Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2673152Z dtype=torch.float64) 2025-12-04T10:08:29.2673154Z 2025-12-04T10:08:29.2673187Z Expected: 2025-12-04T10:08:29.2673240Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2673284Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2673330Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2673374Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2673421Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2673424Z 2025-12-04T10:08:29.2673468Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2673513Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2673559Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2673604Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2673654Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2673658Z 2025-12-04T10:08:29.2673660Z 2025-12-04T10:08:29.2673705Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2673749Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2673794Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2673838Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2673885Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2673886Z 2025-12-04T10:08:29.2673932Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2673977Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2674021Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2674067Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2674129Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2674169Z dtype=torch.float64) 2025-12-04T10:08:29.2674172Z 2025-12-04T10:08:29.2674459Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2674462Z 2025-12-04T10:08:29.2674534Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2674752Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2674754Z 2025-12-04T10:08:29.2674840Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2675040Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2675042Z 2025-12-04T10:08:29.2675135Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2675230Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2675309Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2675312Z 2025-12-04T10:08:29.2675395Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2675497Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2675532Z If the test 2025-12-04T10:08:29.2675627Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2675687Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2675787Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2675868Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2675870Z 2025-12-04T10:08:29.2675960Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2676045Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2676082Z the following. 2025-12-04T10:08:29.2676084Z 2025-12-04T10:08:29.2676173Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2676262Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2676313Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2676376Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2676436Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2676438Z 2025-12-04T10:08:29.2676472Z Got: 2025-12-04T10:08:29.2676527Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2676573Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2676619Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2676665Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2676711Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2676714Z 2025-12-04T10:08:29.2676759Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2676804Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2676848Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2676894Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2676944Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2676946Z 2025-12-04T10:08:29.2676948Z 2025-12-04T10:08:29.2676993Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2677038Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2677082Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2677126Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2677174Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2677176Z 2025-12-04T10:08:29.2677220Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2677265Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2677308Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2677352Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2677425Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2677468Z dtype=torch.float64) 2025-12-04T10:08:29.2677470Z 2025-12-04T10:08:29.2677504Z Expected: 2025-12-04T10:08:29.2677580Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2677625Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2677671Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2677714Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2677772Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2677773Z 2025-12-04T10:08:29.2677818Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2677863Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2677907Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2677952Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2678001Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2678005Z 2025-12-04T10:08:29.2678006Z 2025-12-04T10:08:29.2678051Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2678098Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2678141Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2678185Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2678235Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2678237Z 2025-12-04T10:08:29.2678284Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2678327Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2678371Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2678415Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2678477Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2678518Z dtype=torch.float64) 2025-12-04T10:08:29.2678519Z 2025-12-04T10:08:29.2678805Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2678808Z 2025-12-04T10:08:29.2678880Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2679080Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2679083Z 2025-12-04T10:08:29.2679169Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2679340Z FAILED [0.0261s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2679342Z 2025-12-04T10:08:29.2679435Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2679515Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2679595Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2679598Z 2025-12-04T10:08:29.2679682Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2679783Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2679819Z If the test 2025-12-04T10:08:29.2679913Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2679973Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2680068Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2680149Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2680151Z 2025-12-04T10:08:29.2680255Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2680342Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2680408Z the following. 2025-12-04T10:08:29.2680410Z 2025-12-04T10:08:29.2680499Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2680589Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2680650Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2680715Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2680776Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2680778Z 2025-12-04T10:08:29.2680810Z Got: 2025-12-04T10:08:29.2680864Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2680910Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2680959Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2681003Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2681050Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2681055Z 2025-12-04T10:08:29.2681100Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2681145Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2681189Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2681236Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2681284Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2681286Z 2025-12-04T10:08:29.2681288Z 2025-12-04T10:08:29.2681333Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2681376Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2681420Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2681465Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2681511Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2681513Z 2025-12-04T10:08:29.2681559Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2681604Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2681648Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2681693Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2681756Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2681797Z dtype=torch.float64) 2025-12-04T10:08:29.2681799Z 2025-12-04T10:08:29.2681833Z Expected: 2025-12-04T10:08:29.2681889Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2681933Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2681979Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2682023Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2682070Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2682072Z 2025-12-04T10:08:29.2682118Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2682163Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2682208Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2682254Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2682304Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2682305Z 2025-12-04T10:08:29.2682307Z 2025-12-04T10:08:29.2682351Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2682396Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2682439Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2682483Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2682540Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2682543Z 2025-12-04T10:08:29.2682589Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2682654Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2682700Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2682744Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2682816Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2682856Z dtype=torch.float64) 2025-12-04T10:08:29.2682858Z 2025-12-04T10:08:29.2683187Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2683189Z 2025-12-04T10:08:29.2683263Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2683461Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2683465Z 2025-12-04T10:08:29.2683552Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2683725Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2683728Z 2025-12-04T10:08:29.2683822Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2683902Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2683980Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2683982Z 2025-12-04T10:08:29.2684064Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2684167Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2684201Z If the test 2025-12-04T10:08:29.2684295Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2684357Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2684451Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2684533Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2684535Z 2025-12-04T10:08:29.2684626Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2684710Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2684746Z the following. 2025-12-04T10:08:29.2684748Z 2025-12-04T10:08:29.2684837Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2684928Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2684980Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2685042Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2685104Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2685106Z 2025-12-04T10:08:29.2685138Z Got: 2025-12-04T10:08:29.2685193Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2685239Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2685286Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2685330Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2685377Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2685379Z 2025-12-04T10:08:29.2685423Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2685468Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2685530Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2685577Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2685626Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2685656Z 2025-12-04T10:08:29.2685658Z 2025-12-04T10:08:29.2685703Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2685747Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2685804Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2685848Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2685895Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2685897Z 2025-12-04T10:08:29.2685941Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2685985Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2686029Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2686075Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2686137Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2686181Z dtype=torch.float64) 2025-12-04T10:08:29.2686184Z 2025-12-04T10:08:29.2686219Z Expected: 2025-12-04T10:08:29.2686271Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2686317Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2686362Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2686406Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2686453Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2686454Z 2025-12-04T10:08:29.2686499Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2686543Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2686587Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2686632Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2686681Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2686684Z 2025-12-04T10:08:29.2686685Z 2025-12-04T10:08:29.2686730Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2686775Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2686818Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2686863Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2686908Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2686910Z 2025-12-04T10:08:29.2686957Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2687000Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2687045Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2687090Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2687153Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2687193Z dtype=torch.float64) 2025-12-04T10:08:29.2687196Z 2025-12-04T10:08:29.2687486Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2687489Z 2025-12-04T10:08:29.2687562Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2687759Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2687761Z 2025-12-04T10:08:29.2687847Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2688032Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2688035Z 2025-12-04T10:08:29.2688128Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2688231Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2688310Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2688312Z 2025-12-04T10:08:29.2688410Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2688512Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2688546Z If the test 2025-12-04T10:08:29.2688640Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2688700Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2688794Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2688876Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2688879Z 2025-12-04T10:08:29.2688970Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2689059Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2689094Z the following. 2025-12-04T10:08:29.2689096Z 2025-12-04T10:08:29.2689187Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2689278Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2689329Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2689392Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2689453Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2689455Z 2025-12-04T10:08:29.2689487Z Got: 2025-12-04T10:08:29.2689542Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2689587Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2689634Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2689680Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2689728Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2689730Z 2025-12-04T10:08:29.2689774Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2689820Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2689864Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2689909Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2689958Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2689960Z 2025-12-04T10:08:29.2689962Z 2025-12-04T10:08:29.2690006Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2690051Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2690094Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2690138Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2690186Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2690188Z 2025-12-04T10:08:29.2690233Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2690277Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2690324Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2690367Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2690430Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2690470Z dtype=torch.float64) 2025-12-04T10:08:29.2690472Z 2025-12-04T10:08:29.2690507Z Expected: 2025-12-04T10:08:29.2690559Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2690622Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2690668Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2690717Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2690799Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2690801Z 2025-12-04T10:08:29.2690846Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2690890Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2690949Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2690993Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2691042Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2691044Z 2025-12-04T10:08:29.2691046Z 2025-12-04T10:08:29.2691089Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2691133Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2691177Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2691222Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2691267Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2691272Z 2025-12-04T10:08:29.2691318Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2691362Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2691406Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2691451Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2691513Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2691553Z dtype=torch.float64) 2025-12-04T10:08:29.2691556Z 2025-12-04T10:08:29.2691844Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2691846Z 2025-12-04T10:08:29.2691920Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2692119Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2692122Z 2025-12-04T10:08:29.2692208Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2692380Z FAILED [0.0266s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2692382Z 2025-12-04T10:08:29.2692475Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2692555Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2692635Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2692637Z 2025-12-04T10:08:29.2692721Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2692823Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2692860Z If the test 2025-12-04T10:08:29.2692988Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2693049Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2693144Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2693227Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2693229Z 2025-12-04T10:08:29.2693319Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2693404Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2693439Z the following. 2025-12-04T10:08:29.2693441Z 2025-12-04T10:08:29.2693556Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2693646Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2693726Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2693789Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2693850Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2693865Z 2025-12-04T10:08:29.2693897Z Got: 2025-12-04T10:08:29.2693952Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2693998Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2694044Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2694088Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2694136Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2694138Z 2025-12-04T10:08:29.2694183Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2694228Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2694272Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2694321Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2694370Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2694372Z 2025-12-04T10:08:29.2694374Z 2025-12-04T10:08:29.2694420Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2694464Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2694507Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2694552Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2694597Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2694599Z 2025-12-04T10:08:29.2694645Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2694689Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2694734Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2694778Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2694842Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2694883Z dtype=torch.float64) 2025-12-04T10:08:29.2694885Z 2025-12-04T10:08:29.2694921Z Expected: 2025-12-04T10:08:29.2694974Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2695020Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2695064Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2695108Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2695154Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2695156Z 2025-12-04T10:08:29.2695202Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2695247Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2695291Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2695336Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2695386Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2695389Z 2025-12-04T10:08:29.2695390Z 2025-12-04T10:08:29.2695434Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2695479Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2695522Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2695567Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2695612Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2695615Z 2025-12-04T10:08:29.2695660Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2695704Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2695760Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2695806Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2695879Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2695931Z dtype=torch.float64) 2025-12-04T10:08:29.2695933Z 2025-12-04T10:08:29.2696223Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2696237Z 2025-12-04T10:08:29.2696311Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2696510Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2696512Z 2025-12-04T10:08:29.2696600Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2696771Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2696775Z 2025-12-04T10:08:29.2696868Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2696948Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2697028Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2697030Z 2025-12-04T10:08:29.2697115Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2697215Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2697251Z If the test 2025-12-04T10:08:29.2697344Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2697407Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2697501Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2697583Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2697587Z 2025-12-04T10:08:29.2697677Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2697762Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2697798Z the following. 2025-12-04T10:08:29.2697800Z 2025-12-04T10:08:29.2697888Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2697977Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2698030Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2698092Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2698153Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2698155Z 2025-12-04T10:08:29.2698187Z Got: 2025-12-04T10:08:29.2698242Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2698287Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2698336Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2698380Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2698427Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2698432Z 2025-12-04T10:08:29.2698477Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2698522Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2698566Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2698612Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2698661Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2698663Z 2025-12-04T10:08:29.2698665Z 2025-12-04T10:08:29.2698719Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2698764Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2698830Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2698875Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2698921Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2698923Z 2025-12-04T10:08:29.2698981Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2699024Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2699069Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2699112Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2699175Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2699215Z dtype=torch.float64) 2025-12-04T10:08:29.2699217Z 2025-12-04T10:08:29.2699251Z Expected: 2025-12-04T10:08:29.2699304Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2699350Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2699396Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2699440Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2699487Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2699489Z 2025-12-04T10:08:29.2699535Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2699581Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2699630Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2699675Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2699724Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2699726Z 2025-12-04T10:08:29.2699728Z 2025-12-04T10:08:29.2699772Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2699817Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2699861Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2699907Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2699954Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2699956Z 2025-12-04T10:08:29.2700000Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2700046Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2700089Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2700134Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2700194Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2700235Z dtype=torch.float64) 2025-12-04T10:08:29.2700237Z 2025-12-04T10:08:29.2700523Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2700526Z 2025-12-04T10:08:29.2700600Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2700797Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2700801Z 2025-12-04T10:08:29.2700886Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2701056Z FAILED [0.0265s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2701059Z 2025-12-04T10:08:29.2701151Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2701250Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2701328Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2701331Z 2025-12-04T10:08:29.2701425Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2701538Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2701574Z If the test 2025-12-04T10:08:29.2701667Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2701738Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2701831Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2701913Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2701915Z 2025-12-04T10:08:29.2702004Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2702092Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2702127Z the following. 2025-12-04T10:08:29.2702129Z 2025-12-04T10:08:29.2702219Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2702311Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2702363Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2702426Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2702487Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2702489Z 2025-12-04T10:08:29.2702521Z Got: 2025-12-04T10:08:29.2702576Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2702622Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2702669Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2702713Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2702762Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2702763Z 2025-12-04T10:08:29.2702809Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2702855Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2702899Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2702983Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2703033Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2703036Z 2025-12-04T10:08:29.2703038Z 2025-12-04T10:08:29.2703082Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2703126Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2703169Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2703216Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2703263Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2703265Z 2025-12-04T10:08:29.2703311Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2703354Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2703401Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2703445Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2703508Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2703549Z dtype=torch.float64) 2025-12-04T10:08:29.2703551Z 2025-12-04T10:08:29.2703587Z Expected: 2025-12-04T10:08:29.2703639Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2703684Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2703729Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2703773Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2703819Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2703845Z 2025-12-04T10:08:29.2703891Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2703936Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2704024Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2704070Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2704120Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2704141Z 2025-12-04T10:08:29.2704143Z 2025-12-04T10:08:29.2704188Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2704232Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2704276Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2704320Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2704368Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2704370Z 2025-12-04T10:08:29.2704415Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2704461Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2704507Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2704556Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2704617Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2704658Z dtype=torch.float64) 2025-12-04T10:08:29.2704661Z 2025-12-04T10:08:29.2704955Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2704958Z 2025-12-04T10:08:29.2705033Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2705235Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2705238Z 2025-12-04T10:08:29.2705323Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2705496Z FAILED [0.0262s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2705499Z 2025-12-04T10:08:29.2705590Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2705671Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2705749Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2705751Z 2025-12-04T10:08:29.2705838Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2705940Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2705976Z If the test 2025-12-04T10:08:29.2706070Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2706132Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2706228Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2706313Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2706315Z 2025-12-04T10:08:29.2706404Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2706492Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2706528Z the following. 2025-12-04T10:08:29.2706530Z 2025-12-04T10:08:29.2706619Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2706710Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2706763Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2706836Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2706899Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2706901Z 2025-12-04T10:08:29.2706945Z Got: 2025-12-04T10:08:29.2707011Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2707063Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2707110Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2707166Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2707213Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2707214Z 2025-12-04T10:08:29.2707260Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2707304Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2707349Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2707393Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2707443Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2707445Z 2025-12-04T10:08:29.2707447Z 2025-12-04T10:08:29.2707491Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2707539Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2707582Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2707627Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2707673Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2707675Z 2025-12-04T10:08:29.2707724Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2707768Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2707812Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2707856Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2707920Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2707961Z dtype=torch.float64) 2025-12-04T10:08:29.2707963Z 2025-12-04T10:08:29.2707997Z Expected: 2025-12-04T10:08:29.2708050Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2708097Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2708143Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2708188Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2708235Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2708238Z 2025-12-04T10:08:29.2708282Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2708327Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2708370Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2708415Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2708464Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2708467Z 2025-12-04T10:08:29.2708469Z 2025-12-04T10:08:29.2708516Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2708562Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2708606Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2708649Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2708697Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2708700Z 2025-12-04T10:08:29.2708744Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2708789Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2708832Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2708877Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2708938Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2708979Z dtype=torch.float64) 2025-12-04T10:08:29.2708994Z 2025-12-04T10:08:29.2709291Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2709304Z 2025-12-04T10:08:29.2709378Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2709596Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2709598Z 2025-12-04T10:08:29.2709683Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2709853Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2709855Z 2025-12-04T10:08:29.2709948Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2710028Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2710108Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2710110Z 2025-12-04T10:08:29.2710194Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2710295Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2710331Z If the test 2025-12-04T10:08:29.2710425Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2710487Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2710581Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2710663Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2710665Z 2025-12-04T10:08:29.2710756Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2710841Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2710877Z the following. 2025-12-04T10:08:29.2710881Z 2025-12-04T10:08:29.2710970Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2711061Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2711113Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2711177Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2711237Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2711239Z 2025-12-04T10:08:29.2711272Z Got: 2025-12-04T10:08:29.2711326Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2711372Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2711418Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2711463Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2711509Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2711512Z 2025-12-04T10:08:29.2711557Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2711602Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2711646Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2711692Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2711741Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2711743Z 2025-12-04T10:08:29.2711745Z 2025-12-04T10:08:29.2711789Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2711833Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2711876Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2711933Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2711981Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2711982Z 2025-12-04T10:08:29.2712029Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2712099Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2712148Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2712192Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2712270Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2712310Z dtype=torch.float64) 2025-12-04T10:08:29.2712313Z 2025-12-04T10:08:29.2712348Z Expected: 2025-12-04T10:08:29.2712401Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2712445Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2712492Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2712540Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2712588Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2712590Z 2025-12-04T10:08:29.2712637Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2712682Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2712729Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2712776Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2712825Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2712827Z 2025-12-04T10:08:29.2712828Z 2025-12-04T10:08:29.2712875Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2712920Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2713009Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2713056Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2713103Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2713105Z 2025-12-04T10:08:29.2713149Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2713195Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2713238Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2713285Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2713347Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2713388Z dtype=torch.float64) 2025-12-04T10:08:29.2713390Z 2025-12-04T10:08:29.2713678Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2713682Z 2025-12-04T10:08:29.2713754Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2713955Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2713958Z 2025-12-04T10:08:29.2714044Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2714215Z FAILED [0.0264s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2714218Z 2025-12-04T10:08:29.2714309Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2714389Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2714467Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2714469Z 2025-12-04T10:08:29.2714554Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2714680Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2714717Z If the test 2025-12-04T10:08:29.2714809Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2714900Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2714994Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2715078Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2715092Z 2025-12-04T10:08:29.2715184Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2715267Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2715305Z the following. 2025-12-04T10:08:29.2715307Z 2025-12-04T10:08:29.2715396Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2715487Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2715538Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2715601Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2715664Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2715666Z 2025-12-04T10:08:29.2715699Z Got: 2025-12-04T10:08:29.2715754Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2715801Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2715846Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2715891Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2715939Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2715941Z 2025-12-04T10:08:29.2715988Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2716032Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2716078Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2716122Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2716172Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2716174Z 2025-12-04T10:08:29.2716177Z 2025-12-04T10:08:29.2716222Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2716267Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2716312Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2716432Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2716478Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2716480Z 2025-12-04T10:08:29.2716524Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2716569Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2716612Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2716661Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2716723Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2716765Z dtype=torch.float64) 2025-12-04T10:08:29.2716768Z 2025-12-04T10:08:29.2716802Z Expected: 2025-12-04T10:08:29.2716859Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2716903Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2716949Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2716994Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2717041Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2717043Z 2025-12-04T10:08:29.2717087Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2717132Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2717175Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2717232Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2717281Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2717294Z 2025-12-04T10:08:29.2717296Z 2025-12-04T10:08:29.2717352Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2717396Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2717440Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2717496Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2717543Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2717545Z 2025-12-04T10:08:29.2717589Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2717634Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2717677Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2717724Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2717788Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2717828Z dtype=torch.float64) 2025-12-04T10:08:29.2717832Z 2025-12-04T10:08:29.2718119Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2718122Z 2025-12-04T10:08:29.2718195Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2718394Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2718395Z 2025-12-04T10:08:29.2718479Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2718651Z FAILED [0.0263s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_grad_cholesky_solve_cuda_float64 - Exception: For output 0 and input 0: 2025-12-04T10:08:29.2718653Z 2025-12-04T10:08:29.2718745Z gradcheck or gradgradcheck failed while testing batched gradient computation. 2025-12-04T10:08:29.2718827Z This could have been invoked in a number of ways (via a test that calls 2025-12-04T10:08:29.2718905Z gradcheck/gradgradcheck directly or via an autogenerated test). 2025-12-04T10:08:29.2718908Z 2025-12-04T10:08:29.2718992Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2719093Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck. 2025-12-04T10:08:29.2719127Z If the test 2025-12-04T10:08:29.2719220Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2719280Z with `check_batched_grad=False` as a keyword argument. 2025-12-04T10:08:29.2719374Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2719459Z to have `check_batched_grad=False` and/or `check_batched_gradgrad=False`. 2025-12-04T10:08:29.2719461Z 2025-12-04T10:08:29.2719554Z If you're modifying an existing operator that supports batched grad computation, 2025-12-04T10:08:29.2719640Z or wish to make a new operator work with batched grad computation, please read 2025-12-04T10:08:29.2719677Z the following. 2025-12-04T10:08:29.2719679Z 2025-12-04T10:08:29.2719767Z To compute batched grads (e.g., jacobians, hessians), we vmap over the backward 2025-12-04T10:08:29.2719857Z computation. The most common failure case is if there is a 'vmap-incompatible 2025-12-04T10:08:29.2719907Z operation' in the backward pass. Please see 2025-12-04T10:08:29.2719971Z NOTE: [How to write vmap-compatible backward formulas] 2025-12-04T10:08:29.2720031Z in the codebase for an explanation of how to fix this. 2025-12-04T10:08:29.2720033Z 2025-12-04T10:08:29.2720066Z Got: 2025-12-04T10:08:29.2720120Z tensor([[[[-0.2719, 0.4024, -0.2887, -2.0576, 0.8618], 2025-12-04T10:08:29.2720180Z [-0.8466, 0.4574, -0.5940, -0.5961, 0.3833], 2025-12-04T10:08:29.2720226Z [-0.9359, -0.1574, -0.3459, -1.5506, -0.3524], 2025-12-04T10:08:29.2720299Z [-0.8252, 1.4449, 1.3617, 0.4509, 0.7213], 2025-12-04T10:08:29.2720346Z [-0.1925, 1.0850, -0.2777, -0.5031, -0.8069]], 2025-12-04T10:08:29.2720348Z 2025-12-04T10:08:29.2720395Z [[-0.5862, 2.0317, 0.5228, -0.9374, -0.2581], 2025-12-04T10:08:29.2720454Z [ 1.7385, -1.1806, -0.8664, -0.1663, 0.2489], 2025-12-04T10:08:29.2720500Z [ 1.2862, 0.1637, -0.3305, 0.6038, -2.3231], 2025-12-04T10:08:29.2720544Z [ 0.4414, -1.2707, -1.1609, -0.4252, -0.8452], 2025-12-04T10:08:29.2720593Z [ 0.7683, -0.0579, -0.2376, 0.3612, -1.2254]]], 2025-12-04T10:08:29.2720595Z 2025-12-04T10:08:29.2720597Z 2025-12-04T10:08:29.2720642Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2720685Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2720730Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2720774Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2720823Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2720825Z 2025-12-04T10:08:29.2720869Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2720914Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2720958Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2721003Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2721066Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2721107Z dtype=torch.float64) 2025-12-04T10:08:29.2721109Z 2025-12-04T10:08:29.2721143Z Expected: 2025-12-04T10:08:29.2721198Z tensor([[[[-0.2706, 0.4021, -0.2877, -2.0563, 0.8621], 2025-12-04T10:08:29.2721241Z [-0.8468, 0.4564, -0.5954, -0.5976, 0.3826], 2025-12-04T10:08:29.2721287Z [-0.9356, -0.1588, -0.3464, -1.5508, -0.3522], 2025-12-04T10:08:29.2721332Z [-0.8253, 1.4443, 1.3626, 0.4516, 0.7225], 2025-12-04T10:08:29.2721381Z [-0.1926, 1.0856, -0.2779, -0.5034, -0.8074]], 2025-12-04T10:08:29.2721383Z 2025-12-04T10:08:29.2721427Z [[-0.5914, 2.0344, 0.5256, -0.9378, -0.2540], 2025-12-04T10:08:29.2721472Z [ 1.7380, -1.1792, -0.8651, -0.1658, 0.2496], 2025-12-04T10:08:29.2721517Z [ 1.2848, 0.1647, -0.3293, 0.6036, -2.3205], 2025-12-04T10:08:29.2721563Z [ 0.4410, -1.2702, -1.1604, -0.4251, -0.8445], 2025-12-04T10:08:29.2721611Z [ 0.7677, -0.0578, -0.2374, 0.3609, -1.2244]]], 2025-12-04T10:08:29.2721613Z 2025-12-04T10:08:29.2721615Z 2025-12-04T10:08:29.2721660Z [[[-0.7126, 1.4927, -0.1275, -0.2377, 0.4324], 2025-12-04T10:08:29.2721703Z [ 2.9950, 1.4121, 0.6199, 1.1151, -0.1796], 2025-12-04T10:08:29.2721749Z [ 0.2787, 0.6460, 0.5828, 0.2814, -0.4860], 2025-12-04T10:08:29.2721793Z [-0.2510, 0.9712, -0.7743, 0.4513, 1.2220], 2025-12-04T10:08:29.2721840Z [ 0.3628, 1.0020, -0.3002, -0.6201, 0.1169]], 2025-12-04T10:08:29.2721843Z 2025-12-04T10:08:29.2721889Z [[-0.5530, -0.2916, -1.0238, 0.2140, -0.1018], 2025-12-04T10:08:29.2721933Z [-1.8373, 1.9213, 1.3983, -2.5953, 0.7786], 2025-12-04T10:08:29.2721978Z [ 0.3667, 1.2211, 0.1804, -0.6141, 0.6872], 2025-12-04T10:08:29.2722023Z [-1.3093, 2.0253, 0.6569, -0.9540, -0.0145], 2025-12-04T10:08:29.2722085Z [-0.8080, 0.1937, -1.1268, 0.5421, -0.2414]]]], device='cuda:0', 2025-12-04T10:08:29.2722125Z dtype=torch.float64) 2025-12-04T10:08:29.2722127Z 2025-12-04T10:08:29.2722423Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.float64, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2722425Z 2025-12-04T10:08:29.2722498Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2722722Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_grad_cholesky_solve_cuda_float64 2025-12-04T10:08:29.2722725Z 2025-12-04T10:08:29.2722811Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2723177Z FAILED [0.3516s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 - Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2723233Z numerical:(-0.39084068924293136-1405.505986244369j) 2025-12-04T10:08:29.2723291Z analytical:(-0.3908406912063411-0.15149921416268441j) 2025-12-04T10:08:29.2723293Z 2025-12-04T10:08:29.2723395Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2723500Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2723598Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2723603Z 2025-12-04T10:08:29.2723639Z Numerical: 2025-12-04T10:08:29.2723703Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2723746Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2723800Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2723841Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2723896Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2723937Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2723987Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724025Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2724076Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2724116Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2724165Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724204Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2724239Z ..., 2025-12-04T10:08:29.2724287Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724326Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2724375Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724414Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2724461Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724500Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2724549Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724592Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2724639Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724679Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2724726Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2724804Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2724842Z Analytical: 2025-12-04T10:08:29.2724900Z tensor([[ 5.2809e-04+7.7671e-04j, 7.4796e-01+9.9489e-01j, 2025-12-04T10:08:29.2724939Z -8.4810e-01+1.8098e-01j, ..., 2025-12-04T10:08:29.2724987Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725025Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2725076Z [-2.4723e-04-4.2781e-05j, 6.8531e-01-1.5902e-01j, 2025-12-04T10:08:29.2725114Z 1.5140e-01-5.5888e-01j, ..., 2025-12-04T10:08:29.2725162Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725199Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2725249Z [ 2.3503e-04-8.3980e-04j, -7.2293e-01+3.6400e-01j, 2025-12-04T10:08:29.2725288Z -6.0075e-03+5.7054e-01j, ..., 2025-12-04T10:08:29.2725355Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725394Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2725442Z ..., 2025-12-04T10:08:29.2725504Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725543Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2725591Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725646Z 9.7544e-18-7.2637e-18j], 2025-12-04T10:08:29.2725695Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725734Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2725781Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725822Z -4.6243e-18-1.1498e-17j], 2025-12-04T10:08:29.2725869Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2725908Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2725955Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2726032Z -5.0913e-18+7.9480e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2726037Z 2025-12-04T10:08:29.2726123Z The max per-element difference (slow mode) is: 6.114718200210563e-09. 2025-12-04T10:08:29.2726220Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2726266Z test might've passed in slow_mode! 2025-12-04T10:08:29.2726269Z 2025-12-04T10:08:29.2726354Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2726459Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2726461Z 2025-12-04T10:08:29.2726495Z If the test 2025-12-04T10:08:29.2726588Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2726642Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2726739Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2726786Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2726864Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2726928Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2726930Z 2025-12-04T10:08:29.2727223Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2727226Z 2025-12-04T10:08:29.2727299Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2727511Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2727514Z 2025-12-04T10:08:29.2727602Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2727914Z FAILED [0.2872s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 - Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 0, 2025-12-04T10:08:29.2727972Z numerical:(1696144.6004526883-0.013355989004183888j) 2025-12-04T10:08:29.2728031Z analytical:(-0.39008194078835945-0.013355988641472659j) 2025-12-04T10:08:29.2728034Z 2025-12-04T10:08:29.2728135Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2728238Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2728337Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2728339Z 2025-12-04T10:08:29.2728373Z Numerical: 2025-12-04T10:08:29.2728437Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728487Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2728539Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728588Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2728653Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728692Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2728741Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728790Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2728842Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728880Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2728930Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2728967Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2729002Z ..., 2025-12-04T10:08:29.2729049Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729089Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2729139Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2729179Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2729228Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729267Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2729316Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2729354Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2729402Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729440Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2729489Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2729566Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2729600Z Analytical: 2025-12-04T10:08:29.2729659Z tensor([[-2.1987e-04-1.5730e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729697Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2729747Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729785Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2729837Z [-1.8164e-04+5.3225e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729876Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2729922Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2729961Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2730011Z [-4.5337e-04-7.9884e-04j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2730049Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2730097Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2730135Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2730168Z ..., 2025-12-04T10:08:29.2730216Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2730254Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2730305Z -7.7468e-02+5.7997e-01j, -7.0538e-01+3.9851e-01j, 2025-12-04T10:08:29.2730344Z 4.3185e-19-1.0543e-17j], 2025-12-04T10:08:29.2730392Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2730431Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2730481Z 9.8063e-01-9.5509e-02j, -9.0426e-01+8.7442e-01j, 2025-12-04T10:08:29.2730520Z 4.9808e-18-9.9504e-18j], 2025-12-04T10:08:29.2730568Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2730606Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2730656Z -5.5491e-01+8.3204e-01j, 8.1692e-01+4.4832e-01j, 2025-12-04T10:08:29.2730728Z 9.1827e-18+1.9701e-18j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2730730Z 2025-12-04T10:08:29.2730809Z The max per-element difference (slow mode) is: 10243.111340285763. 2025-12-04T10:08:29.2730811Z 2025-12-04T10:08:29.2730813Z 2025-12-04T10:08:29.2731121Z Caused by sample input at index 9: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2731150Z 2025-12-04T10:08:29.2731223Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2731433Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=9 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2731449Z 2025-12-04T10:08:29.2731535Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2731840Z FAILED [0.3317s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 - Exception: While considering the real part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2731894Z numerical:(-3.8928576251059264-2196.420621897911j) 2025-12-04T10:08:29.2731948Z analytical:(-3.892857622953266+2.269277869184171j) 2025-12-04T10:08:29.2731951Z 2025-12-04T10:08:29.2732050Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2732154Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2732251Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2732254Z 2025-12-04T10:08:29.2732291Z Numerical: 2025-12-04T10:08:29.2732364Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2732419Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2732481Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2732534Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2732596Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2732648Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2732681Z ..., 2025-12-04T10:08:29.2732740Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2732793Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2732850Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2732900Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2732995Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2733048Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2733102Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2733137Z Analytical: 2025-12-04T10:08:29.2733207Z tensor([[-10.5125+15.1865j, -1.2557+0.7625j, -2.0477+6.3031j, ..., 2025-12-04T10:08:29.2733258Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2733317Z [ -8.4762+5.1617j, 2.3487-0.2385j, -3.5290-1.3285j, ..., 2025-12-04T10:08:29.2733370Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2733431Z [ -7.9646+13.7433j, -5.3650-3.0065j, -3.7635+1.5216j, ..., 2025-12-04T10:08:29.2733482Z 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j], 2025-12-04T10:08:29.2733516Z ..., 2025-12-04T10:08:29.2733571Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2733624Z 0.0000+0.0000j, 0.0000+0.0000j, -10.5935+6.6998j], 2025-12-04T10:08:29.2733679Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2733730Z 0.0000+0.0000j, 0.0000+0.0000j, -16.7554-4.6328j], 2025-12-04T10:08:29.2733785Z [ 0.0000+0.0000j, 0.0000+0.0000j, 0.0000+0.0000j, ..., 2025-12-04T10:08:29.2733838Z 0.0000+0.0000j, 0.0000+0.0000j, -13.8938-1.0377j]], 2025-12-04T10:08:29.2733905Z device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2733907Z 2025-12-04T10:08:29.2733987Z The max per-element difference (slow mode) is: 6.6884309542415565e-09. 2025-12-04T10:08:29.2734113Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2734159Z test might've passed in slow_mode! 2025-12-04T10:08:29.2734161Z 2025-12-04T10:08:29.2734247Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2734365Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2734367Z 2025-12-04T10:08:29.2734403Z If the test 2025-12-04T10:08:29.2734496Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2734550Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2734643Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2734691Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2734769Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2734832Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2734837Z 2025-12-04T10:08:29.2735132Z Caused by sample input at index 11: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128]], kwargs={'upper': 'True'}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2735135Z 2025-12-04T10:08:29.2735206Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2735418Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=11 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2735420Z 2025-12-04T10:08:29.2735506Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2735815Z FAILED [0.5100s] test_ops_gradients.py::TestBwdGradientsCUDA::test_fn_gradgrad_cholesky_solve_cuda_complex128 - Exception: While considering the imaginary part of complex outputs only, Jacobian mismatch for output 1 with respect to input 2, 2025-12-04T10:08:29.2735869Z numerical:(-1.7224683846703075+5451.015769314017j) 2025-12-04T10:08:29.2735928Z analytical:(-1.7224683845910052+0.3176942206055258j) 2025-12-04T10:08:29.2735930Z 2025-12-04T10:08:29.2736028Z The above quantities relating the numerical and analytical jacobians are computed 2025-12-04T10:08:29.2736130Z in fast mode. See: https://github.com/pytorch/pytorch/issues/53876 for more background 2025-12-04T10:08:29.2736226Z about fast mode. Below, we recompute numerical and analytical jacobians in slow mode: 2025-12-04T10:08:29.2736229Z 2025-12-04T10:08:29.2736263Z Numerical: 2025-12-04T10:08:29.2736326Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736366Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2736419Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736458Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2736511Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736552Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2736601Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736639Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2736689Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736728Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2736776Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736814Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2736847Z ..., 2025-12-04T10:08:29.2736895Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2736936Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2736986Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2737037Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2737087Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737129Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2737203Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2737243Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2737290Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737340Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2737389Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2737464Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2737498Z Analytical: 2025-12-04T10:08:29.2737558Z tensor([[ 7.3355e-03-5.8399e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737595Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2737643Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737681Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2737731Z [-1.4849e-03+3.9269e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737768Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2737819Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737857Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2737906Z [ 1.1207e-02+5.7334e-03j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2737943Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2737992Z 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2738029Z 0.0000e+00+0.0000e+00j], 2025-12-04T10:08:29.2738062Z ..., 2025-12-04T10:08:29.2738109Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2738147Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2738197Z -2.3963e+00-2.7345e+00j, -3.2554e+00+7.0191e-01j, 2025-12-04T10:08:29.2738237Z -8.7196e-17+2.6134e-17j], 2025-12-04T10:08:29.2738285Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2738323Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2738373Z -1.9070e-02-2.5869e+00j, -3.2542e+00-3.0408e-01j, 2025-12-04T10:08:29.2738414Z 1.1030e-18+1.2745e-16j], 2025-12-04T10:08:29.2738461Z [ 0.0000e+00+0.0000e+00j, 0.0000e+00+0.0000e+00j, 2025-12-04T10:08:29.2738499Z 0.0000e+00+0.0000e+00j, ..., 2025-12-04T10:08:29.2738549Z 2.3321e+00-6.7119e+00j, -7.9643e+00-1.6326e+00j, 2025-12-04T10:08:29.2738622Z 6.4104e-17-1.1007e-16j]], device='cuda:0', dtype=torch.complex128) 2025-12-04T10:08:29.2738624Z 2025-12-04T10:08:29.2738706Z The max per-element difference (slow mode) is: 9.890398048691805e-09. 2025-12-04T10:08:29.2738805Z Fast gradcheck failed but element-wise differences are small. This means that the 2025-12-04T10:08:29.2738849Z test might've passed in slow_mode! 2025-12-04T10:08:29.2738851Z 2025-12-04T10:08:29.2738937Z If you are adding a new operator, please file an issue and then use one of the 2025-12-04T10:08:29.2739039Z workarounds. The workaround depends on how your test invokes gradcheck/gradgradcheck: 2025-12-04T10:08:29.2739043Z 2025-12-04T10:08:29.2739076Z If the test 2025-12-04T10:08:29.2739170Z - manually invokes gradcheck/gradgradcheck, then call gradcheck/gradgradcheck 2025-12-04T10:08:29.2739224Z with `fast_mode=False` as a keyword argument. 2025-12-04T10:08:29.2739319Z - is OpInfo-based (e.g., in test_ops_gradients.py), then modify the OpInfo for the test 2025-12-04T10:08:29.2739365Z to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2739442Z - is a Module test (e.g., in common_nn.py), then modify the corresponding 2025-12-04T10:08:29.2739504Z module_test entry to have `gradcheck_fast_mode=False` 2025-12-04T10:08:29.2739507Z 2025-12-04T10:08:29.2739814Z Caused by sample input at index 21: SampleInput(input=Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128], args=TensorList[Tensor[size=(2, 5, 5), device="cuda:0", dtype=torch.complex128, contiguous=False]], kwargs={}, broadcasts_input=False, name='') 2025-12-04T10:08:29.2739817Z 2025-12-04T10:08:29.2739890Z To execute this test, run the following from the base repo dir: 2025-12-04T10:08:29.2740118Z PYTORCH_OPINFO_SAMPLE_INPUT_INDEX=21 PYTORCH_TEST_WITH_ROCM=1 python test/test_ops_gradients.py TestBwdGradientsCUDA.test_fn_gradgrad_cholesky_solve_cuda_complex128 2025-12-04T10:08:29.2740120Z 2025-12-04T10:08:29.2740217Z This message can be suppressed by setting PYTORCH_PRINT_REPRO_ON_FAILURE=0 2025-12-04T10:08:29.2740283Z ======================= 97 failed, 103 passed in 36.70s ======================== 2025-12-04T10:08:29.2740285Z 2025-12-04T10:08:29.2740434Z FINISHED PRINTING LOG FILE of test_ops_gradients 1/1 (test/test-reports/test_ops_gradients_1.1_89dbe3076ea037ae_.log) 2025-12-04T10:08:29.2740438Z 2025-12-04T10:08:29.2740542Z Finished test_ops_gradients 1/1 ... [2025-12-04 10:08:29.057455][2224080.617156007], took 0.71min 2025-12-04T10:08:29.2740790Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:08:29.2740884Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:08:29.2740979Z GITHUB_RUN_ID, GITHUB_RUN_ATTEMPT, or ARTIFACTS_FILE_SUFFIX not set, not uploading 2025-12-04T10:08:29.2741026Z Uploading artifacts took 0.00 seconds 2025-12-04T10:08:29.2741072Z test_ops_gradients 1/1 failed! 2025-12-04T10:08:29.2741158Z Running test_spectral_ops 1/1 ... [2025-12-04 10:08:29.155616][2224080.715315303] 2025-12-04T10:08:29.2741207Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:08:29.2741562Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_spectral_ops.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:08:29.155910] 2025-12-04T10:08:32.7081253Z 2025-12-04T10:08:32.7086031Z test_spectral_ops 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_spectral_ops_1.1_f17ea600d28c7797_.log 2025-12-04T10:08:32.7086615Z Running 0 items in this shard: 2025-12-04T10:08:32.7086815Z 2025-12-04T10:08:32.7087039Z Finished test_spectral_ops 1/1 ... [2025-12-04 10:08:32.707466][2224084.267165486], took 0.06min 2025-12-04T10:08:32.7087840Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:08:32.9274417Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:08:32.9277368Z Running test_tensorexpr 1/1 ... [2025-12-04 10:08:32.927545][2224084.487244021] 2025-12-04T10:08:32.9277759Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:08:32.9280236Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_tensorexpr.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:08:32.927859] 2025-12-04T10:08:35.6646455Z 2025-12-04T10:08:35.6648747Z test_tensorexpr 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_tensorexpr_1.1_54d78b9506613299_.log 2025-12-04T10:08:35.6649802Z Running 0 items in this shard: 2025-12-04T10:08:35.6650055Z 2025-12-04T10:08:35.6650429Z Finished test_tensorexpr 1/1 ... [2025-12-04 10:08:35.664385][2224087.224083075], took 0.05min 2025-12-04T10:08:35.6659554Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:08:35.9306380Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:08:35.9319506Z Running test_unary_ufuncs 1/1 ... [2025-12-04 10:08:35.931722][2224087.491419111] 2025-12-04T10:08:35.9319825Z SCRIBE_GRAPHQL_ACCESS_TOKEN is NOT set 2025-12-04T10:08:35.9324700Z Executing ['/opt/conda/envs/py_3.12/bin/python', '-bb', 'test_unary_ufuncs.py', '--shard-id=1', '--num-shards=1', '-v', '-vv', '-rfEX', '-p', 'no:xdist', '--use-pytest', '--flake-finder', '--flake-runs=50', '--import-slow-tests', '--import-disabled-tests', '--rerun-disabled-tests'] ... [2025-12-04 10:08:35.932075] 2025-12-04T10:09:04.6988493Z 2025-12-04T10:09:04.6989561Z test_unary_ufuncs 1/1 was successful, full logs can be found in artifacts with path test/test-reports/test_unary_ufuncs_1.1_bc2a199fc8b0a199_.log 2025-12-04T10:09:04.6989983Z Running 0 items in this shard: 2025-12-04T10:09:04.6990090Z 2025-12-04T10:09:04.6990253Z Finished test_unary_ufuncs 1/1 ... [2025-12-04 10:09:04.698509][2224116.258207904], took 0.48min 2025-12-04T10:09:04.7001234Z Parsing testcases for test report: /var/lib/jenkins/pytorch/test/test-reports/python-pytest/inductor.test_torchinductor/inductor.test_torchinductor-6bdddbded43601b6.xml 2025-12-04T10:09:04.7960400Z Failed to parse and upload json test reports: Unable to locate credentials 2025-12-04T10:09:06.9698160Z Running test batch 'tests to run' cost 2486.28 seconds 2025-12-04T10:09:06.9706199Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:06.9710245Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842946_44e3f142d0f911f09fa65e5db5562aa9 2025-12-04T10:09:08.9889544Z /var/lib/jenkins/pytorch/tools/stats/upload_metrics.py:156: UserWarning: Error uploading metric td_test_failure_stats_v2 to DynamoDB: Unable to locate credentials 2025-12-04T10:09:08.9890520Z warn(f"Error uploading metric {metric_name} to DynamoDB: {e}") 2025-12-04T10:09:08.9892149Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:08.9894258Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842948_4617ed0cd0f911f09fa65e5db5562aa9 2025-12-04T10:09:08.9919576Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:08.9920556Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842948_4618547cd0f911f09fa65e5db5562aa9 2025-12-04T10:09:08.9944698Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:08.9945910Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842948_4618b7aad0f911f09fa65e5db5562aa9 2025-12-04T10:09:08.9969508Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:08.9970154Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842948_461917c2d0f911f09fa65e5db5562aa9 2025-12-04T10:09:08.9994843Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:08.9995745Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842948_46197b18d0f911f09fa65e5db5562aa9 2025-12-04T10:09:09.0020105Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:09.0020956Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842949_4619dde2d0f911f09fa65e5db5562aa9 2025-12-04T10:09:09.0045437Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:09.0047983Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842949_461a4048d0f911f09fa65e5db5562aa9 2025-12-04T10:09:09.0071683Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:09.0075273Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842949_461aa592d0f911f09fa65e5db5562aa9 2025-12-04T10:09:09.0098191Z Emitting td_test_failure_stats_v2 2025-12-04T10:09:09.0098641Z Writing 1 documents to S3 ossci-raw-job-status/ossci_uploaded_metrics/td_test_failure_stats_v2_1764842949_461b0c62d0f911f09fa65e5db5562aa9 2025-12-04T10:09:09.0120116Z inductor/test_torchinductor 2/2 failed! 2025-12-04T10:09:09.0120429Z inductor/test_pattern_matcher 1/1 failed! 2025-12-04T10:09:09.0120669Z inductor/test_cuda_repro 1/1 failed! 2025-12-04T10:09:09.0121379Z inductor/test_inductor_freezing 1/1 failed! 2025-12-04T10:09:09.0122000Z inductor/test_torchinductor_strided_blocks 1/1 failed! 2025-12-04T10:09:09.0122321Z inductor/test_triton_kernels 1/1 failed! 2025-12-04T10:09:09.0122654Z inductor/test_benchmark_fusion 1/1 failed! 2025-12-04T10:09:09.0123693Z test_autograd 1/1 failed! 2025-12-04T10:09:09.0123933Z test_nn 1/3 failed! 2025-12-04T10:09:09.0124161Z test_ops_gradients 1/1 failed! 2025-12-04T10:09:09.6258069Z 2025-12-04T10:09:09.6258946Z real 41m31.326s 2025-12-04T10:09:09.6259343Z user 104m17.347s 2025-12-04T10:09:09.6259684Z sys 31m48.972s 2025-12-04T10:09:09.6260068Z + assert_git_not_dirty 2025-12-04T10:09:09.6260498Z + [[ linux-noble-rocm-py3.12-mi300 != *rocm* ]] 2025-12-04T10:09:09.6260958Z + sccache_epilogue 2025-12-04T10:09:09.6261418Z + echo '::group::Sccache Compilation Log' 2025-12-04T10:09:09.6262272Z ##[group]Sccache Compilation Log 2025-12-04T10:09:09.6262799Z + echo '=================== sccache compilation log ===================' 2025-12-04T10:09:09.6263539Z =================== sccache compilation log =================== 2025-12-04T10:09:09.6264273Z + python /var/lib/jenkins/pytorch/.ci/pytorch/print_sccache_log.py /var/lib/jenkins/sccache_error.log 2025-12-04T10:09:09.6337147Z + echo '=========== If your build fails, please take a look at the log above for possible reasons ===========' 2025-12-04T10:09:09.6337620Z =========== If your build fails, please take a look at the log above for possible reasons =========== 2025-12-04T10:09:09.6337999Z + sccache --show-stats 2025-12-04T10:09:09.6357324Z Compile requests 703 2025-12-04T10:09:09.6357662Z Compile requests executed 97 2025-12-04T10:09:09.6357910Z Cache hits 7 2025-12-04T10:09:09.6358129Z Cache hits (C/C++) 4 2025-12-04T10:09:09.6358376Z Cache hits (HIP) 3 2025-12-04T10:09:09.6358613Z Cache misses 90 2025-12-04T10:09:09.6358824Z Cache misses (C/C++) 73 2025-12-04T10:09:09.6359087Z Cache misses (HIP) 17 2025-12-04T10:09:09.6359321Z Cache hits rate 7.22 % 2025-12-04T10:09:09.6359572Z Cache hits rate (C/C++) 5.19 % 2025-12-04T10:09:09.6359824Z Cache hits rate (HIP) 15.00 % 2025-12-04T10:09:09.6360054Z Cache timeouts 0 2025-12-04T10:09:09.6360307Z Cache read errors 0 2025-12-04T10:09:09.6360524Z Forced recaches 0 2025-12-04T10:09:09.6360751Z Cache write errors 0 2025-12-04T10:09:09.6361010Z Cache errors 0 2025-12-04T10:09:09.6361232Z Compilations 90 2025-12-04T10:09:09.6361469Z Compilation failures 0 2025-12-04T10:09:09.6361721Z Non-cacheable compilations 0 2025-12-04T10:09:09.6361948Z Non-cacheable calls 2 2025-12-04T10:09:09.6362198Z Non-compilation calls 604 2025-12-04T10:09:09.6362424Z Unsupported compiler calls 0 2025-12-04T10:09:09.6362652Z Average cache write 0.000 s 2025-12-04T10:09:09.6362917Z Average compiler 10.080 s 2025-12-04T10:09:09.6363186Z Average cache read hit 0.000 s 2025-12-04T10:09:09.6363444Z Failed distributed compilations 0 2025-12-04T10:09:09.6363592Z 2025-12-04T10:09:09.6363686Z Non-cacheable reasons: 2025-12-04T10:09:09.6363897Z -E 2 2025-12-04T10:09:09.6364011Z 2025-12-04T10:09:09.6364190Z Cache location Local disk: "/var/lib/jenkins/.cache/sccache" 2025-12-04T10:09:09.6364470Z Use direct/preprocessor mode? yes 2025-12-04T10:09:09.6364702Z Version (client) 0.10.0 2025-12-04T10:09:09.6364955Z Cache size 31 MiB 2025-12-04T10:09:09.6365187Z Max cache size 10 GiB 2025-12-04T10:09:09.6365430Z + sccache --stop-server 2025-12-04T10:09:09.6378687Z Stopping sccache server... 2025-12-04T10:09:09.6382288Z Compile requests 703 2025-12-04T10:09:09.6382717Z Compile requests executed 97 2025-12-04T10:09:09.6383063Z Cache hits 7 2025-12-04T10:09:09.6383372Z Cache hits (C/C++) 4 2025-12-04T10:09:09.6383744Z Cache hits (HIP) 3 2025-12-04T10:09:09.6384014Z Cache misses 90 2025-12-04T10:09:09.6384317Z Cache misses (C/C++) 73 2025-12-04T10:09:09.6384621Z Cache misses (HIP) 17 2025-12-04T10:09:09.6384897Z Cache hits rate 7.22 % 2025-12-04T10:09:09.6385205Z Cache hits rate (C/C++) 5.19 % 2025-12-04T10:09:09.6385480Z Cache hits rate (HIP) 15.00 % 2025-12-04T10:09:09.6385755Z Cache timeouts 0 2025-12-04T10:09:09.6386054Z Cache read errors 0 2025-12-04T10:09:09.6386317Z Forced recaches 0 2025-12-04T10:09:09.6386602Z Cache write errors 0 2025-12-04T10:09:09.6386863Z Cache errors 0 2025-12-04T10:09:09.6387114Z Compilations 90 2025-12-04T10:09:09.6387406Z Compilation failures 0 2025-12-04T10:09:09.6387691Z Non-cacheable compilations 0 2025-12-04T10:09:09.6387980Z Non-cacheable calls 2 2025-12-04T10:09:09.6388418Z Non-compilation calls 604 2025-12-04T10:09:09.6388683Z Unsupported compiler calls 0 2025-12-04T10:09:09.6388990Z Average cache write 0.000 s 2025-12-04T10:09:09.6389251Z Average compiler 10.080 s 2025-12-04T10:09:09.6389513Z Average cache read hit 0.000 s 2025-12-04T10:09:09.6389743Z Failed distributed compilations 0 2025-12-04T10:09:09.6389894Z 2025-12-04T10:09:09.6389958Z Non-cacheable reasons: 2025-12-04T10:09:09.6390115Z -E 2 2025-12-04T10:09:09.6390227Z 2025-12-04T10:09:09.6390353Z Cache location Local disk: "/var/lib/jenkins/.cache/sccache" 2025-12-04T10:09:09.6390595Z Use direct/preprocessor mode? yes 2025-12-04T10:09:09.6390781Z Version (client) 0.10.0 2025-12-04T10:09:09.6390968Z Cache size 31 MiB 2025-12-04T10:09:09.6391152Z Max cache size 10 GiB 2025-12-04T10:09:09.6391340Z + echo ::endgroup:: 2025-12-04T10:09:09.6391699Z ##[endgroup] 2025-12-04T10:09:09.6447638Z ##[group]Run # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct 2025-12-04T10:09:09.6447968Z # copy test results back to the mounted workspace, needed sudo, resulting permissions were correct 2025-12-04T10:09:09.6448342Z docker exec -t "ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337" sh -c "cd ../pytorch && sudo cp -R test/test-reports ../workspace/test" 2025-12-04T10:09:09.6452689Z shell: /usr/bin/bash -e {0} 2025-12-04T10:09:09.6452800Z env: 2025-12-04T10:09:09.6452893Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:09.6453130Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:09.6453305Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:09.6453480Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:09.6453885Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:09.6454253Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:09.6454366Z AWS_REGION: us-east-1 2025-12-04T10:09:09.6454543Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:09.6454696Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:09.6456780Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:09.6456949Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:09.6457131Z ##[endgroup] 2025-12-04T10:09:09.7104146Z ##[group]Run docker exec -t "ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337" sh -c "sudo chown -R 1001:1001 test" 2025-12-04T10:09:09.7104569Z docker exec -t "ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337" sh -c "sudo chown -R 1001:1001 test" 2025-12-04T10:09:09.7108905Z shell: /usr/bin/bash -e {0} 2025-12-04T10:09:09.7109022Z env: 2025-12-04T10:09:09.7109122Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:09.7109260Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:09.7109528Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:09.7109697Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:09.7110081Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:09.7110477Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:09.7110598Z AWS_REGION: us-east-1 2025-12-04T10:09:09.7110782Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:09.7110938Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:09.7113097Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:09.7113273Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:09.7113459Z ##[endgroup] 2025-12-04T10:09:09.7909751Z ##[group]Run cat test/**/*_toprint.log || true 2025-12-04T10:09:09.7909921Z cat test/**/*_toprint.log || true 2025-12-04T10:09:09.7914044Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:09.7914199Z env: 2025-12-04T10:09:09.7914301Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:09.7914442Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:09.7914624Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:09.7914797Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:09.7915186Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:09.7915562Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:09.7915696Z AWS_REGION: us-east-1 2025-12-04T10:09:09.7915864Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:09.7916048Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:09.7918157Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:09.7918341Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:09.7918533Z ##[endgroup] 2025-12-04T10:09:09.7960957Z cat: 'test/**/*_toprint.log': No such file or directory 2025-12-04T10:09:09.8023824Z Prepare all required actions 2025-12-04T10:09:09.8024182Z Getting action download info 2025-12-04T10:09:10.1947431Z Download action repository 'seemethere/upload-artifact-s3@v5' (SHA:baba72d0712b404f646cebe0730933554ebce96a) 2025-12-04T10:09:11.0523069Z Download action repository 'actions/upload-artifact@v4' (SHA:ea165f8d65b6e75b540449e92b4886f43607fa02) 2025-12-04T10:09:12.6643672Z ##[group]Run ./.github/actions/upload-test-artifacts 2025-12-04T10:09:12.6643839Z with: 2025-12-04T10:09:12.6643946Z use-gha: true 2025-12-04T10:09:12.6644118Z file-suffix: test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360 2025-12-04T10:09:12.6644300Z s3-bucket: gha-artifacts 2025-12-04T10:09:12.6644417Z env: 2025-12-04T10:09:12.6644515Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:12.6644663Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:12.6644851Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:12.6645062Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:12.6645457Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:12.6645843Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:12.6645967Z AWS_REGION: us-east-1 2025-12-04T10:09:12.6646127Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:12.6646286Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:12.6648470Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:12.6648649Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:12.6648837Z ##[endgroup] 2025-12-04T10:09:12.6681193Z ##[group]Run actions/upload-artifact@v4 2025-12-04T10:09:12.6681397Z with: 2025-12-04T10:09:12.6681576Z name: test-jsons-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip 2025-12-04T10:09:12.6681788Z retention-days: 14 2025-12-04T10:09:12.6681914Z if-no-files-found: warn 2025-12-04T10:09:12.6682036Z path: test/**/*.json 2025-12-04T10:09:12.6682149Z compression-level: 6 2025-12-04T10:09:12.6682256Z overwrite: false 2025-12-04T10:09:12.6682362Z include-hidden-files: false 2025-12-04T10:09:12.6682479Z env: 2025-12-04T10:09:12.6682579Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:12.6682719Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:12.6682904Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:12.6683189Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:12.6683582Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:12.6683971Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:12.6684098Z AWS_REGION: us-east-1 2025-12-04T10:09:12.6684246Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:12.6684419Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:12.6686559Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:12.6686745Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:12.6686945Z ##[endgroup] 2025-12-04T10:09:13.0365659Z With the provided path, there will be 6 files uploaded 2025-12-04T10:09:13.0368864Z Artifact name is valid! 2025-12-04T10:09:13.0369804Z Root directory input is valid! 2025-12-04T10:09:13.3155067Z Beginning upload of artifact content to blob storage 2025-12-04T10:09:13.8157557Z Uploaded bytes 46464 2025-12-04T10:09:13.8897201Z Finished uploading artifact content to blob storage! 2025-12-04T10:09:13.8898481Z SHA256 digest of uploaded artifact zip is 304ef288f75d0a6270c3b1b07926f1f19c4ac7c87038a0131edd6ad13064e239 2025-12-04T10:09:13.8899240Z Finalizing artifact upload 2025-12-04T10:09:14.0735335Z Artifact test-jsons-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip.zip successfully finalized. Artifact ID 4762427625 2025-12-04T10:09:14.0736234Z Artifact test-jsons-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip has been successfully uploaded! Final size is 46464 bytes. Artifact ID is 4762427625 2025-12-04T10:09:14.0740121Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/19922812470/artifacts/4762427625 2025-12-04T10:09:14.0835129Z ##[group]Run actions/upload-artifact@v4 2025-12-04T10:09:14.0835275Z with: 2025-12-04T10:09:14.0835471Z name: test-reports-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip 2025-12-04T10:09:14.0835707Z retention-days: 14 2025-12-04T10:09:14.0835826Z if-no-files-found: ignore 2025-12-04T10:09:14.0835953Z path: test/**/*.xml test/**/*.csv 2025-12-04T10:09:14.0836086Z compression-level: 6 2025-12-04T10:09:14.0836209Z overwrite: false 2025-12-04T10:09:14.0836327Z include-hidden-files: false 2025-12-04T10:09:14.0836449Z env: 2025-12-04T10:09:14.0836551Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:14.0836699Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:14.0836889Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:14.0837066Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:14.0837463Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:14.0837853Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:14.0838060Z AWS_REGION: us-east-1 2025-12-04T10:09:14.0838248Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:14.0838413Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:14.0840554Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:14.0840739Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:14.0840996Z ##[endgroup] 2025-12-04T10:09:14.4557748Z With the provided path, there will be 59 files uploaded 2025-12-04T10:09:14.4560821Z Artifact name is valid! 2025-12-04T10:09:14.4561136Z Root directory input is valid! 2025-12-04T10:09:14.7437187Z Beginning upload of artifact content to blob storage 2025-12-04T10:09:15.8068513Z Uploaded bytes 1877068 2025-12-04T10:09:15.8852060Z Finished uploading artifact content to blob storage! 2025-12-04T10:09:15.8854583Z SHA256 digest of uploaded artifact zip is 3baf69a50ee00e22adc02049805f03b1b764c39d45dfa3222834510485a60b07 2025-12-04T10:09:15.8855031Z Finalizing artifact upload 2025-12-04T10:09:16.0738219Z Artifact test-reports-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip.zip successfully finalized. Artifact ID 4762427992 2025-12-04T10:09:16.0739624Z Artifact test-reports-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip has been successfully uploaded! Final size is 1877068 bytes. Artifact ID is 4762427992 2025-12-04T10:09:16.0744164Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/19922812470/artifacts/4762427992 2025-12-04T10:09:16.0852643Z ##[group]Run actions/upload-artifact@v4 2025-12-04T10:09:16.0852814Z with: 2025-12-04T10:09:16.0853072Z name: logs-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip 2025-12-04T10:09:16.0853288Z retention-days: 14 2025-12-04T10:09:16.0853409Z if-no-files-found: ignore 2025-12-04T10:09:16.0853547Z path: usage_log.txt test/**/*.log 2025-12-04T10:09:16.0853685Z compression-level: 6 2025-12-04T10:09:16.0853805Z overwrite: false 2025-12-04T10:09:16.0853928Z include-hidden-files: false 2025-12-04T10:09:16.0854073Z env: 2025-12-04T10:09:16.0854178Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:16.0854330Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:16.0854529Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:16.0854720Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:16.0855274Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:16.0855663Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:16.0855794Z AWS_REGION: us-east-1 2025-12-04T10:09:16.0855979Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:16.0856141Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:16.0858294Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:16.0858477Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:16.0858679Z ##[endgroup] 2025-12-04T10:09:16.4677212Z Multiple search paths detected. Calculating the least common ancestor of all paths 2025-12-04T10:09:16.4678027Z The least common ancestor is /home/runner/_work/pytorch/pytorch. This will be the root directory of the artifact 2025-12-04T10:09:16.4678531Z With the provided path, there will be 57 files uploaded 2025-12-04T10:09:16.4678934Z Artifact name is valid! 2025-12-04T10:09:16.4679309Z Root directory input is valid! 2025-12-04T10:09:16.7763284Z Beginning upload of artifact content to blob storage 2025-12-04T10:09:17.3340707Z Uploaded bytes 197010 2025-12-04T10:09:17.4714529Z Finished uploading artifact content to blob storage! 2025-12-04T10:09:17.4715734Z SHA256 digest of uploaded artifact zip is 625acb99cda156769fc91a848d8078f7d66268090943d723a1c1a817da4d5de3 2025-12-04T10:09:17.4716553Z Finalizing artifact upload 2025-12-04T10:09:17.6557784Z Artifact logs-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip.zip successfully finalized. Artifact ID 4762428308 2025-12-04T10:09:17.6559305Z Artifact logs-runattempt1-test-default-6-6-linux.rocm.gpu.gfx942.1.b_57116139360.zip has been successfully uploaded! Final size is 197010 bytes. Artifact ID is 4762428308 2025-12-04T10:09:17.6563790Z Artifact download URL: https://github.com/pytorch/pytorch/actions/runs/19922812470/artifacts/4762428308 2025-12-04T10:09:17.6672628Z ##[group]Run # shellcheck disable=SC2156 2025-12-04T10:09:17.6672848Z # shellcheck disable=SC2156 2025-12-04T10:09:17.6673183Z find . -iname "core.[1-9]*" -exec docker exec "${CONTAINER_NAME}" sh -c "gdb python {} -ex 'bt' -ex 'q'" \; 2025-12-04T10:09:17.6677856Z shell: /usr/bin/bash -e {0} 2025-12-04T10:09:17.6678011Z env: 2025-12-04T10:09:17.6678133Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:17.6678323Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:17.6678553Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:17.6678777Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:17.6679277Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:17.6679736Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:17.6679902Z AWS_REGION: us-east-1 2025-12-04T10:09:17.6680093Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:17.6680271Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:17.6682421Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:17.6682612Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:17.6682813Z ##[endgroup] 2025-12-04T10:09:17.8046940Z ##[group]Run aws-actions/configure-aws-credentials@ececac1a45f3b08a01d2dd070d28d111c5fe6722 2025-12-04T10:09:17.8047172Z with: 2025-12-04T10:09:17.8047365Z role-to-assume: arn:aws:iam::308535385114:role/gha_workflow_upload-benchmark-results 2025-12-04T10:09:17.8047575Z role-duration-seconds: 18000 2025-12-04T10:09:17.8047715Z aws-region: us-east-1 2025-12-04T10:09:17.8047841Z audience: sts.amazonaws.com 2025-12-04T10:09:17.8047973Z env: 2025-12-04T10:09:17.8048079Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:17.8048229Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:17.8048431Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:17.8048609Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:17.8049030Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:17.8049421Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:17.8049552Z AWS_REGION: us-east-1 2025-12-04T10:09:17.8049731Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:17.8049896Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:17.8052021Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:17.8052219Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:17.8052421Z ##[endgroup] 2025-12-04T10:09:18.1251134Z Assuming role with OIDC 2025-12-04T10:09:18.4772644Z Authenticated as assumedRoleId AROAUPVRELQNA5GQHA6IA:GitHubActions 2025-12-04T10:09:18.5762581Z ##[group]Run pytorch/test-infra/.github/actions/upload-benchmark-results@main 2025-12-04T10:09:18.5762790Z with: 2025-12-04T10:09:18.5762917Z benchmark-results-dir: test/test-reports 2025-12-04T10:09:18.5763277Z dry-run: false 2025-12-04T10:09:18.5763395Z schema-version: v3 2025-12-04T10:09:18.5763664Z github-token: *** 2025-12-04T10:09:18.5763778Z env: 2025-12-04T10:09:18.5763890Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:18.5764048Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:18.5764247Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:18.5764433Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:18.5764915Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:18.5765396Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:18.5765534Z AWS_REGION: us-east-1 2025-12-04T10:09:18.5765674Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:18.5765846Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:18.5768067Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:18.5768260Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:18.5768467Z ##[endgroup] 2025-12-04T10:09:18.5777640Z ##[group]Run set -eux 2025-12-04T10:09:18.5777786Z set -eux 2025-12-04T10:09:18.5777903Z  2025-12-04T10:09:18.5778015Z if [[ -n "" ]]; then 2025-12-04T10:09:18.5778144Z  source "" 2025-12-04T10:09:18.5778261Z fi 2025-12-04T10:09:18.5778424Z python3 -mpip install boto3==1.35.33 psutil==7.0.0 pynvml==12.0.0 2025-12-04T10:09:18.5778607Z  2025-12-04T10:09:18.5778714Z DEVICE_NAME="" 2025-12-04T10:09:18.5778841Z DEVICE_TYPE="" 2025-12-04T10:09:18.5778956Z  2025-12-04T10:09:18.5779077Z if command -v nvidia-smi; then 2025-12-04T10:09:18.5779277Z  # NB: I'm using PyTorch here to get the device name, however, it needs to 2025-12-04T10:09:18.5779518Z  # install the correct version of PyTorch manually for now. Any PyTorch 2025-12-04T10:09:18.5779740Z  # version is fine, I just use 2.7.1 to satify PYPIDEP linter 2025-12-04T10:09:18.5779927Z  python3 -mpip install torch==2.7.1 2025-12-04T10:09:18.5780087Z elif command -v rocminfo; then 2025-12-04T10:09:18.5780273Z  # NB: Installing torch on ROCm runner with pip here causes CI to fail 2025-12-04T10:09:18.5780499Z  # with a memoryview is too large error only on MI300 runners. Is pip 2025-12-04T10:09:18.5780731Z  # version on ROCm runner there too old? As a workaround, let's use the 2025-12-04T10:09:18.5780940Z  # GPU device name coming from rocminfo instead 2025-12-04T10:09:18.5781101Z  DEVICE_NAME=rocm 2025-12-04T10:09:18.5781318Z  DEVICE_TYPE=$(rocminfo | grep "Marketing Name" | tail -n1 | awk -F':' '{print $2}' | xargs) 2025-12-04T10:09:18.5781524Z fi 2025-12-04T10:09:18.5781633Z  2025-12-04T10:09:18.5781769Z echo "DEVICE_NAME=$DEVICE_NAME" >> $GITHUB_ENV 2025-12-04T10:09:18.5781952Z echo "DEVICE_TYPE=$DEVICE_TYPE" >> $GITHUB_ENV 2025-12-04T10:09:18.5786185Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:18.5786353Z env: 2025-12-04T10:09:18.5786469Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:18.5786627Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:18.5786826Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:18.5787018Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:18.5787501Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:18.5787895Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:18.5788033Z AWS_REGION: us-east-1 2025-12-04T10:09:18.5788184Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:18.5788358Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:18.5790571Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:18.5790764Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:18.5790969Z ##[endgroup] 2025-12-04T10:09:18.5809273Z + [[ -n '' ]] 2025-12-04T10:09:18.5809556Z + python3 -mpip install boto3==1.35.33 psutil==7.0.0 pynvml==12.0.0 2025-12-04T10:09:18.7208698Z Defaulting to user installation because normal site-packages is not writeable 2025-12-04T10:09:19.0864438Z Collecting boto3==1.35.33 2025-12-04T10:09:19.1239745Z Downloading boto3-1.35.33-py3-none-any.whl (139 kB) 2025-12-04T10:09:19.1402801Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 139.1/139.1 KB 9.4 MB/s eta 0:00:00 2025-12-04T10:09:19.2152878Z Collecting psutil==7.0.0 2025-12-04T10:09:19.2213914Z Downloading psutil-7.0.0-cp36-abi3-manylinux_2_12_x86_64.manylinux2010_x86_64.manylinux_2_17_x86_64.manylinux2014_x86_64.whl (277 kB) 2025-12-04T10:09:19.2325694Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 278.0/278.0 KB 26.7 MB/s eta 0:00:00 2025-12-04T10:09:19.2443617Z Collecting pynvml==12.0.0 2025-12-04T10:09:19.2507058Z Downloading pynvml-12.0.0-py3-none-any.whl (26 kB) 2025-12-04T10:09:19.2656801Z Collecting jmespath<2.0.0,>=0.7.1 2025-12-04T10:09:19.2712773Z Downloading jmespath-1.0.1-py3-none-any.whl (20 kB) 2025-12-04T10:09:19.6208967Z Collecting botocore<1.36.0,>=1.35.33 2025-12-04T10:09:19.6286337Z Downloading botocore-1.35.99-py3-none-any.whl (13.3 MB) 2025-12-04T10:09:19.8170914Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 13.3/13.3 MB 90.5 MB/s eta 0:00:00 2025-12-04T10:09:19.8498299Z Collecting s3transfer<0.11.0,>=0.10.0 2025-12-04T10:09:19.8553278Z Downloading s3transfer-0.10.4-py3-none-any.whl (83 kB) 2025-12-04T10:09:19.8572474Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 83.2/83.2 KB 91.6 MB/s eta 0:00:00 2025-12-04T10:09:19.8800546Z Collecting nvidia-ml-py<13.0.0a0,>=12.0.0 2025-12-04T10:09:19.8861187Z Downloading nvidia_ml_py-12.575.51-py3-none-any.whl (47 kB) 2025-12-04T10:09:19.8876295Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 47.5/47.5 KB 63.6 MB/s eta 0:00:00 2025-12-04T10:09:19.9053680Z Collecting python-dateutil<3.0.0,>=2.1 2025-12-04T10:09:19.9115430Z Downloading python_dateutil-2.9.0.post0-py2.py3-none-any.whl (229 kB) 2025-12-04T10:09:19.9144374Z ━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━━ 229.9/229.9 KB 108.0 MB/s eta 0:00:00 2025-12-04T10:09:19.9155981Z Requirement already satisfied: urllib3!=2.2.0,<3,>=1.25.4 in /home/runner/.local/lib/python3.10/site-packages (from botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.26.20) 2025-12-04T10:09:20.0026024Z Requirement already satisfied: six>=1.5 in /usr/lib/python3/dist-packages (from python-dateutil<3.0.0,>=2.1->botocore<1.36.0,>=1.35.33->boto3==1.35.33) (1.16.0) 2025-12-04T10:09:20.0776950Z Installing collected packages: nvidia-ml-py, python-dateutil, pynvml, psutil, jmespath, botocore, s3transfer, boto3 2025-12-04T10:09:20.4279046Z Successfully installed boto3-1.35.33 botocore-1.35.99 jmespath-1.0.1 nvidia-ml-py-12.575.51 psutil-7.0.0 pynvml-12.0.0 python-dateutil-2.9.0.post0 s3transfer-0.10.4 2025-12-04T10:09:20.5149442Z + DEVICE_NAME= 2025-12-04T10:09:20.5149753Z + DEVICE_TYPE= 2025-12-04T10:09:20.5150822Z + command -v nvidia-smi 2025-12-04T10:09:20.5151286Z + command -v rocminfo 2025-12-04T10:09:20.5156489Z + DEVICE_NAME=rocm 2025-12-04T10:09:20.5156838Z /usr/bin/rocminfo 2025-12-04T10:09:20.5172290Z ++ grep 'Marketing Name' 2025-12-04T10:09:20.5172594Z ++ tail -n1 2025-12-04T10:09:20.5173179Z ++ rocminfo 2025-12-04T10:09:20.5175742Z ++ xargs 2025-12-04T10:09:20.5178332Z ++ awk -F: '{print $2}' 2025-12-04T10:09:20.5811317Z + DEVICE_TYPE='AMD Instinct MI325X' 2025-12-04T10:09:20.5811826Z + echo DEVICE_NAME=rocm 2025-12-04T10:09:20.5812207Z + echo 'DEVICE_TYPE=AMD Instinct MI325X' 2025-12-04T10:09:20.5834819Z ##[group]Run set -eux 2025-12-04T10:09:20.5835017Z set -eux 2025-12-04T10:09:20.5835183Z  2025-12-04T10:09:20.5835372Z if [[ -z "${GITHUB_TOKEN}" ]]; then 2025-12-04T10:09:20.5835599Z  echo "Missing github-token input" 2025-12-04T10:09:20.5835809Z  exit 1 2025-12-04T10:09:20.5835980Z fi 2025-12-04T10:09:20.5841245Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:20.5841436Z env: 2025-12-04T10:09:20.5841574Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:20.5841755Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:20.5841988Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:20.5842281Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:20.5842748Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:20.5843312Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:20.5843469Z AWS_REGION: us-east-1 2025-12-04T10:09:20.5843681Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:20.5843887Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:20.5846383Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:20.5846606Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:20.5846843Z DEVICE_NAME: rocm 2025-12-04T10:09:20.5846994Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:20.5847285Z GITHUB_TOKEN: *** 2025-12-04T10:09:20.5847425Z ##[endgroup] 2025-12-04T10:09:20.5867542Z + [[ -z *** ]] 2025-12-04T10:09:20.5901618Z ##[group]Run pytorch/test-infra/.github/actions/get-workflow-job-id@main 2025-12-04T10:09:20.5901832Z with: 2025-12-04T10:09:20.5902016Z github-token: *** 2025-12-04T10:09:20.5902140Z env: 2025-12-04T10:09:20.5902259Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:20.5902432Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:20.5902649Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:20.5902844Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:20.5903460Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:20.5903865Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:20.5904015Z AWS_REGION: us-east-1 2025-12-04T10:09:20.5904167Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:20.5904347Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:20.5906534Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:20.5906733Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:20.5906947Z DEVICE_NAME: rocm 2025-12-04T10:09:20.5907080Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:20.5907225Z ##[endgroup] 2025-12-04T10:09:20.5914093Z ##[group]Run set -eux 2025-12-04T10:09:20.5914243Z set -eux 2025-12-04T10:09:20.5914358Z  2025-12-04T10:09:20.5914573Z python3 "${GITHUB_ACTION_PATH}/../../scripts/get_workflow_job_id.py" "${GITHUB_RUN_ID}" "${RUNNER_NAME}" 2025-12-04T10:09:20.5918629Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:20.5918796Z env: 2025-12-04T10:09:20.5918913Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:20.5919078Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:20.5919281Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:20.5919475Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:20.5919887Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:20.5920368Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:20.5920621Z AWS_REGION: us-east-1 2025-12-04T10:09:20.5920779Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:20.5920961Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:20.5923176Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:20.5923382Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:20.5923589Z DEVICE_NAME: rocm 2025-12-04T10:09:20.5923723Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:20.5923916Z GITHUB_TOKEN: *** 2025-12-04T10:09:20.5924038Z ##[endgroup] 2025-12-04T10:09:20.5946036Z + python3 /home/runner/_work/_actions/pytorch/test-infra/main/.github/actions/get-workflow-job-id/../../scripts/get_workflow_job_id.py 19922812470 linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z 2025-12-04T10:09:21.7280635Z setting job-id=57116139360 2025-12-04T10:09:21.7281141Z setting job-name=linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T10:09:21.7365853Z ##[group]Run set -eux 2025-12-04T10:09:21.7366130Z set -eux 2025-12-04T10:09:21.7366244Z  2025-12-04T10:09:21.7366354Z if [[ -n "" ]]; then 2025-12-04T10:09:21.7366489Z  source "" 2025-12-04T10:09:21.7366604Z fi 2025-12-04T10:09:21.7366705Z  2025-12-04T10:09:21.7366871Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_metadata.py" \ 2025-12-04T10:09:21.7367098Z  --schema-version "${SCHEMA_VERSION}" \ 2025-12-04T10:09:21.7367251Z  --repo "${REPO}" \ 2025-12-04T10:09:21.7367394Z  --head-branch "${HEAD_BRANCH}" \ 2025-12-04T10:09:21.7367542Z  --head-sha "${HEAD_SHA}" \ 2025-12-04T10:09:21.7367692Z  --workflow-id "${WORKFLOW_RUN_ID}" \ 2025-12-04T10:09:21.7367861Z  --run-attempt "${RUN_ATTEMPT}" \ 2025-12-04T10:09:21.7368006Z  --job-id "${JOB_ID}" \ 2025-12-04T10:09:21.7368143Z  --job-name "${JOB_NAME}" 2025-12-04T10:09:21.7372458Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:21.7372626Z env: 2025-12-04T10:09:21.7372736Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.7372892Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.7373135Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.7373321Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.7373722Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.7374110Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.7374255Z AWS_REGION: us-east-1 2025-12-04T10:09:21.7374458Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.7374629Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.7376815Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.7377011Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.7377222Z DEVICE_NAME: rocm 2025-12-04T10:09:21.7377346Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.7377481Z SCHEMA_VERSION: v3 2025-12-04T10:09:21.7377608Z REPO: pytorch/pytorch 2025-12-04T10:09:21.7377739Z HEAD_BRANCH: refs/heads/main 2025-12-04T10:09:21.7377893Z HEAD_SHA: ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 2025-12-04T10:09:21.7378051Z WORKFLOW_RUN_ID: 19922812470 2025-12-04T10:09:21.7378180Z RUN_ATTEMPT: 1 2025-12-04T10:09:21.7378291Z JOB_ID: 57116139360 2025-12-04T10:09:21.7378510Z JOB_NAME: linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests) 2025-12-04T10:09:21.7378744Z ##[endgroup] 2025-12-04T10:09:21.7399754Z + [[ -n '' ]] 2025-12-04T10:09:21.7401820Z + python3 /home/runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_metadata.py --schema-version v3 --repo pytorch/pytorch --head-branch refs/heads/main --head-sha ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32 --workflow-id 19922812470 --run-attempt 1 --job-id 57116139360 --job-name 'linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests)' 2025-12-04T10:09:21.7572708Z ##[group]Run set -eux 2025-12-04T10:09:21.7572986Z set -eux 2025-12-04T10:09:21.7573135Z  2025-12-04T10:09:21.7573274Z if [[ -n "" ]]; then 2025-12-04T10:09:21.7573449Z  source "" 2025-12-04T10:09:21.7573598Z fi 2025-12-04T10:09:21.7573730Z  2025-12-04T10:09:21.7573953Z python3 "${GITHUB_ACTION_PATH}/../../scripts/benchmarks/gather_runners_info.py" 2025-12-04T10:09:21.7590223Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:21.7590520Z env: 2025-12-04T10:09:21.7590646Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.7590816Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.7591024Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.7591298Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.7591729Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.7592138Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.7592278Z AWS_REGION: us-east-1 2025-12-04T10:09:21.7592489Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.7592671Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.7594869Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.7595069Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.7595281Z DEVICE_NAME: rocm 2025-12-04T10:09:21.7595416Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.7595567Z ##[endgroup] 2025-12-04T10:09:21.7619910Z + [[ -n '' ]] 2025-12-04T10:09:21.7620235Z + python3 /home/runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/benchmarks/gather_runners_info.py 2025-12-04T10:09:21.7827022Z INFO:root:Fail to import torch to get the device name 2025-12-04T10:09:21.7912760Z ##[group]Run set -eux 2025-12-04T10:09:21.7913030Z set -eux 2025-12-04T10:09:21.7913190Z  2025-12-04T10:09:21.7913377Z # TODO (huydhn): Implement this part 2025-12-04T10:09:21.7913619Z echo "dependencies={}" >> "${GITHUB_OUTPUT}" 2025-12-04T10:09:21.7918815Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:21.7919062Z env: 2025-12-04T10:09:21.7919227Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.7919452Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.7919752Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.7920016Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.7920599Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.7921124Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.7921279Z AWS_REGION: us-east-1 2025-12-04T10:09:21.7921503Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.7921703Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.7924299Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.7924514Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.7924748Z DEVICE_NAME: rocm 2025-12-04T10:09:21.7924897Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.7925054Z ##[endgroup] 2025-12-04T10:09:21.7937923Z + echo 'dependencies={}' 2025-12-04T10:09:21.7964130Z ##[group]Run set -eux 2025-12-04T10:09:21.7964323Z set -eux 2025-12-04T10:09:21.7964464Z  2025-12-04T10:09:21.7964602Z if [[ -n "" ]]; then 2025-12-04T10:09:21.7964755Z  source "" 2025-12-04T10:09:21.7965076Z fi 2025-12-04T10:09:21.7965204Z  2025-12-04T10:09:21.7965361Z if [[ ! -d "${BENCHMARK_RESULTS_DIR}" ]]; then 2025-12-04T10:09:21.7965593Z  echo "${BENCHMARK_RESULTS_DIR} does not exist, skipping" 2025-12-04T10:09:21.7965841Z  # We don't want the job to fail if the directory doesn't exist 2025-12-04T10:09:21.7966032Z  exit 0 2025-12-04T10:09:21.7966167Z fi 2025-12-04T10:09:21.7966297Z  2025-12-04T10:09:21.7966431Z if [[ "${DRY_RUN}" == "true" ]]; then 2025-12-04T10:09:21.7966679Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-12-04T10:09:21.7966956Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-12-04T10:09:21.7967252Z  --metadata "${BENCHMARK_METADATA}" \ 2025-12-04T10:09:21.7967438Z  --runners "${RUNNER_INFO}" \ 2025-12-04T10:09:21.7967628Z  --dependencies "${DEPENDENCIES}" \ 2025-12-04T10:09:21.7968362Z  --dry-run 2025-12-04T10:09:21.7968504Z else 2025-12-04T10:09:21.7968709Z  python3 "${GITHUB_ACTION_PATH}/../../scripts/upload_benchmark_results.py" \ 2025-12-04T10:09:21.7968978Z  --benchmark-results-dir "${BENCHMARK_RESULTS_DIR}" \ 2025-12-04T10:09:21.7969187Z  --metadata "${BENCHMARK_METADATA}" \ 2025-12-04T10:09:21.7969378Z  --runners "${RUNNER_INFO}" \ 2025-12-04T10:09:21.7969559Z  --dependencies "${DEPENDENCIES}" 2025-12-04T10:09:21.7969729Z fi 2025-12-04T10:09:21.7977777Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:21.7977954Z env: 2025-12-04T10:09:21.7978081Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.7978237Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.7978438Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.7978624Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.7979037Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.7979426Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.7979568Z AWS_REGION: us-east-1 2025-12-04T10:09:21.7979781Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.7979958Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.7982168Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.7982368Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.7982578Z DEVICE_NAME: rocm 2025-12-04T10:09:21.7982714Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.7982872Z BENCHMARK_RESULTS_DIR: test/test-reports 2025-12-04T10:09:21.7983077Z DRY_RUN: false 2025-12-04T10:09:21.7983607Z BENCHMARK_METADATA: {"timestamp": 1764842961, "schema_version": "v3", "name": "linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32", "workflow_id": 19922812470, "run_attempt": 1, "job_id": 57116139360} 2025-12-04T10:09:21.7984327Z RUNNER_INFO: [{"cpu_info": "x86_64", "cpu_count": 128, "avail_mem_in_gb": 3023, "extra_info": {"hostname": "linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z"}, "name": "rocm", "type": "AMD Instinct MI325X"}] 2025-12-04T10:09:21.7984640Z DEPENDENCIES: {} 2025-12-04T10:09:21.7984769Z ##[endgroup] 2025-12-04T10:09:21.8004347Z + [[ -n '' ]] 2025-12-04T10:09:21.8004477Z + [[ ! -d test/test-reports ]] 2025-12-04T10:09:21.8004636Z + [[ false == \t\r\u\e ]] 2025-12-04T10:09:21.8005773Z + python3 /home/runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py --benchmark-results-dir test/test-reports --metadata '{"timestamp": 1764842961, "schema_version": "v3", "name": "linux-noble-rocm-py3.12-mi300 / test (default, 6, 6, linux.rocm.gpu.gfx942.1.b, rerun_disabled_tests)", "repo": "pytorch/pytorch", "head_branch": "refs/heads/main", "head_sha": "ffd9b0fb4355e97af82fc42cf185c3ffa0fc0a32", "workflow_id": 19922812470, "run_attempt": 1, "job_id": 57116139360}' --runners '[{"cpu_info": "x86_64", "cpu_count": 128, "avail_mem_in_gb": 3023, "extra_info": {"hostname": "linux.rocm.gpu.gfx942.1.b-gwk9b-runner-5js8z"}, "name": "rocm", "type": "AMD Instinct MI325X"}]' --dependencies '{}' 2025-12-04T10:09:21.8653688Z /home/runner/_work/_actions/pytorch/test-infra/main/.github/actions/upload-benchmark-results/../../scripts/upload_benchmark_results.py:236: UserWarning: {'included': [{'test_file': 'inductor/test_collective_autotuning'}, {'test_file': 'test_public_bindings'}, {'test_file': 'inductor/test_aot_inductor'}, {'test_file': 'inductor/test_torchinductor'}, {'test_file': 'inductor/test_select_algorithm'}, {'test_file': 'inductor/test_torchinductor_dynamic_shapes'}, {'test_file': 'inductor/test_torchinductor_codegen_dynamic_shapes'}, {'test_file': 'inductor/test_torchinductor_opinfo'}, {'test_file': 'inductor/test_kernel_benchmark'}, {'test_file': 'inductor/test_pattern_matcher'}, {'test_file': 'dynamo/test_dynamic_shapes'}, {'test_file': 'inductor/test_cpu_repro'}, {'test_file': 'inductor/test_group_batch_fusion'}, {'test_file': 'dynamo/test_logging'}, {'test_file': 'inductor/test_cuda_repro'}, {'test_file': 'dynamo/test_unspec'}, {'test_file': 'dynamo/test_after_aot'}, {'test_file': 'inductor/test_minifier'}, {'test_file': 'inductor/test_binary_folding'}, {'test_file': 'inductor/test_compiled_autograd'}, {'test_file': 'dynamo/test_activation_checkpointing'}, {'test_file': 'dynamo/test_ctx_manager'}, {'test_file': 'inductor/test_inductor_freezing'}, {'test_file': 'dynamo/test_repros'}, {'test_file': 'inductor/test_mkldnn_pattern_matcher'}, {'test_file': 'dynamo/test_higher_order_ops'}, {'test_file': 'dynamo/test_misc'}, {'test_file': 'dynamo/test_exc'}, {'test_file': 'inductor/test_cudagraph_trees'}, {'test_file': 'inductor/test_custom_lowering'}, {'test_file': 'inductor/test_fused_attention'}, {'test_file': 'inductor/test_layout_optim'}, {'test_file': 'inductor/test_mmdecomp'}, {'test_file': 'inductor/test_perf'}, {'test_file': 'inductor/test_smoke'}, {'test_file': 'inductor/test_snode_runtime'}, {'test_file': 'inductor/test_flex_attention'}, {'test_file': 'inductor/test_cpu_select_algorithm'}, {'test_file': 'inductor/test_cuda_select_algorithm'}, {'test_file': 'inductor/test_cpu_cpp_wrapper'}, {'test_file': 'functorch/test_eager_transforms'}, {'test_file': 'test_content_store'}, {'test_file': 'test_testing'}, {'test_file': 'test_custom_ops'}, {'test_file': 'test_sparse_semi_structured'}, {'test_file': 'inductor/test_aot_inductor_arrayref'}, {'test_file': 'inductor/test_cutlass_backend'}, {'test_file': 'inductor/test_halide'}, {'test_file': 'inductor/test_custom_op_autotune'}, {'test_file': 'inductor/test_torchinductor_strided_blocks'}, {'test_file': 'inductor/test_compile_subprocess'}, {'test_file': 'dynamo/test_einops'}, {'test_file': 'inductor/test_triton_cpu_backend'}, {'test_file': 'export/test_serialize'}, {'test_file': 'inductor/test_deterministic'}, {'test_file': 'inductor/test_multi_kernel'}, {'test_file': 'dynamo/test_model_output'}, {'test_file': 'inductor/test_selective_lowering'}, {'test_file': 'dynamo/test_backends'}, {'test_file': 'inductor/test_loop_ordering'}, {'test_file': 'inductor/test_native_matmul'}, {'test_file': 'inductor/test_triton_heuristics'}, {'test_file': 'inductor/test_flex_decoding'}, {'test_file': 'dynamo/test_aot_autograd'}, {'test_file': 'dynamo/test_functions'}, {'test_file': 'dynamo/test_modules'}, {'test_file': 'inductor/test_subgraph_choice'}, {'test_file': 'inductor/test_gpu_cpp_wrapper'}, {'test_file': 'dynamo/test_regional_inductor'}, {'test_file': 'inductor/test_triton_kernels'}, {'test_file': 'inductor/test_inplace_padding'}, {'test_file': 'inductor/test_fp8'}, {'test_file': 'inductor/test_inductor_scheduler'}, {'test_file': 'inductor/test_analysis'}, {'test_file': 'inductor/test_utils'}, {'test_file': 'inductor/test_op_completeness'}, {'test_file': 'inductor/test_unbacked_symints'}, {'test_file': 'inductor/test_kernel_optimization'}, {'test_file': 'dynamo/test_cudagraphs'}, {'test_file': 'dynamo/test_fx_graph_runnable'}, {'test_file': 'inductor/test_pad_mm'}, {'test_file': 'dynamo/test_fake_distributed'}, {'test_file': 'inductor/test_triton_extension_backend'}, {'test_file': 'inductor/test_distributed_patterns'}, {'test_file': 'dynamo/test_streams'}, {'test_file': 'dynamo/test_utils'}, {'test_file': 'dynamo/test_aot_autograd_cache'}, {'test_file': 'inductor/test_mps_basic'}, {'test_file': 'inductor/test_padding'}, {'test_file': 'inductor/test_external_callables'}, {'test_file': 'export/test_export_training_ir_to_run_decomp'}, {'test_file': 'export/test_retraceability'}, {'test_file': 'inductor/test_b2b_gemm'}, {'test_file': 'inductor/test_provenance_tracing'}, {'test_file': 'dynamo/test_global'}, {'test_file': 'dynamo/test_input_attr_tracking'}, {'test_file': 'export/test_export'}, {'test_file': 'inductor/test_op_dtype_prop'}, {'test_file': 'inductor/test_benchmarking'}, {'test_file': 'inductor/test_cpp_wrapper_hipify'}, {'test_file': 'inductor/test_profiler'}, {'test_file': 'inductor/test_memory'}, {'test_file': 'inductor/test_cutlass_evt'}, {'test_file': 'inductor/test_codecache'}, {'test_file': 'inductor/test_coordinate_descent_tuner'}, {'test_file': 'inductor/test_torchbind'}, {'test_file': 'export/test_unflatten'}, {'test_file': 'export/test_hop'}, {'test_file': 'inductor/test_metrics'}, {'test_file': 'export/test_cpp_serdes'}, {'test_file': 'export/test_serdes'}, {'test_file': 'dynamo/test_pgo'}, {'test_file': 'inductor/test_aot_inductor_package'}, {'test_file': 'inductor/test_async_compile'}, {'test_file': 'inductor/test_benchmark_fusion'}, {'test_file': 'inductor/test_compiled_optimizers'}, {'test_file': 'inductor/test_cudacodecache'}, {'test_file': 'inductor/test_debug_trace'}, {'test_file': 'dynamo/test_guard_serialization'}, {'test_file': 'dynamo/test_recompile_ux'}, {'test_file': 'export/test_torchbind'}, {'test_file': 'export/test_strict_export_v2'}, {'test_file': 'inductor/test_caching'}, {'test_file': 'dynamo/test_structured_trace'}, {'test_file': 'export/test_export_strict'}, {'test_file': 'dynamo/test_aot_compile'}, {'test_file': 'dynamo/test_autograd_function'}, {'test_file': 'dynamo/test_backward_higher_order_ops'}, {'test_file': 'dynamo/test_base_hop'}, {'test_file': 'dynamo/test_base_output'}, {'test_file': 'dynamo/test_buffers_override'}, {'test_file': 'dynamo/test_bytecode_utils'}, {'test_file': 'dynamo/test_callback'}, {'test_file': 'dynamo/test_compile'}, {'test_file': 'dynamo/test_compiler_bisector'}, {'test_file': 'dynamo/test_comptime'}, {'test_file': 'dynamo/test_config'}, {'test_file': 'dynamo/test_cudagraphs_expandable_segments'}, {'test_file': 'dynamo/test_debug_utils'}, {'test_file': 'dynamo/test_decorators'}, {'test_file': 'dynamo/test_deque_reconstruct'}, {'test_file': 'dynamo/test_deviceguard'}, {'test_file': 'dynamo/test_dicts'}, {'test_file': 'dynamo/test_error_messages'}, {'test_file': 'dynamo/test_exceptions'}, {'test_file': 'dynamo/test_export'}, {'test_file': 'dynamo/test_export_mutations'}, {'test_file': 'dynamo/test_flat_apply'}, {'test_file': 'dynamo/test_frame_init'}, {'test_file': 'dynamo/test_fx_annotate'}, {'test_file': 'dynamo/test_fx_passes_pre_grad'}, {'test_file': 'dynamo/test_generator'}, {'test_file': 'dynamo/test_graph_deduplication'}, {'test_file': 'dynamo/test_graph_region_tracker'}, {'test_file': 'dynamo/test_guard_manager'}, {'test_file': 'dynamo/test_hooks'}, {'test_file': 'dynamo/test_inline_and_install'}, {'test_file': 'dynamo/test_install_free_tensors'}, {'test_file': 'dynamo/test_interop'}, {'test_file': 'dynamo/test_list'}, {'test_file': 'dynamo/test_metrics_context'}, {'test_file': 'dynamo/test_minifier'}, {'test_file': 'dynamo/test_modes'}, {'test_file': 'dynamo/test_nested_graph_breaks'}, {'test_file': 'dynamo/test_nops'}, {'test_file': 'dynamo/test_optimizers'}, {'test_file': 'dynamo/test_package'}, {'test_file': 'dynamo/test_pre_dispatch'}, {'test_file': 'dynamo/test_precompile_context'}, {'test_file': 'dynamo/test_profiler'}, {'test_file': 'dynamo/test_python_autograd'}, {'test_file': 'dynamo/test_python_dispatcher'}, {'test_file': 'dynamo/test_recompiles'}, {'test_file': 'dynamo/test_reconstruct'}, {'test_file': 'dynamo/test_reorder_logs'}, {'test_file': 'dynamo/test_resume'}, {'test_file': 'dynamo/test_sdpa'}, {'test_file': 'dynamo/test_sets'}, {'test_file': 'dynamo/test_skip_guard_eval_unsafe'}, {'test_file': 'dynamo/test_skip_non_tensor'}, {'test_file': 'dynamo/test_sources'}, {'test_file': 'dynamo/test_subclasses'}, {'test_file': 'dynamo/test_subgraphs'}, {'test_file': 'dynamo/test_torchrec'}, {'test_file': 'dynamo/test_trace_rules'}, {'test_file': 'dynamo/test_tree_map'}, {'test_file': 'dynamo/test_unittest'}, {'test_file': 'dynamo/test_verify_correctness'}, {'test_file': 'dynamo/test_view'}, {'test_file': 'dynamo/test_wrap_inductor_compiled_regions'}, {'test_file': 'export/test_converter'}, {'test_file': 'export/test_db'}, {'test_file': 'export/test_draft_export'}, {'test_file': 'export/test_dynamic_shapes'}, {'test_file': 'export/test_experimental'}, {'test_file': 'export/test_export_opinfo'}, {'test_file': 'export/test_functionalized_assertions'}, {'test_file': 'export/test_lift_unlift'}, {'test_file': 'export/test_nativert'}, {'test_file': 'export/test_package'}, {'test_file': 'export/test_pass_infra'}, {'test_file': 'export/test_passes'}, {'test_file': 'export/test_schema'}, {'test_file': 'export/test_sparse'}, {'test_file': 'export/test_swap'}, {'test_file': 'export/test_tools'}, {'test_file': 'export/test_tree_utils'}, {'test_file': 'export/test_unflatten_training_ir'}, {'test_file': 'export/test_upgrader'}, {'test_file': 'export/test_verifier'}, {'test_file': 'inductor/test_alignment'}, {'test_file': 'inductor/test_aot_inductor_custom_ops'}, {'test_file': 'inductor/test_aot_inductor_utils'}, {'test_file': 'inductor/test_augmented_graph_helper'}, {'test_file': 'inductor/test_auto_functionalize'}, {'test_file': 'inductor/test_autoheuristic'}, {'test_file': 'inductor/test_best_config'}, {'test_file': 'inductor/test_block_analysis'}, {'test_file': 'inductor/test_cache'}, {'test_file': 'inductor/test_ck_backend'}, {'test_file': 'inductor/test_codegen_triton'}, {'test_file': 'inductor/test_combo_kernels'}, {'test_file': 'inductor/test_compile'}, {'test_file': 'inductor/test_compile_worker'}, {'test_file': 'inductor/test_config'}, {'test_file': 'inductor/test_control_deps'}, {'test_file': 'inductor/test_control_flow'}, {'test_file': 'inductor/test_cooperative_reductions'}, {'test_file': 'inductor/test_cudagraph_trees_expandable_segments'}, {'test_file': 'inductor/test_custom_partitioner_fn'}, {'test_file': 'inductor/test_custom_post_grad_passes'}, {'test_file': 'inductor/test_cutedsl_grouped_mm'}, {'test_file': 'inductor/test_cutedsl_template'}, {'test_file': 'inductor/test_decompose_mem_bound_mm'}, {'test_file': 'inductor/test_dependencies'}, {'test_file': 'inductor/test_device_assert'}, {'test_file': 'inductor/test_efficient_conv_bn_eval'}, {'test_file': 'inductor/test_extension_backend'}, {'test_file': 'inductor/test_flex_flash'}, {'test_file': 'inductor/test_foreach'}, {'test_file': 'inductor/test_fuzzer'}, {'test_file': 'inductor/test_fx_fusion'}, {'test_file': 'inductor/test_fxir_backend'}, {'test_file': 'inductor/test_graph_transform_observer'}, {'test_file': 'inductor/test_helion_kernels'}, {'test_file': 'inductor/test_indexing'}, {'test_file': 'inductor/test_inductor_annotations'}, {'test_file': 'inductor/test_inductor_utils'}, {'test_file': 'inductor/test_inplacing_pass'}, {'test_file': 'inductor/test_lookup_table'}, {'test_file': 'inductor/test_mem_estimation'}, {'test_file': 'inductor/test_memory_planning'}, {'test_file': 'inductor/test_minifier_isolate'}, {'test_file': 'inductor/test_minifier_utils'}, {'test_file': 'inductor/test_mix_order_reduction'}, {'test_file': 'inductor/test_move_constructors_to_gpu'}, {'test_file': 'inductor/test_needs_exact_strides'}, {'test_file': 'inductor/test_online_softmax'}, {'test_file': 'inductor/test_ordered_set'}, {'test_file': 'inductor/test_pallas'}, {'test_file': 'inductor/test_quantization'}, {'test_file': 'inductor/test_remote_cache'}, {'test_file': 'inductor/test_scatter_optimization'}, {'test_file': 'inductor/test_segmented_tree'}, {'test_file': 'inductor/test_split_cat_fx_aten_passes'}, {'test_file': 'inductor/test_split_cat_fx_passes'}, {'test_file': 'inductor/test_static_cuda_launcher'}, {'test_file': 'inductor/test_template_heuristics_registry'}, {'test_file': 'inductor/test_torchinductor_codegen_config_overrides'}, {'test_file': 'inductor/test_triton_syntax'}, {'test_file': 'inductor/test_triton_wrapper'}, {'test_file': 'inductor/test_xpu_basic'}, {'test_file': 'test_model_exports_to_core_aten'}, {'test_file': 'test_sort_and_select'}, {'test_file': 'test_cuda'}, {'test_file': 'test_privateuseone_python_backend'}, {'test_file': 'test_sparse'}, {'test_file': 'profiler/test_profiler'}, {'test_file': 'test_varlen_attention'}, {'test_file': 'test_torch'}, {'test_file': 'test_autograd'}, {'test_file': 'test_matmul_cuda'}, {'test_file': 'test_torchfuzz_repros'}, {'test_file': 'test_linalg'}, {'test_file': 'test_dataloader'}, {'test_file': 'doctests'}, {'test_file': 'test_dynamic_shapes'}, {'test_file': 'test_utils_filelock'}, {'test_file': 'test_fake_tensor'}, {'test_file': 'test_ops'}, {'test_file': 'functorch/test_aot_joint_with_descriptors'}, {'test_file': 'test_decomp'}, {'test_file': 'test_nn'}, {'test_file': 'nn/test_convolution'}, {'test_file': 'nn/test_multihead_attention'}, {'test_file': 'test_foreach'}, {'test_file': 'higher_order_ops/test_invoke_quant'}, {'test_file': 'higher_order_ops/test_local_map'}, {'test_file': 'higher_order_ops/test_invoke_subgraph'}, {'test_file': 'test_transformers'}, {'test_file': 'test_utils'}, {'test_file': 'profiler/test_memory_profiler'}, {'test_file': 'test_expanded_weights'}, {'test_file': 'functorch/test_aotdispatch'}, {'test_file': 'test_cuda_expandable_segments'}, {'test_file': 'test_fx'}, {'test_file': 'nn/test_parametrization'}, {'test_file': 'test_numpy_interop'}, {'test_file': 'test_overrides'}, {'test_file': 'test_package'}, {'test_file': 'test_python_dispatch'}, {'test_file': 'test_tensor_creation_ops'}, {'test_file': 'backends/xeon/test_launch'}, {'test_file': 'benchmark_utils/test_benchmark_utils'}, {'test_file': 'complex_tensor/test_complex_tensor'}, {'test_file': 'cpp_extensions/libtorch_agnostic_2_10_extension/test_version_compatibility'}, {'test_file': 'cpp_extensions/python_agnostic_extension/test/test_python_agnostic'}, {'test_file': 'cpp_extensions/test_libtorch_agnostic'}, {'test_file': 'distributions/test_constraints'}, {'test_file': 'distributions/test_distributions'}, {'test_file': 'functorch/dim/test_getsetitem'}, {'test_file': 'functorch/dim/test_split'}, {'test_file': 'functorch/test_ac'}, {'test_file': 'functorch/test_ac_knapsack'}, {'test_file': 'functorch/test_ac_logging'}, {'test_file': 'functorch/test_control_flow'}, {'test_file': 'functorch/test_logging'}, {'test_file': 'functorch/test_minifier'}, {'test_file': 'functorch/test_ops'}, {'test_file': 'functorch/test_vmap'}, {'test_file': 'functorch/test_vmap_registrations'}, {'test_file': 'higher_order_ops/test_print'}, {'test_file': 'higher_order_ops/test_with_effects'}, {'test_file': 'lazy/test_bindings'}, {'test_file': 'lazy/test_debug_util'}, {'test_file': 'lazy/test_functionalization'}, {'test_file': 'lazy/test_generator'}, {'test_file': 'lazy/test_reuse_ir'}, {'test_file': 'lazy/test_step_closures'}, {'test_file': 'lazy/test_ts_opinfo'}, {'test_file': 'nn/attention/test_fa4'}, {'test_file': 'nn/attention/test_open_registry'}, {'test_file': 'nn/test_dropout'}, {'test_file': 'nn/test_embedding'}, {'test_file': 'nn/test_init'}, {'test_file': 'nn/test_lazy_modules'}, {'test_file': 'nn/test_load_state_dict'}, {'test_file': 'nn/test_module_hooks'}, {'test_file': 'nn/test_packed_sequence'}, {'test_file': 'nn/test_pooling'}, {'test_file': 'nn/test_pruning'}, {'test_file': 'optim/test_lrscheduler'}, {'test_file': 'optim/test_optim'}, {'test_file': 'optim/test_swa_utils'}, {'test_file': 'profiler/test_cpp_thread'}, {'test_file': 'profiler/test_execution_trace'}, {'test_file': 'profiler/test_kineto'}, {'test_file': 'profiler/test_profiler_tree'}, {'test_file': 'profiler/test_python_tracer'}, {'test_file': 'profiler/test_record_function'}, {'test_file': 'profiler/test_torch_tidy'}, {'test_file': 'test_accelerator'}, {'test_file': 'test_ao_sparsity'}, {'test_file': 'test_appending_byte_serializer'}, {'test_file': 'test_as_strided'}, {'test_file': 'test_autocast'}, {'test_file': 'test_autograd_fallback'}, {'test_file': 'test_autoload'}, {'test_file': 'test_autoload_disable'}, {'test_file': 'test_autoload_enable'}, {'test_file': 'test_binary_ufuncs'}, {'test_file': 'test_bundled_inputs'}, {'test_file': 'test_ci_sanity_check_fail'}, {'test_file': 'test_comparison_utils'}, {'test_file': 'test_compile_benchmark_util'}, {'test_file': 'test_complex'}, {'test_file': 'test_cpp_api_parity'}, {'test_file': 'test_cpp_extensions_aot_ninja'}, {'test_file': 'test_cpp_extensions_aot_no_ninja'}, {'test_file': 'test_cpp_extensions_jit'}, {'test_file': 'test_cpp_extensions_mtia_backend'}, {'test_file': 'test_cpp_extensions_stream_and_event'}, {'test_file': 'test_cuda_multigpu'}, {'test_file': 'test_cuda_primary_ctx'}, {'test_file': 'test_cuda_sanitizer'}, {'test_file': 'test_cuda_trace'}, {'test_file': 'test_datapipe'}, {'test_file': 'test_dispatch'}, {'test_file': 'test_dlpack'}, {'test_file': 'test_extension_utils'}, {'test_file': 'test_file_check'}, {'test_file': 'test_flop_counter'}, {'test_file': 'test_function_schema'}, {'test_file': 'test_functional_autograd_benchmark'}, {'test_file': 'test_functional_optim'}, {'test_file': 'test_functionalization'}, {'test_file': 'test_functionalization_of_rng_ops'}, {'test_file': 'test_futures'}, {'test_file': 'test_fx_experimental'}, {'test_file': 'test_fx_passes'}, {'test_file': 'test_fx_reinplace_pass'}, {'test_file': 'test_hop_infra'}, {'test_file': 'test_hub'}, {'test_file': 'test_import_stats'}, {'test_file': 'test_indexing'}, {'test_file': 'test_itt'}, {'test_file': 'test_jit'}, {'test_file': 'test_jit_autocast'}, {'test_file': 'test_jit_disabled'}, {'test_file': 'test_jit_fuser_te'}, {'test_file': 'test_jit_llga_fuser'}, {'test_file': 'test_jiterator'}, {'test_file': 'test_legacy_vmap'}, {'test_file': 'test_license'}, {'test_file': 'test_logging'}, {'test_file': 'test_masked'}, {'test_file': 'test_maskedtensor'}, {'test_file': 'test_meta'}, {'test_file': 'test_mkl_verbose'}, {'test_file': 'test_mkldnn'}, {'test_file': 'test_mkldnn_fusion'}, {'test_file': 'test_mkldnn_verbose'}, {'test_file': 'test_mobile_optimizer'}, {'test_file': 'test_module_tracker'}, {'test_file': 'test_modules'}, {'test_file': 'test_monitor'}, {'test_file': 'test_multiprocessing'}, {'test_file': 'test_multiprocessing_spawn'}, {'test_file': 'test_namedtensor'}, {'test_file': 'test_namedtuple_return_api'}, {'test_file': 'test_native_functions'}, {'test_file': 'test_native_mha'}, {'test_file': 'test_nestedtensor'}, {'test_file': 'test_numa_binding'}, {'test_file': 'test_numba_integration'}, {'test_file': 'test_opaque_obj_v2'}, {'test_file': 'test_openmp'}, {'test_file': 'test_ops_fwd_gradients'}, {'test_file': 'test_ops_gradients'}, {'test_file': 'test_ops_jit'}, {'test_file': 'test_optim'}, {'test_file': 'test_out_dtype_op'}, {'test_file': 'test_per_overload_api'}, {'test_file': 'test_prims'}, {'test_file': 'test_proxy_tensor'}, {'test_file': 'test_pruning_op'}, {'test_file': 'test_pytree'}, {'test_file': 'test_reductions'}, {'test_file': 'test_rename_privateuse1_to_existing_device'}, {'test_file': 'test_scaled_matmul_cuda'}, {'test_file': 'test_scatter_gather_ops'}, {'test_file': 'test_schema_check'}, {'test_file': 'test_segment_reductions'}, {'test_file': 'test_serialization'}, {'test_file': 'test_set_default_mobile_cpu_allocator'}, {'test_file': 'test_shape_ops'}, {'test_file': 'test_show_pickle'}, {'test_file': 'test_sparse_csr'}, {'test_file': 'test_spectral_ops'}, {'test_file': 'test_stateless'}, {'test_file': 'test_subclass'}, {'test_file': 'test_sympy_utils'}, {'test_file': 'test_tensorboard'}, {'test_file': 'test_tensorexpr'}, {'test_file': 'test_tensorexpr_pybind'}, {'test_file': 'test_type_hints'}, {'test_file': 'test_type_info'}, {'test_file': 'test_type_promotion'}, {'test_file': 'test_typing'}, {'test_file': 'test_unary_ufuncs'}, {'test_file': 'test_utils_config_module'}, {'test_file': 'test_view_ops'}, {'test_file': 'test_vulkan'}, {'test_file': 'test_weak'}, {'test_file': 'test_xnnpack_integration'}, {'test_file': 'torch_np/numpy_tests/core/test_dlpack'}, {'test_file': 'torch_np/numpy_tests/core/test_dtype'}, {'test_file': 'torch_np/numpy_tests/core/test_einsum'}, {'test_file': 'torch_np/numpy_tests/core/test_getlimits'}, {'test_file': 'torch_np/numpy_tests/core/test_indexing'}, {'test_file': 'torch_np/numpy_tests/core/test_numeric'}, {'test_file': 'torch_np/numpy_tests/core/test_numerictypes'}, {'test_file': 'torch_np/numpy_tests/core/test_scalar_ctors'}, {'test_file': 'torch_np/numpy_tests/core/test_scalar_methods'}, {'test_file': 'torch_np/numpy_tests/core/test_scalarinherit'}, {'test_file': 'torch_np/numpy_tests/core/test_scalarmath'}, {'test_file': 'torch_np/numpy_tests/core/test_shape_base'}, {'test_file': 'torch_np/numpy_tests/fft/test_helper'}, {'test_file': 'torch_np/numpy_tests/fft/test_pocketfft'}, {'test_file': 'torch_np/numpy_tests/lib/test_arraypad'}, {'test_file': 'torch_np/numpy_tests/lib/test_arraysetops'}, {'test_file': 'torch_np/numpy_tests/lib/test_function_base'}, {'test_file': 'torch_np/numpy_tests/lib/test_histograms'}, {'test_file': 'torch_np/numpy_tests/lib/test_index_tricks'}, {'test_file': 'torch_np/numpy_tests/lib/test_shape_base_'}, {'test_file': 'torch_np/numpy_tests/lib/test_twodim_base'}, {'test_file': 'torch_np/numpy_tests/lib/test_type_check'}, {'test_file': 'torch_np/numpy_tests/linalg/test_linalg'}, {'test_file': 'torch_np/test_basic'}, {'test_file': 'torch_np/test_binary_ufuncs'}, {'test_file': 'torch_np/test_dtype'}, {'test_file': 'torch_np/test_function_base'}, {'test_file': 'torch_np/test_indexing'}, {'test_file': 'torch_np/test_ndarray_methods'}, {'test_file': 'torch_np/test_nep50_examples'}, {'test_file': 'torch_np/test_random'}, {'test_file': 'torch_np/test_reductions'}, {'test_file': 'torch_np/test_scalars_0D_arrays'}, {'test_file': 'torch_np/test_ufuncs_basic'}, {'test_file': 'torch_np/test_unary_ufuncs'}, {'test_file': 'typing/test_python_operators'}, {'test_file': 'xpu/test_conv'}, {'test_file': 'xpu/test_fusion'}, {'test_file': 'xpu/test_gemm'}], 'excluded': []} from test/test-reports/td_exclusions-973ef08d1edb08dd1038.json is not a benchmark record, skipping 2025-12-04T10:09:21.8677915Z warn(f"{result} from {filepath} is not a benchmark record, skipping") 2025-12-04T10:09:21.8746437Z Prepare all required actions 2025-12-04T10:09:21.8746712Z Getting action download info 2025-12-04T10:09:21.8759839Z ##[group]Run ./.github/actions/teardown-rocm 2025-12-04T10:09:21.8759997Z env: 2025-12-04T10:09:21.8760117Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.8760281Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.8760490Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.8760686Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.8761102Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.8761508Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.8761648Z AWS_REGION: us-east-1 2025-12-04T10:09:21.8761834Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.8762036Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.8764257Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.8764457Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.8764667Z DEVICE_NAME: rocm 2025-12-04T10:09:21.8764798Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.8764940Z ##[endgroup] 2025-12-04T10:09:21.8772120Z ##[group]Run # ignore expansion of "docker ps -q" since it could be empty 2025-12-04T10:09:21.8772378Z # ignore expansion of "docker ps -q" since it could be empty 2025-12-04T10:09:21.8772566Z # shellcheck disable=SC2046 2025-12-04T10:09:21.8772734Z docker stop $(docker ps -q) || true 2025-12-04T10:09:21.8772903Z # Prune all stopped containers. 2025-12-04T10:09:21.8773099Z docker container prune -f 2025-12-04T10:09:21.8777034Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:21.8777215Z env: 2025-12-04T10:09:21.8777335Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:21.8777512Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:21.8777802Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:21.8778000Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:21.8778408Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:21.8778860Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:21.8779011Z AWS_REGION: us-east-1 2025-12-04T10:09:21.8779170Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:21.8779350Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:21.8781516Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:21.8781720Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:21.8781935Z DEVICE_NAME: rocm 2025-12-04T10:09:21.8782067Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:21.8782221Z ##[endgroup] 2025-12-04T10:09:32.4975974Z ecc8d1cc1a55 2025-12-04T10:09:35.2737856Z Deleted Containers: 2025-12-04T10:09:35.2738159Z ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:35.2738315Z 2025-12-04T10:09:35.2738383Z Total reclaimed space: 10.54GB 2025-12-04T10:09:35.2776482Z Prepare all required actions 2025-12-04T10:09:35.2791016Z ##[group]Run ./.github/actions/diskspace-cleanup 2025-12-04T10:09:35.2791169Z with: 2025-12-04T10:09:35.2791283Z diskspace-cutoff: 70 2025-12-04T10:09:35.2791406Z env: 2025-12-04T10:09:35.2791512Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:35.2791666Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:35.2791891Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:35.2792074Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:35.2792643Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:35.2793089Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:35.2793229Z AWS_REGION: us-east-1 2025-12-04T10:09:35.2793426Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:35.2793594Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:35.2795760Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:35.2795952Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:35.2796151Z DEVICE_NAME: rocm 2025-12-04T10:09:35.2796269Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:35.2796405Z ##[endgroup] 2025-12-04T10:09:35.2805714Z ##[group]Run set -ex 2025-12-04T10:09:35.2805865Z set -ex 2025-12-04T10:09:35.2805985Z diskspace_cutoff=70 2025-12-04T10:09:35.2806154Z docker_root_dir=$(docker info -f '{{.DockerRootDir}}') 2025-12-04T10:09:35.2806333Z if [ ! -d "$docker_root_dir" ]; then 2025-12-04T10:09:35.2806559Z  echo "Docker root directory ($docker_root_dir) does not exist. Skipping disk space check." 2025-12-04T10:09:35.2806771Z  exit 0 2025-12-04T10:09:35.2806887Z fi 2025-12-04T10:09:35.2807072Z diskspace=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-12-04T10:09:35.2807423Z msg="Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified" 2025-12-04T10:09:35.2807729Z if [[ "$diskspace" -ge "$diskspace_cutoff" ]] ; then 2025-12-04T10:09:35.2807899Z  docker system prune -af 2025-12-04T10:09:35.2808116Z  diskspace_new=$(df -H --output=pcent ${docker_root_dir} | sed -n 2p | sed 's/%//' | sed 's/ //') 2025-12-04T10:09:35.2808356Z  if [[ "$diskspace_new" -gt "$diskspace_cutoff" ]] ; then 2025-12-04T10:09:35.2808543Z  diskspace_cutoff_int=$((diskspace_cutoff + 0)) 2025-12-04T10:09:35.2808762Z  difference=$((100 - diskspace_cutoff_int)) 2025-12-04T10:09:35.2809083Z  echo "Error: Available diskspace is less than $difference percent. Not enough diskspace." 2025-12-04T10:09:35.2809300Z  echo "$msg" 2025-12-04T10:09:35.2809436Z  exit 1 2025-12-04T10:09:35.2809562Z  else 2025-12-04T10:09:35.2809772Z  difference=$((diskspace - diskspace_new)) 2025-12-04T10:09:35.2809959Z  echo "Diskspace saved: $difference percent" 2025-12-04T10:09:35.2810115Z  fi 2025-12-04T10:09:35.2810225Z fi 2025-12-04T10:09:35.2814535Z shell: /usr/bin/bash --noprofile --norc -e -o pipefail {0} 2025-12-04T10:09:35.2814706Z env: 2025-12-04T10:09:35.2824504Z GIT_DEFAULT_BRANCH: main 2025-12-04T10:09:35.2824672Z RUNNER_ARTIFACT_DIR: /home/runner/_work/_temp/artifacts 2025-12-04T10:09:35.2824878Z RUNNER_TEST_RESULTS_DIR: /home/runner/_work/_temp/test-results 2025-12-04T10:09:35.2825075Z RUNNER_DOCS_DIR: /home/runner/_work/_temp/docs 2025-12-04T10:09:35.2825481Z GPU_FLAG: --device=/dev/mem --device=/dev/kfd --group-add 110 --device /dev/dri/renderD152 --group-add video --group-add 109 --group-add daemon --group-add bin --cap-add=SYS_PTRACE --security-opt seccomp=unconfined --network=host 2025-12-04T10:09:35.2825883Z AWS_DEFAULT_REGION: us-east-1 2025-12-04T10:09:35.2826031Z AWS_REGION: us-east-1 2025-12-04T10:09:35.2826199Z AWS_ACCESS_KEY_ID: *** 2025-12-04T10:09:35.2826374Z AWS_SECRET_ACCESS_KEY: *** 2025-12-04T10:09:35.2828576Z AWS_SESSION_TOKEN: *** 2025-12-04T10:09:35.2828771Z CONTAINER_NAME: ecc8d1cc1a55d903e9a084976e06945ecade7ebc32dd8d40c72e06f4bfcbc337 2025-12-04T10:09:35.2828984Z DEVICE_NAME: rocm 2025-12-04T10:09:35.2829117Z DEVICE_TYPE: AMD Instinct MI325X 2025-12-04T10:09:35.2829259Z ##[endgroup] 2025-12-04T10:09:35.2849281Z + diskspace_cutoff=70 2025-12-04T10:09:35.2852577Z ++ docker info -f '{{.DockerRootDir}}' 2025-12-04T10:09:35.3159874Z + docker_root_dir=/home/runner/docker-data 2025-12-04T10:09:35.3160058Z + '[' '!' -d /home/runner/docker-data ']' 2025-12-04T10:09:35.3165814Z ++ df -H --output=pcent /home/runner/docker-data 2025-12-04T10:09:35.3166628Z ++ sed s/%// 2025-12-04T10:09:35.3166755Z ++ sed -n 2p 2025-12-04T10:09:35.3168069Z ++ sed 's/ //' 2025-12-04T10:09:35.3182982Z + diskspace=' 6' 2025-12-04T10:09:35.3183259Z + msg='Please file an issue on pytorch/pytorch reporting the faulty runner. Include a link to the runner logs so the runner can be identified' 2025-12-04T10:09:35.3183602Z + [[ 6 -ge 70 ]] 2025-12-04T10:09:35.3214000Z Post job cleanup. 2025-12-04T10:09:35.3235802Z Post job cleanup. 2025-12-04T10:09:35.3845416Z Post job cleanup. 2025-12-04T10:09:35.3858448Z Post job cleanup. 2025-12-04T10:09:35.4047955Z Logging out of registry 308535385114.dkr.ecr.us-east-1.amazonaws.com 2025-12-04T10:09:35.4242355Z Post job cleanup. 2025-12-04T10:09:35.4840841Z Post job cleanup. 2025-12-04T10:09:35.4877189Z Post job cleanup. 2025-12-04T10:09:35.5320585Z [command]/usr/bin/git version 2025-12-04T10:09:35.5346885Z git version 2.52.0 2025-12-04T10:09:35.5367848Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/2a706775-4c17-494f-bcd6-60c6056b8cbe/.gitconfig' 2025-12-04T10:09:35.5373872Z Temporarily overriding HOME='/home/runner/_work/_temp/2a706775-4c17-494f-bcd6-60c6056b8cbe' before making global git config changes 2025-12-04T10:09:35.5374216Z Adding repository directory to the temporary git global config as a safe directory 2025-12-04T10:09:35.5376648Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-12-04T10:09:35.5407295Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-12-04T10:09:35.5426448Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-12-04T10:09:35.5628824Z Entering 'android/libs/fbjni' 2025-12-04T10:09:35.5657064Z Entering 'third_party/FP16' 2025-12-04T10:09:35.5690346Z Entering 'third_party/FXdiv' 2025-12-04T10:09:35.5722740Z Entering 'third_party/NNPACK' 2025-12-04T10:09:35.5750595Z Entering 'third_party/NVTX' 2025-12-04T10:09:35.5780156Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:35.5806412Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:35.5835766Z Entering 'third_party/aiter' 2025-12-04T10:09:35.5863158Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:35.5894067Z Entering 'third_party/benchmark' 2025-12-04T10:09:35.5920750Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:35.5949745Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:35.5974481Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:35.6000402Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:35.6025321Z Entering 'third_party/cutlass' 2025-12-04T10:09:35.6053232Z Entering 'third_party/fbgemm' 2025-12-04T10:09:35.6082093Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:35.6108491Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:35.6136787Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:35.6163426Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:35.6190522Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:35.6213462Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:35.6234592Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:35.6262824Z Entering 'third_party/flash-attention' 2025-12-04T10:09:35.6289581Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:35.6315984Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:35.6344850Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:35.6368749Z Entering 'third_party/fmt' 2025-12-04T10:09:35.6394731Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:35.6420509Z Entering 'third_party/gloo' 2025-12-04T10:09:35.6445197Z Entering 'third_party/googletest' 2025-12-04T10:09:35.6466486Z Entering 'third_party/ideep' 2025-12-04T10:09:35.6489144Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:35.6518302Z Entering 'third_party/ittapi' 2025-12-04T10:09:35.6541019Z Entering 'third_party/kineto' 2025-12-04T10:09:35.6565133Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:35.6604275Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:35.6633371Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:35.6659976Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:35.6687243Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:35.6714196Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:35.6740012Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:35.6765611Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:35.6790470Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:35.6815580Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:35.6838581Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:35.6864553Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:35.6887342Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:35.6918925Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:35.6942459Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:35.6970906Z Entering 'third_party/kleidiai' 2025-12-04T10:09:35.6996447Z Entering 'third_party/mimalloc' 2025-12-04T10:09:35.7021458Z Entering 'third_party/nlohmann' 2025-12-04T10:09:35.7054751Z Entering 'third_party/onnx' 2025-12-04T10:09:35.7085581Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:35.7111630Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:35.7139592Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:35.7162634Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:35.7187134Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:35.7210111Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:35.7235374Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:35.7257594Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:35.7280115Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:35.7304507Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:35.7330956Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:35.7356669Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:35.7392155Z Entering 'third_party/pocketfft' 2025-12-04T10:09:35.7420019Z Entering 'third_party/protobuf' 2025-12-04T10:09:35.7449551Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:35.7478751Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:35.7506181Z Entering 'third_party/psimd' 2025-12-04T10:09:35.7532886Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:35.7557435Z Entering 'third_party/pybind11' 2025-12-04T10:09:35.7587703Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:35.7618474Z Entering 'third_party/sleef' 2025-12-04T10:09:35.7653120Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:35.7680929Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:35.7709753Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:35.7734832Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:35.7758758Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:35.7782612Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:35.7831949Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-12-04T10:09:35.7848413Z http.https://github.com/.extraheader 2025-12-04T10:09:35.7858247Z [command]/usr/bin/git config --local --unset-all http.https://github.com/.extraheader 2025-12-04T10:09:35.7879380Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-12-04T10:09:35.8038031Z Entering 'android/libs/fbjni' 2025-12-04T10:09:35.8058597Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8077234Z Entering 'third_party/FP16' 2025-12-04T10:09:35.8091320Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8110099Z Entering 'third_party/FXdiv' 2025-12-04T10:09:35.8123071Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8143740Z Entering 'third_party/NNPACK' 2025-12-04T10:09:35.8155971Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8176753Z Entering 'third_party/NVTX' 2025-12-04T10:09:35.8190971Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8209324Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:35.8222407Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8242914Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:35.8257273Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8280458Z Entering 'third_party/aiter' 2025-12-04T10:09:35.8295473Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8313924Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:35.8327611Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8356161Z Entering 'third_party/benchmark' 2025-12-04T10:09:35.8370459Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8390728Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:35.8406443Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8430530Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:35.8442223Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8460510Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:35.8478039Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8499350Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:35.8516477Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8537769Z Entering 'third_party/cutlass' 2025-12-04T10:09:35.8552773Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8577221Z Entering 'third_party/fbgemm' 2025-12-04T10:09:35.8592216Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8610133Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:35.8625176Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8645698Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:35.8661549Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8684381Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:35.8696457Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8713324Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:35.8725736Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8743562Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:35.8755204Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8772370Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:35.8784981Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8803785Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:35.8817780Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8838444Z Entering 'third_party/flash-attention' 2025-12-04T10:09:35.8851638Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8868868Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:35.8885196Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8906784Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:35.8923185Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8946442Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:35.8961499Z http.https://github.com/.extraheader 2025-12-04T10:09:35.8982219Z Entering 'third_party/fmt' 2025-12-04T10:09:35.8997440Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9020483Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:35.9036567Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9056162Z Entering 'third_party/gloo' 2025-12-04T10:09:35.9069889Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9087663Z Entering 'third_party/googletest' 2025-12-04T10:09:35.9102230Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9128254Z Entering 'third_party/ideep' 2025-12-04T10:09:35.9147994Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9173674Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:35.9189541Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9215077Z Entering 'third_party/ittapi' 2025-12-04T10:09:35.9230322Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9248372Z Entering 'third_party/kineto' 2025-12-04T10:09:35.9264871Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9283534Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:35.9297694Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9317397Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:35.9332525Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9352514Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:35.9368260Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9388515Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:35.9404915Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9428864Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:35.9444179Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9461099Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:35.9476548Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9499719Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:35.9514586Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9533865Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:35.9548956Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9568543Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:35.9582870Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9600802Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:35.9614188Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9633000Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:35.9648754Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9823690Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:35.9838162Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9884592Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:35.9908392Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9932270Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:35.9946977Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9965632Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:35.9980010Z http.https://github.com/.extraheader 2025-12-04T10:09:35.9999617Z Entering 'third_party/kleidiai' 2025-12-04T10:09:36.0015378Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0039076Z Entering 'third_party/mimalloc' 2025-12-04T10:09:36.0054137Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0075692Z Entering 'third_party/nlohmann' 2025-12-04T10:09:36.0090529Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0114981Z Entering 'third_party/onnx' 2025-12-04T10:09:36.0130006Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0167755Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:36.0182903Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0205440Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:36.0222050Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0243048Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:36.0258746Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0276622Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:36.0294123Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0311366Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:36.0325688Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0343332Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:36.0359283Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0386914Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:36.0412615Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0436800Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:36.0455359Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0477204Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:36.0495687Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0515937Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.0528438Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0549894Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.0566188Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0590574Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:36.0607690Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0639805Z Entering 'third_party/pocketfft' 2025-12-04T10:09:36.0656256Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0677014Z Entering 'third_party/protobuf' 2025-12-04T10:09:36.0690824Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0711439Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:36.0731341Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0751780Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:36.0769230Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0793314Z Entering 'third_party/psimd' 2025-12-04T10:09:36.0809221Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0829740Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:36.0842096Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0863394Z Entering 'third_party/pybind11' 2025-12-04T10:09:36.0876412Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0896874Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:36.0911805Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0931355Z Entering 'third_party/sleef' 2025-12-04T10:09:36.0945567Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0964204Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:36.0980415Z http.https://github.com/.extraheader 2025-12-04T10:09:36.0999121Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:36.1010831Z http.https://github.com/.extraheader 2025-12-04T10:09:36.1029514Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:36.1049652Z http.https://github.com/.extraheader 2025-12-04T10:09:36.1072302Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:36.1087285Z http.https://github.com/.extraheader 2025-12-04T10:09:36.1109227Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:36.1125057Z http.https://github.com/.extraheader 2025-12-04T10:09:36.1144335Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:36.1162852Z http.https://github.com/.extraheader 2025-12-04T10:09:36.1205626Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.1228324Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url 2025-12-04T10:09:36.1388914Z Entering 'android/libs/fbjni' 2025-12-04T10:09:36.1398503Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T10:09:36.1408697Z Entering 'third_party/FP16' 2025-12-04T10:09:36.1423234Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T10:09:36.1432686Z Entering 'third_party/FXdiv' 2025-12-04T10:09:36.1445588Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T10:09:36.1453575Z Entering 'third_party/NNPACK' 2025-12-04T10:09:36.1464266Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T10:09:36.1473950Z Entering 'third_party/NVTX' 2025-12-04T10:09:36.1485585Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T10:09:36.1495512Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:36.1506432Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T10:09:36.1515942Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:36.1526222Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T10:09:36.1544742Z Entering 'third_party/aiter' 2025-12-04T10:09:36.1556054Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T10:09:36.1564986Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:36.1577580Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T10:09:36.1591958Z Entering 'third_party/benchmark' 2025-12-04T10:09:36.1603511Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:36.1612122Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:36.1623524Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T10:09:36.1635746Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:36.1646847Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T10:09:36.1655566Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:36.1665898Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T10:09:36.1676803Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:36.1687484Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T10:09:36.1698238Z Entering 'third_party/cutlass' 2025-12-04T10:09:36.1708605Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T10:09:36.1722722Z Entering 'third_party/fbgemm' 2025-12-04T10:09:36.1733555Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T10:09:36.1746077Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:36.1754780Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T10:09:36.1764830Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:36.1775637Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T10:09:36.1788332Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:36.1798125Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T10:09:36.1807767Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:36.1817288Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T10:09:36.1832417Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:36.1842135Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T10:09:36.1851181Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:36.1869385Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T10:09:36.1886271Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:36.1891617Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T10:09:36.1901946Z Entering 'third_party/flash-attention' 2025-12-04T10:09:36.1915221Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T10:09:36.1924778Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:36.1934975Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T10:09:36.1947561Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:36.1957939Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T10:09:36.1972604Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:36.1984355Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T10:09:36.1996205Z Entering 'third_party/fmt' 2025-12-04T10:09:36.2006521Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T10:09:36.2015820Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:36.2027478Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T10:09:36.2036962Z Entering 'third_party/gloo' 2025-12-04T10:09:36.2048611Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T10:09:36.2057664Z Entering 'third_party/googletest' 2025-12-04T10:09:36.2068615Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.2078743Z Entering 'third_party/ideep' 2025-12-04T10:09:36.2089330Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T10:09:36.2098034Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:36.2110159Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T10:09:36.2123446Z Entering 'third_party/ittapi' 2025-12-04T10:09:36.2134424Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T10:09:36.2144538Z Entering 'third_party/kineto' 2025-12-04T10:09:36.2155132Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T10:09:36.2165428Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:36.2177123Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T10:09:36.2187188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:36.2199933Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T10:09:36.2210349Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:36.2222397Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T10:09:36.2231842Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:36.2253394Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T10:09:36.2261444Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:36.2274775Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T10:09:36.2285156Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:36.2297491Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T10:09:36.2309819Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:36.2321342Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T10:09:36.2331403Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:36.2343562Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.2355188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:36.2366588Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T10:09:36.2376832Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:36.2388396Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T10:09:36.2399159Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:36.2410553Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T10:09:36.2421149Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.2432968Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T10:09:36.2443929Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.2456094Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T10:09:36.2472161Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:36.2483267Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T10:09:36.2494111Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:36.2506828Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.2517587Z Entering 'third_party/kleidiai' 2025-12-04T10:09:36.2530253Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T10:09:36.2541694Z Entering 'third_party/mimalloc' 2025-12-04T10:09:36.2554152Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T10:09:36.2563745Z Entering 'third_party/nlohmann' 2025-12-04T10:09:36.2573741Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T10:09:36.2589774Z Entering 'third_party/onnx' 2025-12-04T10:09:36.2603017Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T10:09:36.2621260Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:36.2640358Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:36.2657405Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:36.2670654Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T10:09:36.2684693Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:36.2695831Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:36.2708122Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:36.2719202Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.2728063Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:36.2744647Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T10:09:36.2753833Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:36.2767848Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T10:09:36.2776625Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:36.2789096Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T10:09:36.2798586Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:36.2812069Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T10:09:36.2822429Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:36.2834292Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T10:09:36.2843953Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.2856380Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T10:09:36.2868774Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.2879745Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T10:09:36.2891242Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:36.2906598Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T10:09:36.2925074Z Entering 'third_party/pocketfft' 2025-12-04T10:09:36.2936828Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T10:09:36.2947266Z Entering 'third_party/protobuf' 2025-12-04T10:09:36.2959706Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T10:09:36.2970857Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:36.2982199Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:36.2991920Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:36.3004216Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.3016748Z Entering 'third_party/psimd' 2025-12-04T10:09:36.3028096Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T10:09:36.3037954Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:36.3050213Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T10:09:36.3060161Z Entering 'third_party/pybind11' 2025-12-04T10:09:36.3072443Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:36.3081401Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:36.3092412Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T10:09:36.3103625Z Entering 'third_party/sleef' 2025-12-04T10:09:36.3114350Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T10:09:36.3123975Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:36.3137360Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T10:09:36.3147545Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:36.3157274Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:36.3166304Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:36.3177474Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T10:09:36.3187840Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:36.3196481Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T10:09:36.3206923Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:36.3217101Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:36.3226517Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:36.3242655Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T10:09:36.3273294Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3291971Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3305639Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3319190Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3334797Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3351321Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3377374Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3382900Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3398642Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3413732Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3427377Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3441902Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3456688Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3470961Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3487605Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3501763Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3514538Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3528507Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3544436Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3558551Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3572395Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3587257Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3603332Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3617227Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3629667Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3645110Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3659143Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3676737Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3691383Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3705816Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3719658Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3734691Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3748476Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3763889Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3778867Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3797363Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3814451Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3834000Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3856404Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3879043Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3896179Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3911254Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3926983Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3941113Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3954109Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3966760Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3979299Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.3991690Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4004522Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4017222Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4032092Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4047693Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4061883Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4076579Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4091118Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4106011Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4120774Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4134220Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4149049Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4164148Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4179098Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4194104Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4209612Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4224292Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4237551Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4253663Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4278535Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4294139Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4310047Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4324618Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4338866Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4354105Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4367470Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4382816Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4398638Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4413920Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4427073Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4441513Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4456440Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4472203Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4485781Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.4585735Z Post job cleanup. 2025-12-04T10:09:36.5039103Z [command]/usr/bin/git version 2025-12-04T10:09:36.5058921Z git version 2.52.0 2025-12-04T10:09:36.5074768Z Copying '/home/runner/.gitconfig' to '/home/runner/_work/_temp/9da4e73d-b269-40e0-addb-199bf4bc8769/.gitconfig' 2025-12-04T10:09:36.5079563Z Temporarily overriding HOME='/home/runner/_work/_temp/9da4e73d-b269-40e0-addb-199bf4bc8769' before making global git config changes 2025-12-04T10:09:36.5079923Z Adding repository directory to the temporary git global config as a safe directory 2025-12-04T10:09:36.5081650Z [command]/usr/bin/git config --global --add safe.directory /home/runner/_work/pytorch/pytorch 2025-12-04T10:09:36.5099553Z [command]/usr/bin/git config --local --name-only --get-regexp core\.sshCommand 2025-12-04T10:09:36.5116576Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'core\.sshCommand' && git config --local --unset-all 'core.sshCommand' || :" 2025-12-04T10:09:36.5304622Z Entering 'android/libs/fbjni' 2025-12-04T10:09:36.5329162Z Entering 'third_party/FP16' 2025-12-04T10:09:36.5354825Z Entering 'third_party/FXdiv' 2025-12-04T10:09:36.5381118Z Entering 'third_party/NNPACK' 2025-12-04T10:09:36.5413884Z Entering 'third_party/NVTX' 2025-12-04T10:09:36.5438108Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:36.5468347Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:36.5500176Z Entering 'third_party/aiter' 2025-12-04T10:09:36.5524407Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:36.5548569Z Entering 'third_party/benchmark' 2025-12-04T10:09:36.5571162Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:36.5601813Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:36.5630881Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:36.5656210Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:36.5685107Z Entering 'third_party/cutlass' 2025-12-04T10:09:36.5715343Z Entering 'third_party/fbgemm' 2025-12-04T10:09:36.5745633Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:36.5771070Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:36.5803126Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:36.5830217Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:36.5863555Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:36.5889674Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:36.5915948Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:36.5944573Z Entering 'third_party/flash-attention' 2025-12-04T10:09:36.5974368Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:36.6004671Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:36.6032126Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:36.6059122Z Entering 'third_party/fmt' 2025-12-04T10:09:36.6086218Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:36.6111364Z Entering 'third_party/gloo' 2025-12-04T10:09:36.6135704Z Entering 'third_party/googletest' 2025-12-04T10:09:36.6163289Z Entering 'third_party/ideep' 2025-12-04T10:09:36.6190491Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:36.6220083Z Entering 'third_party/ittapi' 2025-12-04T10:09:36.6248262Z Entering 'third_party/kineto' 2025-12-04T10:09:36.6273640Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:36.6301573Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:36.6324881Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:36.6352634Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:36.6376764Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:36.6398875Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:36.6422447Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:36.6447533Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:36.6479956Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:36.6507831Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:36.6531194Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:36.6557948Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.6583113Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.6608005Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:36.6629858Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:36.6654562Z Entering 'third_party/kleidiai' 2025-12-04T10:09:36.6682148Z Entering 'third_party/mimalloc' 2025-12-04T10:09:36.6710898Z Entering 'third_party/nlohmann' 2025-12-04T10:09:36.6737803Z Entering 'third_party/onnx' 2025-12-04T10:09:36.6770617Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:36.6798531Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:36.6827842Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:36.6852078Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:36.6877675Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:36.6902382Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:36.6928311Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:36.6953423Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:36.6979190Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:36.7005936Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.7031280Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.7058978Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:36.7093292Z Entering 'third_party/pocketfft' 2025-12-04T10:09:36.7118865Z Entering 'third_party/protobuf' 2025-12-04T10:09:36.7146460Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:36.7183797Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:36.7207982Z Entering 'third_party/psimd' 2025-12-04T10:09:36.7233435Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:36.7258664Z Entering 'third_party/pybind11' 2025-12-04T10:09:36.7284663Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:36.7309701Z Entering 'third_party/sleef' 2025-12-04T10:09:36.7334194Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:36.7358968Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:36.7389817Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:36.7416269Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:36.7441602Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:36.7474417Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:36.7519873Z [command]/usr/bin/git config --local --name-only --get-regexp http\.https\:\/\/github\.com\/\.extraheader 2025-12-04T10:09:36.7542225Z [command]/usr/bin/git submodule foreach --recursive sh -c "git config --local --name-only --get-regexp 'http\.https\:\/\/github\.com\/\.extraheader' && git config --local --unset-all 'http.https://github.com/.extraheader' || :" 2025-12-04T10:09:36.7705642Z Entering 'android/libs/fbjni' 2025-12-04T10:09:36.7727962Z Entering 'third_party/FP16' 2025-12-04T10:09:36.7750559Z Entering 'third_party/FXdiv' 2025-12-04T10:09:36.7772892Z Entering 'third_party/NNPACK' 2025-12-04T10:09:36.7798593Z Entering 'third_party/NVTX' 2025-12-04T10:09:36.7823245Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:36.7847834Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:36.7879394Z Entering 'third_party/aiter' 2025-12-04T10:09:36.7904557Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:36.7932740Z Entering 'third_party/benchmark' 2025-12-04T10:09:36.7960484Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:36.7993241Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:36.8016692Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:36.8045339Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:36.8072792Z Entering 'third_party/cutlass' 2025-12-04T10:09:36.8104708Z Entering 'third_party/fbgemm' 2025-12-04T10:09:36.8134791Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:36.8158532Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:36.8188310Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:36.8211963Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:36.8239989Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:36.8265151Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:36.8292295Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:36.8318701Z Entering 'third_party/flash-attention' 2025-12-04T10:09:36.8346806Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:36.8374947Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:36.8403982Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:36.8432542Z Entering 'third_party/fmt' 2025-12-04T10:09:36.8459152Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:36.8487152Z Entering 'third_party/gloo' 2025-12-04T10:09:36.8513981Z Entering 'third_party/googletest' 2025-12-04T10:09:36.8540169Z Entering 'third_party/ideep' 2025-12-04T10:09:36.8566523Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:36.8595746Z Entering 'third_party/ittapi' 2025-12-04T10:09:36.8620933Z Entering 'third_party/kineto' 2025-12-04T10:09:36.8649121Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:36.8674306Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:36.8704065Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:36.8743886Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:36.8772406Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:36.8798122Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:36.8824740Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:36.8850101Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:36.8876054Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:36.8902770Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:36.8927304Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:36.8952188Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.8978815Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.9007808Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:36.9032766Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:36.9061867Z Entering 'third_party/kleidiai' 2025-12-04T10:09:36.9090732Z Entering 'third_party/mimalloc' 2025-12-04T10:09:36.9119022Z Entering 'third_party/nlohmann' 2025-12-04T10:09:36.9147141Z Entering 'third_party/onnx' 2025-12-04T10:09:36.9182456Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:36.9213472Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:36.9241284Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:36.9265749Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:36.9292729Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:36.9317234Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:36.9341736Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:36.9372108Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:36.9400003Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:36.9426409Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:36.9450630Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:36.9479541Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:36.9514314Z Entering 'third_party/pocketfft' 2025-12-04T10:09:36.9540834Z Entering 'third_party/protobuf' 2025-12-04T10:09:36.9571241Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:36.9593727Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:36.9624027Z Entering 'third_party/psimd' 2025-12-04T10:09:36.9655943Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:36.9690281Z Entering 'third_party/pybind11' 2025-12-04T10:09:36.9722743Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:36.9752509Z Entering 'third_party/sleef' 2025-12-04T10:09:36.9782508Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:36.9816816Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:36.9844146Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:36.9869126Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:36.9894494Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:36.9925119Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:36.9971855Z [command]/usr/bin/git config --local --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:36.9994886Z [command]/usr/bin/git submodule foreach --recursive git config --local --show-origin --name-only --get-regexp remote.origin.url 2025-12-04T10:09:37.0168415Z Entering 'android/libs/fbjni' 2025-12-04T10:09:37.0180438Z file:/home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config remote.origin.url 2025-12-04T10:09:37.0192037Z Entering 'third_party/FP16' 2025-12-04T10:09:37.0204043Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config remote.origin.url 2025-12-04T10:09:37.0241874Z Entering 'third_party/FXdiv' 2025-12-04T10:09:37.0255556Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config remote.origin.url 2025-12-04T10:09:37.0265284Z Entering 'third_party/NNPACK' 2025-12-04T10:09:37.0278358Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config remote.origin.url 2025-12-04T10:09:37.0291746Z Entering 'third_party/NVTX' 2025-12-04T10:09:37.0304559Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config remote.origin.url 2025-12-04T10:09:37.0315661Z Entering 'third_party/VulkanMemoryAllocator' 2025-12-04T10:09:37.0328153Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config remote.origin.url 2025-12-04T10:09:37.0337594Z Entering 'third_party/XNNPACK' 2025-12-04T10:09:37.0353239Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config remote.origin.url 2025-12-04T10:09:37.0374169Z Entering 'third_party/aiter' 2025-12-04T10:09:37.0386350Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config remote.origin.url 2025-12-04T10:09:37.0395541Z Entering 'third_party/aiter/3rdparty/composable_kernel' 2025-12-04T10:09:37.0414494Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config remote.origin.url 2025-12-04T10:09:37.0429614Z Entering 'third_party/benchmark' 2025-12-04T10:09:37.0441872Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:37.0451020Z Entering 'third_party/composable_kernel' 2025-12-04T10:09:37.0462431Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config remote.origin.url 2025-12-04T10:09:37.0475097Z Entering 'third_party/cpp-httplib' 2025-12-04T10:09:37.0485208Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config remote.origin.url 2025-12-04T10:09:37.0494131Z Entering 'third_party/cpuinfo' 2025-12-04T10:09:37.0503903Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config remote.origin.url 2025-12-04T10:09:37.0512806Z Entering 'third_party/cudnn_frontend' 2025-12-04T10:09:37.0523296Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config remote.origin.url 2025-12-04T10:09:37.0531966Z Entering 'third_party/cutlass' 2025-12-04T10:09:37.0541614Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config remote.origin.url 2025-12-04T10:09:37.0553311Z Entering 'third_party/fbgemm' 2025-12-04T10:09:37.0565615Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config remote.origin.url 2025-12-04T10:09:37.0574590Z Entering 'third_party/fbgemm/external/asmjit' 2025-12-04T10:09:37.0583612Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config remote.origin.url 2025-12-04T10:09:37.0592290Z Entering 'third_party/fbgemm/external/composable_kernel' 2025-12-04T10:09:37.0601333Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config remote.origin.url 2025-12-04T10:09:37.0613687Z Entering 'third_party/fbgemm/external/cpuinfo' 2025-12-04T10:09:37.0624183Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config remote.origin.url 2025-12-04T10:09:37.0632868Z Entering 'third_party/fbgemm/external/cutlass' 2025-12-04T10:09:37.0642257Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config remote.origin.url 2025-12-04T10:09:37.0654474Z Entering 'third_party/fbgemm/external/googletest' 2025-12-04T10:09:37.0663726Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config remote.origin.url 2025-12-04T10:09:37.0672275Z Entering 'third_party/fbgemm/external/hipify_torch' 2025-12-04T10:09:37.0681839Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config remote.origin.url 2025-12-04T10:09:37.0694146Z Entering 'third_party/fbgemm/external/json' 2025-12-04T10:09:37.0703699Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config remote.origin.url 2025-12-04T10:09:37.0716309Z Entering 'third_party/flash-attention' 2025-12-04T10:09:37.0726468Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config remote.origin.url 2025-12-04T10:09:37.0735993Z Entering 'third_party/flash-attention/csrc/composable_kernel' 2025-12-04T10:09:37.0745269Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config remote.origin.url 2025-12-04T10:09:37.0757356Z Entering 'third_party/flash-attention/csrc/cutlass' 2025-12-04T10:09:37.0768113Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config remote.origin.url 2025-12-04T10:09:37.0783741Z Entering 'third_party/flatbuffers' 2025-12-04T10:09:37.0794465Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config remote.origin.url 2025-12-04T10:09:37.0804552Z Entering 'third_party/fmt' 2025-12-04T10:09:37.0815853Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config remote.origin.url 2025-12-04T10:09:37.0825704Z Entering 'third_party/gemmlowp/gemmlowp' 2025-12-04T10:09:37.0836100Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config remote.origin.url 2025-12-04T10:09:37.0844676Z Entering 'third_party/gloo' 2025-12-04T10:09:37.0864758Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config remote.origin.url 2025-12-04T10:09:37.0865039Z Entering 'third_party/googletest' 2025-12-04T10:09:37.0872830Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.0881270Z Entering 'third_party/ideep' 2025-12-04T10:09:37.0891917Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config remote.origin.url 2025-12-04T10:09:37.0901227Z Entering 'third_party/ideep/mkl-dnn' 2025-12-04T10:09:37.0912124Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config remote.origin.url 2025-12-04T10:09:37.0926835Z Entering 'third_party/ittapi' 2025-12-04T10:09:37.0937068Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config remote.origin.url 2025-12-04T10:09:37.0945785Z Entering 'third_party/kineto' 2025-12-04T10:09:37.0955430Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config remote.origin.url 2025-12-04T10:09:37.0965749Z Entering 'third_party/kineto/libkineto/third_party/dynolog' 2025-12-04T10:09:37.0984583Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config remote.origin.url 2025-12-04T10:09:37.0988721Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/DCGM' 2025-12-04T10:09:37.1008164Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config remote.origin.url 2025-12-04T10:09:37.1017375Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/cpr' 2025-12-04T10:09:37.1031112Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config remote.origin.url 2025-12-04T10:09:37.1041957Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/fmt' 2025-12-04T10:09:37.1058126Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config remote.origin.url 2025-12-04T10:09:37.1066837Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags' 2025-12-04T10:09:37.1079588Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config remote.origin.url 2025-12-04T10:09:37.1089911Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/gflags/doc' 2025-12-04T10:09:37.1101354Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config remote.origin.url 2025-12-04T10:09:37.1113594Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/glog' 2025-12-04T10:09:37.1125329Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config remote.origin.url 2025-12-04T10:09:37.1135907Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/googletest' 2025-12-04T10:09:37.1147805Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.1157508Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/json' 2025-12-04T10:09:37.1168667Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config remote.origin.url 2025-12-04T10:09:37.1182430Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/pfs' 2025-12-04T10:09:37.1193718Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config remote.origin.url 2025-12-04T10:09:37.1204764Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp' 2025-12-04T10:09:37.1215294Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T10:09:37.1225254Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:37.1235870Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T10:09:37.1246928Z Entering 'third_party/kineto/libkineto/third_party/dynolog/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:37.1258812Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T10:09:37.1273480Z Entering 'third_party/kineto/libkineto/third_party/fmt' 2025-12-04T10:09:37.1285980Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config remote.origin.url 2025-12-04T10:09:37.1295305Z Entering 'third_party/kineto/libkineto/third_party/googletest' 2025-12-04T10:09:37.1306083Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.1317934Z Entering 'third_party/kleidiai' 2025-12-04T10:09:37.1329578Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config remote.origin.url 2025-12-04T10:09:37.1338966Z Entering 'third_party/mimalloc' 2025-12-04T10:09:37.1349778Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config remote.origin.url 2025-12-04T10:09:37.1359797Z Entering 'third_party/nlohmann' 2025-12-04T10:09:37.1370685Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config remote.origin.url 2025-12-04T10:09:37.1380853Z Entering 'third_party/onnx' 2025-12-04T10:09:37.1391900Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config remote.origin.url 2025-12-04T10:09:37.1407347Z Entering 'third_party/onnx/third_party/pybind11' 2025-12-04T10:09:37.1419000Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:37.1431878Z Entering 'third_party/opentelemetry-cpp' 2025-12-04T10:09:37.1443394Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config remote.origin.url 2025-12-04T10:09:37.1453021Z Entering 'third_party/opentelemetry-cpp/third_party/benchmark' 2025-12-04T10:09:37.1462219Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:37.1471275Z Entering 'third_party/opentelemetry-cpp/third_party/googletest' 2025-12-04T10:09:37.1480487Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.1489918Z Entering 'third_party/opentelemetry-cpp/third_party/ms-gsl' 2025-12-04T10:09:37.1499800Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config remote.origin.url 2025-12-04T10:09:37.1508236Z Entering 'third_party/opentelemetry-cpp/third_party/nlohmann-json' 2025-12-04T10:09:37.1517536Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config remote.origin.url 2025-12-04T10:09:37.1526503Z Entering 'third_party/opentelemetry-cpp/third_party/opentelemetry-proto' 2025-12-04T10:09:37.1535564Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config remote.origin.url 2025-12-04T10:09:37.1544227Z Entering 'third_party/opentelemetry-cpp/third_party/opentracing-cpp' 2025-12-04T10:09:37.1554383Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config remote.origin.url 2025-12-04T10:09:37.1563937Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp' 2025-12-04T10:09:37.1575856Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config remote.origin.url 2025-12-04T10:09:37.1585204Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/civetweb' 2025-12-04T10:09:37.1595595Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config remote.origin.url 2025-12-04T10:09:37.1606048Z Entering 'third_party/opentelemetry-cpp/third_party/prometheus-cpp/3rdparty/googletest' 2025-12-04T10:09:37.1616512Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config remote.origin.url 2025-12-04T10:09:37.1627949Z Entering 'third_party/opentelemetry-cpp/tools/vcpkg' 2025-12-04T10:09:37.1637523Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config remote.origin.url 2025-12-04T10:09:37.1655560Z Entering 'third_party/pocketfft' 2025-12-04T10:09:37.1665604Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config remote.origin.url 2025-12-04T10:09:37.1675711Z Entering 'third_party/protobuf' 2025-12-04T10:09:37.1686257Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config remote.origin.url 2025-12-04T10:09:37.1697612Z Entering 'third_party/protobuf/third_party/benchmark' 2025-12-04T10:09:37.1708398Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config remote.origin.url 2025-12-04T10:09:37.1718275Z Entering 'third_party/protobuf/third_party/googletest' 2025-12-04T10:09:37.1730349Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.1741035Z Entering 'third_party/psimd' 2025-12-04T10:09:37.1752157Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config remote.origin.url 2025-12-04T10:09:37.1766240Z Entering 'third_party/pthreadpool' 2025-12-04T10:09:37.1782075Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config remote.origin.url 2025-12-04T10:09:37.1803205Z Entering 'third_party/pybind11' 2025-12-04T10:09:37.1810484Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:37.1822557Z Entering 'third_party/python-peachpy' 2025-12-04T10:09:37.1834218Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config remote.origin.url 2025-12-04T10:09:37.1845154Z Entering 'third_party/sleef' 2025-12-04T10:09:37.1856942Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config remote.origin.url 2025-12-04T10:09:37.1867623Z Entering 'third_party/tensorpipe' 2025-12-04T10:09:37.1879802Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config remote.origin.url 2025-12-04T10:09:37.1890160Z Entering 'third_party/tensorpipe/third_party/googletest' 2025-12-04T10:09:37.1901109Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config remote.origin.url 2025-12-04T10:09:37.1911264Z Entering 'third_party/tensorpipe/third_party/libnop' 2025-12-04T10:09:37.1921707Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config remote.origin.url 2025-12-04T10:09:37.1930966Z Entering 'third_party/tensorpipe/third_party/libuv' 2025-12-04T10:09:37.1940595Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config remote.origin.url 2025-12-04T10:09:37.1949474Z Entering 'third_party/tensorpipe/third_party/pybind11' 2025-12-04T10:09:37.1958926Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config remote.origin.url 2025-12-04T10:09:37.1967607Z Entering 'third_party/tensorpipe/third_party/pybind11/tools/clang' 2025-12-04T10:09:37.1977231Z file:/home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config remote.origin.url 2025-12-04T10:09:37.2007108Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/android/libs/fbjni/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2026019Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FP16/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2043885Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/FXdiv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2059966Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2074252Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NVTX/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2090504Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/VulkanMemoryAllocator/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2105525Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/XNNPACK/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2120671Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2135437Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/aiter/modules/3rdparty/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2149891Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2164859Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2179333Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpp-httplib/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2194308Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2210212Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cudnn_frontend/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2224620Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2239096Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2253200Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/asmjit/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2267903Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2282852Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cpuinfo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2299186Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2313836Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2328754Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/hipify_torch/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2343058Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fbgemm/modules/external/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2356001Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2369094Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/composable_kernel/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2382157Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flash-attention/modules/csrc/cutlass/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2395790Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/flatbuffers/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2410069Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2424393Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gemmlowp/gemmlowp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2438565Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/gloo/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2452526Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2470826Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2486485Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ideep/modules/mkl-dnn/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2508044Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/ittapi/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2531922Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2544960Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2562078Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/DCGM/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2579809Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/cpr/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2601650Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2615752Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2636905Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/gflags/modules/doc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2652417Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/glog/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2666178Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2681316Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2695943Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/pfs/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2711334Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2725531Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2741597Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/dynolog/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2755613Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/fmt/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2770315Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kineto/modules/libkineto/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2784416Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/kleidiai/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2799225Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/mimalloc/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2813947Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/nlohmann/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2829350Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2845043Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/onnx/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2860821Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2875939Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2892502Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2909058Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/ms-gsl/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2932745Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/nlohmann-json/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2949456Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentelemetry-proto/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2963432Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/opentracing-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2983217Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.2998939Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/civetweb/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3015659Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/third_party/prometheus-cpp/modules/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3030685Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/opentelemetry-cpp/modules/tools/vcpkg/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3045743Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pocketfft/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3061149Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3077541Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/benchmark/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3092587Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/protobuf/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3108446Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/psimd/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3124092Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/NNPACK_deps/pthreadpool/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3144676Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3160743Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/python-peachpy/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3175865Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/sleef/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3191632Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3206913Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/googletest/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3221507Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libnop/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3237778Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/libuv/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3254271Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3272511Z [command]/usr/bin/git config --file /home/runner/_work/pytorch/pytorch/.git/modules/third_party/tensorpipe/modules/third_party/pybind11/modules/tools/clang/config --name-only --get-regexp ^includeIf\.gitdir: 2025-12-04T10:09:37.3386181Z Cleaning up orphan processes